How are administrators alerted to moderated Khanmigo chats?

To help schools identify and respond to potential student safety concerns, Khan Academy Districts partners can designate specific administrators to receive email notifications when Khanmigo flags content classified as Credible Harm. 

How moderation alerts work

Khanmigo uses an automated moderation system that combines large language models and other technologies to identify potentially concerning content in student conversations.

The system uses two classifications, Community Guidelines Violation and Credible Harm, to help notify appropriate school personnel based on the nature and severity of the flagged content.

Here's a quick overview:

Community Guidelines Violation Alerts (Teachers Only)

• Who gets notified: The teacher associated with the student's Khan Academy account, based on the student's activity and classroom associations.
• What gets flagged: Content identified as potentially inappropriate, offensive, or concerning (e.g., profanity, bullying, or other inappropriate behavior).
• Purpose: Helps teachers monitor student interactions and address concerns that may arise during Khanmigo use.
• Frequency: These alerts are more common and generally involve lower-risk concerns.

Credible Harm Alerts (Teachers and Designated Administrators)

• Who gets notified: Teachers and any designated administrators added to the district's moderation alert list.
• What gets flagged: Content classified as Credible Harm by Khanmigo's automated moderation system, which may include threats of violence, indications of harm to self or others, illicit content, or other serious safety concerns.
• Purpose: These alerts help school personnel identify conversations that may indicate real-world safety risks and warrant additional attention or follow-up. A Credible Harm classification does not necessarily mean that a real-world threat has been confirmed or that immediate intervention is required.
• Frequency: These alerts are generally less common and involve more serious concerns that may require attention beyond routine classroom management.

Important: Administrators will only receive Credible Harm alerts if they have been designated to receive these notifications in the district's settings.

This article will:

1. Provide setup instructions for adding or removing yourself or other administrators to receive high-severity email alerts

• Please note: there is no default person who is added to this list. Unless an administrator is added, only teachers will continue to receive moderation email alerts.

2. Show a sample email that designated administrators will receive

Section 1: Adding or removing administrators for high-severity alerts

Follow these steps to manage which administrators receive notifications for the most serious moderation flags.

Steps to add administrators:

1. Log into your Khan Academy District Administrator account
2. Access the Administrator Dashboard
   • Click your name in the top right corner
   • Select "Administrator dashboard" from the dropdown menu
3. Select "Settings" from the left-hand menu
   
   
    
4. Select administrators to notify
   • Use the "Select Admins" box to find and select the administrators you'd like to add. 
     
      
   • Note: If the list is missing someone, it means they are not rostered as an administrator with Khan Academy Districts, or you do not have the necessary permissions to view them. For example, school administrators will not see district administrators on the list unless they too have district-level permissions. 

     5. Save your selections

• Click the blue "Add Users" button 
  

To remove administrators:

Click the blue X next to any name in the list to remove them from notifications

 

Section 2: Sample email individuals will receive once on this list

Once an individual has been added to the notification list, they'll receive email alerts whenever a student's conversation with Khanmigo is flagged as high-severity.

Please see the below image showing a sample email of what you will receive when you are added to the above list:

Accessing the full chat history

Important: Only the following people can view the complete conversation by clicking the "Khanmigo chat from [date]" link in the email:

• The student's assigned teacher
• The student's parent/guardian (if relevant)
• Administrators on your high-severity notification list

Troubleshooting access issues:
If you click the chat history link and see a message saying you don't have access to view this content, it means you either:

• Don't have the correct permissions to view the chat
• Are not logged into Khan Academy with an account that has appropriate permissions

Need help?

This feature is designed to give you and your school community greater peace of mind regarding student safety. If you have questions or need assistance, please reach out to our Support team. We are happy to help!