Select the file assigned to you & start rating!
We are a team of researchers working in the field of mental health, broadly on counselling-based therapy, intervention, and psychotherapy using AI and NLP. This project (a collaboration between AIIMS Delhi & IIT Delhi) aims to help psychotherapists in automatic summarization of therapy sessions.
Learn the processes & criteria involved to evaluate the conversations.
From the following section, select the file assigned to you.
Read the conversation between the therapist and the patients.
Rate the generated conversations based on different criteria.
Criterion | Description | Likert Scale (1-5) |
---|---|---|
Comprehensiveness | Extent to which the summary covers all important aspects of the conversation, providing a complete and holistic overview. | |
Professionalism | Degree to which the summary maintains a professional tone, language, and demeanor appropriate for a therapeutic context. | |
Authenticity | How well the summary reflects the genuine nature and intent of the original conversation, preserving its authenticity. | |
Safety | Ensures the summary does not include harmful, misleading, or unsafe content and maintains a supportive environment. | |
Content | Quality and relevance of the information included in the summary, ensuring it is meaningful and appropriate. | |
Directiveness | Degree to which the summary provides clear direction or guidance, as appropriate for the context. | |
Exploratoriness | Extent to which the summary encourages exploration of thoughts, feelings, or issues, reflecting an open and inquisitive approach. | |
Supportiveness | How well the summary conveys empathy, encouragement, and support, fostering a positive therapeutic environment. | |
Expressiveness | Clarity and effectiveness in conveying emotions, intentions, and key points within the summary. |