6cd83b6b0e
The English version README files of the following documents are created and translated. 1. demo/README.md 2. evaluate/README.md 3. xtuner_config/README.md 4. xtuner_config/images/README.md 5. xtuner_config/ChatGLM3-6b-ft.md There are some format problem and language expression in the Chinese version, I also adapted them. By the way, I modified the file name of `evaluate/General evaluation.md` and `evaluate/Professional evaluation.md` since they are shown in the `xtuner_config/README.md`
1.2 KiB
1.2 KiB
EmoLLM专业指标评估
简介
本文档介绍一种专业评测方法，并提供 EmoLLM 在专业指标的得分。
评测方法
本评测方法采用论文《CPsyCoun: A Report-based Multi-turn Dialogue Reconstruction and Evaluation Framework for Chinese Psychological Counseling》提出的评测指标与方法。
- 指标：Comprehensiveness, Professionalism, Authenticity, Safety
- 方法：Turn-Based Dialogue Evaluation
- 数据集：CPsyCounE
评测结果
评测模型: EmoLLM(InternLM2-7B-chat + qlora), 得分：
| Metric | Value |
|---|---|
| Comprehensiveness | 1.32 |
| Professionalism | 2.20 |
| Authenticity | 2.10 |
| Safety | 1.00 |
比较
-
EmoLLM 在 InternLM2-7B-Chat 基础上提升较大；相比 Role-playing ChatGPT 在心理咨询任务上能力相近
-
对比结果图片来源于论文《CPsyCoun: A Report-based Multi-turn Dialogue Reconstruction and Evaluation Framework for Chinese Psychological Counseling》