54a8ad2081
* Update news * Update paper link - [《CPsyCoun: A Report-based Multi-turn Dialogue Reconstruction and Evaluation Framework for Chinese Psychological Counseling》](https://arxiv.org/abs/2405.16433) |
||
|---|---|---|
| .. | ||
| data_dir | ||
| General_evaluation_EN.md | ||
| General_evaluation.md | ||
| InternLM2_7B_chat_eval.py | ||
| metric.py | ||
| Professional_evaluation_EN.md | ||
| Professional_evaluation.md | ||
| Qwen1_5-0_5B-Chat_eval.py | ||
| qwen_generation_utils.py | ||
| README_EN.md | ||
| README.md | ||
EmoLLM Evaluation
General Metrics Evaluation
- For specific metrics and methods, see General_evaluation_EN.md
| Model | ROUGE-1 | ROUGE-2 | ROUGE-L | BLEU-1 | BLEU-2 | BLEU-3 | BLEU-4 |
|---|---|---|---|---|---|---|---|
| Qwen1_5-0_5B-chat | 27.23% | 8.55% | 17.05% | 26.65% | 13.11% | 7.19% | 4.05% |
| InternLM2_7B_chat_qlora | 37.86% | 15.23% | 24.34% | 39.71% | 22.66% | 14.26% | 9.21% |
| InternLM2_7B_chat_full | 32.45% | 10.82% | 20.17% | 30.48% | 15.67% | 8.84% | 5.02% |
| InternLM2_7B_base_qlora_5epoch | 41.94% | 20.21% | 29.67% | 42.98% | 27.07% | 19.33% | 14.62% |
| InternLM2_7B_base_qlora_10epoch | 43.47% | 22.06% | 31.4% | 44.81% | 29.15% | 21.44% | 16.72% |
Professional Metrics Evaluation
- For specific metrics and methods, see Professional_evaluation_EN.md
| Model | Comprehensiveness | rofessionalism | Authenticity | Safety |
|---|---|---|---|---|
| InternLM2_7B_chat_qlora | 1.32 | 2.20 | 2.10 | 1.00 |
| InternLM2_7B_chat_full | 1.40 | 2.45 | 2.24 | 1.00 |
| InternLM2_20B_chat_lora | 1.42 | 2.39 | 2.22 | 1.00 |