bakaEC/OliveSensorAPI

History

MING_X cb360ac1fe Update Professional_evaluation.md		2024-03-06 17:34:47 +08:00
..
data_dir	add InterLM2_7B eval	2024-03-03 17:20:16 +08:00
General_evaluation.md	Update General_evaluation.md	2024-03-06 17:33:39 +08:00
InternLM2_7B_chat_eval.py	add InternLM2_7B_chat_full eval	2024-03-03 22:50:54 +08:00
metric.py	add InterLM2_7B eval	2024-03-03 17:20:16 +08:00
Professional_evaluation_EN.md	Create Professional_evaluation_EN.md	2024-03-06 17:29:52 +08:00
Professional_evaluation.md	Update Professional_evaluation.md	2024-03-06 17:34:47 +08:00
Qwen1_5-0_5B-Chat_eval.py	add InterLM2_7B eval	2024-03-03 17:20:16 +08:00
qwen_generation_utils.py	add evaluation part	2024-02-28 20:14:46 +08:00
README_EN.md	Update README_EN.md	2024-03-06 17:33:08 +08:00
README.md	Update README.md	2024-03-06 17:33:55 +08:00

README_EN.md

EmoLLM Evaluation

General Metrics Evaluation

For specific metrics and methods, see General_evaluation_EN.md

Model	ROUGE-1	ROUGE-2	ROUGE-L	BLEU-1	BLEU-2	BLEU-3	BLEU-4
Qwen1_5-0_5B-chat	27.23%	8.55%	17.05%	26.65%	13.11%	7.19%	4.05%
InternLM2_7B_chat_qlora	37.86%	15.23%	24.34%	39.71%	22.66%	14.26%	9.21%
InternLM2_7B_chat_full	32.45%	10.82%	20.17%	30.48%	15.67%	8.84%	5.02%

Professional Metrics Evaluation

For specific metrics and methods, see Professional_evaluation_EN.md

Model	Comprehensiveness	rofessionalism	Authenticity	Safety
InternLM2_7B_chat_qlora	1.32	2.20	2.10	1.00