Commit Graph

7 Commits

Author SHA1 Message Date
HongCheng
1d9ee54555 自我认知数据集和处理代码 2024-04-20 21:04:00 +09:00
HongCheng
89dea4826a 更正示例数据集 multi_turn_dataset_2, 添加更多描述, 移动处理文件 2024-04-20 13:44:46 +09:00
santiagoTOP
186511ce9c Baby EmoLLM 2024-04-14 20:20:11 +08:00
HongCheng
4ff7910368
Update process_merge.py 2024-03-21 16:07:18 +09:00
HongCheng
d25a304c4d
Update process_single_turn_conversation_construction.py 2024-03-21 16:06:41 +09:00
HongCheng
085a01eafa add dataset processing codes
1. update process.py for multi_turn_dataset(1 and 2) and data.json, data_pro.json
2. add datasets\processed\process_single_turn_conversation_construction.py for single-turn dataset (1 and 2)
3. add datasets\processed\process_merge.py for these 6 updated dataset in datasets\processed\
2024-03-21 16:01:54 +09:00
aJupyter
4d8ae7d428 feat: add internlm2-chat-7b-config 2024-03-03 21:08:52 +08:00