Commit Graph

14 Commits

Author SHA1 Message Date
jujimeizuo
ad7c611476 initial emollm-metagpt 2024-03-25 21:00:07 +08:00
HongCheng
c16761e289 update three merge_json*.py files and corresponding tutorial in CN and EN
update three merge_json*.py files and corresponding tutorial in CN and EN
2024-03-18 23:35:21 +09:00
HongCheng
3cadeadf09 Merge branch 'main' of https://github.com/chg0901/EmoLLM 2024-03-18 22:24:26 +09:00
HongCheng
042146af56 Revert "modified merge_jsonl and merge_jsonl_r"
This reverts commit a38ef60058.
2024-03-18 22:13:35 +09:00
xzw
12eeaf8cc1
Merge pull request #89 from chg0901/main
optimizing the merge_json.py + moving files +Update zhipuai_gen_data.py 添加glm-4 response获取异常处理
2024-03-18 21:02:57 +08:00
HongCheng
a38ef60058 modified merge_jsonl and merge_jsonl_r
merge_jsonl is for merge jsonl files in a folder
merge_jsonl_r if for merge jsonl files in one folder's subfolders

uasge:
python merge_jsonl_r.py > qwen2.txt
python merge_jsonl_r.py > zhipuai.txt

python merge_jsonl.py > curr.txt

│   学业_merge.json
│   家人_merge.json
│   就业_merge.json
│   工作_merge.json
│   恋爱_merge.json
│   朋友_merge.json
│   环境_merge.json
│   生活_merge.json
│   社交_merge.json
│   责任_merge.json
│   身体_merge.json
│   隐私_merge.json
│
├───学业
│       兴奋.jsonl
│       冷静.jsonl
│       厌倦.jsonl
│       厌恶.jsonl
│       同情.jsonl
│       困惑.jsonl
│       娱乐.jsonl
│       嫉妒.jsonl
│       尴尬.jsonl
│       崇拜.jsonl
│       快乐.jsonl
│       怀旧.jsonl
│       性欲.jsonl
│       恐惧.jsonl
│       悲伤.jsonl
│       敬畏.jsonl
│       有趣.jsonl
│       欣赏.jsonl
│       浪漫.jsonl
│       渴望.jsonl
│       满意.jsonl
│       满足.jsonl
│       焦虑.jsonl
│       痛恨.jsonl
│       痛苦.jsonl
│       着迷.jsonl
│       钦佩.jsonl
│
├───家人
│       兴奋.jsonl
│       冷静.jsonl
│       厌倦.jsonl
│       厌恶.jsonl
│       同情.jsonl
│       困惑.jsonl
│       娱乐.jsonl
│       嫉妒.jsonl
2024-03-18 20:16:39 +09:00
HongCheng
441d06463a update gitignore (add *.jsonl) 2024-03-17 10:57:51 +09:00
aJupyter
ebe031af1a add gitignore 2024-03-16 23:06:42 +08:00
jupyter
64b114269c refactor: modified xtuner_config and removed model_config 2024-01-26 21:37:15 +08:00
jujimeizuo
c136dfc47b feat: add web_internlm2 and upload s.t. scripts 2024-01-25 19:02:24 +08:00
jujimeizuo
45b143b6ef feat: finetune Qwen and demo 2024-01-21 19:12:03 +08:00
jujimeizuo
92f1272ed3 chore: update script 2024-01-19 15:49:20 +08:00
jujimeizuo
b1cba0c11b feat: add zhipuai_gen_data 2024-01-18 22:50:42 +08:00
jupyter
07fc5577fd ADD data_process.py @ajupyter 2024-01-17 21:04:44 +08:00