HongCheng
|
a38ef60058
|
modified merge_jsonl and merge_jsonl_r
merge_jsonl is for merge jsonl files in a folder
merge_jsonl_r if for merge jsonl files in one folder's subfolders
uasge:
python merge_jsonl_r.py > qwen2.txt
python merge_jsonl_r.py > zhipuai.txt
python merge_jsonl.py > curr.txt
│ 学业_merge.json
│ 家人_merge.json
│ 就业_merge.json
│ 工作_merge.json
│ 恋爱_merge.json
│ 朋友_merge.json
│ 环境_merge.json
│ 生活_merge.json
│ 社交_merge.json
│ 责任_merge.json
│ 身体_merge.json
│ 隐私_merge.json
│
├───学业
│ 兴奋.jsonl
│ 冷静.jsonl
│ 厌倦.jsonl
│ 厌恶.jsonl
│ 同情.jsonl
│ 困惑.jsonl
│ 娱乐.jsonl
│ 嫉妒.jsonl
│ 尴尬.jsonl
│ 崇拜.jsonl
│ 快乐.jsonl
│ 怀旧.jsonl
│ 性欲.jsonl
│ 恐惧.jsonl
│ 悲伤.jsonl
│ 敬畏.jsonl
│ 有趣.jsonl
│ 欣赏.jsonl
│ 浪漫.jsonl
│ 渴望.jsonl
│ 满意.jsonl
│ 满足.jsonl
│ 焦虑.jsonl
│ 痛恨.jsonl
│ 痛苦.jsonl
│ 着迷.jsonl
│ 钦佩.jsonl
│
├───家人
│ 兴奋.jsonl
│ 冷静.jsonl
│ 厌倦.jsonl
│ 厌恶.jsonl
│ 同情.jsonl
│ 困惑.jsonl
│ 娱乐.jsonl
│ 嫉妒.jsonl
|
2024-03-18 20:16:39 +09:00 |
|
HongCheng
|
441d06463a
|
update gitignore (add *.jsonl)
|
2024-03-17 10:57:51 +09:00 |
|
jupyter
|
64b114269c
|
refactor: modified xtuner_config and removed model_config
|
2024-01-26 21:37:15 +08:00 |
|
jujimeizuo
|
c136dfc47b
|
feat: add web_internlm2 and upload s.t. scripts
|
2024-01-25 19:02:24 +08:00 |
|
jujimeizuo
|
45b143b6ef
|
feat: finetune Qwen and demo
|
2024-01-21 19:12:03 +08:00 |
|
jujimeizuo
|
92f1272ed3
|
chore: update script
|
2024-01-19 15:49:20 +08:00 |
|
jujimeizuo
|
b1cba0c11b
|
feat: add zhipuai_gen_data
|
2024-01-18 22:50:42 +08:00 |
|
jupyter
|
07fc5577fd
|
ADD data_process.py @ajupyter
|
2024-01-17 21:04:44 +08:00 |
|