HongCheng
d25a304c4d
Update process_single_turn_conversation_construction.py
2024-03-21 16:06:41 +09:00
HongCheng
085a01eafa
add dataset processing codes
...
1. update process.py for multi_turn_dataset(1 and 2) and data.json, data_pro.json
2. add datasets\processed\process_single_turn_conversation_construction.py for single-turn dataset (1 and 2)
3. add datasets\processed\process_merge.py for these 6 updated dataset in datasets\processed\
2024-03-21 16:01:54 +09:00
HongCheng
ce2cb5156c
update data.json (delete 4 empty data)
...
4 empty lines in data.json 425 483 742 1120
2024-03-21 15:56:54 +09:00
HongCheng
d42f378eaa
add internlm2_7b_base_qlora_e3.py and modify requirements.txt
2024-03-21 15:55:50 +09:00
zealot52099
e2025cc8ea
[DOC]update datesets/README.md
2024-03-21 08:24:15 +08:00
zealot52099
3b21f79c3c
Merge branch 'dev' of https://github.com/SmartFlowAI/EmoLLM into dev
2024-03-21 07:59:16 +08:00
zealot52099
c354ffd7e0
[DOC]update datesets/README.md
2024-03-21 07:58:13 +08:00
xzw
fcd7ea5327
Merge pull request #114 from SmartFlowAI/dev
...
Dev
2024-03-20 23:45:28 +08:00
xzw
f5eb0ddc93
Merge pull request #113 from lll997150986/main
...
scientist.json
2024-03-20 23:44:46 +08:00
jeky
dbdd731565
1111
2024-03-20 23:25:07 +08:00
xzw
817c25b349
Merge pull request #112 from zealot52099/dev
...
update deduplicate.py
2024-03-20 23:20:14 +08:00
zealot52099
927659148c
Merge branch 'dev' of https://github.com/SmartFlowAI/EmoLLM into dev
2024-03-20 23:14:20 +08:00
zealot52099
77ff2d079c
update deduplicate.py
2024-03-20 23:08:36 +08:00
xzw
4e8271a540
Merge pull request #110 from SmartFlowAI/dev
...
Dev
2024-03-20 19:51:33 +08:00
MING_X
9e86195458
Merge pull request #109 from MING-ZCH/main
...
[DOC] Update README.md
2024-03-20 18:01:15 +08:00
xzw
585facad06
Merge pull request #108 from zealot52099/dev
...
update rag/src/data_processing.py & main,py
2024-03-20 17:58:12 +08:00
MING_X
c35f75ff1d
Update README_EN.md
2024-03-20 17:54:26 +08:00
zealot52099
41744ed604
[DOC] update datasets/README_EN.md
2024-03-20 17:52:23 +08:00
zealot52099
9b4e58f732
[DOC]update datasets/README.md
2024-03-20 17:40:31 +08:00
MING_X
12959e6d1a
Update README.md
2024-03-20 17:40:07 +08:00
MING_X
4c855f521d
Add files via upload
2024-03-20 17:21:16 +08:00
zealot52099
fdf05f480c
update rag/src/data_processing.py & main,py
2024-03-20 16:51:07 +08:00
MING_X
cf1b17abf3
Update README.md
2024-03-20 16:05:31 +08:00
MING_X
3393149685
Update README.md
2024-03-20 16:01:43 +08:00
MING_X
4d4dfbae88
Update README_EN.md
2024-03-20 15:58:48 +08:00
xzw
a119fdb507
Merge pull request #107 from SmartFlowAI/dev
...
Dev
2024-03-19 22:03:10 +08:00
xzw
37fbba84a5
Merge pull request #106 from Anooyman/main
...
update RAG pipeline
2024-03-19 22:02:11 +08:00
xzw
01b5231aa0
Merge pull request #105 from zealot52099/main
...
update deduplicate.py
2024-03-19 22:00:44 +08:00
Anooyman
96f6ce307e
Update
2024-03-19 21:11:10 +08:00
zealot52099
feb252d5b5
Merge branch 'SmartFlowAI:main' into main
2024-03-19 20:14:33 +08:00
zealot52099
b542929c1d
add deduplicate.py
2024-03-19 20:09:44 +08:00
xzw
af53e9744d
Merge pull request #104 from wwwyfff/clean-QA
...
GLM-6B ft
2024-03-19 18:14:04 +08:00
王友昉
6e7bd5e5d4
GLM-6B ft
2024-03-19 18:03:26 +08:00
xzw
19724be6b0
Merge pull request #103 from zealot52099/main
...
add deduplicate.py
2024-03-19 17:09:43 +08:00
xzw
3eb1642f92
Merge pull request #102 from jkhumor/modify_readme
...
update readme
2024-03-19 17:08:28 +08:00
zealot52099
861f12d47a
add deduplicate.py
2024-03-19 16:41:09 +08:00
jkhumor
1ee3a481b8
update readme
2024-03-19 13:11:39 +08:00
jkhumor
7bbe3842dc
modify readme
2024-03-19 12:34:51 +08:00
xzw
c7d916bf4f
Merge pull request #100 from zealot52099/main
...
update
2024-03-18 23:22:02 +08:00
xzw
c403563865
Merge pull request #99 from wwwyfff/clean-QA
...
update README
2024-03-18 23:18:31 +08:00
王友昉
1de2cf5a86
update README
2024-03-18 23:13:00 +08:00
xzw
9cb21785e3
Merge pull request #98 from chg0901/main
...
Update three merge_json*.py files and corresponding tutorial in CN and EN
2024-03-18 22:44:20 +08:00
HongCheng
275f249709
small update
2024-03-18 23:39:49 +09:00
HongCheng
c16761e289
update three merge_json*.py files and corresponding tutorial in CN and EN
...
update three merge_json*.py files and corresponding tutorial in CN and EN
2024-03-18 23:35:21 +09:00
HongCheng
3cadeadf09
Merge branch 'main' of https://github.com/chg0901/EmoLLM
2024-03-18 22:24:26 +09:00
xzw
0ede108138
Merge pull request #97 from SmartFlowAI/dev
...
添加框架图
2024-03-18 21:24:09 +08:00
xzw
4a36ff428a
Merge pull request #96 from zxazys/main
...
框架图
2024-03-18 21:23:25 +08:00
HongCheng
72a7746d8b
Merge pull request #1 from SmartFlowAI/main
...
同步
2024-03-18 22:23:25 +09:00
HongCheng
042146af56
Revert "modified merge_jsonl and merge_jsonl_r"
...
This reverts commit a38ef60058
2024-03-18 22:13:35 +09:00
ZhouXinAo
28086d3f89
Update README.md
2024-03-18 21:09:47 +08:00
