Commit Graph

739 Commits

Author SHA1 Message Date
xzw
a7774a2c49 Revert "更新了readme" 2024-03-27 20:23:36 +08:00
xzw
e423e91462 Update README_EN.md 2024-03-27 20:23:36 +08:00
xzw
185e3ea0f0 Update README.md 2024-03-27 20:23:36 +08:00
xzw
42e1193962 Delete .~README.md 2024-03-27 20:23:36 +08:00
nln
70503cea3c 更新了readme 2024-03-27 20:23:36 +08:00
nln
a2e7e8eea7 更新了readme 2024-03-27 20:23:36 +08:00
dream00001
96a152bf9e Add files via upload
更新了微信小程序原型设计部分(贡献者:潘晓航,南林娜)
2024-03-27 20:23:36 +08:00
nln
f0ad377c16 更新了后端数据库信息 2024-03-27 20:23:36 +08:00
jujimeizuo
dc028b7679 feat: add agents/utils/llm_api 2024-03-27 20:23:36 +08:00
jujimeizuo
bebcaec0cd initial emollm-metagpt 2024-03-27 20:23:36 +08:00
HongCheng
c902356919 update remove a space for bold 2024-03-27 20:23:36 +08:00
HongCheng
0a96e999a9 update xtuner_config\README_internlm2_7b_base_qlora.md
add hyperparamters
update model release part
update environment building part
2024-03-27 20:23:36 +08:00
Zetao Feng
5bc9739f3c
feat: add agents/actions/write_markdown (#152) 2024-03-27 15:55:55 +08:00
jujimeizuo
6b76eed754 feat: add agents/actions/write_markdown 2024-03-27 15:53:52 +08:00
xzw
d9785ee500
[DOC] update readme (#149) 2024-03-26 14:17:18 +08:00
aJupyter
31b0b0366e [DOC] update readme 2024-03-26 14:16:32 +08:00
xzw
e7f16f21f5
Merge Dev (#148) 2024-03-26 13:57:16 +08:00
xzw
1ace001616
[DOC]update readme 2024-03-26 13:56:02 +08:00
xzw
75a91f61a9
Revert "更新了readme" 2024-03-26 13:54:54 +08:00
xzw
ba5993e240
更新了readme (#146) 2024-03-26 13:54:46 +08:00
xzw
9dbb5b7781
Update README_EN.md 2024-03-26 13:54:33 +08:00
xzw
c22972e770
Update README.md 2024-03-26 13:53:38 +08:00
xzw
5368046cbf
Delete .~README.md 2024-03-26 13:51:32 +08:00
xzw
8d5ff268d5
Add wechat UI (#145) 2024-03-26 13:49:55 +08:00
nln
00b50282d6 更新了readme 2024-03-26 00:27:00 +08:00
nln
0e712971b6 更新了readme 2024-03-26 00:26:42 +08:00
dream00001
8499b0b74a
Add files via upload
更新了微信小程序原型设计部分(贡献者:潘晓航,南林娜)
2024-03-26 00:12:57 +08:00
xzw
71f18a9369
Dev (#144) 2024-03-25 23:50:36 +08:00
xzw
463d7ad78a
数据库 (#143) 2024-03-25 23:49:52 +08:00
nln
fd3460e5d9 更新了后端数据库信息 2024-03-25 23:22:49 +08:00
jujimeizuo
f54e567d7d feat: add agents/utils/llm_api 2024-03-25 21:00:07 +08:00
jujimeizuo
ad7c611476 initial emollm-metagpt 2024-03-25 21:00:07 +08:00
xzw
f16b10ef05
Dev (#141) 2024-03-24 16:11:54 +08:00
xzw
7fa3a8b706
Updata RAG (#140) 2024-03-24 16:11:15 +08:00
Anooyman
c50b834104
Merge branch 'dev' into main 2024-03-24 16:09:51 +08:00
xzw
5cb25854f4
update xtuner_config\README_internlm2_7b_base_qlora.md (#138) 2024-03-24 16:08:44 +08:00
Anooyman
d2f805c854
Smart flow ai dev (#4)
* update rag/src/data_processing.py

* Add files via upload

allow user to load embedding & rerank models from cache

* Add files via upload

embedding_path = os.path.join(model_dir, 'embedding_model')  
rerank_path = os.path.join(model_dir, 'rerank_model')

* 测试push dev

测试push dev

* Add files via upload

两个母亲多轮对话数据集合并、清理和去重之后,得到 2439 条多轮对话数据(每条有6-8轮对话)。

* optimize deduplicate.py

Add time print information
save duplicate dataset as well
remove print(content)

* add base model qlora fintuning config file: internlm2_7b_base_qlora_e10_M_1e4_32_64.py

* add full finetune code from internlm2

* other 2 configs for base model

* update cli_internlm2.py

 three methods to load model

1. download model in openxlab
2. download model in modelscope
3. offline model

* create upload_modelscope.py

* add base model and update personal contributions

* add README.md for Emollm_Scientist

* Create README_internlm2_7b_base_qlora.md

InternLM2 7B Base QLoRA 微调指南

* [DOC]EmoLLM_Scientist微调指南

* [DOC]EmoLLM_Scientist微调指南

* [DOC]EmoLLM_Scientist微调指南

* [DOC]EmoLLM_Scientist微调指南

* [DOC]EmoLLM_Scientist微调指南

* [DOC]EmoLLM_Scientist微调指南

* update

* [DOC]README_scientist.md

* delete config

* format update

* upload xlab

* add README_Model_Uploading.md and images

* modelscope model upload

* Modify Recent Updates

* update daddy-like Boy-Friend EmoLLM

* update model uploading with openxlab

* update model uploading with openxlab

---------

Co-authored-by: zealot52099 <songyan5209@163.com>
Co-authored-by: xzw <62385492+aJupyter@users.noreply.github.com>
Co-authored-by: zealot52099 <67356208+zealot52099@users.noreply.github.com>
Co-authored-by: Bryce Wang <90940753+brycewang2018@users.noreply.github.com>
Co-authored-by: HongCheng <kwchenghong@gmail.com>
2024-03-24 16:01:07 +08:00
Anooyman
773c70687e Update main.py 2024-03-24 15:52:12 +08:00
Anooyman
8c81c222a9 Update 2024-03-24 15:48:59 +08:00
Anooyman
f44310f665 update 2024-03-24 15:18:35 +08:00
HongCheng
0a231f39d4 update remove a space for bold 2024-03-24 14:26:59 +09:00
HongCheng
5e3e2f44e7 update xtuner_config\README_internlm2_7b_base_qlora.md
add hyperparamters
update model release part
update environment building part
2024-03-24 13:31:32 +09:00
Anooyman
de0674ccf7
Update main code (#2)
* update rag/src/data_processing.py

* Add files via upload

allow user to load embedding & rerank models from cache

* Add files via upload

embedding_path = os.path.join(model_dir, 'embedding_model')  
rerank_path = os.path.join(model_dir, 'rerank_model')

* 测试push dev

测试push dev

* Add files via upload

两个母亲多轮对话数据集合并、清理和去重之后,得到 2439 条多轮对话数据(每条有6-8轮对话)。

* optimize deduplicate.py

Add time print information
save duplicate dataset as well
remove print(content)

* add base model qlora fintuning config file: internlm2_7b_base_qlora_e10_M_1e4_32_64.py

* add full finetune code from internlm2

* other 2 configs for base model

* update cli_internlm2.py

 three methods to load model

1. download model in openxlab
2. download model in modelscope
3. offline model

* create upload_modelscope.py

* add base model and update personal contributions

* add README.md for Emollm_Scientist

* Create README_internlm2_7b_base_qlora.md

InternLM2 7B Base QLoRA 微调指南

* [DOC]EmoLLM_Scientist微调指南

* [DOC]EmoLLM_Scientist微调指南

* [DOC]EmoLLM_Scientist微调指南

* [DOC]EmoLLM_Scientist微调指南

* [DOC]EmoLLM_Scientist微调指南

* [DOC]EmoLLM_Scientist微调指南

* update

* [DOC]README_scientist.md

* delete config

* format update

* upload xlab

* add README_Model_Uploading.md and images

* modelscope model upload

* Modify Recent Updates

* update daddy-like Boy-Friend EmoLLM

* update model uploading with openxlab

* update model uploading with openxlab

---------

Co-authored-by: zealot52099 <songyan5209@163.com>
Co-authored-by: xzw <62385492+aJupyter@users.noreply.github.com>
Co-authored-by: zealot52099 <67356208+zealot52099@users.noreply.github.com>
Co-authored-by: Bryce Wang <90940753+brycewang2018@users.noreply.github.com>
Co-authored-by: HongCheng <kwchenghong@gmail.com>
2024-03-24 11:51:19 +08:00
xzw
d4f64ab2f4
Dev (#137) 2024-03-24 11:47:40 +08:00
xzw
f7046e3c05
update model uploading with openxlab (#136) 2024-03-24 11:47:15 +08:00
HongCheng
07ea64b4c5 update model uploading with openxlab 2024-03-24 12:43:24 +09:00
HongCheng
7c3b9a1d23 update model uploading with openxlab 2024-03-24 12:38:51 +09:00
xzw
d9c44ff9d1
Dev (#135) 2024-03-24 00:48:06 +08:00
xzw
06f9fe543b
add README_Model_Uploading.md and images (#134) 2024-03-24 00:47:49 +08:00
HongCheng
d0b70677f6
Merge pull request #2 from SmartFlowAI/main
同步
2024-03-24 01:05:02 +09:00