bakaEC/OliveSensorAPI
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
495 Commits 1 Branch 0 Tags 91 MiB
2632ec390d
Commit Graph

495 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Anooyman
2632ec390d Add RAG into internlm2 2024-04-14 12:22:35 +08:00
Anooyman
14890fad56
Update code (#8) 
* feat: add agents/actions/write_markdown

* [ADD] add evaluation result of base model on 5/10 epochs

* Rename mother.json to mother_v1_2439.json

* Add files via upload

* [DOC] update README

* Update requirements.txt

update mpi4py installation

* Update README_EN.md

update English comma

* Update README.md

基于母亲角色的多轮对话模型微调完毕。已上传到 Huggingface。

* 多轮对话母亲角色的微调的脚本

* Update README.md

加上了王几行XING 和 思在 的作者信息

* Update README_EN.md

* Update README.md

* Update README_EN.md

* Update README_EN.md

* Changes to be committed:
	modified:   .gitignore
	modified:   README.md
	modified:   README_EN.md
	new file:   assets/EmoLLM_transparent.png
	deleted:    assets/Shusheng.jpg
	new file:   assets/Shusheng.png
	new file:   assets/aiwei_demo1.gif
	new file:   assets/aiwei_demo2.gif
	new file:   assets/aiwei_demo3.gif
	new file:   assets/aiwei_demo4.gif

* Update README.md

rectify aiwei_demo.gif

* Update README.md

rectify aiwei_demo style

* Changes to be committed:
	modified:   README.md
	modified:   README_EN.md

* Changes to be committed:
	modified:   README.md
	modified:   README_EN.md

* [Doc] update readme

* [Doc] update readme

* Update README.md

* Update README_EN.md

* Update README.md

* Update README_EN.md

* Delete datasets/mother_v1_2439.json

* Rename mother_v2_3838.json to mother_v2.json

* Delete datasets/mother_v2.json

* Add files via upload

* Update README.md

* Update README_EN.md

* [Doc] Update README_EN.md

minor fix

* InternLM2-Base-7B QLoRA微调模型 链接和测评结果更新

* add download_model.py script, automatic download of model libraries

* 清除图片的黑边、更新作者信息
	modified:   README.md
	new file:   assets/aiwei_demo.gif
	deleted:    assets/aiwei_demo1.gif
	modified:   assets/aiwei_demo2.gif
	modified:   assets/aiwei_demo3.gif
	modified:   assets/aiwei_demo4.gif

* rectify aiwei_demo transparent

* transparent

* modify: aiwei_demo table--->div

* modified:   aiwei_demo

* modify: div ---> table

* modified:   README.md

* modified:   README_EN.md

* update model config file links

* Create internlm2_20b_chat_lora_alpaca_e3.py

20b模型的配置文件

* update model config file links

update model config file links

* Revert "update model config file links"

---------

Co-authored-by: jujimeizuo <fengzetao.zed@foxmail.com>
Co-authored-by: xzw <62385492+aJupyter@users.noreply.github.com>
Co-authored-by: Zeyu Ba <72795264+ZeyuBa@users.noreply.github.com>
Co-authored-by: Bryce Wang <90940753+brycewang2018@users.noreply.github.com>
Co-authored-by: zealot52099 <songyan5209@163.com>
Co-authored-by: HongCheng <kwchenghong@gmail.com>
Co-authored-by: Yicong <yicooong@qq.com>
Co-authored-by: Yicooong <54353406+Yicooong@users.noreply.github.com>
Co-authored-by: aJupyter <ajupyter@163.com>
Co-authored-by: MING_X <119648793+MING-ZCH@users.noreply.github.com>
Co-authored-by: Ikko Eltociear Ashimine <eltociear@gmail.com>
Co-authored-by: HatBoy <null2none@163.com>
Co-authored-by: ZhouXinAo <142309012+zxazys@users.noreply.github.com>
 2024-04-14 10:09:17 +08:00
Anooyman
1f7ef9cac0
feat: add agents/actions/write_markdown (#7) 
Co-authored-by: jujimeizuo <fengzetao.zed@foxmail.com>
 2024-03-27 21:16:32 +08:00
Anooyman
66f59a4ced Merge branch 'main' of https://github.com/Anooyman/EmoLLM 2024-03-27 21:15:19 +08:00
Anooyman
25184d894c Revert "Revert "Update RAG"" 
This reverts commit a67596a215.
 2024-03-27 21:14:19 +08:00
Anooyman
a67596a215 Revert "Update RAG" 
This reverts commit d0663208e3.
 2024-03-27 21:13:26 +08:00
Anooyman
d0663208e3 Update RAG 2024-03-27 21:11:06 +08:00
aJupyter
5e9d4f43a8 [DOC] update readme 2024-03-27 20:23:36 +08:00
xzw
a7774a2c49 Revert "更新了readme" 2024-03-27 20:23:36 +08:00
xzw
e423e91462 Update README_EN.md 2024-03-27 20:23:36 +08:00
xzw
185e3ea0f0 Update README.md 2024-03-27 20:23:36 +08:00
xzw
42e1193962 Delete .~README.md 2024-03-27 20:23:36 +08:00
nln
70503cea3c 更新了readme 2024-03-27 20:23:36 +08:00
nln
a2e7e8eea7 更新了readme 2024-03-27 20:23:36 +08:00
dream00001
96a152bf9e Add files via upload 
更新了微信小程序原型设计部分（贡献者：潘晓航，南林娜）
 2024-03-27 20:23:36 +08:00
nln
f0ad377c16 更新了后端数据库信息 2024-03-27 20:23:36 +08:00
jujimeizuo
dc028b7679 feat: add agents/utils/llm_api 2024-03-27 20:23:36 +08:00
jujimeizuo
bebcaec0cd initial emollm-metagpt 2024-03-27 20:23:36 +08:00
HongCheng
c902356919 update remove a space for bold 2024-03-27 20:23:36 +08:00
HongCheng
0a96e999a9 update xtuner_config\README_internlm2_7b_base_qlora.md 
add hyperparamters
update model release part
update environment building part
 2024-03-27 20:23:36 +08:00
xzw
d9785ee500
[DOC] update readme (#149) 2024-03-26 14:17:18 +08:00
aJupyter
31b0b0366e [DOC] update readme 2024-03-26 14:16:32 +08:00
xzw
e7f16f21f5
Merge Dev (#148) 2024-03-26 13:57:16 +08:00
xzw
1ace001616
[DOC]update readme 2024-03-26 13:56:02 +08:00
xzw
75a91f61a9
Revert "更新了readme" 2024-03-26 13:54:54 +08:00
xzw
ba5993e240
更新了readme (#146) 2024-03-26 13:54:46 +08:00
xzw
9dbb5b7781
Update README_EN.md 2024-03-26 13:54:33 +08:00
xzw
c22972e770
Update README.md 2024-03-26 13:53:38 +08:00
xzw
5368046cbf
Delete .~README.md 2024-03-26 13:51:32 +08:00
xzw
8d5ff268d5
Add wechat UI (#145) 2024-03-26 13:49:55 +08:00
nln
00b50282d6 更新了readme 2024-03-26 00:27:00 +08:00
nln
0e712971b6 更新了readme 2024-03-26 00:26:42 +08:00
dream00001
8499b0b74a
Add files via upload 
更新了微信小程序原型设计部分（贡献者：潘晓航，南林娜）
 2024-03-26 00:12:57 +08:00
xzw
71f18a9369
Dev (#144) 2024-03-25 23:50:36 +08:00
xzw
463d7ad78a
数据库 (#143) 2024-03-25 23:49:52 +08:00
nln
fd3460e5d9 更新了后端数据库信息 2024-03-25 23:22:49 +08:00
jujimeizuo
f54e567d7d feat: add agents/utils/llm_api 2024-03-25 21:00:07 +08:00
jujimeizuo
ad7c611476 initial emollm-metagpt 2024-03-25 21:00:07 +08:00
xzw
f16b10ef05
Dev (#141) 2024-03-24 16:11:54 +08:00
xzw
7fa3a8b706
Updata RAG (#140) 2024-03-24 16:11:15 +08:00
Anooyman
c50b834104
Merge branch 'dev' into main 2024-03-24 16:09:51 +08:00
xzw
5cb25854f4
update xtuner_config\README_internlm2_7b_base_qlora.md (#138) 2024-03-24 16:08:44 +08:00
Anooyman
d2f805c854
Smart flow ai dev (#4) 
* update rag/src/data_processing.py

* Add files via upload

allow user to load embedding & rerank models from cache

* Add files via upload

embedding_path = os.path.join(model_dir, 'embedding_model')  
rerank_path = os.path.join(model_dir, 'rerank_model')

* 测试push dev

测试push dev

* Add files via upload

两个母亲多轮对话数据集合并、清理和去重之后，得到 2439 条多轮对话数据（每条有6-8轮对话）。

* optimize deduplicate.py

Add time print information
save duplicate dataset as well
remove print(content)

* add base model qlora fintuning config file: internlm2_7b_base_qlora_e10_M_1e4_32_64.py

* add full finetune code from internlm2

* other 2 configs for base model

* update cli_internlm2.py

 three methods to load model

1. download model in openxlab
2. download model in modelscope
3. offline model

* create upload_modelscope.py

* add base model and update personal contributions

* add README.md for Emollm_Scientist

* Create README_internlm2_7b_base_qlora.md

InternLM2 7B Base QLoRA 微调指南

* [DOC]EmoLLM_Scientist微调指南

* [DOC]EmoLLM_Scientist微调指南

* [DOC]EmoLLM_Scientist微调指南

* [DOC]EmoLLM_Scientist微调指南

* [DOC]EmoLLM_Scientist微调指南

* [DOC]EmoLLM_Scientist微调指南

* update

* [DOC]README_scientist.md

* delete config

* format update

* upload xlab

* add README_Model_Uploading.md and images

* modelscope model upload

* Modify Recent Updates

* update daddy-like Boy-Friend EmoLLM

* update model uploading with openxlab

* update model uploading with openxlab

---------

Co-authored-by: zealot52099 <songyan5209@163.com>
Co-authored-by: xzw <62385492+aJupyter@users.noreply.github.com>
Co-authored-by: zealot52099 <67356208+zealot52099@users.noreply.github.com>
Co-authored-by: Bryce Wang <90940753+brycewang2018@users.noreply.github.com>
Co-authored-by: HongCheng <kwchenghong@gmail.com>
 2024-03-24 16:01:07 +08:00
Anooyman
773c70687e Update main.py 2024-03-24 15:52:12 +08:00
Anooyman
8c81c222a9 Update 2024-03-24 15:48:59 +08:00
Anooyman
f44310f665 update 2024-03-24 15:18:35 +08:00
HongCheng
0a231f39d4 update remove a space for bold 2024-03-24 14:26:59 +09:00
HongCheng
5e3e2f44e7 update xtuner_config\README_internlm2_7b_base_qlora.md 
add hyperparamters
update model release part
update environment building part
 2024-03-24 13:31:32 +09:00
Anooyman
de0674ccf7
Update main code (#2) 
* update rag/src/data_processing.py

* Add files via upload

allow user to load embedding & rerank models from cache

* Add files via upload

embedding_path = os.path.join(model_dir, 'embedding_model')  
rerank_path = os.path.join(model_dir, 'rerank_model')

* 测试push dev

测试push dev

* Add files via upload

两个母亲多轮对话数据集合并、清理和去重之后，得到 2439 条多轮对话数据（每条有6-8轮对话）。

* optimize deduplicate.py

Add time print information
save duplicate dataset as well
remove print(content)

* add base model qlora fintuning config file: internlm2_7b_base_qlora_e10_M_1e4_32_64.py

* add full finetune code from internlm2

* other 2 configs for base model

* update cli_internlm2.py

 three methods to load model

1. download model in openxlab
2. download model in modelscope
3. offline model

* create upload_modelscope.py

* add base model and update personal contributions

* add README.md for Emollm_Scientist

* Create README_internlm2_7b_base_qlora.md

InternLM2 7B Base QLoRA 微调指南

* [DOC]EmoLLM_Scientist微调指南

* [DOC]EmoLLM_Scientist微调指南

* [DOC]EmoLLM_Scientist微调指南

* [DOC]EmoLLM_Scientist微调指南

* [DOC]EmoLLM_Scientist微调指南

* [DOC]EmoLLM_Scientist微调指南

* update

* [DOC]README_scientist.md

* delete config

* format update

* upload xlab

* add README_Model_Uploading.md and images

* modelscope model upload

* Modify Recent Updates

* update daddy-like Boy-Friend EmoLLM

* update model uploading with openxlab

* update model uploading with openxlab

---------

Co-authored-by: zealot52099 <songyan5209@163.com>
Co-authored-by: xzw <62385492+aJupyter@users.noreply.github.com>
Co-authored-by: zealot52099 <67356208+zealot52099@users.noreply.github.com>
Co-authored-by: Bryce Wang <90940753+brycewang2018@users.noreply.github.com>
Co-authored-by: HongCheng <kwchenghong@gmail.com>
 2024-03-24 11:51:19 +08:00
xzw
d4f64ab2f4
Dev (#137) 2024-03-24 11:47:40 +08:00