bakaEC/OliveSensorAPI
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
662 Commits 1 Branch 0 Tags 91 MiB
d9dd95ff08
Commit Graph

662 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
xzw
71f18a9369
Dev (#144) 2024-03-25 23:50:36 +08:00
xzw
463d7ad78a
数据库 (#143) 2024-03-25 23:49:52 +08:00
nln
fd3460e5d9 更新了后端数据库信息 2024-03-25 23:22:49 +08:00
jujimeizuo
f54e567d7d feat: add agents/utils/llm_api 2024-03-25 21:00:07 +08:00
jujimeizuo
ad7c611476 initial emollm-metagpt 2024-03-25 21:00:07 +08:00
xzw
f16b10ef05
Dev (#141) 2024-03-24 16:11:54 +08:00
xzw
7fa3a8b706
Updata RAG (#140) 2024-03-24 16:11:15 +08:00
Anooyman
c50b834104
Merge branch 'dev' into main 2024-03-24 16:09:51 +08:00
xzw
5cb25854f4
update xtuner_config\README_internlm2_7b_base_qlora.md (#138) 2024-03-24 16:08:44 +08:00
Anooyman
d2f805c854
Smart flow ai dev (#4) 
* update rag/src/data_processing.py

* Add files via upload

allow user to load embedding & rerank models from cache

* Add files via upload

embedding_path = os.path.join(model_dir, 'embedding_model')  
rerank_path = os.path.join(model_dir, 'rerank_model')

* 测试push dev

测试push dev

* Add files via upload

两个母亲多轮对话数据集合并、清理和去重之后，得到 2439 条多轮对话数据（每条有6-8轮对话）。

* optimize deduplicate.py

Add time print information
save duplicate dataset as well
remove print(content)

* add base model qlora fintuning config file: internlm2_7b_base_qlora_e10_M_1e4_32_64.py

* add full finetune code from internlm2

* other 2 configs for base model

* update cli_internlm2.py

 three methods to load model

1. download model in openxlab
2. download model in modelscope
3. offline model

* create upload_modelscope.py

* add base model and update personal contributions

* add README.md for Emollm_Scientist

* Create README_internlm2_7b_base_qlora.md

InternLM2 7B Base QLoRA 微调指南

* [DOC]EmoLLM_Scientist微调指南

* [DOC]EmoLLM_Scientist微调指南

* [DOC]EmoLLM_Scientist微调指南

* [DOC]EmoLLM_Scientist微调指南

* [DOC]EmoLLM_Scientist微调指南

* [DOC]EmoLLM_Scientist微调指南

* update

* [DOC]README_scientist.md

* delete config

* format update

* upload xlab

* add README_Model_Uploading.md and images

* modelscope model upload

* Modify Recent Updates

* update daddy-like Boy-Friend EmoLLM

* update model uploading with openxlab

* update model uploading with openxlab

---------

Co-authored-by: zealot52099 <songyan5209@163.com>
Co-authored-by: xzw <62385492+aJupyter@users.noreply.github.com>
Co-authored-by: zealot52099 <67356208+zealot52099@users.noreply.github.com>
Co-authored-by: Bryce Wang <90940753+brycewang2018@users.noreply.github.com>
Co-authored-by: HongCheng <kwchenghong@gmail.com>
 2024-03-24 16:01:07 +08:00
Anooyman
773c70687e Update main.py 2024-03-24 15:52:12 +08:00
Anooyman
8c81c222a9 Update 2024-03-24 15:48:59 +08:00
Anooyman
f44310f665 update 2024-03-24 15:18:35 +08:00
HongCheng
0a231f39d4 update remove a space for bold 2024-03-24 14:26:59 +09:00
HongCheng
5e3e2f44e7 update xtuner_config\README_internlm2_7b_base_qlora.md 
add hyperparamters
update model release part
update environment building part
 2024-03-24 13:31:32 +09:00
Anooyman
de0674ccf7
Update main code (#2) 
* update rag/src/data_processing.py

* Add files via upload

allow user to load embedding & rerank models from cache

* Add files via upload

embedding_path = os.path.join(model_dir, 'embedding_model')  
rerank_path = os.path.join(model_dir, 'rerank_model')

* 测试push dev

测试push dev

* Add files via upload

两个母亲多轮对话数据集合并、清理和去重之后，得到 2439 条多轮对话数据（每条有6-8轮对话）。

* optimize deduplicate.py

Add time print information
save duplicate dataset as well
remove print(content)

* add base model qlora fintuning config file: internlm2_7b_base_qlora_e10_M_1e4_32_64.py

* add full finetune code from internlm2

* other 2 configs for base model

* update cli_internlm2.py

 three methods to load model

1. download model in openxlab
2. download model in modelscope
3. offline model

* create upload_modelscope.py

* add base model and update personal contributions

* add README.md for Emollm_Scientist

* Create README_internlm2_7b_base_qlora.md

InternLM2 7B Base QLoRA 微调指南

* [DOC]EmoLLM_Scientist微调指南

* [DOC]EmoLLM_Scientist微调指南

* [DOC]EmoLLM_Scientist微调指南

* [DOC]EmoLLM_Scientist微调指南

* [DOC]EmoLLM_Scientist微调指南

* [DOC]EmoLLM_Scientist微调指南

* update

* [DOC]README_scientist.md

* delete config

* format update

* upload xlab

* add README_Model_Uploading.md and images

* modelscope model upload

* Modify Recent Updates

* update daddy-like Boy-Friend EmoLLM

* update model uploading with openxlab

* update model uploading with openxlab

---------

Co-authored-by: zealot52099 <songyan5209@163.com>
Co-authored-by: xzw <62385492+aJupyter@users.noreply.github.com>
Co-authored-by: zealot52099 <67356208+zealot52099@users.noreply.github.com>
Co-authored-by: Bryce Wang <90940753+brycewang2018@users.noreply.github.com>
Co-authored-by: HongCheng <kwchenghong@gmail.com>
 2024-03-24 11:51:19 +08:00
xzw
d4f64ab2f4
Dev (#137) 2024-03-24 11:47:40 +08:00
xzw
f7046e3c05
update model uploading with openxlab (#136) 2024-03-24 11:47:15 +08:00
HongCheng
07ea64b4c5 update model uploading with openxlab 2024-03-24 12:43:24 +09:00
HongCheng
7c3b9a1d23 update model uploading with openxlab 2024-03-24 12:38:51 +09:00
xzw
d9c44ff9d1
Dev (#135) 2024-03-24 00:48:06 +08:00
xzw
06f9fe543b
add README_Model_Uploading.md and images (#134) 2024-03-24 00:47:49 +08:00
HongCheng
d0b70677f6
Merge pull request #2 from SmartFlowAI/main 
同步
 2024-03-24 01:05:02 +09:00
HongCheng
49bd97901b update daddy-like Boy-Friend EmoLLM 2024-03-24 01:03:11 +09:00
HongCheng
f7af159539 Modify Recent Updates 2024-03-24 00:45:02 +09:00
HongCheng
f344d45ff1 modelscope model upload 2024-03-24 00:28:23 +09:00
HongCheng
9e09279f80 add README_Model_Uploading.md and images 2024-03-23 23:53:17 +09:00
HongCheng
8efac035b9 upload xlab 2024-03-23 23:14:22 +09:00
HongCheng
f7c35fef14 format update 2024-03-23 22:36:44 +09:00
xzw
3232964494
Dev (#133) 2024-03-23 21:15:19 +08:00
xzw
70a080c0a8
[DOC]README_scientist.md (#132) 2024-03-23 21:14:07 +08:00
zealot52099
ace96c6248 delete config 2024-03-23 20:16:29 +08:00
zealot52099
17c18a3197 [DOC]README_scientist.md 2024-03-23 20:10:13 +08:00
xzw
1cd1fb7727
Dev (#131) 2024-03-23 20:00:00 +08:00
xzw
aaacfb149b
加入微调README.md 以及相关文件 (#130) 2024-03-23 19:59:26 +08:00
zealot52099
063b4d8692 update 2024-03-23 19:39:43 +08:00
zealot52099
b1df036d10 [DOC]EmoLLM_Scientist微调指南 2024-03-23 19:38:09 +08:00
zealot52099
0e6bef8b52 [DOC]EmoLLM_Scientist微调指南 2024-03-23 19:34:06 +08:00
zealot52099
ef7ce349b1 [DOC]EmoLLM_Scientist微调指南 2024-03-23 19:29:40 +08:00
zealot52099
0183301636 [DOC]EmoLLM_Scientist微调指南 2024-03-23 19:27:28 +08:00
xzw
2851a70730
Dev (#129) 2024-03-23 19:20:46 +08:00
xzw
a12a7ef107
add base model qlora fintuning config file and optimize deduplicate.py (#128) 2024-03-23 19:20:17 +08:00
zealot52099
53d69301ff [DOC]EmoLLM_Scientist微调指南 2024-03-23 19:19:07 +08:00
xzw
c4187b6e9e
Add files via upload (#127) 2024-03-23 19:16:37 +08:00
zealot52099
8f63772651 [DOC]EmoLLM_Scientist微调指南 2024-03-23 19:14:40 +08:00
HongCheng
383789e869 Create README_internlm2_7b_base_qlora.md 
InternLM2 7B Base QLoRA 微调指南
 2024-03-23 19:52:52 +09:00
zealot52099
0c72c31b4f add README.md for Emollm_Scientist 2024-03-23 15:59:02 +08:00
HongCheng
6e0042a54d add base model and update personal contributions 2024-03-23 16:05:05 +09:00
HongCheng
affd90b177 create upload_modelscope.py 2024-03-23 15:45:11 +09:00
HongCheng
a22ec59be5 update cli_internlm2.py 
three methods to load model

1. download model in openxlab
2. download model in modelscope
3. offline model
 2024-03-23 15:43:01 +09:00