[DOC]EmoLLM_Scientist微调指南
This commit is contained in:
parent
8f63772651
commit
53d69301ff
@ -1,7 +1,7 @@
|
||||
# EmoLLM_Scientist微调指南
|
||||
|
||||
## 数据
|
||||
微调数据共包含3800段对话,借助LLM自动生成,后续进行人工校验。数据路径:'datasets\scientist.json'
|
||||
微调数据共包含3800段对话,借助LLM自动生成,后续进行人工校验。数据路径:`datasets\scientist.json`
|
||||
|
||||
## 基座
|
||||
基座模型采用InternLM2-Chat-7B,模型介绍请见[InternLM](https://github.com/InternLM/InternLM)
|
||||
@ -37,8 +37,8 @@ xtuner convert pth_to_hf internlm2_7b_chat_qlora_e3_scienctist.py ./work_dirs/in
|
||||
|
||||
---
|
||||
|
||||
### 将 HuggingFace adapter 合并到大语言模型
|
||||
|
||||
### 模型合并
|
||||
将 HuggingFace adapter 合并到大语言模型
|
||||
```bash
|
||||
xtuner convert merge ./internlm2-chat-7b ./hf ./merged --max-shard-size 2GB
|
||||
# xtuner convert merge \
|
||||
@ -60,12 +60,12 @@ python cli_internlm2_scientist.py
|
||||
---
|
||||
|
||||
## 模型上传
|
||||
完成测试后可将模型上传到ModelScope和Openxlab平台
|
||||
### ModelScope
|
||||
脚本:'scripts/upload_modelscope.py'
|
||||
完成测试后可将模型上传到ModelScope和Openxlab平台(不建议在Windows下操作)
|
||||
#### ModelScope
|
||||
[Openxlab模型上传](https://openxlab.org.cn/docs/models/%E4%B8%8A%E4%BC%A0%E6%A8%A1%E5%9E%8B.html)
|
||||
脚本:`scripts/upload_modelscope.py`
|
||||
|
||||
### Openxlab
|
||||
#### Openxlab
|
||||
[ModelScope模型上传](https://modelscope.cn/docs/%E6%A8%A1%E5%9E%8B%E7%9A%84%E5%88%9B%E5%BB%BA%E4%B8%8E%E6%96%87%E4%BB%B6%E4%B8%8A%E4%BC%A0)
|
||||
|
||||
## 其他
|
||||
|
Loading…
Reference in New Issue
Block a user