bakaEC/OliveSensorAPI
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity

添加cli_Llama3.py参考链接

Browse Source
This commit is contained in:
HongCheng 2024-04-20 13:28:58 +09:00
parent f58f6711ca
commit 302c7229a8
1 changed files with 1 additions and 1 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

2
xtuner_config/README_llama3_8b_instruct_qlora_alpaca_e3_M.md
View File

@ -261,7 +261,7 @@ xtuner convert merge /root/models/LLM-Research/Meta-Llama-3-8B-Instruct ./hf_lla
## 测试 ## 测试
在EmoLLM的demo文件夹下，创建`cli_Llama3.py`，注意，这里我们采用本地离线测试（offline model），在线测试可以上传模型到有关平台后，再下载测试 在EmoLLM的demo文件夹下，创建`cli_Llama3.py`(文件修改自[社区分享](https://github.com/CrazyBoyM/llama3-Chinese-chat),感谢~)，注意，这里我们采用本地离线测试（offline model），在线测试可以上传模型到有关平台后，再下载测试
```python ```python
from transformers import AutoTokenizer, AutoConfig, AddedToken, AutoModelForCausalLM, BitsAndBytesConfig from transformers import AutoTokenizer, AutoConfig, AddedToken, AutoModelForCausalLM, BitsAndBytesConfig