bakaEC/OliveSensorAPI
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity

Merge branch 'SmartFlowAI:main' into main

Browse Source
This commit is contained in:
zealot52099 2024-03-19 20:14:33 +08:00 committed by GitHub
commit feb252d5b5
No known key found for this signature in database
GPG Key ID: B5690EEEBB952194
3 changed files with 4 additions and 3 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

3
README.md
View File

@ -229,7 +229,8 @@ git clone https://github.com/SmartFlowAI/EmoLLM.git
| [Vicky-3021](https://github.com/Vicky-3021) | 西安电子科技大学硕士（研0） | | | | [Vicky-3021](https://github.com/Vicky-3021) | 西安电子科技大学硕士（研0） | | |
| [SantiagoTOP](https://github.com/santiagoTOP) | 太原理工大学在读硕士 | | | | [SantiagoTOP](https://github.com/santiagoTOP) | 太原理工大学在读硕士 | | |
| [zealot52099](https://github.com/zealot52099) | AI搬用工 | |清洗数据、RAG| | [zealot52099](https://github.com/zealot52099) | AI搬用工 | |清洗数据、RAG|
| [wwwyfff](https://github.com/wwwyfff) | 复旦大学在读硕士 | || | [wwwyfff](https://github.com/wwwyfff) | 复旦大学在读硕士 | ||
| [jkhumor](https://github.com/jkhumor) | 南开大学在读硕士 | |RAG|
### 版权说明 ### 版权说明

1
README_EN.md
View File

@ -246,6 +246,7 @@ This project uses Git for version control. You can see the currently available v
| [SantiagoTOP](https://github.com/santiagoTOP) | Taiyuan University of Technology, Master's student | | | | [SantiagoTOP](https://github.com/santiagoTOP) | Taiyuan University of Technology, Master's student | | |
| [zealot52099](https://github.com/zealot52099) | AI Mover | |Data Processing and RAG| | [zealot52099](https://github.com/zealot52099) | AI Mover | |Data Processing and RAG|
| [wwwyfff](https://github.com/wwwyfff) | FuDan University, Master's student | || | [wwwyfff](https://github.com/wwwyfff) | FuDan University, Master's student | ||
| [jkhumor](https://github.com/jkhumor) | Nankai University, Master's student | |RAG|
### Copyright Notice ### Copyright Notice

3
xtuner_config/ChatGLM3-6b-ft.md
View File

@ -65,8 +65,7 @@ LLM 的微调一般指指令微调过程。所谓指令微调，是说我们使
def process_func(example): def process_func(example):
MAX_LENGTH = 512 MAX_LENGTH = 512
input_ids, labels = [], [] input_ids, labels = [], []
instruction = tokenizer.encode(text="\n".join(["<|system|>", "现在你是一个心理专家，我有一些心理问题，请你用专业的知识帮我解决。", "<|user|>", instruction = tokenizer.encode(text="\n".join(["<|system|>", example["system"], "<|user|>", example["input"] + "<|assistant|>"]).strip() + "\n",
example["system"] + example["input"] + "<|assistant|>"]).strip() + "\n",
add_special_tokens=True, truncation=True, max_length=MAX_LENGTH) add_special_tokens=True, truncation=True, max_length=MAX_LENGTH)
response = tokenizer.encode(text=example["output"], add_special_tokens=False, truncation=True, response = tokenizer.encode(text=example["output"], add_special_tokens=False, truncation=True,