From 000491f1befab3f8b5989b0b54b568c29e017768 Mon Sep 17 00:00:00 2001
From: Anooyman <875734078@qq.com>
Date: Fri, 15 Mar 2024 19:51:04 +0800
Subject: [PATCH] Merge Main code (#2)
MIME-Version: 1.0
Content-Type: text/plain; charset=UTF-8
Content-Transfer-Encoding: 8bit
* Add files via upload
* 新增ENmd文档
* Update README.md
* Update README_EN.md
* Update LICENSE
* [docs] update lmdeploy file
* add ocr.md
* Update tutorial.md
* Update tutorial_EN.md
* Update General_evaluation_EN.md
* Update General_evaluation_EN.md
* Update README.md
Add InternLM2_7B_chat_full's professional evaluation results
* Update Professional_evaluation.md
* Update Professional_evaluation.md
* Update Professional_evaluation.md
* Update Professional_evaluation.md
* Update Professional_evaluation_EN.md
* Update README.md
* Update README.md
* Update README_EN.md
* Update README_EN.md
* Update README_EN.md
* [DOC] update readme
* Update LICENSE
* Update LICENSE
* update personal info and small format optimizations
* update personal info and translations for contents in a table
* Update RAG README
* Update demo link in README.md
* Update xlab app link
* Update xlab link
* add xlab model
* Update web_demo-aiwei.py
* add bitex
---------
Co-authored-by: xzw <62385492+aJupyter@users.noreply.github.com>
Co-authored-by: এ許我辞忧࿐♡ <127636623+Smiling-Weeping-zhr@users.noreply.github.com>
Co-authored-by: Vicky
- 简体中文| English
+
-
+EmoLLM
-
@@ -103,22 +119,23 @@
## 目录
- [EmoLLM-心理健康大模型](#emollm-心理健康大模型)
- - [最近更新](#最近更新)
+ - [🎇最近更新](#最近更新)
+ - [🎯路线图](#路线图)
- [目录](#目录)
- [开发前的配置要求](#开发前的配置要求)
- [**使用指南**](#使用指南)
- - [文件目录说明](#文件目录说明)
- [数据构建](#数据构建)
- [微调指南](#微调指南)
- [部署指南](#部署指南)
+ - [RAG(检索增强生成)Pipeline](#rag检索增强生成pipeline)
- [使用到的框架](#使用到的框架)
- [如何参与本项目](#如何参与本项目)
- - [版本控制](#版本控制)
- [作者(排名不分先后)](#作者排名不分先后)
- [版权说明](#版权说明)
- [特别鸣谢](#特别鸣谢)
- [Star History](#star-history)
- [🌟 Contributors](#-contributors)
+ - [交流群](#交流群)
###### 开发前的配置要求
@@ -133,31 +150,17 @@ git clone https://github.com/SmartFlowAI/EmoLLM.git
```
2. 依次阅读或者选择感兴趣的部分阅读:
- - [文件目录说明](#文件目录说明)
- [数据构建](#数据构建)
- [微调指南](#微调指南)
- [部署指南](#部署指南)
+ - [RAG](#rag检索增强生成pipeline)
- 查看更多详情
-
-### 文件目录说明
-
-```
-├─assets:图像资源
-├─datasets:数据集
-├─demo:demo脚本
-├─generate_data:生成数据指南
-│ └─xinghuo
-├─scripts:一些可用工具
-└─xtuner_config:微调指南
- └─images
-```
-
### 数据构建
-请阅读[数据构建指南](generate_data/tutorial.md)查阅
+- 请阅读[数据构建指南](generate_data/tutorial.md)查阅
-本次微调用到的数据集见[datasets](datasets/data.json)
+- 微调用到的数据集见[datasets](datasets/data.json)
### 微调指南
@@ -165,16 +168,24 @@ git clone https://github.com/SmartFlowAI/EmoLLM.git
### 部署指南
-详见[部署指南](demo/README.md)
+- Demo部署:详见[部署指南](demo/README.md)
+- 基于[LMDeploy](https://github.com/InternLM/lmdeploy/)的量化部署:详见[deploy](./deploy/lmdeploy.md)
+
+### RAG(检索增强生成)Pipeline
+
+- 详见[RAG](./rag/)
+
+
+
+
+
-
-
-
+ }8Q71dLK~x9NVCmsj1OZz;FGsHOnCez@88
z+SH2i@y^$Wqw%slx+XOFZl !u#qEiY更多详情
### 使用到的框架
-- [Xtuner](https://github.com/InternLM/xtuner)
+- [Xtuner](https://github.com/InternLM/xtuner):用于微调
- [Transformers](https://github.com/huggingface/transformers)
- [Pytorch](https://pytorch.org/)
+- [LMDeploy](https://github.com/InternLM/lmdeploy/):用于量化部署
+- [Stremlit](https://streamlit.io/):用于构建Demo
+- [DeepSpeed](https://github.com/microsoft/DeepSpeed):并行训练
- …
#### 如何参与本项目
@@ -187,45 +198,44 @@ git clone https://github.com/SmartFlowAI/EmoLLM.git
4. Push to the Branch (`git push origin feature/AmazingFeature`)
5. Open a Pull Request
-### 版本控制
-
-该项目使用Git进行版本管理。您可以在repository参看当前可用版本。
-
-
-EmoLLM
@@ -35,24 +41,31 @@
-**EmoLLM** is a series of large language models designed to understand, support and help customers in mental health counseling. It is fine-tuned from the LLM instructions. We really appreciate it if you can give it a star~⭐⭐. The open-sourced configuration is as follows:
+**EmoLLM** is a series of large language models designed to understand, support and help customers in mental health counseling. It is fine-tuned from the LLM instructions. We really appreciate it if you could give it a star~⭐⭐. The open-sourced configuration is as follows:
-| model | type |
+Additional Details
@@ -179,6 +201,9 @@ For details, see the [deployment guide](demo/README.md)
- [Xtuner](https://github.com/InternLM/xtuner)
- [Transformers](https://github.com/huggingface/transformers)
- [Pytorch](https://pytorch.org/)
+- [LMDeploy](https://github.com/InternLM/lmdeploy/): for quantitative deployment
+- [Stremlit](https://streamlit.io/): for building demos
+- [DeepSpeed](https://github.com/microsoft/DeepSpeed): for parallel training
- …
#### How to participate in this project
@@ -193,39 +218,31 @@ Contributions make the open-source community an excellent place for learning, in
### Version control
-This project uses Git for version control. You can see the current available versions in the repository.
+This project uses Git for version control. You can see the currently available versions in the repository.
-!9#5y{*UmKDV*KrK9WKN!|J
zvcH7AYFE09o$WxeN6kWcxb`p+jI$DWU8U6-Vs
dbGcUu!&Epub{{r1We
{Qoq*yvVi&Xl1A&wU)NI7i$+o5=0GSVvhK&%a
zt*@P3LU=7kGDCD9FcFY%UidsRhgFiWu~z#(RF(G=y5opAwN8zdhcom7I3xh+d(;+d
zaUpB2l}z)#{00n7-Vj?z;k)>9W_J&-eP6i`RI+crW-VcAWBRN;<}te;-#<~;1BGdz
zfbOYy7gBDAS1`m<=nJKh(H*TwKDYK84%2ybgUiwqz0+%lJyvn^3=PvkSzSUpfo!Kb
zfm*!9p}GyAW&cz9>MqEu7ETs8(F7uaN6s`--HV#9kFvS7`6f1QHHmu{Q*#zDy4Ci2
zD6u9M`MpGlmySC7=?W$NfvXCq(oxi2e4!+!b0=D2r>jJxtfRqhJm0k0ui^G2e4N4;
z^f;~XB7iwd)bakR1AV}=xgMWCIn^EXu<)UaOPZyu8vzF3sO|A@fQ&A9j}Tlq&=c~S
zMEn-B|JTWS3v)|WrXoDS@RzUjg4I4m>3U3_Ft0dBud47e_WYbJ>X!Am+mqQv0?Qg-|Jkw%t-M!x6st+IPJ%7G;0B@`N2MO4GfLPvgU
zH>?5ct|zU!ZEvg6k&)HR;zyd+Ji82=;-WcRF-7epGe7El!_LUq6W5+yXZWboYsQ^7
zXvbRorQRdiS}Q$N=}!E@?#Q2>ZXM39A-BN14JhxXHO$biz)Z{{=B1>J5YM5h2`yN#
zx{-6)8aB>a9DDlP
z*ztZ;e<5QYHyxZpk~Nth_@IB=L~W6eB#O{2^jUekiDxXzxtq6k!MY86?xSR%0JbKG
zVfu;C)^dnxbji(Syp&+wy>w66{TO=pV==P&;nTirGle?S`aSu#C7%{$Ej%72mgSF<
zR_4D=f?zdP7mYb7=ZG$dis5kN*Dwht?H~!t)HBlP(V8ItMTNN3f>-qA2AYNNx981F
z)n5Ck
u
zu5Ot_Fq#9>J|*JlXJG4l69~{d7IJMlYXm>qREM+bV!D}1%cJMYw=}E)=PSNU5vz$r
zSj?2?wr(|PABQOGK5g!LOuHVKf9}J*SI2kI78+MlLw%ky(K`sJB$J!Bh;d0Sv4e9;
z_*;74`XQT8Eu5;@)FJSgjjOr&H#V}x3In3Wqt?r#xUUlgNmGJhGXe^FYfshCGKg|T
z{t^WmjYi^G?*>cEaJ{nnkJouyyVsR{Exa~5y!Oppdw3zsIs1pq7B;F
zMr?dRicNE)qAZ*OX9OsjtKe9?>m3+?XN5$a7