Commit Graph

305 Commits

Author SHA1 Message Date
HongCheng
042146af56 Revert "modified merge_jsonl and merge_jsonl_r"
This reverts commit a38ef60058.
2024-03-18 22:13:35 +09:00
HongCheng
a833832908
Delete generate_data/upload_openxlab.py 2024-03-18 20:45:48 +09:00
HongCheng
19edf026eb
Delete generate_data/trans_process.py 2024-03-18 20:45:18 +09:00
HongCheng
b894b87a9d Revert "moving files in scripts related to generate data to generate_data folder"
This reverts commit 05ff5e8407.
2024-03-18 20:43:39 +09:00
HongCheng
a38ef60058 modified merge_jsonl and merge_jsonl_r
merge_jsonl is for merge jsonl files in a folder
merge_jsonl_r if for merge jsonl files in one folder's subfolders

uasge:
python merge_jsonl_r.py > qwen2.txt
python merge_jsonl_r.py > zhipuai.txt

python merge_jsonl.py > curr.txt

│   学业_merge.json
│   家人_merge.json
│   就业_merge.json
│   工作_merge.json
│   恋爱_merge.json
│   朋友_merge.json
│   环境_merge.json
│   生活_merge.json
│   社交_merge.json
│   责任_merge.json
│   身体_merge.json
│   隐私_merge.json
│
├───学业
│       兴奋.jsonl
│       冷静.jsonl
│       厌倦.jsonl
│       厌恶.jsonl
│       同情.jsonl
│       困惑.jsonl
│       娱乐.jsonl
│       嫉妒.jsonl
│       尴尬.jsonl
│       崇拜.jsonl
│       快乐.jsonl
│       怀旧.jsonl
│       性欲.jsonl
│       恐惧.jsonl
│       悲伤.jsonl
│       敬畏.jsonl
│       有趣.jsonl
│       欣赏.jsonl
│       浪漫.jsonl
│       渴望.jsonl
│       满意.jsonl
│       满足.jsonl
│       焦虑.jsonl
│       痛恨.jsonl
│       痛苦.jsonl
│       着迷.jsonl
│       钦佩.jsonl
│
├───家人
│       兴奋.jsonl
│       冷静.jsonl
│       厌倦.jsonl
│       厌恶.jsonl
│       同情.jsonl
│       困惑.jsonl
│       娱乐.jsonl
│       嫉妒.jsonl
2024-03-18 20:16:39 +09:00
HongCheng
0553c3877b Merge branch 'main' of https://github.com/chg0901/EmoLLM 2024-03-17 10:57:57 +09:00
HongCheng
441d06463a update gitignore (add *.jsonl) 2024-03-17 10:57:51 +09:00
HongCheng
4bcacd8b67
Delete generate_data/curr_merge.json
This is a merged file
2024-03-17 10:19:14 +09:00
HongCheng
baba0d611d move scripts/upload_openxlab.py and scripts/trans_process.py 2024-03-17 10:13:18 +09:00
HongCheng
05ff5e8407 moving files in scripts related to generate data to generate_data folder
also optimizing the merge_json.py
2024-03-17 10:05:50 +09:00
HongCheng
b47a102994
Update zhipuai_gen_data.py 添加glm-4 response获取异常处理
# 解决方法
``` python
    try:
        response = client.chat.completions.create(
            model='glm-4',
            messages=messages,
            top_p=top_p,
        )
    except:
        response = client.chat.completions.create(
            model='glm-4',
            messages=messages,
            top_p=top_p,
        )

``` 
# 报错
``` python
    # Error code: 400, with error text {"error":{"code":"1301","message":"系统检测到输入或生成内容可能包含不安全或敏感内容,请您避免输入易产生敏感内容的提示语,感谢您的配合。"}}
```
2024-03-17 08:45:33 +09:00
HongCheng
a9721ea582
Update config.yml 2024-03-16 22:02:11 +09:00
HongCheng
33e11caf97
Update requirements.txt 2024-03-16 22:01:35 +09:00
HongCheng
93067cfd64
Update config.yml 2024-03-16 22:00:51 +09:00
HongCheng
a82ae114ea
Update config.yml in generate_data 2024-03-16 21:57:29 +09:00
HongCheng
d51c894d3f
Update requirements.txt 2024-03-16 21:56:19 +09:00
HongCheng
eb12c3aa2b update qwen, zhipuai gen_data and readme 2024-03-16 21:46:02 +09:00
MING_X
82465ae12b
Merge pull request #79 from chg0901/patch-4
Update ChatGLM3-6b-ft_EN.md
2024-03-16 19:40:02 +08:00
HongCheng
5174fcb68b
Update ChatGLM3-6b-ft_EN.md 2024-03-16 20:21:20 +09:00
xzw
0c7cf9be68
Update LICENSE 2024-03-16 18:50:10 +08:00
xzw
826ab30b0f
Merge pull request #75 from chg0901/patch-3
Update ChatGLM3-6b-ft.md
2024-03-16 18:41:42 +08:00
xzw
660e36b952
Merge pull request #78 from SmartFlowAI/dev
Dev
2024-03-16 18:41:25 +08:00
xzw
ca1b0d2c20
Merge branch 'main' into dev 2024-03-16 18:40:42 +08:00
xzw
031b8ebc0b
Merge pull request #72 from Anooyman/main
Add RAG README.md
2024-03-16 18:39:22 +08:00
MING_X
ef5eb66a4f
Update README_EN.md 2024-03-16 15:58:07 +08:00
MING_X
0cb5cb4037
Merge pull request #73 from chg0901/patch-2
Update README_EN.md with xlab demo links
2024-03-16 15:45:53 +08:00
MING_X
a703b9a690
Update README.md 2024-03-16 15:42:16 +08:00
HongCheng
72b6c4a000
Update ChatGLM3-6b-ft.md 2024-03-16 15:59:22 +09:00
HongCheng
968234fbe7
Update README_EN.md with xlab demo links 2024-03-16 11:01:15 +09:00
Anooyman
c08e4dccd6
Merge branch 'dev' into main 2024-03-16 08:39:25 +08:00
edward_ke
55a9f48b20 Update README.md 2024-03-16 08:32:35 +08:00
edward_ke
2cce4d44a5 Update README.md 2024-03-16 08:29:47 +08:00
xzw
5485b4c124
Update web_demo-aiwei.py 2024-03-15 21:12:24 +08:00
Anooyman
000491f1be
Merge Main code (#2)
* Add files via upload

* 新增ENmd文档

* Update README.md

* Update README_EN.md

* Update LICENSE

* [docs] update lmdeploy file

* add ocr.md

* Update tutorial.md

* Update tutorial_EN.md

* Update General_evaluation_EN.md

* Update General_evaluation_EN.md

* Update README.md

Add InternLM2_7B_chat_full's professional evaluation results

* Update Professional_evaluation.md

* Update Professional_evaluation.md

* Update Professional_evaluation.md

* Update Professional_evaluation.md

* Update Professional_evaluation_EN.md

* Update README.md

* Update README.md

* Update README_EN.md

* Update README_EN.md

* Update README_EN.md

* [DOC] update readme

* Update LICENSE

* Update LICENSE

* update personal info and small format optimizations

* update personal info and translations for contents in a table

* Update RAG README

* Update demo link in README.md

* Update xlab app link

* Update xlab link

* add xlab model

* Update web_demo-aiwei.py

* add bitex

---------

Co-authored-by: xzw <62385492+aJupyter@users.noreply.github.com>
Co-authored-by: এ許我辞忧࿐♡ <127636623+Smiling-Weeping-zhr@users.noreply.github.com>
Co-authored-by: Vicky <vicky_3021@163.com>
Co-authored-by: MING_X <119648793+MING-ZCH@users.noreply.github.com>
Co-authored-by: Nobody-ML <1755309985@qq.com>
Co-authored-by: 8baby8 <3345710651@qq.com>
Co-authored-by: chaoke <101492509+8baby8@users.noreply.github.com>
Co-authored-by: aJupyter <ajupyter@163.com>
Co-authored-by: HongCheng <kwchenghong@gmail.com>
Co-authored-by: santiagoTOP <“1537211712top@gmail.com”>
2024-03-15 19:51:04 +08:00
xzw
ccfa75c493
Merge pull request #71 from chg0901/patch-1
add bitex
2024-03-15 16:38:16 +08:00
HongCheng
6e16d19bc1
add bitex 2024-03-15 13:10:30 +09:00
xzw
33b71a690d
Update web_demo-aiwei.py 2024-03-15 10:45:58 +08:00
xzw
a625386874
Merge pull request #68 from chg0901/main
Update demo link in README.md
2024-03-15 10:23:18 +08:00
HongCheng
5bdbf9364c
add xlab model 2024-03-15 11:10:21 +09:00
HongCheng
0c925d5d14
Update xlab link 2024-03-15 11:06:48 +09:00
HongCheng
e305def96a
Update xlab app link 2024-03-15 10:59:01 +09:00
HongCheng
7cb32e1249
Update demo link in README.md 2024-03-15 10:51:42 +09:00
এ許我辞忧࿐♡
8d8cb07c59
Add files via upload
添加本地部署fastapi
2024-03-14 23:56:18 +08:00
xzw
1862bbbd7d
Merge pull request #67 from SmartFlowAI/dev
Dev
2024-03-14 17:08:45 +08:00
xzw
d862eb5da8
Merge pull request #66 from santiagoTOP/TP_Dev
Update RAG README
2024-03-14 17:08:23 +08:00
santiagoTOP
12e05e37d4 Update RAG README 2024-03-14 16:31:00 +08:00
xzw
e00a27d65f
Merge pull request #65 from chg0901/main
update personal info and translations for contents in a table
2024-03-13 11:01:09 +08:00
HongCheng
6214a30cea update personal info and translations for contents in a table 2024-03-13 01:45:22 +09:00
xzw
f722dda605
Merge pull request #64 from SmartFlowAI/dev
Dev
2024-03-13 00:32:42 +08:00
xzw
3ffefd1429
Merge pull request #63 from chg0901/main
update personal info and small format optimizations
2024-03-13 00:31:04 +08:00