| 
							
							
								 xzw | 585facad06 | Merge pull request #108 from zealot52099/dev update rag/src/data_processing.py & main,py | 2024-03-20 17:58:12 +08:00 |  | 
			
				
					| 
							
							
								 MING_X | c35f75ff1d | Update README_EN.md | 2024-03-20 17:54:26 +08:00 |  | 
			
				
					| 
							
							
								 zealot52099 | 41744ed604 | [DOC] update datasets/README_EN.md | 2024-03-20 17:52:23 +08:00 |  | 
			
				
					| 
							
							
								 zealot52099 | 9b4e58f732 | [DOC]update datasets/README.md | 2024-03-20 17:40:31 +08:00 |  | 
			
				
					| 
							
							
								 MING_X | 12959e6d1a | Update README.md | 2024-03-20 17:40:07 +08:00 |  | 
			
				
					| 
							
							
								 MING_X | 4c855f521d | Add files via upload | 2024-03-20 17:21:16 +08:00 |  | 
			
				
					| 
							
							
								 zealot52099 | fdf05f480c | update rag/src/data_processing.py & main,py | 2024-03-20 16:51:07 +08:00 |  | 
			
				
					| 
							
							
								 MING_X | cf1b17abf3 | Update README.md | 2024-03-20 16:05:31 +08:00 |  | 
			
				
					| 
							
							
								 MING_X | 3393149685 | Update README.md | 2024-03-20 16:01:43 +08:00 |  | 
			
				
					| 
							
							
								 MING_X | 4d4dfbae88 | Update README_EN.md | 2024-03-20 15:58:48 +08:00 |  | 
			
				
					| 
							
							
								 xzw | a119fdb507 | Merge pull request #107 from SmartFlowAI/dev Dev | 2024-03-19 22:03:10 +08:00 |  | 
			
				
					| 
							
							
								 xzw | 37fbba84a5 | Merge pull request #106 from Anooyman/main update RAG pipeline | 2024-03-19 22:02:11 +08:00 |  | 
			
				
					| 
							
							
								 xzw | 01b5231aa0 | Merge pull request #105 from zealot52099/main update deduplicate.py | 2024-03-19 22:00:44 +08:00 |  | 
			
				
					| 
							
							
								 Anooyman | 96f6ce307e | Update | 2024-03-19 21:11:10 +08:00 |  | 
			
				
					| 
							
							
								 zealot52099 | feb252d5b5 | Merge branch 'SmartFlowAI:main' into main | 2024-03-19 20:14:33 +08:00 |  | 
			
				
					| 
							
							
								 zealot52099 | b542929c1d | add deduplicate.py | 2024-03-19 20:09:44 +08:00 |  | 
			
				
					| 
							
							
								 xzw | af53e9744d | Merge pull request #104 from wwwyfff/clean-QA GLM-6B ft | 2024-03-19 18:14:04 +08:00 |  | 
			
				
					| 
							
							
								 王友昉 | 6e7bd5e5d4 | GLM-6B ft | 2024-03-19 18:03:26 +08:00 |  | 
			
				
					| 
							
							
								 xzw | 19724be6b0 | Merge pull request #103 from zealot52099/main add deduplicate.py | 2024-03-19 17:09:43 +08:00 |  | 
			
				
					| 
							
							
								 xzw | 3eb1642f92 | Merge pull request #102 from jkhumor/modify_readme update readme | 2024-03-19 17:08:28 +08:00 |  | 
			
				
					| 
							
							
								 zealot52099 | 861f12d47a | add deduplicate.py | 2024-03-19 16:41:09 +08:00 |  | 
			
				
					| 
							
							
								 jkhumor | 1ee3a481b8 | update readme | 2024-03-19 13:11:39 +08:00 |  | 
			
				
					| 
							
							
								 jkhumor | 7bbe3842dc | modify readme | 2024-03-19 12:34:51 +08:00 |  | 
			
				
					| 
							
							
								 xzw | c7d916bf4f | Merge pull request #100 from zealot52099/main update | 2024-03-18 23:22:02 +08:00 |  | 
			
				
					| 
							
							
								 xzw | c403563865 | Merge pull request #99 from wwwyfff/clean-QA update README | 2024-03-18 23:18:31 +08:00 |  | 
			
				
					| 
							
							
								 王友昉 | 1de2cf5a86 | update README | 2024-03-18 23:13:00 +08:00 |  | 
			
				
					| 
							
							
								 xzw | 9cb21785e3 | Merge pull request #98 from chg0901/main Update three merge_json*.py files and corresponding tutorial in CN and EN | 2024-03-18 22:44:20 +08:00 |  | 
			
				
					| 
							
							
								 HongCheng | 275f249709 | small update | 2024-03-18 23:39:49 +09:00 |  | 
			
				
					| 
							
							
								 HongCheng | c16761e289 | update three merge_json*.py files and corresponding tutorial in CN and EN update three merge_json*.py files and corresponding tutorial in CN and EN | 2024-03-18 23:35:21 +09:00 |  | 
			
				
					| 
							
							
								 HongCheng | 3cadeadf09 | Merge branch 'main' of https://github.com/chg0901/EmoLLM | 2024-03-18 22:24:26 +09:00 |  | 
			
				
					| 
							
							
								 xzw | 0ede108138 | Merge pull request #97 from SmartFlowAI/dev 添加框架图 | 2024-03-18 21:24:09 +08:00 |  | 
			
				
					| 
							
							
								 xzw | 4a36ff428a | Merge pull request #96 from zxazys/main 框架图 | 2024-03-18 21:23:25 +08:00 |  | 
			
				
					| 
							
							
								 HongCheng | 72a7746d8b | Merge pull request #1 from SmartFlowAI/main 同步 | 2024-03-18 22:23:25 +09:00 |  | 
			
				
					| 
							
							
								 HongCheng | 042146af56 | Revert "modified merge_jsonl and merge_jsonl_r" This reverts commit a38ef60058. | 2024-03-18 22:13:35 +09:00 |  | 
			
				
					| 
							
							
								 ZhouXinAo | 28086d3f89 | Update README.md | 2024-03-18 21:09:47 +08:00 |  | 
			
				
					| 
							
							
								 ZhouXinAo | 95cf9ecde2 | Add files via upload | 2024-03-18 21:08:35 +08:00 |  | 
			
				
					| 
							
							
								 xzw | 12eeaf8cc1 | Merge pull request #89 from chg0901/main optimizing the merge_json.py + moving files +Update zhipuai_gen_data.py 添加glm-4 response获取异常处理 | 2024-03-18 21:02:57 +08:00 |  | 
			
				
					| 
							
							
								 xzw | 95dd6616fb | Merge pull request #95 from chg0901/patch-1 Update tutorial.md update part 5 and 6 | 2024-03-18 20:58:56 +08:00 |  | 
			
				
					| 
							
							
								 HongCheng | bf174f6e02 | Update tutorial.md update part 5 and 6 | 2024-03-18 21:45:04 +09:00 |  | 
			
				
					| 
							
							
								 HongCheng | a833832908 | Delete generate_data/upload_openxlab.py | 2024-03-18 20:45:48 +09:00 |  | 
			
				
					| 
							
							
								 HongCheng | 19edf026eb | Delete generate_data/trans_process.py | 2024-03-18 20:45:18 +09:00 |  | 
			
				
					| 
							
							
								 HongCheng | b894b87a9d | Revert "moving files in scripts related to generate data to generate_data folder" This reverts commit 05ff5e8407. | 2024-03-18 20:43:39 +09:00 |  | 
			
				
					| 
							
							
								 HongCheng | a38ef60058 | modified merge_jsonl and merge_jsonl_r merge_jsonl is for merge jsonl files in a folder
merge_jsonl_r if for merge jsonl files in one folder's subfolders
uasge:
python merge_jsonl_r.py > qwen2.txt
python merge_jsonl_r.py > zhipuai.txt
python merge_jsonl.py > curr.txt
│   学业_merge.json
│   家人_merge.json
│   就业_merge.json
│   工作_merge.json
│   恋爱_merge.json
│   朋友_merge.json
│   环境_merge.json
│   生活_merge.json
│   社交_merge.json
│   责任_merge.json
│   身体_merge.json
│   隐私_merge.json
│
├───学业
│       兴奋.jsonl
│       冷静.jsonl
│       厌倦.jsonl
│       厌恶.jsonl
│       同情.jsonl
│       困惑.jsonl
│       娱乐.jsonl
│       嫉妒.jsonl
│       尴尬.jsonl
│       崇拜.jsonl
│       快乐.jsonl
│       怀旧.jsonl
│       性欲.jsonl
│       恐惧.jsonl
│       悲伤.jsonl
│       敬畏.jsonl
│       有趣.jsonl
│       欣赏.jsonl
│       浪漫.jsonl
│       渴望.jsonl
│       满意.jsonl
│       满足.jsonl
│       焦虑.jsonl
│       痛恨.jsonl
│       痛苦.jsonl
│       着迷.jsonl
│       钦佩.jsonl
│
├───家人
│       兴奋.jsonl
│       冷静.jsonl
│       厌倦.jsonl
│       厌恶.jsonl
│       同情.jsonl
│       困惑.jsonl
│       娱乐.jsonl
│       嫉妒.jsonl | 2024-03-18 20:16:39 +09:00 |  | 
			
				
					| 
							
							
								 zealot52099 | 98ecdda78d | fix bug | 2024-03-18 10:46:09 +08:00 |  | 
			
				
					| 
							
							
								 zealot52099 | 74db6d9893 | update main.py | 2024-03-18 10:33:01 +08:00 |  | 
			
				
					| 
							
							
								 zealot52099 | 5879afffe6 | add data_processing.py | 2024-03-18 10:32:27 +08:00 |  | 
			
				
					| 
							
							
								 zealot52099 | ce7a4ae416 | add more directories | 2024-03-18 10:31:34 +08:00 |  | 
			
				
					| 
							
							
								 xzw | 8a36a3bd9a | Merge pull request #94 from santiagoTOP/main Update RAG README | 2024-03-17 20:49:06 +08:00 |  | 
			
				
					| 
							
							
								 santiagoTOP | f693d5a7df | Merge branch 'dev' | 2024-03-17 20:38:28 +08:00 |  | 
			
				
					| 
							
							
								 santiagoTOP | 88218bfd4b | Update RAG README | 2024-03-17 20:37:26 +08:00 |  |