bakaEC/OliveSensorAPI
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity

Update internlm2_5_chat_7b_qlora_oasst1_e3.py

Browse Source
This commit is contained in:
Kevin Rose 2024-07-09 21:18:21 +08:00 committed by GitHub
parent ef56283630
commit 0f29a835ad
No known key found for this signature in database
GPG Key ID: B5690EEEBB952194
1 changed files with 2 additions and 2 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

4
xtuner_config/internlm2_5_chat_7b_qlora_oasst1_e3.py
View File

@ -95,8 +95,8 @@ model = dict(
bnb_4bit_quant_type='nf4')), bnb_4bit_quant_type='nf4')),
lora=dict( lora=dict(
type=LoraConfig, type=LoraConfig,
r=64, r=32,
lora_alpha=16, lora_alpha=64,
lora_dropout=0.1, lora_dropout=0.1,
bias='none', bias='none',
task_type='CAUSAL_LM')) task_type='CAUSAL_LM'))