bakaEC/kopa
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity

Merge pull request #20 from greyovo/patch-1

Browse Source 
fix: Error when loading dataset from JSON
This commit is contained in:
Yichi Zhang 2023-12-22 10:57:55 +08:00 committed by GitHub
commit 0d5c7016b9
No known key found for this signature in database
GPG Key ID: 4AEE18F83AFDEB23
1 changed files with 1 additions and 1 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

2
finetune_kopa.py
View File

@ -179,7 +179,7 @@ def train(
slama_model = KoPAWithAdapter(model, num_prefix, kge_model=kge_model) slama_model = KoPAWithAdapter(model, num_prefix, kge_model=kge_model)
if data_path.endswith(".json") or data_path.endswith(".jsonl"): if data_path.endswith(".json") or data_path.endswith(".jsonl"):
data = load_dataset("json") data = load_dataset("json", data_files=data_path)
else: else:
data = load_dataset(data_path) data = load_dataset(data_path)