Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

protocol_prefix = fs.protocol + "://" if fs.protocol != "file" else "" #767

Open
sunyue-s opened this issue May 11, 2024 · 1 comment
Open

Comments

@sunyue-s
Copy link

执行微调命令:torchrun --nproc_per_node 1 -m FlagEmbedding.reranker.run --output_dir ./FlagEmbedding/reranker/rerank_output --model_name_or_path ./model/BAAIbge-reranker-base --train_data ./examples/reranker/toy_finetune_data.jsonl --learning_rate 6e-5 --fp16 --num_train_epochs 2 --per_device_train_batch_size 1 --gradient_accumulation_steps 4 --dataloader_drop_last True --train_group_size 16 --max_len 512 --weight_decay 0.01 --logging_steps 10
报错:protocol_prefix = fs.protocol + "://" if fs.protocol != "file" else ""
TypeError: can only concatenate tuple (not "str") to tuple 项目代码数据没有任何改动,写绝对路径加引号也不行,什么问题?

@sunyue-s
Copy link
Author

执行微调命令:torchrun --nproc_per_node 1 -m FlagEmbedding.reranker.run --output_dir ./FlagEmbedding/reranker/rerank_output --model_name_or_path ./model/BAAIbge-reranker-base --train_data ./examples/reranker/toy_finetune_data.jsonl --learning_rate 6e-5 --fp16 --num_train_epochs 2 --per_device_train_batch_size 1 --gradient_accumulation_steps 4 --dataloader_drop_last True --train_group_size 16 --max_len 512 --weight_decay 0.01 --logging_steps 10 报错:protocol_prefix = fs.protocol + "://" if fs.protocol != "file" else "" TypeError: can only concatenate tuple (not "str") to tuple 项目代码数据没有任何改动,写绝对路径加引号也不行,什么问题?

参考:https://github.com/ymcui/Chinese-LLaMA-Alpaca-2/issues/434解决,datasets版本问题,升级为0.13.0后可以了。

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant