New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

pretrain中的pretrain.sh并不是从头开始训练吧，是增量训练吧 #306

Open

zc-Chao opened this issue Mar 19, 2024 · 1 comment

zc-Chao commented Mar 19, 2024

我看脚本中提供了这个参数model_name_or_path，但是没有提供model_type参数，这是增量训练的设置呀！若是从头开始训练应该提供model_type而不提供model_name_or_path呀，有大佬解释下吗？

Collaborator

ZHangZHengEric commented Apr 26, 2024

可以从头训练，调整一下she’ll脚本就可以

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment