New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
finetune with lora #127
Comments
看您运行成功了,可以请问一下llava_image_tune_.json,videochatgpt_tune_.json,nlp_tune.json三个文件是在哪里下载的吗,原本数据集上好像并没有 |
数据集可以选择huggingface中的某一组,valley的可以只下一部分,然后打开用于测试 |
@cm-xcju 兄弟,可以麻烦您给一个环境的各种包的版本吗,我在安装deepspeed的时候,发现他和python=3.10和torch 2.0.1有很多冲突,想参考一下你的环境。感谢感谢🙏,期待回复 |
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
这是我的配置finetune_lora.sh. 运行后现存不够。我这边只有2张4090,每张24显存。可以训练吗,或者我该如何设置去减小我训练的消耗。我只需要简单微调就行。
The text was updated successfully, but these errors were encountered: