New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
train模式和test模式差别很大 #276
Comments
Did you set .eval() mode during inference? |
我已经设置了eval,并且我发现当我把在geo3k的训练集上lora微调后的模型(loss已下降到0.03)再次加载在同一数据集上进行训练时,loss又变为了1.7,是否是模型保存或加载出现了问题(原代码加载微调后的模型会报错,我是使用automodel加载的) |
补充一下,我在全参数微调时并没有遇见这种情况 |
It looks like your LoRA model is not loaded correctly. Do u use the |
我在测试的时候是用这个加载的,再次微调也使用这个来加载吗? |
补充一下,在测试过程中使用AutoPeftModelForCausalLM加载并不能解决训练loss和测试结果不对齐的问题 |
我对一张图片微调至过拟合,训练过程中生成的答案与真值已经完全相同,但是我加载此模型去测试同一张图发现,生成的结果和真值句式和顺序的差别很大,这是为什么呢,请给我一些帮助
The text was updated successfully, but these errors were encountered: