Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

微调问题，微调后模型遗忘 #338

Open
sungatetop opened this issue Jan 21, 2024 · 0 comments
Open

微调问题，微调后模型遗忘 #338

sungatetop opened this issue Jan 21, 2024 · 0 comments

Comments

@sungatetop
Copy link

根据fewshotdata制作了数据集，用于微调，图片的文本描述，都是“图像里是什么”，微调后模型回答对于与微调使用的数据集中不同类型的图像，模型失去了微调前的能力？回答的内容都是围绕微调数据的文本内容，这个要怎么解决？把finetune之前的数据也加入微调吗？
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
1 participant
@sungatetop