Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

大神和原版vicuna仓库对比过效果吗? #3

Open
magneter opened this issue May 5, 2023 · 1 comment
Open

大神和原版vicuna仓库对比过效果吗? #3

magneter opened this issue May 5, 2023 · 1 comment

Comments

@magneter
Copy link

magneter commented May 5, 2023

我想基于vicuna-7b,在自己的数据集上做微调试一下。
仅仅做指令微调,相当于只做你的第一步supervised_finetune,
但是我不确定这样做的效果,大神有什么建议吗?

大神你的第一步supervised_finetune跑完,特别是代码和数理逻辑,和原版vicuna仓库对比过效果吗?

@jackaduma
Copy link
Owner

我想基于vicuna-7b,在自己的数据集上做微调试一下。 仅仅做指令微调,相当于只做你的第一步supervised_finetune, 但是我不确定这样做的效果,大神有什么建议吗?

大神你的第一步supervised_finetune跑完,特别是代码和数理逻辑,和原版vicuna仓库对比过效果吗?

做了个 业务数据的 微调。感觉还是可以的。 因为是强业务相关的知识问答类,所以是比 原版好。
您这边 代码和数理 相关的, 我不太确定。

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants