We read every piece of feedback, and take your input very seriously.
To see all available qualifiers, see our documentation.
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
I'd like to fine tune the new Phi-3 model added yesterday, but it looks like the chat template file hasn't been updated to support it
The text was updated successfully, but these errors were encountered:
There is now an example for it: https://colab.research.google.com/drive/1NvkBmkHfucGO3Ve9s1NKZvMNlw5p83ym?usp=sharing
Sorry, something went wrong.
@molbal this example doesn't show how to use the chat template with the Phi-3 model and the https://github.com/unslothai/unsloth/blob/main/unsloth/chat_templates.py file doesn't include it
I don't know that unfortunately.. Maybe its somewhere in here? #397 Or someone on the Discord server could help
in my tries it used it thus https://github.com/CrispStrobe/unsloth/blob/main/Phi3_ORPO_Unsloth.ipynb but now you can adapt to the non-llamafied model ofc
Oh very good point on the phi-3 template - will add one in
No branches or pull requests
I'd like to fine tune the new Phi-3 model added yesterday, but it looks like the chat template file hasn't been updated to support it
The text was updated successfully, but these errors were encountered: