Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add Phi-3 chat template #398

Open
djannot opened this issue Apr 30, 2024 · 5 comments
Open

Add Phi-3 chat template #398

djannot opened this issue Apr 30, 2024 · 5 comments
Labels
currently fixing Am fixing now!

Comments

@djannot
Copy link

djannot commented Apr 30, 2024

I'd like to fine tune the new Phi-3 model added yesterday, but it looks like the chat template file hasn't been updated to support it

@molbal
Copy link

molbal commented Apr 30, 2024

@djannot
Copy link
Author

djannot commented Apr 30, 2024

@molbal this example doesn't show how to use the chat template with the Phi-3 model and the https://github.com/unslothai/unsloth/blob/main/unsloth/chat_templates.py file doesn't include it

@molbal
Copy link

molbal commented Apr 30, 2024

I don't know that unfortunately.. Maybe its somewhere in here? #397 Or someone on the Discord server could help

@CrispStrobe
Copy link

in my tries it used it thus https://github.com/CrispStrobe/unsloth/blob/main/Phi3_ORPO_Unsloth.ipynb but now you can adapt to the non-llamafied model ofc

@danielhanchen
Copy link
Contributor

Oh very good point on the phi-3 template - will add one in

@danielhanchen danielhanchen added the currently fixing Am fixing now! label May 1, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
currently fixing Am fixing now!
Projects
None yet
Development

No branches or pull requests

4 participants