Can the base model use the template of the chat model? #3197
Unanswered
ChrisKimZHT
asked this question in
Q&A
Replies: 1 comment 3 replies
-
You can fine-tune your model with arbitrary template we provided, but make sure the special token in template are added to the tokenizer and fine-tuned by specifying the |
Beta Was this translation helpful? Give feedback.
3 replies
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
-
When fine-tuning the base model, if the default template is selected, the effect is not very good.
So, can we use the chat template for fine-tuning?
Beta Was this translation helpful? Give feedback.
All reactions