Replies: 3 comments 1 reply
-
bumping this because the server docs don't mention this feature. |
Beta Was this translation helpful? Give feedback.
0 replies
-
Any help on this? |
Beta Was this translation helpful? Give feedback.
1 reply
-
Hi, Server readme shows command line option --chat-template JINJA_TEMPLATE. By default, llama_chat_apply_template() uses the template from a models metadata, Here's supported templates for --chat-template. For example,
|
Beta Was this translation helpful? Give feedback.
0 replies
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
-
I've been struggling with template for a long time, and now I've discovered that in the last commits 11b12de what I've been waiting for. But how to use it? Do I need to specify any parameters? Or is everything automatically loaded from the model?
Beta Was this translation helpful? Give feedback.
All reactions