You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
I think it would be helpful to be able to import/export templates. So when I load up to run a new model with llamafile, i can simply point it to some template file definition that contains all the required template fields for this specific model.
To take it a step further, it would be very helpful to have baked in templates. For instance, I was just playing with jart's Phi-3 llamafile. I'm still trying to convert what was mentioned as the template into the correct fields and stuff on the web interface. Instead, in the name of simplicity, what if the llamafile itself would have the appropriate template baked into it, so you literally just ./ run it and go. No need to configure basically anything.
Thanks for the great work folks!
The text was updated successfully, but these errors were encountered:
I think it would be helpful to be able to import/export templates. So when I load up to run a new model with llamafile, i can simply point it to some template file definition that contains all the required template fields for this specific model.
To take it a step further, it would be very helpful to have baked in templates. For instance, I was just playing with jart's Phi-3 llamafile. I'm still trying to convert what was mentioned as the template into the correct fields and stuff on the web interface. Instead, in the name of simplicity, what if the llamafile itself would have the appropriate template baked into it, so you literally just ./ run it and go. No need to configure basically anything.
Thanks for the great work folks!
The text was updated successfully, but these errors were encountered: