You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
I believe this is a way to improve. I'll try to join the Continue Discord for questions
I'm not able to find an open issue that requests the same enhancement
Problem
I've noticed that when I use ollama to chat, the model loading always occurs during the first round of conversation, which makes the first round much slower than subsequent ones.
I'm exploring ways to help ollama preload the model. Even though I tried ollama run llama2:latest before conversation, the model still loads at the start of the first conversation.
Solution
No response
The text was updated successfully, but these errors were encountered:
Validations
Problem
I've noticed that when I use ollama to chat, the model loading always occurs during the first round of conversation, which makes the first round much slower than subsequent ones.
I'm exploring ways to help ollama preload the model. Even though I tried
ollama run llama2:latest
before conversation, the model still loads at the start of the first conversation.Solution
No response
The text was updated successfully, but these errors were encountered: