You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
ollama processes share the model cache on the filesystem in the container
if requests result in multiple ollama processes warming up in parallel, they tread on eachothers' cache
I've seen issues with the model cache getting corrupted in this case. We should just warm up the ollama model cache once, based on the warmup models, before spinning up multiple ollama instances
The text was updated successfully, but these errors were encountered:
I've seen issues with the model cache getting corrupted in this case. We should just warm up the ollama model cache once, based on the warmup models, before spinning up multiple ollama instances
The text was updated successfully, but these errors were encountered: