You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
As stated in Ollama website, to run containers, Docker uses a VM on Mac.
It uses Apples own hypervisor, which doesn't provide GPU access.
So, Ollama on Docker on MacOS isn't not GPU accelerated.
The menu bar app version of Ollama,anyway, is GPU accelerated on Apple Silicon.
Are there other ways to accelerate an Ollama containers on OsX?
If answer is no, wait next Apple announcement on their hypervisor at WWDC next year.
The text was updated successfully, but these errors were encountered:
lecciovich
changed the title
Docker compose on OsX does not support GPUs acceleration
Docker on OsX does not support GPUs acceleration
Nov 17, 2023
As stated in Ollama website, to run containers, Docker uses a VM on Mac.
It uses Apples own hypervisor, which doesn't provide GPU access.
So, Ollama on Docker on MacOS isn't not GPU accelerated.
The menu bar app version of Ollama,anyway, is GPU accelerated on Apple Silicon.
Are there other ways to accelerate an Ollama containers on OsX?
If answer is no, wait next Apple announcement on their hypervisor at WWDC next year.
The text was updated successfully, but these errors were encountered: