Skip to content

Commit

Permalink
πŸ“ explain Ollama remote hosting in docs
Browse files Browse the repository at this point in the history
  • Loading branch information
sestinj committed Apr 29, 2024
1 parent 3e68fd6 commit 16bfb95
Showing 1 changed file with 4 additions and 1 deletion.
5 changes: 4 additions & 1 deletion docs/docs/reference/Model Providers/ollama.md
Original file line number Diff line number Diff line change
Expand Up @@ -9,12 +9,15 @@
"title": "Ollama",
"provider": "ollama",
"model": "llama2-7b",
"completionOptions": {}
"completionOptions": {},
"apiBase": "http://localhost:11434"
}
]
}
```

If you'd like to host Ollama on another machine, you can set it up as described in the [Ollama FAQ](https://github.com/ollama/ollama/blob/main/docs/faq.md#how-can-i-expose-ollama-on-my-network), and then set `"apiBase"` to match the IP address / port of that machine.

## Completion Options

In addition to the model type, you can also configure some of the parameters that Ollama uses to run the model.
Expand Down

0 comments on commit 16bfb95

Please sign in to comment.