Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

how to set open llms configurations for memgpt server on docker #1363

Open
Archer-Thane opened this issue May 10, 2024 · 0 comments
Open

how to set open llms configurations for memgpt server on docker #1363

Archer-Thane opened this issue May 10, 2024 · 0 comments

Comments

@Archer-Thane
Copy link

Is your feature request related to a problem? Please describe.
I have docker installed and run the docker compose up to run the server. It works fine, but I want to use a local llm (like ollama or even vllm) and don't know how to configure the docker compose.yaml file or any other config file to get it working with my local llm.

Describe the solution you'd like
A clear documentation can actually help a lot.

Describe alternatives you've considered

Additional context

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
Status: To triage
Development

No branches or pull requests

1 participant