Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Support for Gpt4all REST API #174

Open
anthonyronda opened this issue Nov 29, 2023 · 1 comment
Open

Support for Gpt4all REST API #174

anthonyronda opened this issue Nov 29, 2023 · 1 comment
Labels
enhancement New feature or request

Comments

@anthonyronda
Copy link

Is your feature request related to a problem? Please describe.
I am trying to access the local LLM running on my PC from other devices. I am using Gpt4all, which provides a REST API, but doesn't provide a web client that can access it.

Describe the solution you'd like
A clear and concise description of what you want to happen.
As an alternative to using node-chatgpt-api, modify the code to also allow use of gpt4all-api
https://github.com/nomic-ai/gpt4all/tree/main/gpt4all-api

Describe alternatives you've considered
A clear and concise description of any alternative solutions or features you've considered.

Additional context
Add any other context or screenshots about the feature request here.
I am willing to write my own implementation and contribute it to the project if I can get a push in the right direction to help me get started.

@anthonyronda anthonyronda added the enhancement New feature or request label Nov 29, 2023
@Richard-Weiss
Copy link

@anthonyronda
I've implemented using Local LLMs with node-chatgpt-api and the LM Studio inference server.
You can take a look at my forks:
https://github.com/Richard-Weiss/node-chatgpt-api
https://github.com/Richard-Weiss/PandoraAI

But maybe it's enough for you to change the completionsURL in the ChatGPTClient file.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
None yet
Development

No branches or pull requests

2 participants