Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[PR] Added Docker Example Usage / Support - Still needs support for multiple concurrent instances #8

Draft
wants to merge 1 commit into
base: main
Choose a base branch
from

Conversation

zudsniper
Copy link

[PR] Merge docker examples by @juanfpo96

This active fork by @juanfpo96 adds an example of how this application can be dockerized.


Future Desires

I think this tool has lots of potential -- if it is done right. Here is whatever I think that means.

  • Add full docker support (include .env file vars for docker & docker related things, add CLI override flags for ease-of-use)

  • Add docker-compose support, enabling the building of custom images to be deployed -- with the local folder of a users project, for instance, as the last layer of the image.

    I am no docker guru, so correct me if I say something stupid

  • Add Multiple Auto-GPT Instance Support (parallel)

    • Implement a scheduling algorithm for mutually-exclusive resources to avoid deadlock/starvation
    • Minimize mutually-exclusive resource use, make functionality as concurrent friendly as possible.
    • Include Event emitters & listeners, as well as potentially a message queue system like rabbitmq.
    • Essentially, just need a whole ass AutoGPT-Instance-Manager which is non-nominal work...
  • Web Management Panel
    including an intricate panel system wherein the status of each AGPT instance can be monitored. Display health percentage of system.

etc


zod.tf

Discord GitHub issue custom search GitHub followers

fullstack development, server administration, web design, branding creation, musical composition & performance, video editing, and more probably

zod.tf logo

Copy link
Owner

@aorumbayev aorumbayev left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks for the submission @juanfpo96 , taking Future Desires aside please add additional details into PR description in regards to .devcontainer and how it can be initialized/configured from within IDEs like VScode or else. I will later update the readme based on your description + assuming we merge this.

Please note both localai and gpt4all contain docker compose files already and are well optimized to be easily executed from docker. The reason for why i opted for building all sources manually is to avoid heuristics with allocated compute resources to docker vm and etc to run these models + the repo mainly served as an experimental playground to demonstrate how localai can integrate with gpt4all.

@@ -27,7 +27,7 @@
## TEMPERATURE - Sets temperature in OpenAI (Default: 0)
## USE_AZURE - Use Azure OpenAI or not (Default: False)
OPENAI_API_KEY="sk-XXXXXXXXXXXXXXXXXXXX"
OPENAI_API_BASE="http://localhost:8080"
Copy link
Owner

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

please change this back to localhost OR introduce a new execution mode flag to the bash script so it replaces localhost with openapi if user selects docker during script execution

@juanfadev
Copy link

Thank you, but I didn't ask to be merged as I'm in a WIP state with this. Once it is completed I will have a complete standalone version running in docker containers.

@aorumbayev aorumbayev marked this pull request as draft June 8, 2023 18:41
@zudsniper
Copy link
Author

Thank you, but I didn't ask to be merged as I'm in a WIP state with this. Once it is completed I will have a complete standalone version running in docker containers.

my apologies @juanfpo96! I just saw your progress and created a PR.

this is just a hardworking good programmer; he was gonna PR when he was ready, my bad.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

3 participants