FEATURE REQUEST: Add new models automatically using a YAML file

[mjtechguy]

Hello,

I would like to be able to load new models automatically (specifically for Ollama) using a YAML config file.

Maybe something like dialoqbase.yaml with the following:

API_TYPE=Ollama
OLLAMA_URL=http://ADDRESS:11434
MODEL_ID=llama2
MODEL_NAME=llama2
STREAMING=true

Also, maybe add something to hide the default ones:

HIDE_DEFAULT=true

Would that be possible? Thanks!

[n4ze3m]

Hey, I think you can load Ollama models via the UI. Instead of that, automatically load newly added Ollama models, right?

[n4ze3m]

Hey @mjtechguy, just to confirm, do you mean "a feature to automatically load newly added Ollama models," right? Also, Dialoqbase has a Discord server: https://discord.com/invite/SPE3npH7Wu.

[mjtechguy]

Sorry, was traveling. So, where right now you have to manually add Ollama models and embedding models in the UI.

It would be great if these could be configured at deployment time so that they already exist when a user logs in. Also, it would be nice to hide the other default models from the list if this was used in a completely private way.

[n4ze3m]

Hey, there are new model settings in the application section where you can dynamically configure fetching the ollama model, hide default third-party models, etc. Please let me know if you encounter any issues.