-
-
Notifications
You must be signed in to change notification settings - Fork 2.8k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
feat: detailed model info #1486
Comments
Ya, tbh I'd kinda like if the "Assistant" profile picture in chats were instead the logo we set for a given model (defaults can be inferred by API base URLs and/or model names in many cases) too, along with other things that have been requested by others such as being able to edit names, set rate limits (per user), and other more granular controls for model and API access. |
Using the Assistant profile picture would tie in nicely if Assistants end up supporting multiple models/servers as well ;) |
i noticed also that [system prompt] is not based on which model in use, instead of is just one per chat. so we can't switch models in between. |
@abqareno yeah I noticed that as well, I think that's worth logging a separate bug / feature request for though if you could? |
Closing in favour of #1655 |
Bug Report
Description
Bug Summary:
The UI doesn't show which server is providing a given model.
For example, say you have:
And you're selecting which model to use - you have no idea which host you're going to be performing the inference on.
For example, in the following screenshot these models could be provided by OpenAI, OpenRouter, Ollama or some other proxy - and if there's multiple accounts/keys for a service - which one is in use?
Steps to Reproduce:
Add multiple providers with the same or similar model names and try to select a model to use.
Another nice option might be to give servers a 'name' attribute and show that.
Expected Behaviour:
In the models drop down, I'd expect next to the model name to have the server shown.
For example:
Actual Behaviour:
No model server is shown.
Environment
Reproduction Details
Confirmation:
Logs and Screenshots
Screenshots (if applicable):
Installation Method
n/a
Additional Information
n/a
Note
n/a
The text was updated successfully, but these errors were encountered: