Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Store supported AI models in SQLite instead of code #95

Open
brainless opened this issue Apr 19, 2024 · 3 comments
Open

Store supported AI models in SQLite instead of code #95

brainless opened this issue Apr 19, 2024 · 3 comments
Assignees
Labels
enhancement New feature or request rust Pull requests that update Rust code

Comments

@brainless
Copy link
Owner

As a user I would like updated list of the AI models that are supported, including latest versions and costs. Right now list of models is in Rust code and this should be moved into SQLite DB which can sync from an online list (on https://dwata.com).

As the list of supported models and AI providers increase, and many providers support using OpenAI compatible API, we can also add support for new models without changing code.

@brainless brainless added enhancement New feature or request rust Pull requests that update Rust code labels Apr 19, 2024
@brainless brainless self-assigned this Apr 19, 2024
@brainless
Copy link
Owner Author

We should also store features per AI model and/or model so it is easy to surface these capabilities through the API.

@brainless
Copy link
Owner Author

Features would include:

  • function calling
  • embedding

@brainless
Copy link
Owner Author

I decided not to store model information in SQLite since the code to work with models will anyhow need to be written and perhaps it is practical to build feature or model list from API calls or Rust code.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request rust Pull requests that update Rust code
Projects
Status: In review
Development

No branches or pull requests

1 participant