Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Feature] Update embedding model to text-embedding-3-large #16

Open
2 tasks done
athrael-soju opened this issue Apr 25, 2024 · 0 comments
Open
2 tasks done

[Feature] Update embedding model to text-embedding-3-large #16

athrael-soju opened this issue Apr 25, 2024 · 0 comments
Labels
enhancement New feature or request

Comments

@athrael-soju
Copy link

athrael-soju commented Apr 25, 2024

Is this your first time submitting a feature request?

  • I have searched the existing issues, and I could not find an existing issue for this feature
  • I am requesting a straightforward extension of existing functionality

Describe the feature

This is a very minor request to update the embedding model used to text-embedding-3-large here

As it's the most capable 3rd generation embedding model, it would be nice to see how it performs over text-embedding-ada-002

Note:

  • This would require an Output Dimension of 3,072, so the index would have to be recreated as such.
  • Also, text-embedding-3-large is just slightly more expensive, at $0.13 / 1M tokens, but nothing to write home about.

Describe alternatives you've considered

text-embedding-3-small can also be an option, as it's still has Increased performance over the 2nd generation ada embedding model and retains the vector dimension at 1536, so it would be a matter of just replacing the existing model in the code.

Note:

  • text-embedding-3-small is also much cheaper to use, at $0.02 / 1M tokens

Who will this benefit?

Embedding V3 large is the most capable embedding model for both english and non-english tasks, with expected precision increase in semantic search tasks.

Are you interested in contributing this feature?

Yes

Anything else?

Happy to make this change, if needed.

@athrael-soju athrael-soju added the enhancement New feature or request label Apr 25, 2024
@athrael-soju athrael-soju changed the title [Update embedding model] <Update embedding model to text-embedding-3-large> Feature - Update embedding model to text-embedding-3-large Apr 25, 2024
@athrael-soju athrael-soju changed the title Feature - Update embedding model to text-embedding-3-large [Feature] Update embedding model to text-embedding-3-large Apr 25, 2024
@athrael-soju athrael-soju changed the title [Feature] Update embedding model to text-embedding-3-large [Feature] Update embedding model to text-embedding-3-large Apr 25, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
None yet
Development

No branches or pull requests

1 participant