Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Feature] API version should be dynamic ? #284

Open
AvinashDalvi89 opened this issue Apr 4, 2024 · 0 comments
Open

[Feature] API version should be dynamic ? #284

AvinashDalvi89 opened this issue Apr 4, 2024 · 0 comments
Labels
enhancement New feature or request triage

Comments

@AvinashDalvi89
Copy link

What Would You Like to See with the Gateway?

As a user, the AI model API version should have dynamic parameters like a model. 
Currently,

getBaseURL: () => 'https://generativelanguage.googleapis.com/v1beta',
is hardcoded. Due to this, we can't test an older model or another version of the of the model. It will be good to have it as a param. 

Context for your Request

This feature will give users the benefit of switching to any AI model API version. For example, Google Gemini has the v1 beta version supported, but tomorrow they will introduce a new version, and then the Portkey gateway will need to update. Instead of this, give dynamic parameters so that the code dependency for the AI model API version change will be removed. 

Your Twitter/LinkedIn

https://twitter.com/AvinashDalvi_ and https://www.linkedin.com/in/avinash-dalvi-315b021a/

@AvinashDalvi89 AvinashDalvi89 added the enhancement New feature or request label Apr 4, 2024
@github-actions github-actions bot added the triage label Apr 4, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request triage
Projects
None yet
Development

No branches or pull requests

1 participant