Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Give ability to change retry prompt and model/provider #520

Open
aiseei opened this issue Mar 21, 2024 · 2 comments
Open

Give ability to change retry prompt and model/provider #520

aiseei opened this issue Mar 21, 2024 · 2 comments

Comments

@aiseei
Copy link

aiseei commented Mar 21, 2024

Is your feature request related to a problem? Please describe.
For complex queries mistral-intruct/others on ollama dont work and multiple retries still dont give a parseble soln.

Describe the solution you'd like
Allow n retries on the same model else give a Callaback where in i can swicth the model/provider. ie from mistral/ollama to gpt4/Azure and prompt if needed.

Describe alternatives you've considered
None - other than custom

Additional context
Add any other context or screenshots about the feature request here.

@jxnl
Copy link
Owner

jxnl commented Mar 21, 2024

do you have a proposal for what that looks like?

@Mr-Ruben
Copy link

Mr-Ruben commented Mar 22, 2024

Would this work? (no need to change Instructor)

try:
    call_model1()
except Exception:
    try:
        call_model2()
    except Exception:
        call_model3()
        

Allow n retries on the same model

This is already possible with max_retries

I am very interested in being able to edit the 'retry prompt' as mentioned here

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants