Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We鈥檒l occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add retry for LLMFactory or BaseLLM #651

Open
Undertone0809 opened this issue May 7, 2024 · 0 comments
Open

Add retry for LLMFactory or BaseLLM #651

Undertone0809 opened this issue May 7, 2024 · 0 comments
Labels
enhancement New feature or request good first issue Good for newcomers

Comments

@Undertone0809
Copy link
Owner

馃殌 Feature Request

Add the retry mechanism to increase the robustness of the system because LLM output is unstable and sometimes not output in the specified format if formatted.

import promptulate as pne

model = pne.LLMFactory.build(model_name="gpt-4-turbo", model_config={...}, max_retry=5)
model("hello")

The model must run five times before it finally throws an exception.

@Undertone0809 Undertone0809 added enhancement New feature or request good first issue Good for newcomers labels May 7, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request good first issue Good for newcomers
Projects
None yet
Development

No branches or pull requests

1 participant