Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

LLM-based evaluators shouldn't return NaN #7671

Closed
davidsbatista opened this issue May 8, 2024 · 0 comments · Fixed by #7685
Closed

LLM-based evaluators shouldn't return NaN #7671

davidsbatista opened this issue May 8, 2024 · 0 comments · Fixed by #7685
Assignees
Labels
2.x Related to Haystack v2.0 P1 High priority, add to the next sprint topic:LLM type:bug Something isn't working
Milestone

Comments

@davidsbatista
Copy link
Contributor

Is your feature request related to a problem? Please describe.

  • {'statements': [], 'statement_scores': [], 'score': nan}
  • The score should be a number instead.

Possible solution

@davidsbatista davidsbatista added type:bug Something isn't working topic:LLM 2.x Related to Haystack v2.0 labels May 8, 2024
@davidsbatista davidsbatista added this to the 2.1.1 milestone May 8, 2024
@davidsbatista davidsbatista added the P1 High priority, add to the next sprint label May 8, 2024
@masci masci removed this from the 2.1.1 milestone May 9, 2024
@masci masci assigned davidsbatista and unassigned julian-risch May 10, 2024
@shadeMe shadeMe added this to the 2.1.2 milestone May 13, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
2.x Related to Haystack v2.0 P1 High priority, add to the next sprint topic:LLM type:bug Something isn't working
Projects
None yet
Development

Successfully merging a pull request may close this issue.

4 participants