You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Frequency penalty is validated to be strictly positive in the python library type validation, but is validated to be in the range [-2.0, 2.0] in the actual webserver. This means that i can send a REST API request to TGI with frequency penalty < 0 but will run into validation error when doing it via the text generation client
fromtext_generationimportClientendpoint_url="https://YOUR_ENDPOINT.endpoints.huggingface.cloud"client=Client(endpoint_url)
text=client.generate("Why is the sky blue?", frequency_penalty=-1.0).generated_textprint(text)
# ' Rayleigh scattering'
Expected behavior
No validation errors for frequency_penalty in the range [-2.0, 2.0]
The text was updated successfully, but these errors were encountered:
System Info
NA
Information
Tasks
Reproduction
Frequency penalty is validated to be strictly positive in the python library type validation, but is validated to be in the range [-2.0, 2.0] in the actual webserver. This means that i can send a REST API request to TGI with frequency penalty < 0 but will run into validation error when doing it via the text generation client
Expected behavior
No validation errors for
frequency_penalty
in the range [-2.0, 2.0]The text was updated successfully, but these errors were encountered: