You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
The string prompt_end gives an error in "Evaluate prompt engineering using locally-defined custom metrics" section. The fix: Add f at the beginning of first prompt_end and delete the fourth quotation mark at the end of the second prompt_end.
Cosmetics: Delete from BUCKET_URI definition.
Metric list gives an error in "Validate prompt by comparing LLM 1 with LLM 2". The fix: Delete rouge_1 and rouge_2 from metrics.
class EvaluationTextSummarizationSpec in "Using Vertex AI Model Evaluation Computation-based metrics" is not imported from language_models and gives an error. It doesn't exist in this version of the module (it is in preview).
Thanks!
Relevant log output
No response
Code of Conduct
I agree to follow this project's Code of Conduct
The text was updated successfully, but these errors were encountered:
File Name
https://github.com/GoogleCloudPlatform/generative-ai/blob/main/gemini/evaluation/get_started_with_genai_model_eval_service.ipynb
What happened?
Thanks!
Relevant log output
No response
Code of Conduct
The text was updated successfully, but these errors were encountered: