eval problem

[UestcJay]

hi, I reproduce the traning, the response of the model I trained is neither an answer starting with yes or no when eval mme. Will your model be like this? how can i eval mme?

question:

Is this artwork created by gentile da fabriano? Please answer yes or no.

warning: Setting pad_token_id to eos_token_id:50256 for open-end generation.

response:

the artwork in question is not created by gentile da fabriano gentile da fabriano was an italian painter active 
in the early renaissance, known for his work in florence the style of the painting, with its gold leaf background and the particular rendering of the figures, is more indicative of the work of artists from the late gothic period, such as fra angelico or giotto, who were active in the early 15th century the use of gold leaf and the specific iconography of the virgin mary and child are also more characteristic of the early renaissance, which followed the gothic period therefore, the correct answer to the question is  no, this artwork is not created by gentile da fabriano

[baichuanzhou]

Which model is this? You can evaluate mme in the evaluation script mme.sh