hf model text generation problem

[genesiz7]

hi.

i am trying finetuning hf model with sft or pretrain.
however in this GUI platform, hf model doesn't work well.

for example, after mistral_7b_0.2_hf or lama2_7b_hf model loaded, type some text, model generate wrong text like below image.
chat model work well.

how can i operate hf model?

[hiyouga]

You cannot directly chat with the base models (ones without chat tag) because they haven't instruction-following abilities. You should first fine-tune them using instruction datasets and chat with the fine-tuned models