[BUG]Output my input

[Yummy416]

After I finished fine-tuning with the full parameters, instead of using your chatbot, I called it in the way of pipeline. Why would I output my input in answer every time? For example:
The input is: Please tell me who you are.
The output is: Please tell me who you are. I'm a big AI model.

[research4pan]

Thanks for your interest in LMFlow! The behavior of the model depends on the model type, training parameters and adopted dataset. Could you please provide the following information so we could better understand the issue?

• model name
• an example of data sample
• prompt structure
• end string/character

Thanks very much 😄

[Yummy416]

@research4pan Hello, here are the details：
model name: Baichuan2-13B-Chat
example of data sample:

end string/character: "</s>"
I trained in this way, input content, he will input and output all the content to me output

[research4pan]

According to my knowledge, Baichuan is a decoder-only model. So it is better to use "text-only" format as follows

###Human: 请给我写一个... ###Answer: 你能帮我...

and use chatbot with --prompt_structure ###Human: {input_text} ###Answer: and --end_string ###.

Hope that can answer your question 😄

[Yummy416]

Ok, thanks for your reply. I'll have a try