We read every piece of feedback, and take your input very seriously.
To see all available qualifiers, see our documentation.
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
基模型推理,任何问题都会在回答问题之后输出训练数据 温度低时输出完数据还会一直重复某些句子
No response
response, _history = model.chat(tokenizer, request, history=history, max_length= 512, num_beams=1, do_sample=True, top_p=0.8, temperature=0.1)
- OS:Ubuntu 20.04 - Python:3.10 - Transformers:4.33.2 - PyTorch: - CUDA Support (`python -c "import torch; print(torch.cuda.is_available())"`) :True
The text was updated successfully, but these errors were encountered:
No branches or pull requests
Is there an existing issue for this?
Current Behavior
基模型推理,任何问题都会在回答问题之后输出训练数据
温度低时输出完数据还会一直重复某些句子
Expected Behavior
No response
Steps To Reproduce
tokenizer = AutoTokenizer.from_pretrained(model_path, trust_remote_code=True)
model = AutoModelForCausalLM.from_pretrained(model_path, trust_remote_code=True, device='cuda')
response, _history = model.chat(tokenizer, request, history=history, max_length= 512, num_beams=1,
do_sample=True, top_p=0.8, temperature=0.1)
Environment
Anything else?
No response
The text was updated successfully, but these errors were encountered: