New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

加载Yi-6B进行lora微调报错 #166

Open

zhadandeiren opened this issue Mar 15, 2024 · 1 comment

zhadandeiren commented Mar 15, 2024

基本信息

你使用的操作系统: win10
你使用的Python版本: 3.10
你使用的Pytorch版本: 2.0.1
你使用的bert4torch版本: 最新版
你加载的预训练模型:Yi-6B

输出信息

4bit量化报错
NotImplementedError: Cannot copy out of meta tensor; no data!

代码用的examples里task_llama-2_lora.py，config已替换过Yi-6B对应的bert4torch_config了，请问这个是哪的问题？谢谢

Owner

Tongjilibo commented Mar 22, 2024

不好意思，还没来得及处理，我这两天看一下

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment