New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Overriding torch_dtype=None with `torch_dtype=torch.float16` due to requirements of `bitsandbytes` to enable model loading in mixed int8. Either pass torch_dtype=torch.float16 or don't pass this argument at all to remove this warning. #235

Open

sanwei111 opened this issue May 19, 2023 · 0 comments

sanwei111 commented May 19, 2023

我用in8，需要改torch_dtype参数吗

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment