Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

RuntimeError: Error building extension 'fused_adam' #125

Open
LeFuGang opened this issue Dec 27, 2023 · 2 comments
Open

RuntimeError: Error building extension 'fused_adam' #125

LeFuGang opened this issue Dec 27, 2023 · 2 comments

Comments

@LeFuGang
Copy link

LeFuGang commented Dec 27, 2023

deepspeed==0.12.6
pytorch==1.13.0+cu116
cuda版本11.0
用的模型是glm3,单卡的

image

image

请问这个问题怎么处理呀,能帮忙解决下吧,谢谢了

@liucongg
Copy link
Owner

liucongg commented Jan 7, 2024

应该是cuda版本的问题,你要升级到11.6

@chenchen333-dev
Copy link

应该是cuda版本的问题,你要升级到11.6

我CUDA 12.0也是这个问题

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants