求助，单机多卡微调时报错RuntimeError: CUDA error: CUBLAS_STATUS_NOT_INITIALIZED when calling cublasCreate(handle)
#3294
Replies: 1 comment 1 reply
-
|
多卡显存爆了，换个其他模型试试，例如 yi-6b 和 qwen1.5 |
Beta Was this translation helpful? Give feedback.
1 reply
-
|
多卡显存要求这么高嘛，我用的三张3090 24G |
Beta Was this translation helpful? Give feedback.
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
-
运行的lora_multi_gpu文件里的single_node.sh，在加载完模型权重后报错RuntimeError: CUDA error: CUBLAS_STATUS_NOT_INITIALIZED when calling
cublasCreate(handle)，以下是我的参数设置以及详细的报错信息
另外我在运行单卡lora微调时是可以正常运行的，请问有没有人遇到过同样的问题，是如何解决的
Beta Was this translation helpful? Give feedback.
All reactions