Can't get ORTStableDiffusionPipeline to run on GPU on neither AWS nor GCP fresh instances #1844
Open
2 of 4 tasks
Labels
bug
Something isn't working
System Info
Who can help?
Pipelines: @philschmid
ONNX Runtime: @JingyaHuang, @echarlaix
Information
Tasks
examples
folder (such as GLUE/SQuAD, ...)Reproduction (minimal, reproducible, runnable)
Step 1: Verify that ONNX sees the GPU:
Step 2: Attempt to run this official example using the 'CUDAExecutionProvider':
Error:
From what I can tell, the requirements are met, at least on the GCP setup:
CUDA version = 12.1
cuDNN version = 8.9
onnxruntime version = 1.17
Note that, if I omit the provider, the pipeline will run on the CPU (I can tell because one image generation takes ~3 minutes, and nvidia-smi shows no activity on the GPU).
Expected behavior
pipeline = ORTStableDiffusionPipeline.from_pretrained("runwayml/stable-diffusion-v1-5", revision="onnx", provider="CUDAExecutionProvider")
should run with no errors.The text was updated successfully, but these errors were encountered: