You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
I am very impressed with the great work you have done. I have a Mac M2 ultra so can't run the model locally because of the need to use cuda, instead of the apple gpu,mps. I have managed to the model loaded and generate the input ids tokenizer and pixel values as shown in the huggingface repository. Unfortunately lmdeploy and flash attention don't function on the Mac. If there is any possibility of adding support for apple silica many more people in the community would get to experience your great work. Thank you for creating the gradio demo. That way even though the model is inaccessible for local testing I can see what I'm missing. Thanks again for all your efforts.
The text was updated successfully, but these errors were encountered:
I am very impressed with the great work you have done. I have a Mac M2 ultra so can't run the model locally because of the need to use cuda, instead of the apple gpu,mps. I have managed to the model loaded and generate the input ids tokenizer and pixel values as shown in the huggingface repository. Unfortunately lmdeploy and flash attention don't function on the Mac. If there is any possibility of adding support for apple silica many more people in the community would get to experience your great work. Thank you for creating the gradio demo. That way even though the model is inaccessible for local testing I can see what I'm missing. Thanks again for all your efforts.
The text was updated successfully, but these errors were encountered: