DeepSparse on ARM ? Is it on the pipeline anytime soon for production use ?

[thusinh1969]

I found that the nightly version somehow runs on Raspberry PI 4 but the performance is not good vs any other kind of run (openvino, pure onnx etc.). DeepSparse on ARM ? Is it on the pipeline anytime soon for production use ?

Thank you for a great product.
Steve

[mgoin]

Hi @thusinh1969 that is awesome you got the alpha functional on there! We've only tested on server ARM chips but absolutely want to get down to and push performance on RPi this year. We are still in closed alpha and hope to be in open beta in a few months. Edge devices will be soon to follow that.

Please let us know if you have any results to share! Thanks for trying

[Corallo]

Looking forward to see the perforance on RPi!

[StuartIanNaylor]

Any update as noticed it mentioned Armv8.2 with rk3588(s) & Rpi5 out know this would be really beneficial.
Just tried running the yolov8 pip install and it tries a load of nightlies then installs but fails on run