Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[CANN] Add Ascend NPU support #2552

Open
wants to merge 1 commit into
base: master
Choose a base branch
from

Conversation

wangshuai09
Copy link

Motivation

Hi, thanks for your great work! I've run insightface on my Ascend NPU Device and then want to make this contribution for other users using the same hardware. Would love to get feedback :)

ONNX Runtime has nativaly supported Ascend NPU since v1.12.1, more information in ONNX Runtime-CANN-ExecutionProvider

Change

This PR supports Ascend NPU as a new backend for insightface.

Test

Person Detection Test with 2k images
cpu: 19.6 FPS
image
npu: 69.7 FPS
image

Web-demo Test

  • sim: 0.6081, message: They ARE the same person
    image
    xxx
    DavidSchwimmer
  • sim: 0.0444, message: They are NOT the same person
    image
    jennifer
    xxx

@wangshuai09
Copy link
Author

Hi @nttstar, thank you for this great job. Because the onnxruntime is officially support Ascend with CANN EP, it does not modify too much code to adapt this project. May i know if this could be merged or what else do i need to do?

More Information

Ascend is a full-stack AI computing infrastructure for industry applications and services based on Huawei Ascend processors and software. For more information about Ascend, see Ascend Community.
CANN (Compute Architecture of Neural Networks), developped by Huawei, is a heterogeneous computing architecture for AI.
Pytorch has officially announced support for Ascend NPU (through key PrivateUse1)

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

1 participant