Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Support QNN (Qualcomm AI Engine Direct) #4296

Open
anyj0527 opened this issue Oct 26, 2023 · 3 comments
Open

Support QNN (Qualcomm AI Engine Direct) #4296

anyj0527 opened this issue Oct 26, 2023 · 3 comments
Assignees

Comments

@anyj0527
Copy link
Member

anyj0527 commented Oct 26, 2023

May make tensor_filter::qnn? or support it as other filter's delegate (tflite / onnxruntime / executorch)
QNN: The Qualcomm® AI Engine Direct SDK provides lower-level, unified APIs for AI development.

REF: https://developer.qualcomm.com/software/qualcomm-ai-engine-direct-sdk

@taos-ci
Copy link
Collaborator

taos-ci commented Oct 26, 2023

:octocat: cibot: Thank you for posting issue #4296. The person in charge will reply soon.

@anyj0527
Copy link
Member Author

tflite's QNN delegate: in some private place
onnxruntime's QNN Execution Provider: https://onnxruntime.ai/docs/execution-providers/QNN-ExecutionProvider.html
executorch's QNN backend: https://github.com/pytorch/executorch/blob/main/backends/qualcomm/setup.md

@myungjoo myungjoo added this to the NNStreamer 24 PoC milestone Nov 30, 2023
@myungjoo
Copy link
Member

myungjoo commented Nov 30, 2023

If it's going to be a delegation of a subplugin (tflite, onnxruntime, ...), as long as we open up an interface for the runtime/subplugin, it should be enough.

Anyway, are you going to use accelerator property for configuring delegation ? (then, we need additional comments on the property description and the subplugin documentation (nnstreamer-chk).)

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants