How to use GPU Acceleration on Android?

[tomerh2001]

The guide mentioned setting up GPU delegation for IOS, but how can I do it in Android?

[mrousavy]

As of today, there is no GPU acceleration available on Android. I didn't add it yet. If you need GPU acceleration on Android, consider contacting me through my agency Margelo, and we can develop that feature for you 👍

[jslok]

I have tried to enable nnapi acceleration but not sure what I am missing. The below will cause the camera to show a white screen for about 20 seconds on init, then the model will fail to load. The interpreter ends up null and throws error "Failed to create TFLite interpreter from model". I am open to hints if you are willing to point me in the direction, Marc.

In TensorflowPlugin.cpp:

#include <tensorflow/lite/delegates/nnapi/nnapi_delegate_c_api.h>

TfLiteNnapiDelegateOptions nnapi_options = TfLiteNnapiDelegateOptionsDefault();
auto delegate = TfLiteNnapiDelegateCreate(&nnapi_options);
TfLiteInterpreterOptionsAddDelegate(options, delegate);

Also tried with TfLiteInterpreterOptionsSetUseNNAPI but same result.

[mrousavy]

Yea I tried that as well but didn't investigate further.
If you find something let me know!