We read every piece of feedback, and take your input very seriously.
To see all available qualifiers, see our documentation.
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Android平台GPU:Arm Mali-G57
2-8-1
代码如下:
std::shared_ptr<MNN::Interpreter> mnnNet; mnnNet = std::shared_ptr<MNN::Interpreter>(MNN::Interpreter::createFromFile(model_name.c_str())); mnnNet->setCacheFile(".tempcache"); ScheduleConfig netConfig; netConfig.type = MNN_FORWARD_OPENCL; netConfig.mode = MNN_GPU_TUNING_NORMAL | MNN_GPU_MEMORY_BUFFER; netConfig.numThread = 1; BackendConfig backendConfig; backendConfig.precision = BackendConfig::Precision_High; backendConfig.power = BackendConfig::Power_Normal; netConfig.backendConfig = &backendConfig; MNN::Session* session = mnnNet->createSession(netConfig); /* 推理 */ mnnNet->updateCacheFile(session);
The device support i8sdot:1, support fp16:1, support i8mm: 0 Update cache to .tempcache, from size:329124 -> size:347844
主要是createSession的耗时过长,需要30多秒,使用setCacheFile()后耗时仍是这么多; 还有办法进一步优化createSession耗时问题吗?谢谢
The text was updated successfully, but these errors were encountered:
setCacheFile 是加快第二次 createSession 的,前后两次 createSession 的耗时对比是多少?
Sorry, something went wrong.
都是30多秒,没有变化😂
cache 文件是否读取成功了?
第一次的时候会报一个err log
第二次的时候就没了
第二次读取的时候还是使用setCacheFile()吗?
No branches or pull requests
平台(如果交叉编译请再附上交叉编译目标平台):
Platform(Include target platform as well if cross-compiling):
Android平台GPU:Arm Mali-G57
Github版本:
Github Version:
2-8-1
代码如下:
Log:
主要是createSession的耗时过长,需要30多秒,使用setCacheFile()后耗时仍是这么多;
还有办法进一步优化createSession耗时问题吗?谢谢
The text was updated successfully, but these errors were encountered: