New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
RetinaFace, calibration int8, tensorRT8.6.1 error [pluginV2Runner.cpp::execute::265] Error Code 2: Internal Error (Assertion status == kSTATUS_SCUESS failed. ) #1456
Comments
What did you mean of this? 【The FP16 engine is working but with less performance 】 You mean the latency is higher than int8? So that you want to use int8? |
|
If the fp16 accuracy is not as expected, then it's meaningless to try int8. Can you try fp32? And also try lower version of tensorrt. i.e. 8.4 |
Yes the calibration int8 for RetinaFace work for previous TR versions, but i would like to know the reason of the error "Assertion scales.size() == 1 failed" with tr 8.6.1. I tried yolov7 and v9 with the same tr version and the calibration int8 work |
Another information, we can no longer use the retinaface code from ubuntu 22.04 because only tensorRT version 8.6.1 is compatible. |
To reproduce the error, just use docker "nvcr.io/nvidia/tensorrt:24.01-py3", install opencv and launch calib int8 from "https://github.com/wang-xinyu/tensorrtx/tree/master/retinaface" |
Hi @ohadjerci |
No, the issue is not related to deprecated operations. |
Env
About this repo
repo wang-xinyu/tensorrtx/retinaface
model retinaface
Hello,
The FP16 engine is working but with less performance and with some warning for TR 8.6.1.6
In the other hand, calibration int8 with tr8.6.1.6 leads to errors :
Firstly, i tried to generate an engine with a trained model (half precision). Secondly, i reorganize the code like yolov9/v7.. but without sucess.
I’m hoping someone can tell me more about this error msg, or point me to documents that can explain it. Does it mean that the building process failed due while processing a plugin or the scale of the interpolation ?
Any suggestion is highly appreciated. Thanks in advance.
The text was updated successfully, but these errors were encountered: