Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Non-exisiting commands in sampleInt8API README #3839

Closed
spadacesco opened this issue May 5, 2024 · 3 comments
Closed

Non-exisiting commands in sampleInt8API README #3839

spadacesco opened this issue May 5, 2024 · 3 comments
Assignees
Labels
triaged Issue has been triaged by maintainers

Comments

@spadacesco
Copy link
Contributor

Description

The sample INT8 API README gives a walkthrough on how to setup the builder for INT8 Neural Network Quantization. Nevertheless, the examples refer to non-existing function calls (e.g setInt8Mode(true)). When following the rest of the example on "Configuring the builder to use INT8 without the INT8 calibrator"

Environment

TensorRT Version: 10.0.0

NVIDIA GPU: NVIDIA GeForce RTX 3050 Ti Laptop GPU

NVIDIA Driver Version: 550

CUDA Version: 12.0

CUDNN Version: 8.9.7

Operating System: Ubuntu 22.04 LTS

Python Version (if applicable): -

Tensorflow Version (if applicable): -

PyTorch Version (if applicable): -

Baremetal or Container (if so, version): -

Relevant Files

https://github.com/NVIDIA/TensorRT/tree/28733f0fdccde2967fed395b06ca491af3a561a9/samples/sampleINT8API

Steps To Reproduce

Follow the instructions here on Configuring the builder to use INT8 without the INT8 calibrator and it will not start to quantize to INT8. Especially the call builder->setInt8Mode(true); does not even exist.

@spadacesco
Copy link
Contributor Author

spadacesco commented May 5, 2024

Propesed a solution to this issue in #3845

@zerollzeng
Copy link
Collaborator

Thanks, I'll check it internally.

@zerollzeng zerollzeng self-assigned this May 8, 2024
@zerollzeng zerollzeng added the triaged Issue has been triaged by maintainers label May 8, 2024
@spadacesco
Copy link
Contributor Author

Closed since changes are now merged, see here

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
triaged Issue has been triaged by maintainers
Projects
None yet
Development

No branches or pull requests

2 participants