Brevitas: neural network quantization in PyTorch
-
Updated
May 9, 2024 - Python
Brevitas: neural network quantization in PyTorch
More readable and flexible yolov5 with more backbone(gcn, resnet, shufflenet, moblienet, efficientnet, hrnet, swin-transformer, etc) and (cbam,dcn and so on), and tensorrt
Model Compression Toolkit (MCT) is an open source project for neural network model optimization under efficient, constrained hardware. This project provides researchers, developers, and engineers advanced quantization and compression tools for deploying state-of-the-art neural networks.
quantization example for pqt & qat
Generating tensorrt model using onnx
Build AI model to classify beverages for blind individuals
inference with the structured sparsity and quantization
Post post-training-quantization (PTQ) method for improving LLMs. Unofficial implementation of https://arxiv.org/abs/2309.02784
EfficientNetV2 (Efficientnetv2-b2) and quantization int8 and fp32 (QAT and PTQ) on CK+ dataset . fine-tuning, augmentation, solving imbalanced dataset, etc.
Add a description, image, and links to the ptq topic page so that developers can more easily learn about it.
To associate your repository with the ptq topic, visit your repo's landing page and select "manage topics."