#

distillation

Here are 157 public repositories matching this topic...

IntelLabs / distiller

Neural Network Distiller by Intel AI Lab: a Python package for neural network compression research. https://intellabs.github.io/distiller

deep-neural-networks jupyter-notebook pytorch regularization pruning quantization group-lasso distillation onnx truncated-svd network-compression pruning-structures early-exit automl-for-compression

Updated Apr 24, 2023
Jupyter Notebook

dkozlov / awesome-knowledge-distillation

Awesome Knowledge Distillation

deep-learning knowledge-distillation teacher-student knowledge-transfer co-training model-compression distillation kd knowldge-distillation distillation-model model-distillation

Updated Dec 20, 2023

FLHonker / Awesome-Knowledge-Distillation

Awesome Knowledge-Distillation. 分类整理的知识蒸馏paper(2014-2021)。

deep-learning transfer-learning model-compression distillation kd knowldge-distillation

Updated May 30, 2023

airaria / TextBrewer

A PyTorch-based knowledge distillation toolkit for natural language processing

nlp knowledge pytorch bert distillation

Updated May 8, 2023
Python

PaddlePaddle / PaddleSlim

PaddleSlim is an open-source library for deep model compression and architecture search.

sparsity compression detection transformer segmentation pruning quantization nas bert tensorrt distillation ernie yolov5 yolov6 yolov7

Updated Mar 28, 2024
Python

AberHu / Knowledge-Distillation-Zoo

Pytorch implementation of various Knowledge Distillation (KD) methods.

knowledge-distillation teacher-student knowledge-transfer model-compression distillation kd kd-methods

Updated Nov 25, 2021
Python

GMvandeVen / continual-learning

PyTorch implementation of various methods for continual learning (XdG, EWC, SI, LwF, FROMP, DGR, BI-R, ER, A-GEM, iCaRL, Generative Classifier) in three different scenarios.

deep-learning artificial-neural-networks replay incremental-learning variational-autoencoder generative-models lifelong-learning distillation continual-learning elastic-weight-consolidation replay-through-feedback icarl gradient-episodic-memory class-incremental-learning task-incremental-learning domain-incremental-learning

Updated Mar 21, 2024
Jupyter Notebook

ViTAE-Transformer / ViTPose

The official repo for [NeurIPS'22] "ViTPose: Simple Vision Transformer Baselines for Human Pose Estimation" and [TPAMI'23] "ViTPose++: Vision Transformer for Generic Body Pose Estimation"

deep-learning pytorch pose-estimation mae distillation self-supervised-learning vision-transformer

Updated Nov 3, 2023
Python

tangxyw / RecSysPapers

推荐/广告/搜索领域工业界经典以及最前沿论文集合。A collection of industry classics and cutting-edge papers in the field of recommendation/advertising/search.

Updated Dec 30, 2023
Python

Syencil / mobile-yolov5-pruning-distillation

mobilev2-yolov5s剪枝、蒸馏，支持ncnn，tensorRT部署。ultra-light but better performence！

pruning ncnn distillation yolov5 mobile-yolov5s

Updated Sep 26, 2022
Jupyter Notebook

CLUEbenchmark / CLUEPretrainedModels

高质量中文预训练模型集合：最先进大模型、最快小模型、相似度专门模型

text-classification corpus dataset chinese semantic-similarity pretrained-models sentence-classification albert bert sentence-analysis distillation sentence-pairs roberta

Updated Jul 8, 2020
Python

szq0214 / MEAL-V2

MEAL V2: Boosting Vanilla ResNet-50 to 80%+ Top-1 Accuracy on ImageNet without Tricks. In NeurIPS 2020 workshop.

pytorch imagenet model-architecture compression-algorithm pre-trained meal imagenet-dataset distillation resnet50 mobilenetv3 efficientnet distillation-model

Updated Dec 24, 2021
Python

Tanuki / tanuki.py

Prompt engineering for developers

python ai tdd alignment distillation tanuki pydantic gpt-4 llm chat-gpt gpt-4-api ai-functions

Updated Feb 13, 2024
Python

segmind / distill-sd

Segmind Distilled diffusion

inference knowledge-distillation distillation stable-diffusion

Updated Oct 18, 2023
Python

thu-ml / ares

A Python library for adversarial machine learning focusing on benchmarking adversarial robustness.

nes pca bim benchmark-framework evolutionary spsa boundary adversarial-machine-learning distillation fgsm adversarial-attacks deepfool adversarial-robustness mi-fgsm mmlda hgd

Updated Oct 15, 2023
Python

anarchy-ai / LLM-VM

irresponsible innovation. Try now at https://chat.dev/

machine-learning deep-learning artificial-intelligence distillation distillation-model llm llm-agent llm-training llm-inference llm-local

Updated Mar 1, 2024
Python

Zhen-Dong / HAWQ

Quantization library for PyTorch. Support low-precision and mixed-precision quantization, with hardware implementation through TVM.

pytorch quantization hessian 8-bit model-compression distillation tvm 4-bit mixed-precision tensorcore quantized-neural-networks hardware-aware efficient-neural-networks

Updated May 15, 2023
Python

dotchen / LAV

(CVPR 2022) A minimalist, mapless, end-to-end self-driving stack for joint perception, prediction, planning and control.

prediction planning perception autonomous-driving imitation-learning distillation carla-simulator cvpr2022

Updated Oct 13, 2022
Python

huggingface / optimum-intel

🤗 Optimum Intel: Accelerate inference with Intel optimization tools

optimization intel transformers inference pruning quantization distillation onnx openvino diffusers

Updated May 8, 2024
Jupyter Notebook

qiangsiwei / bert_distill

BERT distillation（基于BERT的蒸馏实验）

nlp classification bert distillation

Updated Jul 30, 2020
Python

Improve this page

Add a description, image, and links to the distillation topic page so that developers can more easily learn about it.

Curate this topic

Add this topic to your repo

To associate your repository with the distillation topic, visit your repo's landing page and select "manage topics."