Skip to content
@mit-han-lab

MIT HAN Lab

Efficient AI Computing. PI: Song Han

Pinned

  1. streaming-llm streaming-llm Public

    [ICLR 2024] Efficient Streaming Language Models with Attention Sinks

    Python 6.3k 354

  2. smoothquant smoothquant Public

    [ICML 2023] SmoothQuant: Accurate and Efficient Post-Training Quantization for Large Language Models

    Python 1k 117

  3. llm-awq llm-awq Public

    [MLSys 2024 Best Paper Award] AWQ: Activation-aware Weight Quantization for LLM Compression and Acceleration

    Python 1.9k 136

  4. bevfusion bevfusion Public

    [ICRA'23] BEVFusion: Multi-Task Multi-Sensor Fusion with Unified Bird's-Eye View Representation

    Python 2.1k 373

  5. once-for-all once-for-all Public

    [ICLR 2020] Once for All: Train One Network and Specialize it for Efficient Deployment

    Python 1.8k 332

  6. temporal-shift-module temporal-shift-module Public

    [ICCV 2019] TSM: Temporal Shift Module for Efficient Video Understanding

    Python 2k 418

Repositories

Showing 10 of 50 repositories
  • efficientvit Public

    EfficientViT is a new family of vision models for efficient high-resolution vision.

    Python 1,481 Apache-2.0 130 70 0 Updated May 20, 2024
  • patch_conv Public

    Patch convolution to avoid large GPU memory usage of Conv2D

    Python 55 MIT 4 0 1 Updated May 18, 2024
  • TinyChatEngine Public

    TinyChatEngine: On-Device LLM Inference Library

    C++ 565 MIT 54 24 2 Updated May 16, 2024
  • qserve Public

    QServe: W4A8KV4 Quantization and System Co-design for Efficient LLM Serving

    Python 236 Apache-2.0 4 9 1 Updated May 14, 2024
  • llm-awq Public

    [MLSys 2024 Best Paper Award] AWQ: Activation-aware Weight Quantization for LLM Compression and Acceleration

    Python 1,921 MIT 136 101 6 Updated May 13, 2024
  • lmquant Public
    Python 53 Apache-2.0 0 0 0 Updated May 11, 2024
  • distrifuser Public

    [CVPR 2024 Highlight] DistriFusion: Distributed Parallel Inference for High-Resolution Diffusion Models

    Python 450 MIT 11 2 0 Updated May 5, 2024
  • spatten-llm Public

    [HPCA'21] SpAtten: Efficient Sparse Attention Architecture with Cascade Token and Head Pruning

    Scala 51 MIT 3 1 0 Updated May 3, 2024
  • torchquantum Public

    A PyTorch-based framework for Quantum Classical Simulation, Quantum Machine Learning, Quantum Neural Networks, Parameterized Quantum Circuits with support for easy deployments on real quantum computers.

    Jupyter Notebook 1,202 MIT 169 60 (5 issues need help) 4 Updated Apr 30, 2024
  • smoothquant Public

    [ICML 2023] SmoothQuant: Accurate and Efficient Post-Training Quantization for Large Language Models

    Python 1,049 MIT 117 54 1 Updated Apr 29, 2024

People

This organization has no public members. You must be a member to see who’s a part of this organization.