Mamba-Papers-Hub

🔥 Mamba has proven its exceptional performance across diverse domains, often rivaling, and occasionally outperforming, state-of-the-art Transformer models. This repository presents a curated compilation of papers focusing on Mamba, complemented by accompanying code implementations. Additionally, it includes a variety of supplementary resources such as videos and blogs discussing about Mamba.

Table of Content

• Awesome-Mamba
  • Papers
  • Video Tutorials
  • Blogs
  • Contributing

Milestone Papers

Date	keywords	Institute	Paper	Code
2023-12	Mamba	Carnegie Mellon & Together AI	Mamba: Linear-Time Sequence Modeling with Selective State Spaces	[Github]
2024-01	MambaByte	Cornell University	MambaByte: Token-free Selective State Space Model	[Github]
2024-01	Vision Mamba	Huazhong University of Science and Technology, Horizon Robotics, Beijing Academy of Artificial Intelligence	Vision Mamba: Efficient Visual Representation Learning with Bidirectional State Space Model	[Github]
2024-01	SegMamba	The Hong Kong University of Science and Technology & Beijing Academy of Artificial Intelligence	SegMamba: Long-range Sequential Modeling Mamba For 3D Medical Image Segmentation	[Github]
2024-01	MoE-Mamba	University of Warsaw	MoE-Mamba: Efficient Selective State Space Models with Mixture of Experts	[Github]
2024-01	U-Mamba	Vector Institute for AI & University of Toronto	U-Mamba: Enhancing Long-range Dependency for Biomedical Image Segmentation	[Github]
2024-01	Vivim	The Hong Kong University of Science and Technology	Vivim: a Video Vision Mamba for Video Object Segmentation	[Github]
2024-01	VMamba	University of Chinese Academy of Sciences, HUAWEI Inc. & PengCheng Lab	VMamba: Visual State Space Model	[Github]
2024-01	MambaTab	University of Kentucky	MambaTab: A Simple Yet Effective Approach for Handling Tabular Data	[Github]
2024-02	Graph-Mamba	University of Toronto	Graph-Mamba: Towards Long-Range Graph Sequence Modeling with Selective State Spaces	[Github]
2024-02	Swin-UMamba	Paul C. Lauterbur Research Center for Biomedical Imaging	Swin-UMamba: Mamba-based UNet with ImageNet-based pretraining	[Github]
2024-02	BlackMamba	Zyphra	BlackMamba: Mixture of Experts for State-Space Models	[Github]
2024-02	MambaFormer	KRAFTON & Seoul National University	Can Mamba Learn How to Learn? A Comparative Study on In-Context Learning Tasks	[Github]
2024-02	U-shaped Vision Mamba	Nanjing University	U-shaped Vision Mamba for Single Image Dehazing	[Github]
2024-02	MambaMorph	Beihang University	MambaMorph: a Mamba-based Backbone with Contrastive Feature Learning for Deformable MR-CT Registration	[Github]
2024-02	nnMamba	Shenzhen Research	nnMamba: 3D Biomedical Image Segmentation, Classification and Landmark Detection with StateSpace Model	[Github]
2024-02	Graphs with State Space Models		Graph Mamba: Towards Learning on Graphs with State Space Models	[Github]
2024-02	Vision Mamba UNet	Shanghai Jiao Tong University	VM-UNet: Vision Mamba UNet for Medical Image Segmentation	[Github]
2024-02	P-Mamba	Institute of Intelligent Software	P-Mamba: Marrying Perona Malik Diffusion with Mamba for Efficient Pediatric Echocardiographic Left Ventricular Segmentation	[Github]
2024-02	FD-Vision Mamba	Nanjing University of Science and Technology	FD-Vision Mamba for Endoscopic Exposure Correction	[Github]
2024-02	Semi-Mamba-UNet	University of Oxford	Semi-Mamba-UNet: Pixel-Level Contrastive Cross-Supervised Visual Mamba-based UNet for Semi-Supervised Medical Image Segmentation	[Github]
2024-02	Mamba-ND	University of California, Los Angeles	Mamba-ND: Selective State Space Modeling for Multi-Dimensional Data	[Github]
2024-02	Mamba-Diffusion	Kunlun Inc.	Scalable Diffusion Models with State Space Backbone	[Github]
2024-02	Hierarchical Mamba	Carnegie Mellon University & Meta	Hierarchical State Space Models for Continuous Sequence-to-Sequence Modeling	[Github]
2024-02	Res-VMamba	National Taiwan University	Res-VMamba: Fine-Grained Food Category Visual Classification Using Selective State Space Models with Deep Residual Learning	[Github]
2024-02	PointMamba	Huazhong University of Science & Technology	PointMamba: A Simple State Space Model for Point Cloud Analysis	[Github]
2024-02	MambaIR	Tsinghua University & Shenzhen University	MambaIR: A Simple Baseline for Image Restoration with State-Space Model	[Github]
2024-02	Pan-Mamba	Chinese Academy of Sciences	Pan-Mamba: Effective Pan-Sharpening with State Space Model	[Github]
2024-02	Weak-Mamba-UNet	University of Oxford	Weak-Mamba-UNet: Visual Mamba Makes CNN and ViT Work Better for Scribble-based Medical Image Segmentation	[Github]
2024-02	DenseMamba	Huawei	DenseMamba: State Space Models with Dense Hidden Connection for Efficient Large Language Models	[Github]
2024-03	Mamba4Rec	Texas A&M University	Mamba4Rec: Towards Efficient Sequential Recommendation with Selective State Space Models	[Github]
2024-03	MiM-ISTD: Mamba-in-Mamba	Alibaba Group	MiM-ISTD: Mamba-in-Mamba for Efficient Infrared Small Target Detection	[Github]
2024-03	Point Could Mamba	Wuhan University	Point Could Mamba: Point Cloud Learning via State Space Model	[Github]
2024-03	Hidden Attention of Mamba	Tel Aviv University	The Hidden Attention of Mamba Models	[Github]
2024-03	MED-MAMBA	Guangzhou Medical University	MEDMAMBA: VISION MAMBA FOR MEDICAL IMAGE CLASSIFICATION	[Github]
2024-03	MamMIL	Tsinghua University	MamMIL: Multiple Instance Learning for Whole Slide Images with State Space Models	[Github]
2024-03	MambaLithium	Ji Hua Laboratory	MambaLithium: Selective state space model for remaining-useful-life, state-of-health, and state-of-charge estimation of lithium-ion batteries	[Github]
2024-03	LightM-UNet	Key Laboratory	LightM-UNet: Mamba Assists in Lightweight UNet for Medical Image Segmentation	[Github]
2024-03	MambaMIL	Hong Kong University	MambaMIL: Enhancing Long Sequence Modeling with Sequence Reordering in Computational Pathology	[Github]
2024-03	VideoMamba	OpenGVLab & Shenzhen Institute	VideoMamba: State Space Model for Efficient Video Understanding	[Github]
2024-03	LargeMamba-UNet	Zhejiang University & University of Illinois Urbana-Champaign	Large Window-based Mamba UNet for Medical Image Segmentation:Beyond Convolution and Self-attention	[Github]
2024-03	Motion Mamba	Monash University & The Australian National University	Motion Mamba: Efficient and Long Sequence Motion Generation with Hierarchical and Bidirectional Selective SSM	[Github]
2024-03	LocalMamba	The University of Sydney & University of China	LocalMamba: Visual State Space Model with Windowed Selective Scan	[Github]
2024-03	MambaTalk	Tsinghua University	MambaTalk: Efficient Holistic Gesture Synthesis with Selective State Space Models	[Github]
2024-03	ClinicalMamba	Tsinghua University	ClinicalMamba: A Generative Clinical Language Model on Longitudinal Clinical Notes	[Github]
2024-03	Video Mamba Suite	Nanjing University	Video Mamba Suite: State Space Model as a Versatile Alternative for Video Understanding	[Github]
2024-03	EfficientVMamba	The University of Sydney	EfficientVMamba: Atrous Selective Scan for Light Weight Visual Mamba	[Github]
2024-03	STG-Mamba	University of New South Wales	STG-Mamba: Spatial-Temporal Graph Learning via Selective State Space Model	[Github]
2024-03	S-D-Mamba	Northeastern University	Is Mamba Effective for Time Series Forecasting?	[Github]
2024-03	Low-shot-[V]-Mamba	Mila - Quebec AI Institute	On the low-shot transferability of [V]-Mamba	[Github]
2024-03	ZigMa	LMU Munich	ZigMa: Zigzag Mamba Diffusion Model	[Github]
2024-03	ProMamba	Peking University	ProMamba: Prompt-Mamba for polyp segmentation	[Github]
2024-03	VL-Mamba	The University of Adelaide	VL-Mamba: Exploring State Space Models for Multimodal Learning	[Github]
2024-03	H-vmunet	Shanghai University	H-vmunet: High-order Vision Mamba UNet for Medical Image Segmentation	[Github]
2024-03	Cobra	Westlake University & Zhejiang University	Cobra: Extending Mamba to Multi-Modal Large Language Model for Efficient Inference	[Github]
2024-03	SiMBA	Microsoft	SiMBA: Simplified Mamba-based Architecture for Vision and Multivariate Time series	[Github]

Video Tutorials

• [Yannic Kilcher] Mamba Paper Explained Youtube
• [Umar Jamil] Mamba and S4 Explained Youtube
• [1littlecoder] MoE-Mamba Youtube
• [AI Coffee Break with Letitia] SSM explained Youtube
• [Samuel Albanie] Mamba - a replacement for Transformers? Youtube
• [hu-po] Video Mamba vs Motion Mamba Youtube
• [ Fahd Mirza] Install Mamba - State Space Model Youtube

Blogs

• [Joe El Khoury] What is Mamba? Medium
• [Vishal Rajput] Mamba: Can it replace Transformers? Medium
• [Azhar] Decoding Mamba Medium
• [Maarten Grootendorst] A Visual Guide to Mamba and State Space Models Substack
• [Joe El Khoury] Why Mamba was rejected? Medium

Contributing

This is an active repository and your contributions are always welcome!

---

If you have any questions do not hesitate to contact me at hitesh.patel945@gmail.com, bhargava1409@gmail.com or karangupta485@gmail.com