OpenMMLab's Next Generation Video Understanding Toolbox and Benchmark

A curated list of action recognition and related area resources

[CVPR2024 Highlight][VideoChatGPT] ChatGPT with video understanding! And many more supported LMs such as miniGPT4, StableLM, and MOSS.

A curated list of recent diffusion models for video generation, editing, restoration, understanding, etc.

[ICCV 2019] TSM: Temporal Shift Module for Efficient Video Understanding

An open-source toolbox for action understanding based on PyTorch

Code & Models for Temporal Segment Networks (TSN) in ECCV 2016

Awesome video understanding toolkits based on PaddlePaddle. It supports video data annotation tools, lightweight RGB and skeleton based action recognition model, practical applications for video tagging and sport action detection.

[NeurIPS 2022 Spotlight] VideoMAE: Masked Autoencoders are Data-Efficient Learners for Self-Supervised Video Pre-Training

Temporal Segment Networks (TSN) in PyTorch

awesome grounding: A curated list of research papers in visual grounding

Video Foundation Models & Data for Multimodal Understanding

temporal action detection with SSN

[CVPR 2024 Highlight🔥] Chat-UniVi: Unified Visual Representation Empowers Large Language Models with Image and Video Understanding

[ICCV 2023] MeViS: A Large-scale Benchmark for Video Segmentation with Motion Expressions

A collection of recent video understanding datasets, under construction!

Temporal Segments LSTM and Temporal-Inception for Activity Recognition

[CVPR 2023] VideoMAE V2: Scaling Video Masked Autoencoders with Dual Masking

[CVPR 2021] TDN: Temporal Difference Networks for Efficient Action Recognition

Official code for MiniGPT4-video