[CVPR2024 Highlight][VideoChatGPT] ChatGPT with video understanding! And many more supported LMs such as miniGPT4, StableLM, and MOSS.
-
Updated
May 22, 2024 - Python
[CVPR2024 Highlight][VideoChatGPT] ChatGPT with video understanding! And many more supported LMs such as miniGPT4, StableLM, and MOSS.
FreeVA: Offline MLLM as Training-Free Video Assistant
Awesome OVD-OVS - A Survey on Open-Vocabulary Detection and Segmentation: Past, Present, and Future
The official code of "CSTA: CNN-based Spatiotemporal Attention for Video Summarization"
SoccerNet Game State Reconstruction: End-to-End Athlete Tracking and Identification on a Minimap (CVPR24 - CVSports workshop)
Video Foundation Models & Data for Multimodal Understanding
Official code for MiniGPT4-video
Code for LifelongMemory: Leveraging LLMs for Answering Queries in Long-form Egocentric Videos
OpenMMLab's Next Generation Video Understanding Toolbox and Benchmark
Code release for "Training a Large Video Model on a Single Machine in a Day"
(2024CVPR) MA-LMM: Memory-Augmented Large Multimodal Model for Long-Term Video Understanding
Official Repo for CVPR 2024 Paper "FACT: Frame-Action Cross-Attention Temporal Modeling for Efficient Fully-Supervised Action Segmentation"
[IJCNN 2024] Unifying Global and Local Scene Entities Modelling for Precise Action Spotting
A Large Short-video Recommendation Dataset with Raw Text/Audio/Image/Videos (Talk Invited by DeepMind).
[NAACL 2024] Z-GMOT: Zero-shot Generic Multiple Object Tracking
VTC: Improving Video-Text Retrieval with User Comments
Benchmarking Panoptic Video Scene Graph Generation (PVSG), CVPR'23
A curated list of recent diffusion models for video generation, editing, restoration, understanding, etc.
[NAACL 2024] Official Implementation of paper "Self-Adaptive Sampling for Efficient Video Question Answering on Image--Text Models"
Add a description, image, and links to the video-understanding topic page so that developers can more easily learn about it.
To associate your repository with the video-understanding topic, visit your repo's landing page and select "manage topics."