🏄 Scalable embedding, reasoning, ranking for images and sentences with CLIP

a state-of-the-art-level open visual language model | 多模态预训练模型

[ICLR 2024] Official implementation of " 🦙 Time-LLM: Time Series Forecasting by Reprogramming Large Language Models"

Codebase for ECCV18 "The Sound of Pixels"

TOMM2020 Dual-Path Convolutional Image-Text Embedding 🐾 https://arxiv.org/abs/1711.05535

Tools for movie and video research

Update-to-data resources for conditional content generation, including human motion generation, image or video generation and editing.

[CVPR2023] The code for 《Position-guided Text Prompt for Vision-Language Pre-training》

Awesome Cross-modality Person Re-identification

PyTorch implementation of the paper "Semantically Tied Paired Cycle Consistency for Zero-Shot Sketch-based Image Retrieval", CVPR 2019.

Co-Separating Sounds of Visual Objects (ICCV 2019)

Demo code for visible thermal (cross-modality) person re-identification

[CVPR 2023] Diverse Embedding Expansion Network and Low-Light Cross-Modality Benchmark for Visible-Infrared Person Re-identification

CM-NAS: Cross-Modality Neural Architecture Search for Visible-Infrared Person Re-Identification (ICCV2021)

Pytorch code for Towards a Unified Middle Modality Learning for Visible-Infrared Person Re-Identification

A New Strong and Simple Baseline Method for VI-ReID (Bridging the Gap: Multi-level Cross-modality Joint Alignment for Visible-infrared Person Re-identification)

An alternative EQA paradigm and informative benchmark + models (BMVC 2019, ViGIL 2019 spotlight)

Code for the WWW'20 paper "Nowhere to Hide: Cross-modal Identity Leakage between Biometrics and Devices"

[AAAI 2022] Detecting Human-Object Interactions with Object-Guided Cross-Modal Calibrated Semantics.