Simple Video Retrieval System

Demo

System overview

Description

In this project, I aim to develop a system to automatically search and retrieve similar videos in large scale dataset. However, the time project is limit (2 week), then the small dataset was selected from UCF11 which are about humans action: biking/cycling, diving, golf swinging, horse back riding,...

The dataset contains 121 videos :

• Biking: 25 videos
• Juggle: 27 videos
• Ridding: 24 videos
• Shooting: 22 videos
• Spiking: 23 videos

Our system consists of two parts :

• Video representation:
  • Step 1: extract keyframe/keyframes from Videos using Katna.
  • Step 2: motivated by the great success of deep learning approaches, we use pretrained model (MobileNet) from Vectorhub for representing image (key frame -> vector).
  • Strp 3: Concat vectors for representing video.
• Retrieval: a video retrieval system based on distance (FAISS)

Reference

• milvus-application-image-search-system
• video-search-system