Skip to content

Music player which pauses and resumes when you face away or towards the screen respectively.

Notifications You must be signed in to change notification settings

sayansil/Liquid-Player

Repository files navigation

Liquid-Player

A Media Player which recognises the emotion of the user and plays a song accordingly. Currently supported emotions are:

  • Happy
  • Sad
  • Neutral

The songs have to be kept in three different folders namely happy, sad and neutral and based on the emotion, a random song is played from the corresponding folder. The song is played as long as long as a face is being detected in the feed obtained from the webcam. The moment no face is detected, the song pauses automatically and then resumes when a face is detected.

Features separating this from an ordinary media player:

  • Emotion recognition
  • Automatic pause and resume based on face detection

Hardware requirements:

A mid-ranged GPU is highly recommended for getting a good FPS value of the CNN based face detector. We have developed and tested this throughly on a gaming laptop with a 4GB NVIDIA GeForce GTX 1050 card and an i7 7700HQ CPU with 8GB RAM running Linux Mint 18.3.

Libraries used:

  • We have used the libvlc C++ wrapper as the Media Player backend.
  • The Dlib C++ Library has been used for face detection. In our project we have used the CNN-based face detector available in Dlib shown in this example
  • The emotion recognition part has been done in Python using Keras.

Note:

The emotion detection has been done in Python and the video playing and face detection has been done in C++. The integration of these two portions have been done using a system call: system("python3 realtime.py"); in test2.cpp. This has prevented the need of using any wrapper code.

About

Music player which pauses and resumes when you face away or towards the screen respectively.

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published