A web-based music player which detects the user's mood and recommends a set of songs, while changing its background theme accordingly. Created for TOHacks 2021, May 8-9. Made using HTML/CSS/Javascript for the frontend and Django/Python for the backend. The backend integrates both the Haar Cascade machine learning model and a CNN classifier through OpenCV. The classifier was trained using Colaboratory and Tensorflow. Essentially, the Haar Cascade algorithm utilizes the user's webcam to locate the user's face, which is then passed onto the classifier to detect what emotion the person is displaying. The classifier is trained on 4 emotions: Angry, Happy, Calm, and Sad. Depending on what emotion it detects, it will change the song selection and background of the music player accordingly.
To deploy on a local host:
cd main
python manage.py runserver
See requirements.txt. Note that most of it isn't needed to run locally, but for hosting on Heroku.
tensorflow-cpu
opencv-python-headless
imutils==0.5.3
imageio
dj-database-url==0.5.0
Django==3.1.2
gunicorn==20.0.4
psycopg2-binary==2.8.6
whitenoise==5.2.0
Web app is already deployed on Heroku: https://emotion-music-player.herokuapp.com/
- HTML/CSS - Frontend styling and web page design
- Javascript - Frontend music player functions
- Django - Backend integration of machine learning algorithms
- OpenCV - Computer vision tasks
- Colab/Tensorflow - Training the emotion classifier
The dataset was initially retrieved from Kaggle from a research prediction competiton titled "Challenges in Representation Learning: Facial Expression Recognition Challenge." A direct link to the dataset is also provided. The data consists of 48x48 pixel grayscale images of faces. The faces have been automatically registered so that the face is more or less centered and occupies about the same amount of space in each image. Even though there are 7 labelled classes of expressions, we only decided to utilize the 4 most common ones.
Final Accuracy = 58.33%, Validation Accuracy = 54.99%
Big thanks to the organizers at TOHacks and everyone on Team AlphaHax.
- Charles Yuan
- Dulhan Naidappuwa Waduge
- Golden Wang
- Ilan Benjamin
This project is licensed under the MIT License - see the LICENSE file for details.