Skip to content

jhan15/facial_emotion_recognition

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

33 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

GitHub issues GitHub last commit

facial_emotion_recognition

Recognize facial emotions in 7 categories: angry, disgust, fear, happy, sad, surprise, neutral.

Dataset

The dataset is provided by a competition, which is quite similar to FER2013 dataset.

image

Model

The API for face detection is Google's mediapipe API. The model for emotion recognition is a 15-layer (8 convs + 4 pooling + 3 fcs) VGG style network.

Pipeline
├── face detection: mediapipe
└── emotion recognition: vggnet

VGG architecture

image

Data flow

image

Upsampling

The upsampling technique is SMOTE.

image

Usage

Train

If you have a dataset, you can train use training.ipynb Open In Colab

Inference

If you want infer directly, use inference.ipynb Open In Colab

The weights I trained is located in saved_models. The default setting is a voting classifer of a model trained by orginal data and a model trained by upsampled data.

Performance

image

Result

Video

Images

About

It's a project of facial emotion recognition.

Topics

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published