This is a social robot simulator. The robot will read your facial features and response to your faicial expression.
The robot has 3 major features:
- Have Eye Contact
- Mirror the facial expression
- Response to the user's general mood
This is the experiment for the Robotics class. For the motivation and result of the experiment, please refer to the paper
- Use Anaconda to install the packages for running the program (For Windows, we recommend using the Anaconda Prompt)
conda create -name ENVNAME
conda activate ENVNAME
conda install -c conda-forge opencv # Install opencv
conda install -c conda-forge dlib- Run the robot simulation using Python3
python main.py- The dataset we use can be found in data_source.zip. If you want to train a dataset for emotion recognition, run:
python mood_tracker/train.pyThis project use dlib and opencv for the computer vision function