Eye

Tracks the eye pupil's movement and effectively detects the blinking of eye. Blinking of eye can be easily detected when eye(facial) landmarks are available, Eye is a computer vision application which can effectively tracks the pupil and find the eye blinking based on heuristics powered by data.

Instructions to Run

Clone the project

$ git clone https://github.com/aditya98ak/Eye.git

Install the dependencies, create a virtual environment (recommended)

$ cd Eye
$ pip install -r requirements.txt

Run the application

$ python main.py

I've added a video file in order to show how it works. As of now, this application works on closely cropped eye videos stacked side by side (horizontally). The aim of this application is to apply heuristics to find blinking of the eye in case where eye(facial) landmarks are not available or can not be generated. This is just a POC and it's performace can definately be improved!

Final Result

Screenshots

1. Sample frame
2. Detection of pupil
3. Detection of blink
4. SSIM Difference

This approach can be helpful in cases where data is obtained from devices in healthcare domain and we may still need to track, capture blink of eye and not whole face is visible. If whole face is visible, then eye blink can be easily detected with help of (eye) facial landmarks!

Contributing

All patches welcome!