NEURAL KEYBOARD :

The neural keyboard is an Eye-controlled keyboard for physically-challenged people. It uses Neural Networks to predict the eye's state accurately using which the keyboard is operated.

How it works

For each frame in a second:

1. Using Dlib frontal face detector all of the 68 facial landmarks co-ordinates are detected and the co-ordinates are converted into numpy array.
2. Pass 36,37,38,39,40,41th index of array to the crop_eye() function as it contains co-ordinates of respective landmarks and function returns cropped image for left eye.
3. Similarly pass 42,43,44,45,46,47 index to get cropped image of right eye.

4. Pass the cropped eye images through the model for the detection of the eyes width.

This code was developed on:

python == 3.7.0
opencv-python == 4.3.0.36
tensorflow==2.3.0
dlib == 19.20.0
imutils==0.5.3

NOTE:

Download the shape_predictor_68_face_landmarks.dat file from HERE and paste it in the Files folder.

With the joint effort of: https://github.com/basnetrikesh