Skip to content

kenaimachine/HumanIdentification_Openpose

Repository files navigation

Human Identification Using Openpose

Project Title:

Human Identification Via Walking Posture

Due to the Covid-19 situation, people are made to wear masks. This will make facial recognition difficult. Therefore, other human identification methods will be required.

Gait recognition may be a feasible method for human identification.

Human gait or walking manner is a potential biometric feature that provide unique identification of a person when other biometric featues such as face is not visible. Gait recognition also has the added advantage that it can be performed at a long distance, and requires no physical contact with surfaces or close proximity to another human.

Objective:

Develope a Neural Network based algorithm to recognize a person from video footage of walking posture.

Reference Paper :

Human Identification From Freestyle Walks Using Posture Based Gait Feature

https://ieeexplore.ieee.org/document/8007293

Training Dataset:

Training dataset consist of video footage of walking postures.

Download Dataset :. https://data.mendeley.com/datasets/gprg4s73v4/2

This video dataset comprises (44) recordings of the human gait with (396) edited videos, with stable background.

Pose estimation is used to generate keypoint data from video frames. The keypoint data will then be input to a neural network as training data. Below are screenshots of a video of a subject walking and the keypoints are identified using pose estimation.

This Project Uses OPENPOSE as a real time multi-person system to detect human body keypoints on single images

https://github.com/CMU-Perceptual-Computing-Lab/openpose

SubjectWalkingWithkeypoints

The output of the JSON files consist of a set of keypoints, whose ordering is realted with the outputformat shown:

Pose Output Format (COCO) - total of 18 keypoints

OpenPose_keypoints

Running OPENPOSE throught our training dataset, the number of video frames with keypoints detected are:

NumberOfFramesWithKeypointsDetcted

Using a sample training data, I illustrate how the keypoints coordinates changes over time across the image frame:

KeypointsMovementOverFrame

FramesInSequentialOrder

Gait Recognition Model And Results

Gait Recognition Model

GaitRecognitionModel

Gait Recognition Accuracy, Loss Curve

GaitRecognitionAccuracyLossCurve

Gait Recognition Confusion Matrix

GaitRecognitionConfusionMatrix

Gait Verification Model And Results

DataAugmentation SiameseModel SiameseModelDiagram SiameseModelResult NumberOfFramesAndResults

Video Of Keypoint Extraction Using Openpose :

Watch the video

Video Of Onboarding New Personnel:

Watch the video

Video Of Model Inference On Onboarded New Personnel:

Watch the video

About

Human Identification Using Gait Recognition And Gait Verification Through Bidirectional LSTM model.

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published