Skip to content

A sensor fusion approach to the recognition of microgestures.

License

Notifications You must be signed in to change notification settings

ApocalyVec/mGesf

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

MicroGesture SensorFusion (mGesf)

Check out our video

This repo extends the work in this two papers: ThuMouse: A Micro-gesture Cursor Input through mmWave Radar-based Interaction and IndexPen: Two-Finger Text Input with Millimeter-Wave Radar. Cite us in your work if you find the code we shared help your project.

This application supports a variety of sensors, including:

  • Texas Instrument mmWave Sensors: IWR6843ISK, IWR6843AoP
  • LeapMotion (coming soon)
  • DecaWave UWB sensors (coming soon)

To run this application, first make sure you have the GUI backend PyQT5 installed. Depending on your O.S., use the following commands:

ubuntu: sudo apt-get install python3-pyqt5 MacOs: brew install pyqt

Then install the package in your python interpreter: pip install pyqt5

first run this command to install the prerequisites.

python setup.py install

Now run this app with this command

python main.py

Make sure you have the audio library installed: Mac:

brew install ffmpeg

Ubuntu:

sudo apt-get install ffmpeg

For Windows, it's a bit more involved as the downloaded library needs to be added to the environment variables. This is a good tuorial.

If you are getting 'permission denied' errors (likely to occur on Windows), install the simpleaudio package by running:

pip install simpleaudio

Releases

No releases published

Packages

No packages published

Contributors 4

  •  
  •  
  •  
  •