Open the app in CodeSandbox, or see it in action here.
This app includes:
- A basic multi-participant call UI built with React and the Daily React library
- Hand gesture detection with TensorFlowJS and Fingerpose
- Sending gestures to other call participants
- Object detection with TensorFlowJS and coco-ssd
Note on object detection: coco-ssd is powerful, but can take up computing resources. This app may be less performant on lower-end devices. A Start/stop scan button is added to give the user control over when to run the detection. Predictions run only every 1000 ms, slowing down new object detection.
This is a demo app meant to showcase how to interact with the Daily APIs. It is not optimized for large calls. (Read our large meetings series for more information.)
To use this demo, you will first need to create a Daily account.
You will also need a Daily room URL. You can use any existing Daily room in the demo by pasting the room URL into the input. The room URL should be in this format to be valid: https://your-domain.daily.co/room-name, with daily-domain changed to your domain, and room-name changed to the name of the existing room you would like to use.
To run this demo locally:
- Clone the repo:
git clone git@github.com:daily-demos/daily-react-tfjs - Install dependencies
npm install - Start dev server
npm start - Then open your browser and go to
http://localhost:3000.