Skip to content

leonkoech/SignWhisper

Repository files navigation

Beesper: A Virtual Reality Sign Language Learning Adventure (A fun way to learn ASL in VR!)

Beesper Logo

Table of Contents

  1. Introduction
  2. Project Overview
  3. Features
  4. Getting Started
  5. How to Use Beesper
  6. License
  7. Shout-Outs

Introduction

Welcome to Beesper! We live in a world rich with diverse ways of communicating, but for some, expressing themselves through American Sign Language (ASL) can be challenging. Traditional methods of learning ASL, such as books and videos, lack the immersive and interactive experience needed to master this beautiful language. ASL is not just about words; it's about connection.

Beesper is here to change the game! Our Virtual Reality (VR) application transforms the way you learn ASL by providing an engaging and immersive experience packed with minigames designed to help learn/practice signing. We bring ASL to life in a virtual world where learning is as fun as playing your favorite video game.

####Video Presentation: link to video

Project Overview

  • What is Beesper? Beesper is a VR application designed to teach American Sign Language (ASL) in an interactive and engaging manner. It provides real-time feedback, making the learning process enjoyable and effective.

  • Why Beesper? Traditional methods of learning ASL can be dull and lack interaction. Beesper bridges the gap by creating a virtual space where learners can practice ASL through games and interactive experiences.

  • Who is Beesper for? Beesper is for anyone who wants to learn ASL, whether you're a beginner or looking to improve your skills. It's designed to make learning accessible and fun for all.

Features

  • Immersive VR Learning: Dive into a virtual world where ASL comes to life. Learn by doing, not just watching.

  • Real-time Feedback: Receive instant guidance and corrections to perfect your ASL gestures.

  • Interactive Games: Engage in fun and educational games that reinforce your ASL skills.

  • Community Learning: Connect with learners from around the world, making ASL learning a community experience.

  • Personal ASL Coach: Benefit from a virtual ASL coach that guides you through the learning process.

  • Breaking Barriers: Beesper aims to break down communication barriers, making ASL accessible to everyone.

Getting Started

To get started with Beesper, you'll need:

  • A compatible VR headset (Meta Quest 2 or 3)
  • Two Leap 2 by Ultraleap
  • Download the Beesper app from your VR app store
  • Create an account and start your ASL learning journey

Hardware Requirements

--

Software Dependencies

--

How to Use Beesper

  1. Launch the App: Put on your VR headset, launch Beesper, and sign in to your account.

  2. Choose Your Learning Path: Select your skill level and preferred ASL curriculum.

  3. Immerse Yourself: Dive into the virtual world of ASL learning. Follow the guided lessons and practice your gestures.

  4. Receive Feedback: Beesper provides real-time feedback on your gestures. Adjust and improve as you go along.

  5. Explore Games: Engage in interactive games and challenges to reinforce your learning.

  6. Connect with Others through Multi-Player: Join the Beesper community, connect with fellow learners, and practice ASL together.

License

Beesper is released under the MIT License. You are free to use, modify, and distribute the software in accordance with the terms of the license.

Shout-Outs

MVP award goes to Tahnee Gehm for being our local ASL expert and taking time to be interviewed and teach our team the basics of ASL. This project would have never succeeded without you.

Special thanks to the following Mentors: **list consistent mentors -Patrick for providing guidance for polishing presentations, video documentation and expression of impact. -Russel go guidance of structure for presentations. -Paul for assisting with multiple technical difficulties and for finding our out of norm table 105 location -The entire Ultraleap engineering team at Reality Hacks to confirm that multi-player along with other features were running successfully.

This project would not have been possible without your support!

Finally, thank you to you the user for choosing Beesper as your ASL learning companion. Let's make the world a more connected place, one sign at a time!

About

Developed at MIT. Gamification of ASL learning using Ultraleap pose recording + Unity Multiplayer (NetCode)

Topics

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published