Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Major feat: Hand tracking #124

Open
DiddiLeija opened this issue Apr 29, 2023 · 0 comments
Open

Major feat: Hand tracking #124

DiddiLeija opened this issue Apr 29, 2023 · 0 comments
Labels
enhancement New feature or request help wanted Extra attention is needed
Milestone

Comments

@DiddiLeija
Copy link
Owner

DiddiLeija commented Apr 29, 2023

Is your feature request related to a problem? Please describe.

Currently, the HTML version of the game can be opened almost everywhere. However, mobile devices cannot run the game without a keyboard connected. Quoting from the Q&A entry in our wiki, talking about the HTML dist:

Note: For use in Android devices, by now, you must have a keyboard connected (since gameplay requires pressing keys).

Describe the solution you'd like

@HarshNarayanJha and I were discussing a possible fix to this problem: Hand tracking (using some sort of machine learning?).

Since our game is mainly Python, we could combine Pyxel with another tool (we've proposed MediaPipe) to recognize a user's hand in the camera, interpretate commands and replace keys. The idea is based in https://nuitducode.github.io/air-pyxel-demo/ (from a French project I discovered).

There's still a lot of things to discuss and clarify, that's why I opened this GitHub ticket ;)

Describe alternatives you've considered

Keep as is, which would keep the issue.

Adding gamepad keys? See #128.

Additional context

N/A

@DiddiLeija DiddiLeija added enhancement New feature or request help wanted Extra attention is needed labels Apr 29, 2023
@DiddiLeija DiddiLeija changed the title Feat: Hand tracking Major feat: Hand tracking Apr 29, 2023
@DiddiLeija DiddiLeija added this to the 4.0 milestone Jun 12, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request help wanted Extra attention is needed
Projects
None yet
Development

No branches or pull requests

1 participant