A Unity plugin of utilities to run Transformer 🤗 models in Unity games.
Sharp transformers is designed to be functionally equivalent to Hugging Face’s [transformers python library](https://github.com/huggingface/transformers/tree/main).
If you like this library, don't hesitate to ⭐ star this repository. This helps us for discoverability 🤗.
In your Unity Project:
- Go to "Window" > "Package Manager" to open the Package Manager.
- Click the "+" in the upper left-hand corner and select "Add package from git URL".
- Enter the URL of this repository and click "Add": https://github.com/huggingface/sharp-transformers.git
We published a tutorial where you're to build this smart robot that can understand player orders and perform them using a Sentence Similarity Model.
The Tutorial 👉 https://open.substack.com/pub/thomassimonini/p/create-an-ai-robot-npc-using-hugging?r=dq5fg&utm_campaign=post&utm_medium=web
The Demo (Windows Executable) 👉 https://singularite.itch.io/jammo-the-robot-with-unity-sentis
- For now only BERT models for embedding are supported but we plan to support more models in the future see roadmap
- Bert Tokenizer
- Llama 2 Tokenizers (BPE)
- Whisper Tokenizers and PostProcessing
- STT Tokenizers