WorldLoader is an machine learning driven Unity plugin which can reconstruct 3D environment in Unity based on a environment picture as input. The goal of this project and tool is to prototype a semantic camera which can be integrated into 3D content creation workflow and accelerate the production process.
WorldLoader combines two different machine models which in charge of different functionality.
- "Detectron" in charge for object detection and coodinate of object.
- "3D Bounding Box Estimation Using Deep Learning and Geometry" in charge for orientation of objects.
git clonethis project in your Unity Asset Folder- In Unity, add and empty GameObject at where you want to generate the environment.
- Attach the script..... in the Script Folder to the GameObject.
- Drag a picture of an environment to the "environment slot".
- Click "Load Scene" Button to send picture to server ane generate environment.
- Environmnet is generated, and ready for manipulate!
