Skip to content

studiolanes/vision-utils

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

15 Commits
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

 __   _(_)___(_) ___  _ __    _   _| |_(_) |___
 \ \ / / / __| |/ _ \| '_ \  | | | | __| | / __|
  \ V /| \__ \ | (_) | | | | | |_| | |_| | \__ \
   \_/ |_|___/_|\___/|_| |_|  \__,_|\__|_|_|___/

vision-utils

This repo contains various projects related to the Vision Pro & visionOS.

Content

2D to Spatial Content

Convert any photos to spatial photos and videos viewable in the Apple Vision Pro! There is a mini swift cli executable that works on M1 apple computers to attach png files together.

See Photo Blog Post and Video Blog Post for more info.

Dependencies

We borrow the executable and iPhone args from Mike Swanson for converting over under videos to spatial videos.

We assume that you have poetry globally installed for python packaging and you're using Python 3.

cd spatialconverter
poetry install
poetry shell
# Poetry breaks when trying to install transformers from source, so run this installation the first time
pip install -q git+https://github.com/huggingface/transformers.git

Subsequent runs

cd spatialconverter/spatialconverter
poetry shell
python main.py --photo /Users/herk/Downloads/photo.png
# python main.py --video /Users/herk/Downloads/skydive.mp4