Projection-mapping techniques allow you use software to paint with projected light onto physical shapes. Projection mapping is an effect of Chiaroscuro, which is an art that "uses of contrasts of light to achieve a sense of volume in modelling three-dimensional objects and figures."
Gabriel Dunne
gabe@gabrieldunne.com
gabrieldunne.com
- 2014 Summer, Gray Area Creative Code Immersive
- 2014 Fall, Gray Area Creative Code Immersive
- 6 - 9pm, Tue, Dec 2 2014
- 6 - 9pm, Thu, Dec 4 2014
- 12 - 4pm, Sat, Dec 6 2014
====
Typically the light cast from a typical projector is a rectangle, representing an rectangular screen output, a most content built for screens are in a rectangle shape. To throw a rectangular imagine into a specific area, we "corner pin" the quad, with four movable points. Using this hand-mapping technique, we can draw a series of rectangles that are aligned onto a space or object. This is great for:
- Images
- Videos
- Emulation of multiple "screens"
- Placing "screens" of content where ever you like
In the examples/ folder, you will find a few Processing sketches. One of which is an example that uses Projected Quads, based on a processing sketch by Marcin Ignac. Navigate to the examples/ folder in this repo and open ProjectedQuadsGLShaders, for example.
Features:
- Using OpenGL (hardware accellerated)
- Live Video Textures
- GLSL Shaders
- Shader Uniforms are passed into the shaders-
- Live Shader Reloading
Key Commands
'SPACE' toggle debug mode
's' save settings
'l' load settings
',' select next quad in debug mode
'.' select prev quad in debug mode
'1', '2', '3', '4' select one of selected quad's corners
Arrow keys (left, right, up, down) move selected corner's position (you can also use mouse for that)
Demo of this sketch in action, as used by Stephanie Sherriff for her "Whitish Paintings" series.
Load your own content into these sketches, and quad-map the content.
====
By manipulating a mesh, we begin interleaving physical form and software geometry. Starting with a 3D object, which can be created in a variety of ways. You can use 3D modeling software, like Sketchup or Rhinoceros 3D, Maya, Cinema4D.
There are a variety of methods to scan forms, using a depth camera, 2D camera vision, or 3D laser scanners. Even DIY methods.
Computer Vision techniques use matrix transformations to approzimate focal distortion through a lense. This method distorts the frame of reference based on a pattern, or markers on a physical object, usually read by a camera, sensors, or manual input.
ProCamToolkit is a modular toolkit developed with YCAM Interlab by Kyle Mcdonald, built with OpenFrameworks. It's collection software and code for openFrameworks that uses camera vision to aid in projection mapping tasks.
Mapamok is a module of ProCamToolkit used for for exploring projection mapping. It includes features for matching geometry to space using camera vision and calibration tools.
After downloading Mapamok, grab the grandtheater.dae file in the assets/ folder of this repo, and put it inside Mapamok data folder. Rename the "grandtheater.dae" to "model.dae". You'll have to rename the original "model.dae" to something else.
Then, follow along with the [Mapamok Tutorial](https://github.com/YCAMInterlab/ProCamToolkit/wiki/mapamok-(English).
The concept of Mapamok has been ported to Touch Designer with CamSchnappr
Align a 3D object to a physical shape via projection. Choose a simple elements such as a corner, or a window, or a doorway. Deconstruct your shape down to its component parts and try to use modeling primitives in a modular way.
====
DLP stands for Digital Light Processing. These projectors use an array of tiny mirrors to reflect light toward the screen (an "on" pixel) or away (an "off" pixel). A informative video on the technology. Most use a color wheel -- literally a spinning wheel with color filters -- to create sequential color. Some high-end models use three DLP chips; one each for red, green, and blue. DLP projectors range in price from a few hundred dollars to tens of thousands, and more. Most projectors in movie theaters use DLP. A challenge imposed by DLP projectors is that unless you are filming them with a high-end camera, you will see banding on most consumer digital cameras.
Pros of DLP:
- Great color accuracy
- Great contrast.
- Best contrast ratios and shadow detail.
- Same technology as projectors installed in digital theaters.
Cons of DLP:
- On some projectors, viewers can detect a color breakup effect called the "rainbow" effect.
- Sometimes color saturation is not as good as LCD or home theater DLP projectors.
LCD, i.e., liquid crystal display, is the technology found in most TVs. LCD projectors use three liquid crystal panels, each tasked with creating an image using just one of the primary colors (red, green, and blue). All three are projected on the screen at once, so you see a full color image. LCD projectors range in price from a few hundred to several thousand dollars. LCD projectors will film properly with hand-held and consumer cameras, they are ideal for documenting projection works.
Pros of LCD
- Very bright
- True high definition models are the least costly of any technologies with 720p models starting at under $2k.
- Great color saturation.
- 1000 lumen and lower models will usually have long lasting lamps.
- Cna be filmed with consumer cameras w/out banding.
Cons of LCD
- Dead pixels
- Contrast ratios are lower than those on DLP projectors
- Shadow detail and absolute black levels are worse than DLP
- Panel convergence problems (where the three LCD panels don't align properly producing a noticeable color halo around each pixel) are common.
- LCD panels are organic and lose image quality over time. The less the machine is used each day, the less of a problem this is. Projectors that are used for over eight (8) hours a day can exhibit problems fairly quickly.
- Color uniformity across the image is lower than that of DLP powered projectors.
LCoS, or liquid crystal on silicone projectors, came along at about the same time as DLP powered projectors. It is a bit of a hybrid between LCD and DLP LCoS technology is also referred to as reflective LCD, while individual manufacturers use their own names. Sony and JVC are the primary manufacturers of LCoS projectors, which they call SXRD and D-ILA, respectively. LCoS projectors range in price from a few thousand dollars to a few models that are in the tens-of-thousands range.
Pros of LCoS:
- LCoS resolutions tend to start at SXGA enabling native 720p high definition images to be shown.
- Like LCD, LCoS machines can be very bright.
- Offers a very smooth, film-like image due to its pixel structure.
- Great color saturation and accuracy.
Cons:
- Can be pricey, although based on resolution, the cost is not much more than that of DLP.
- Dead pixels are more visible than with other technologies and happen as often as with LCD's.
====
Projector References:
- http://www.projectorcentral.com/
- http://www.theprojectorpros.com/learn-s-learn-p-theater_dlp_vs_lcd_vs_lcos.htm
- http://www.cnet.com/news/dlp-vs-lcd-vs-lcos-projector-tech-pros-and-cons/
- Consider which architectural elements in the theater you want to map
- Use the toolkit of your choice to map the element
- Use mesh mapping, quad mapping, CV methods, mapamok, or combination.
- Balance your the time spent modeling, content, calibration
- Group work is encouraged! Divide up tasks, share amongst teams.
Pablo Valbuena
Xavier Chassaing
Dev Harlan
AntiVJ
Obscura Digital
Bot & Dolly
Nobumichi Asai
Masaru Ozaki
Kyle Mcdonald, Jonas Jongejan
More...
- Hyper Matrix
- Northern Ballet
- Tims Vermeer
- ProjectionMapping.org
- Creative Applications Projection-Mapping Tag
- MIT “Shader Lamps”
- MIT "Shader Lamps"
- Osman Khan "Sur La Table"
- Wake Me Up - Jack Conte
- Cubepix
- MIT Tangible Media Group
- RFIG: High-precision RFID Location Sensing using Pocket Projector
- Lasers and LeapMotion
- Automatic Projection Calbration by Jonny Lee
- Lasers and Bubble Tracking
- Light and Bottle
- Oblivion Making-Of
Any software is usable if it can create, distort, and texture geometry and/or flat planes.