Capturing 3D Surfaces Simply With a Flash Camera
For a high-level description of the technique, here is the abstract from a presentation given about it during the "Perception & Hallucination " session from SIGGRAPH earlier this month:
"A Perceptually Validated Model for Surface Depth Hallucination
Capturing depth to represent detailed surface geometry normally requires expensive, specialized equipment and/or collection of a large amount of data. By trading accuracy for ease of capture, the authors of this paper aim to recover surfaces that can be plausibly relit and viewed from any angle under any lighting. This multiscale shape-from-shading method takes diffuse-lit and flash-lit image pairs, and produces an albedo map and textured height field. Using two lighting conditions enables subtraction of one from the other to estimate albedo. Experimental validation shows that the method works for a broad range of textured surfaces, and users are frequently unable to identify the results as synthetic in a randomized presentation."
Credit: Maya Skies|
"Software then compares the brightness of every matching pair of pixels in the two images and calculates how much of a pixel's brightness is down to its position, and how much is due to its colour.
That information is used to produce a realistic rendering of a surface's texture. By altering the direction of illumination on the virtual surface the system can generate realistic shadow effects."
This technique is already being utilized to capture 3D textures of the surfaces of Mayan ruins. The rendered images are being incorporated into the " Maya Skies " project, which the Chabot Space & Science Center says is a "bi-lingual full-dome digital planetarium show featuring the scientific achievements, and the cosmology, of the Maya ." The show is scheduled to start showing in select planetariums in the summer of 2009.
Preliminary tests show that people could not tell the difference between images captured using this technique and images captured using the more expensive and time-consuming approach of laser scanning. And while the technique is currently being used to capture 3D surfaces of real-world objects, it is possible that aspects of it can be incorporated into easier, quicker, and less expensive ways to generate 3D surfaces and textures for virtual worlds, such as games.