Discover

Image-Based 3D Photography using Opacity Hulls


Title:
Image-Based 3D Photography using Opacity Hulls

Description:
We have built a system for acquiring and displaying high quality graphical models of objects that are impossible to scan with traditional scanners. Our system can acquire highly specular and fuzzy materials, such as fur and feathers. The hardware set-up consists of a turntable, two plasma displays, an array of cameras, and a rotating array of directional lights. We use multi-background matting techniques to acquire alpha mattes of the object from multiple viewpoints. The alpha mattes are used to construct an opacity hull. The opacity hull is a new shape representation, defined as the visual hull of the object with view-dependent opacity. It enables visualization of complex object silhouettes and seamless blending of objects into new environments. Our system also supports relighting of objects with arbitrary appearance using surface reflectance fields, a purely image-based appearance representation. Our system is the first to acquire and render surface reflectance fields under varying illumination from arbitrary viewpoints. We have built three generations of digitizers with increasing sophistication. In this paper, we present our results from digitizing hundreds of models. http://people.csail.mit.edu/wojciech/

Author:
wmatusik

Tags:
3D, CG, CGI, computer, generated, graphics, hull, ibr, image-based, images, models, opacity, Photography, rendering, scanner, scanning,

Related Videos:

transforming 2d image to 3d
transforming 2d image to 3d
Future of 3D Photography
Looks at how 3d is being used today (well, 2006). Part 4 -- final piece -- of the "Stereo Photography 101" video I made.
How to Transform 2D Pictures into 3D Scenes
The "V+R Challenge 3D" is a real-time 3D application open for all created by Dassault Systèmes and developed for Sports Without Borders. Through the application the general public can show its support for the not-for-profit by participating in a virtual 3D relay from March through August 2008. The application generates 3D avatars from personal photos submitted by Internet users using 3D server technology. Virtual runners will also be able to select a virtual running environment from an innovative 3D-calibrated photo library and invite Facebook friends to participate in their own virtual relays. Participants will receive a video of their virtual run; and virtual runners will also receive a video showing their group virtual relay.
Image-based visual hulls
We describe an efficient image-based approach to computing and shading visual hulls from silhouette image data. Our algorithm takes advantage of epipolar geometry and incremental computation to achieve a constant rendering cost per rendered pixel. It does not suffer from the computation complexity, limited resolution, or quantization artifacts of previous volumetric approaches. We demonstrate the use of this algorithm in a real-time virtualized reality application running off a small number of video streams. http://people.csail.mit.edu/wojciech/
3d Photo Equipment
Overview of most common ways to take 3D photos. Part 3 of the "Stereo Photography 101" short video I made. Made this in 2006, so the most recent advances available for digital photography aren't included. I'll be making one soon.
Easy 3D photography
Short test with blender and heightmaps.
High Fidelity Image-Based Modeling
Google Tech Talks August 9, 2007 ABSTRACT In this talk, I will propose a novel algorithm for calibrated multi-view stereopsis that outputs a (quasi) dense set of rectangular patches covering the surfaces visible in the input images. This algorithm does not require any initialization in the form of a bounding volume, and it detects and discards automatically outliers and obstacles. It does not perform any smoothing across nearby features, yet is currently the top performer in terms of both coverage and accuracy for four of the six benchmarkdat asets presented in the Multi-View Stereo Evaluation (http://vision.middlebury.edu/mview/eval/). The keys to its performance are effective techniques for...
Make Any Photo Look 3D
Creative use of photoshop & compositing software. Also, since I'm getting such great response for this video, I'd like to shamelessly promote the 2 music videos i directed (ivan ives & iv league) and edited and one other i just edited (ashley garland). All can be found in my favorites
Non-Rigid Photometric Stereo with Colored Lights (Part 2)
3D reconstruction of deforming cloth from a single camera. http://mi.eng.cam.ac.uk/research/projects/VideoNormals/
3D scanner
Full body CG scanner