Shape estimation using polarization and shading from two views.
IEEE Transactions on Pattern Analysis and Machine Intelligence, 29 (11).
- Published Version
Publisher's URL: http://dx.doi.org/10.1109/TPAMI.2007.1099
This paper presents a novel method for 3D surface reconstruction that uses polarization and shading information from two views. The method relies on polarization data acquired using a standard digital camera and a linear polarizer. Fresnel theory is used to process the raw images and to obtain initial estimates of surface normals, assuming that the reflection type is diffuse. Based on this idea, the paper presents two novel contributions to the problem of surface reconstruction. The first is a technique to enhance the surface normal estimates by incorporating shading information into the method. This is done using robust statistics to estimate how the measured pixel brightnesses depend on the surface orientation. This gives an estimate of the object material reflectance function, which is used to refine the estimates of the surface normals. The second contribution is to use the refined estimates to establish correspondence between two views of an object. To do this, a set of patches are extracted from each view and are aligned by minimizing an energy functional based on the surface normal estimates and local topographic properties. The optimum alignment parameters for different patch pairs are then used to establish stereo correspondence. This process results in an unambiguous field of surface normals, which can be integrated to recover the surface depth. Our technique is most suited to smooth, non-metallic surfaces. It complements existing stereo algorithms since it does not require salient surface features to obtain correspondences. An extensive set of experiments, yielding reconstructed objects and reflectance functions, are presented and compared to ground truth.
|Additional Information:||© 2007 IEEE. Personal use of this material is permitted. However, permission to reprint/republish this material for advertising or promotional purposes or for creating new collective works for resale or redistribution to servers or lists, or to reuse any copyrighted component of this work in other works must be obtained from the IEEE.|
|Uncontrolled Keywords:||polarization imaging, surface shape recovery, stereo, reflectance function estimation, patch alignment|
|Faculty/Department:||Faculty of Environment and Technology > Department of Engineering Design and Mathematics|
Dr G. Atkinson
|Deposited On:||23 Nov 2010 09:05|
|Last Modified:||12 Aug 2013 09:00|
Request a change to this item
Total Document Downloads in Past 12 Months