|
Published Articles >> Table of Contents >> Abstract
February 2007 (Vol. 29, No. 2)
pp. 362-367
Polarization Multiplexing and Demultiplexing for Appearance-Based Modeling
Oana G. Cula, IEEE
Kristin J. Dana, IEEE
Dinesh K. Pai, IEEE
Dongsheng Wang
Full Article Text:
   
DOI Bookmark: http://doi.ieeecomputersociety.org/10.1109/TPAMI.2007.39
Send link to a friend
| Abstract |
|
Polarization has been used in numerous prior studies for separating diffuse and specular reflectance components, but in this work we show that it also can be used to separate surface reflectance contributions from individual light sources. Our approach is called polarization multiplexing and it has a significant impact in appearance modeling where the image as a function of illumination direction is needed. Multiple unknown light sources can illuminate the scene simultaneously, and the individual contributions to the overall surface reflectance are estimated. Polarization multiplexing relies on the relationship between the light source direction and the intensity modulation. Inverting this transformation enables the individual intensity contributions to be estimated. In addition to polarization multiplexing, we show that phase histograms from the intensity modulations can be used to estimate scene properties including the number of light sources.
|
 References
|
[1] O.G. Cula, K.J. Dana, F. Murphy, and B.K. Rao, “Skin Texture Modeling,” Int'l J. Computer Vision, vol. 62, nos. 1-2, pp. 97-119, Apr.-May 2005.
[2] K.J. Dana, B. van Ginneken, S.K. Nayar, and J.J. Koenderink, “Reflectance and Texture of Real World Surfaces,” ACM Trans. Graphics, vol. 18, no. 1, pp. 1-34, Jan. 1999.
[3] P.E. Debevec and J. Malik, “Recovering High Dynamic Range Radiance Maps from Photographs,” Proc. ACM SIGGRAPH, pp. 369-378, Aug. 1997.
[4] P.E. Debevec, T. Hawkins, C. Tchou, H.-P. Duiker, W. Sarokin, and M. Sagar, “Acquiring the Reflectance Field of a Human Face,” Proc. ACM SIGGRAPH, pp. 145-156, 2000.
[5] C. Donner and H.W. Jensen, “Light Diffusion in Multi-Layered Translucent Materials,” Proc. ACM SIGGRAPH, pp. 1208-1215, Aug. 2005.
[6] P. Hanrahan and W. Krueger, “Reflection from Layered Surfaces Due to Subsurface Scattering,” Proc. ACM SIGGRAPH, pp. 165-174, 1993.
[7] A. Haro, B. Guenter, and I. Essa, “Real-Time, Photo-Realistic, Physically Based Rendering of Fine Scale Human Skin Structure,” Proc. 12th Eurographics Workshop Rendering, pp. 53-62, June 2001.
[8] T. Hawkins, A. Wegner, C. Tchou, A. Gardner, F. Goransson, and P. Debevec, “Animatable Facial Reflectance Fields,” Proc. Eurographics Symp. Rendering, pp. 309-321, 2004.
[9] H.W. Jensen, S.R. Marschner, M. Levoy, and P. Hanrahan, “A Practical Model for Subsurface Light Transport,” Proc. ACM SIGGRAPH, pp. 511-518, 2001.
[10] H.W. Jensen, “Digital Face Cloning,” Proc. ACM SIGGRAPH, July 2003.
[11] M.L. Koudelka, S. Magda, P.N. Belhumeur, and D.J. Kriegman, “Acquisition, Compression and Synthesis of Bidirectional Texture Functions,” Proc. Third Int'l Workshop Texture Analysis and Synthesis, pp. 59-64, Oct. 2003.
[12] H.P.A. Lensch, J. Kautz, and M. Goesele, W. Heidrich, and H.P. Seidel, “Image-Based Reconstruction of Spatial Appearance and Geometric Detail,” ACM Trans. Graphics, vol. 22, no. 2, pp. 234-257, Apr. 2003.
[13] D. Miyazaki, M. Saito, Y. Sato, and K. Ikeuchi, “Determining Surface Orientations of Transparent Objects Based on Polarization Degrees in Visible and Infrared Wavelengths,” J. Optical Soc. Am., vol. 19, no. 4, pp.687-694, Apr. 2002.
[14] D. Miyazaki, R.T. Tan, K. Hara, and K. Ikeuchi, “Polarization-Based Inverse Rendering in a Single View,” Proc. Int'l Conf. Computer Vision, pp. 982-987, 1997.
[15] S.K. Nayar, X.S. Fang, and T. Boult, “Separation of Reflection Components Using Color and Polarization,” Int'l J. Computer Vision, vol. 21, no. 3, pp.163-186, Feb. 1997.
[16] C.S. Ng and L. Li, “A Multi-Layered Reflection Model of Natural Human Skin,” Computer Graphics Int'l, pp. 249-256, 2001.
[17] K. Nishino, Y. Sato, and K. Ikeuchi, “EigenTexture Method: Appearance Compression and Synthesis Based on a 3D Model,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 23, no. 11, pp. 1257-1265, Nov. 2001.
[18] S. Rahmann and N. Canterakis, “Reconstruction of Specular Surfaces Using Polarization Imaging,” Proc. IEEE Conf. Computer Vision and Pattern Recognition, pp. 149-155, 2001.
[19] M. Saito, Y. Sato, K. Ikeuchi, and H. Kashiwagi, “Measurement of Surface Orientations of Transparent Objects Using Polarization in Highlight,” Proc. IEEE Conf. Computer Vision and Pattern Recognition, vol. 1, pp. 381-386, 1999.
[20] Y.Y. Schechner, J. Shamir, and N. Kiryati, “Polarization-Based Decorrelation of Transparent Layers: The Inclination Angle of an Invisible Surface,” Proc. Int'l Conf. Computer Vision, pp. 814-819, 1999.
[21] Y.Y. Schechner, S.K. Nayar, and P.N. Belhumeur, “A Theory of Multiplexed Illumination,” Proc. Int'l Conf. Computer Vision, pp. 808-815, 2003.
[22] N. Tsumura, N. Ojima, K. Sato, M. Shiraishi, H. Shimizu, H. Nabeshima, S. Akazaki, K. Hori, and Y. Miyake, “Image-Based Skin Color and Texture Analysis/Synthesis by Extracting Hemoglobin and Melanin Information in the Skin,” ACM Trans. Graphics, vol. 22, no. 3, pp. 770-779, July 2003.
[23] M.A.O. Vasilescu and D. Terzopoulos, “TensorTextures,” Proc. ACM SIGGRAPH, pp. 336-342, 2004.
[24] L. Williams, “The Gemini Man,” Proc. ACM SIGGRAPH, Digital Face Cloning: Course in Siggraph, 2005.
[25] L.B. Wolff and T.E. Boult, “Constraining Object Features Using a Polarization Reflectance Model,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 13, no. 7, pp. 635-657, July 1991.
[26] L.B. Wolff, “Polarization-Based Material Classification from Specular Reflection,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 12, no. 11, pp. 1059-1071, Nov. 1990.
|
 Additional Information
|
Index Terms- Reflectance, surface reflectance, specular reflectance, body reflectance, diffuse reflectance, polarization, multiplexing, appearance, appearance-based modeling.
Citation:
Oana G. Cula, Kristin J. Dana, Dinesh K. Pai, Dongsheng Wang,
"Polarization Multiplexing and Demultiplexing for Appearance-Based Modeling,"
IEEE Transactions on Pattern Analysis and Machine Intelligence,
vol. 29,
no. 2,
pp. 362-367,
Feb.,
2007
|
|
RSS Feed