Material properties derived from three-dimensional shape representations

Abstract

Retinal image structure is due to a complex mixture of physical sources that includes the surface’s 3D shape, light-reflectance and transmittance properties, and the light field. The visual system can somehow discriminate between these different sources of image structure and recover information about the objects and surfaces in the scene. There has been significant debate about the nature of the representations that are used to derive surface reflectance properties such as specularity (gloss). Specularity could be derived either directly from 2D image properties or by exploiting information that can only be derived from representations in which 3D shape has been made explicit. We recently provided evidence that 3D shape information can play a critical role in the perception of material specularity, but the shape manipulation in our prior study also significantly changed 2D image properties (Marlow, Todorović, & Anderson, 2015). Here, we held fixed all monocularly visible 2D image properties and manipulated 3D shape stereoscopically. When binocularly fused, the depicted 3D shapes induced striking transformations in the surfaces’ apparent material properties, which vary from matte to ‘metallic’. Our psychophysical measurements of perceived specularity reveal that 3D shape information can play a critical role in material perception for both singly-curved surfaces and more complex geometries that curve in two directions. These results provide strong evidence that the perception of material specularity can depend on physical constraints derived from representations in which three-dimensional shape has been made explicit.