Volume 10, Number 1, Article 2, Pages 1-25 doi:10.1167/10.1.2 http://journalofvision.org/10/1/2/ ISSN 1534-7362
Estimating perception of scene layout properties from global image features
Michael G. Ross
Department of Brain & Cognitive Sciences, Massachusetts Institute of Technology, USA
[home] [e-mail]
Aude Oliva
Department of Brain & Cognitive Sciences, Massachusetts Institute of Technology, USA
[home] [e-mail]
Abstract

The relationship between image features and scene structure is central to the study of human visual perception and computer vision, but many of the specifics of real-world layout perception remain unknown. We do not know which image features are relevant to perceiving layout properties, or whether those features provide the same information for every type of image. Furthermore, we do not know the spatial resolutions required for perceiving different properties. This paper describes an experiment and a computational model that provides new insights on these issues. Humans perceive the global spatial layout properties such as dominant depth, openness, and perspective, from a single image. This work describes an algorithm that reliably predicts human layout judgments. This model's predictions are general, not specific to the observers it trained on. Analysis reveals that the optimal spatial resolutions for determining layout vary with the content of the space and the property being estimated. Openness is best estimated at high resolution, depth is best estimated at medium resolution, and perspective is best estimated at low resolution. Given the reliability and simplicity of estimating the global layout of real-world environments, this model could help resolve perceptual ambiguities encountered by more detailed scene reconstruction schemas.

View full-text

History
Received July 10, 2009; published January 8, 2010
Citation
Ross, M. G., & Oliva, A. (2010). Estimating perception of scene layout properties from global image features. Journal of Vision, 10(1):2, 1-25, http://journalofvision.org/10/1/2/, doi:10.1167/10.1.2.
Keywords
space and scene perception, computational modeling, depth, structure of natural images
Downloads
213 Total.
 
Search
for articles that cite this paper
for related articles by these authors
for papers that cite this paper
Get citation






jov