Mental object rotation based on two-dimensional visual representations
Mental object rotation based on two-dimensional visual representations
The discovery of mental rotation was one of the most significant landmarks in experimental psychology, leading to the ongoing assumption that to visually compare objects from different three-dimensional viewpoints, we use explicit internal simulations of object rotations, to ‘mentally adjust’ one object until it matches the other1. These rotations are thought to be performed on three-dimensional representations of the object, by literal analogy to physical rotations. In particular, it is thought that an imagined object is continuously adjusted at a constant three-dimensional angular rotation rate from its initial orientation to the final orientation through all intervening viewpoints2. While qualitative theories have tried to account for this phenomenon3, to date there has been no explicit, image-computable model of the underlying processes. As a result, there is no quantitative account of why some object viewpoints appear more similar to one another than others when the three-dimensional angular difference between them is the same4,5. We reasoned that the specific pattern of non-uniformities in the perception of viewpoints can reveal the visual computations underlying mental rotation. We therefore compared human viewpoint perception with a model based on the kind of two-dimensional ‘optical flow’ computations that are thought to underlie motion perception in biological vision6, finding that the model reproduces the specific errors that participants make. This suggests that mental rotation involves simulating the two-dimensional retinal image change that would occur when rotating objects. When we compare objects, we do not do so in a distal three-dimensional representation as previously assumed, but by measuring how much the proximal stimulus would change if we watched the object rotate, capturing perspectival appearance changes7.
R1224-R1225
Stewart, Emma E.M.
84ac943a-32e8-46ad-bb18-2423c49c4d25
Hartmann, Frieder T.
744a8944-e6cb-46fb-899d-9e87084d127f
Morgenstern, Yaniv
780d3b51-75e6-4d3c-bdf6-4a8a73fc3464
Storrs, Katherine R.
d3376207-a72a-4931-a7fb-1cbef061c3f7
Maiello, Guido
c122b089-1bbc-4d3e-b178-b0a1b31a5295
Fleming, Roland W.
f9a60356-03e6-4931-a332-f3a7aa9f9915
Stewart, Emma E.M.
84ac943a-32e8-46ad-bb18-2423c49c4d25
Hartmann, Frieder T.
744a8944-e6cb-46fb-899d-9e87084d127f
Morgenstern, Yaniv
780d3b51-75e6-4d3c-bdf6-4a8a73fc3464
Storrs, Katherine R.
d3376207-a72a-4931-a7fb-1cbef061c3f7
Maiello, Guido
c122b089-1bbc-4d3e-b178-b0a1b31a5295
Fleming, Roland W.
f9a60356-03e6-4931-a332-f3a7aa9f9915
Stewart, Emma E.M., Hartmann, Frieder T., Morgenstern, Yaniv, Storrs, Katherine R., Maiello, Guido and Fleming, Roland W.
(2022)
Mental object rotation based on two-dimensional visual representations.
Current Biology, 32 (21), .
(doi:10.1016/j.cub.2022.09.036).
Abstract
The discovery of mental rotation was one of the most significant landmarks in experimental psychology, leading to the ongoing assumption that to visually compare objects from different three-dimensional viewpoints, we use explicit internal simulations of object rotations, to ‘mentally adjust’ one object until it matches the other1. These rotations are thought to be performed on three-dimensional representations of the object, by literal analogy to physical rotations. In particular, it is thought that an imagined object is continuously adjusted at a constant three-dimensional angular rotation rate from its initial orientation to the final orientation through all intervening viewpoints2. While qualitative theories have tried to account for this phenomenon3, to date there has been no explicit, image-computable model of the underlying processes. As a result, there is no quantitative account of why some object viewpoints appear more similar to one another than others when the three-dimensional angular difference between them is the same4,5. We reasoned that the specific pattern of non-uniformities in the perception of viewpoints can reveal the visual computations underlying mental rotation. We therefore compared human viewpoint perception with a model based on the kind of two-dimensional ‘optical flow’ computations that are thought to underlie motion perception in biological vision6, finding that the model reproduces the specific errors that participants make. This suggests that mental rotation involves simulating the two-dimensional retinal image change that would occur when rotating objects. When we compare objects, we do not do so in a distal three-dimensional representation as previously assumed, but by measuring how much the proximal stimulus would change if we watched the object rotate, capturing perspectival appearance changes7.
Text
1-s2.0-S0960982222015366-main
- Version of Record
More information
e-pub ahead of print date: 7 November 2022
Additional Information:
Funding Information:
This project was supported by the Deutsche Forschungsgemeinschaft, through project numbers 460533638 (E.E.M.S.) and 222641018–SFB/TRR-135 TP C1 (G.M. and R.W.F.), and by the Research Cluster “The Adaptive Mind”, funded by the Hessian Ministry for Higher Education, Research, Science and the Arts. We thank Wiebke Siedentop and Andre Gomes for help with data collection. Data are available at https://doi.org/10.5281/zenodo.6697546 .
Publisher Copyright:
© 2022 The Authors
Identifiers
Local EPrints ID: 484869
URI: http://eprints.soton.ac.uk/id/eprint/484869
ISSN: 0960-9822
PURE UUID: 9c087f49-7386-40d7-aabb-00b03ee70e93
Catalogue record
Date deposited: 23 Nov 2023 17:56
Last modified: 18 Mar 2024 04:11
Export record
Altmetrics
Contributors
Author:
Emma E.M. Stewart
Author:
Frieder T. Hartmann
Author:
Yaniv Morgenstern
Author:
Katherine R. Storrs
Author:
Guido Maiello
Author:
Roland W. Fleming
Download statistics
Downloads from ePrints over the past year. Other digital versions may also be available to download e.g. from the publisher's website.
View more statistics