The University of Southampton
×
Filter your search:
University of Southampton Institutional Repository

Eye tracking: empirical foundations for a minimal reporting guideline

Eye tracking: empirical foundations for a minimal reporting guideline
Eye tracking: empirical foundations for a minimal reporting guideline

In this paper, we present a review of how the various aspects of any study using an eye tracker (such as the instrument, methodology, environment, participant, etc.) affect the quality of the recorded eye-tracking data and the obtained eye-movement and gaze measures. We take this review to represent the empirical foundation for reporting guidelines of any study involving an eye tracker. We compare this empirical foundation to five existing reporting guidelines and to a database of 207 published eye-tracking studies. We find that reporting guidelines vary substantially and do not match with actual reporting practices. We end by deriving a minimal, flexible reporting guideline based on empirical research (Section “An empirically based minimal reporting guideline”).

Data quality, Eye movements, Eye tracking, Replicability, Reporting guidelines, Reporting practices, Reporting standards, Reproducibility
1554-351X
364-416
Holmqvist, Kenneth
571a300c-07f5-4c08-8332-f839b6a2d2e3
Örbom, Saga Lee
a1872d2e-cd4b-479f-a110-94602d0ca5d9
Hooge, Ignace T. C.
4a9afa3e-3a78-497f-892b-7dad68eeb321
Niehorster, Diederick C.
abf4b169-7960-4d04-8341-26f190565f85
Alexander, Robert G.
ffec2455-6649-4518-911c-b69bf813651e
Andersson, Richard
00e5809f-2a34-4a8b-8950-b6603082e859
Benjamins, Jeroen S.
d10e3f07-0368-44c4-9c7f-a6cb89a022a1
Blignaut, Pieter
4e831f90-ca53-4b3e-a0de-4a9f81558c19
Brouwer, Anne-Marie
b88af369-f029-46f8-8c54-d8427b23393b
Chuang, Lewis L.
218cf61d-87e4-4540-af18-17b8772b7a30
Dalrymple, Kirsten A.
78cf292b-4d9f-4dbe-9e9b-a9f8d27b11a7
Drieghe, Denis
dfe41922-1cea-47f4-904b-26d5c9fe85ce
Dunn, Matt J.
b2cac768-6cfd-446a-810b-f4f5344d0732
Ettinger, Ulrich
c960a50f-91e8-492f-84b3-e7b2ef4a882e
Fiedler, Susann
b601e298-9719-46d0-8ba8-3127deb44302
Foulsham, Tom
3f032e73-3f98-48d0-9d3f-37dff41dbf31
van der Geest, Jos N.
5b606272-68f4-4765-b0ae-b5e70db17811
Hanson, Dan Witzner
76abb1b6-18c7-4b24-aec8-80e7106f40d8
Hutton, Sam
50f40941-58cc-4d5a-beb3-c4e9bf5c9d71
Kasneci, Enkelejda
d3f49c5d-8ffa-4151-bb26-cd396e412d6e
Kingstone, Alan
c1655319-2e8f-403c-89c7-ef087e64171b
Knox, Paul C.
916473d2-6168-48e0-b3f8-2ce84d7b703d
Kok, Ellen M.
0cbcc7db-6ffa-4ad0-ad87-62f9088190fc
Lee, Helena
5d36fd1e-9334-4db5-b201-034d147133fb
Lee, Joy Yeonjoo
5c9c84e8-6b30-41c7-b25e-1769c900f20f
Leppänen, Jukka M.
454d239a-3477-446b-a4e3-a112738c6a42
Macknik, Stephen
0f634ae5-7456-4b8b-9971-ffe6219fd79f
Majaranta, Païvi
b7c9d005-9dc5-43db-8240-2481679dd1cb
Martinez-Conde, Susana
d8431590-e26b-41c4-b75d-d2ad4362837f
Nuthmann, Antje
280739d7-a705-42da-9102-8a748a8807ef
Nyström, Marcus
1c907e87-9279-4f54-b8a5-b57e37c6ff50
Orquin, Jacob L.
8506948c-3c0d-4ec5-b400-017b1a1b9ca6
Otero-Milan, Jorge
e05d4c24-9baa-4210-a024-4a13dcccbdbb
Park, Soon Young
8a52a655-2f4f-4933-800c-ea79ea6f2beb
Popelka, Stanislav
521936a3-9812-4836-a825-2bbf96925b79
Proudlock, Frank
de8992cb-8490-4621-8a53-19c2b91cb4be
Renkewitz, Frank
aa6f803c-e74d-47f6-9687-261ded0e1e60
Roorda, Austin J.
735d9dff-babb-4f7c-8d85-d64c3f528ca4
Schulte-Mecklenbeck, Michael
05ae2f91-83ca-44e2-84ff-76dce3d4e084
Sharif, Bonita
36306dfd-93ee-4eb6-97ce-2b94242789a8
Shic, Frederick
0d4a851e-5a03-467a-a8b5-2fc2ec2511dc
Shovman, Mark
104d32a5-ceef-45d0-9915-55357f5092ae
Thomas, Mervyn G.
8e6aea5c-113e-4fd7-81e9-5937f94f1a4d
Venrooij, Ward
7d1c11b9-54c2-4acb-9c69-7fcbd257300f
Zemblys, Raymondas
13c1f5ee-8435-4548-9158-41758785cd49
Hessels, Roy S.
05081b62-a772-4c77-af1d-8c2068bccc06
Holmqvist, Kenneth
571a300c-07f5-4c08-8332-f839b6a2d2e3
Örbom, Saga Lee
a1872d2e-cd4b-479f-a110-94602d0ca5d9
Hooge, Ignace T. C.
4a9afa3e-3a78-497f-892b-7dad68eeb321
Niehorster, Diederick C.
abf4b169-7960-4d04-8341-26f190565f85
Alexander, Robert G.
ffec2455-6649-4518-911c-b69bf813651e
Andersson, Richard
00e5809f-2a34-4a8b-8950-b6603082e859
Benjamins, Jeroen S.
d10e3f07-0368-44c4-9c7f-a6cb89a022a1
Blignaut, Pieter
4e831f90-ca53-4b3e-a0de-4a9f81558c19
Brouwer, Anne-Marie
b88af369-f029-46f8-8c54-d8427b23393b
Chuang, Lewis L.
218cf61d-87e4-4540-af18-17b8772b7a30
Dalrymple, Kirsten A.
78cf292b-4d9f-4dbe-9e9b-a9f8d27b11a7
Drieghe, Denis
dfe41922-1cea-47f4-904b-26d5c9fe85ce
Dunn, Matt J.
b2cac768-6cfd-446a-810b-f4f5344d0732
Ettinger, Ulrich
c960a50f-91e8-492f-84b3-e7b2ef4a882e
Fiedler, Susann
b601e298-9719-46d0-8ba8-3127deb44302
Foulsham, Tom
3f032e73-3f98-48d0-9d3f-37dff41dbf31
van der Geest, Jos N.
5b606272-68f4-4765-b0ae-b5e70db17811
Hanson, Dan Witzner
76abb1b6-18c7-4b24-aec8-80e7106f40d8
Hutton, Sam
50f40941-58cc-4d5a-beb3-c4e9bf5c9d71
Kasneci, Enkelejda
d3f49c5d-8ffa-4151-bb26-cd396e412d6e
Kingstone, Alan
c1655319-2e8f-403c-89c7-ef087e64171b
Knox, Paul C.
916473d2-6168-48e0-b3f8-2ce84d7b703d
Kok, Ellen M.
0cbcc7db-6ffa-4ad0-ad87-62f9088190fc
Lee, Helena
5d36fd1e-9334-4db5-b201-034d147133fb
Lee, Joy Yeonjoo
5c9c84e8-6b30-41c7-b25e-1769c900f20f
Leppänen, Jukka M.
454d239a-3477-446b-a4e3-a112738c6a42
Macknik, Stephen
0f634ae5-7456-4b8b-9971-ffe6219fd79f
Majaranta, Païvi
b7c9d005-9dc5-43db-8240-2481679dd1cb
Martinez-Conde, Susana
d8431590-e26b-41c4-b75d-d2ad4362837f
Nuthmann, Antje
280739d7-a705-42da-9102-8a748a8807ef
Nyström, Marcus
1c907e87-9279-4f54-b8a5-b57e37c6ff50
Orquin, Jacob L.
8506948c-3c0d-4ec5-b400-017b1a1b9ca6
Otero-Milan, Jorge
e05d4c24-9baa-4210-a024-4a13dcccbdbb
Park, Soon Young
8a52a655-2f4f-4933-800c-ea79ea6f2beb
Popelka, Stanislav
521936a3-9812-4836-a825-2bbf96925b79
Proudlock, Frank
de8992cb-8490-4621-8a53-19c2b91cb4be
Renkewitz, Frank
aa6f803c-e74d-47f6-9687-261ded0e1e60
Roorda, Austin J.
735d9dff-babb-4f7c-8d85-d64c3f528ca4
Schulte-Mecklenbeck, Michael
05ae2f91-83ca-44e2-84ff-76dce3d4e084
Sharif, Bonita
36306dfd-93ee-4eb6-97ce-2b94242789a8
Shic, Frederick
0d4a851e-5a03-467a-a8b5-2fc2ec2511dc
Shovman, Mark
104d32a5-ceef-45d0-9915-55357f5092ae
Thomas, Mervyn G.
8e6aea5c-113e-4fd7-81e9-5937f94f1a4d
Venrooij, Ward
7d1c11b9-54c2-4acb-9c69-7fcbd257300f
Zemblys, Raymondas
13c1f5ee-8435-4548-9158-41758785cd49
Hessels, Roy S.
05081b62-a772-4c77-af1d-8c2068bccc06

Holmqvist, Kenneth, Örbom, Saga Lee, Hooge, Ignace T. C., Niehorster, Diederick C., Alexander, Robert G., Andersson, Richard, Benjamins, Jeroen S., Blignaut, Pieter, Brouwer, Anne-Marie, Chuang, Lewis L., Dalrymple, Kirsten A., Drieghe, Denis, Dunn, Matt J., Ettinger, Ulrich, Fiedler, Susann, Foulsham, Tom, van der Geest, Jos N., Hanson, Dan Witzner, Hutton, Sam, Kasneci, Enkelejda, Kingstone, Alan, Knox, Paul C., Kok, Ellen M., Lee, Helena, Lee, Joy Yeonjoo, Leppänen, Jukka M., Macknik, Stephen, Majaranta, Païvi, Martinez-Conde, Susana, Nuthmann, Antje, Nyström, Marcus, Orquin, Jacob L., Otero-Milan, Jorge, Park, Soon Young, Popelka, Stanislav, Proudlock, Frank, Renkewitz, Frank, Roorda, Austin J., Schulte-Mecklenbeck, Michael, Sharif, Bonita, Shic, Frederick, Shovman, Mark, Thomas, Mervyn G., Venrooij, Ward, Zemblys, Raymondas and Hessels, Roy S. (2023) Eye tracking: empirical foundations for a minimal reporting guideline. Behavior Research Methods, 55 (1), 364-416. (doi:10.3758/s13428-021-01762-8).

Record type: Article

Abstract

In this paper, we present a review of how the various aspects of any study using an eye tracker (such as the instrument, methodology, environment, participant, etc.) affect the quality of the recorded eye-tracking data and the obtained eye-movement and gaze measures. We take this review to represent the empirical foundation for reporting guidelines of any study involving an eye tracker. We compare this empirical foundation to five existing reporting guidelines and to a database of 207 published eye-tracking studies. We find that reporting guidelines vary substantially and do not match with actual reporting practices. We end by deriving a minimal, flexible reporting guideline based on empirical research (Section “An empirically based minimal reporting guideline”).

Text
Holmqvist et al. - accepted BRM - Eye tracking empirical foundations - Author's Original
Available under License University of Southampton Accepted Manuscript Licence.
Download (1MB)

More information

Accepted/In Press date: 29 November 2021
e-pub ahead of print date: 6 April 2022
Published date: 1 January 2023
Additional Information: Publisher Copyright: © 2022, The Author(s).
Keywords: Data quality, Eye movements, Eye tracking, Replicability, Reporting guidelines, Reporting practices, Reporting standards, Reproducibility

Identifiers

Local EPrints ID: 452739
URI: http://eprints.soton.ac.uk/id/eprint/452739
DOI: doi:10.3758/s13428-021-01762-8
ISSN: 1554-351X
PURE UUID: e569213a-2ba2-4baf-ba4a-afbad9d3dae5
ORCID for Denis Drieghe: ORCID iD orcid.org/0000-0001-9630-8410
ORCID for Helena Lee: ORCID iD orcid.org/0000-0002-2573-9536

Catalogue record

Date deposited: 17 Dec 2021 17:47
Last modified: 17 Mar 2024 06:59

Export record

Altmetrics

Contributors

Author: Kenneth Holmqvist
Author: Saga Lee Örbom
Author: Ignace T. C. Hooge
Author: Diederick C. Niehorster
Author: Robert G. Alexander
Author: Richard Andersson
Author: Jeroen S. Benjamins
Author: Pieter Blignaut
Author: Anne-Marie Brouwer
Author: Lewis L. Chuang
Author: Kirsten A. Dalrymple
Author: Denis Drieghe ORCID iD
Author: Matt J. Dunn
Author: Ulrich Ettinger
Author: Susann Fiedler
Author: Tom Foulsham
Author: Jos N. van der Geest
Author: Dan Witzner Hanson
Author: Sam Hutton
Author: Enkelejda Kasneci
Author: Alan Kingstone
Author: Paul C. Knox
Author: Ellen M. Kok
Author: Helena Lee ORCID iD
Author: Joy Yeonjoo Lee
Author: Jukka M. Leppänen
Author: Stephen Macknik
Author: Païvi Majaranta
Author: Susana Martinez-Conde
Author: Antje Nuthmann
Author: Marcus Nyström
Author: Jacob L. Orquin
Author: Jorge Otero-Milan
Author: Soon Young Park
Author: Stanislav Popelka
Author: Frank Proudlock
Author: Frank Renkewitz
Author: Austin J. Roorda
Author: Michael Schulte-Mecklenbeck
Author: Bonita Sharif
Author: Frederick Shic
Author: Mark Shovman
Author: Mervyn G. Thomas
Author: Ward Venrooij
Author: Raymondas Zemblys
Author: Roy S. Hessels

Download statistics

Downloads from ePrints over the past year. Other digital versions may also be available to download e.g. from the publisher's website.

View more statistics

Library staff additional information
Atom RSS 1.0 RSS 2.0

Contact ePrints Soton: eprints@soton.ac.uk

ePrints Soton supports OAI 2.0 with a base URL of http://eprints.soton.ac.uk/cgi/oai2

This repository has been built using EPrints software, developed at the University of Southampton, but available to everyone to use.

We use cookies to ensure that we give you the best experience on our website. If you continue without changing your settings, we will assume that you are happy to receive cookies on the University of Southampton website.

×