The University of Southampton
University of Southampton Institutional Repository

Leveraging error correction in voice-based text entry by Talk-and-Gaze

Leveraging error correction in voice-based text entry by Talk-and-Gaze
Leveraging error correction in voice-based text entry by Talk-and-Gaze
We present the design and evaluation of Talk-and-Gaze (TaG), a method for selecting and correcting errors with voice and gaze. TaG uses eye gaze to overcome the inability of voiceonly systems to provide spatial information. The user’s point of gaze is used to select an erroneous word either by dwelling on the word for 800 ms (D-TaG) or by uttering a “select” voice command (V-TaG). A user study with 12 participants compared D-TaG, V-TaG, and a voice-only method for selecting and correcting words. Corrections were performed more than 20% faster with D-TaG compared to the V-TaG or voice-only methods. As well, D-TaG was observed to require 24% less selection effort than V-TaG and 11% less selection effort than voice-only error correction. D-TaG was well received in a subjective assessment with 66% of users choosing it as their preferred choice for error correction in voice-based text entry.
eye tracking, interaction design, multimodal, text entry, usability, voice
1-11
Sengupta, Korok
72599c31-2af0-4bc4-961e-de785c13a69b
Bhattarai, Sabin
d35c8f9d-aba5-4804-ad17-28fca90e8c40
Sarcar, Sayan
7db408dd-2b88-47e5-86e8-de98c735fc03
MacKenzie, Scott
6cf71d46-4a6a-443e-bb37-d939c8a2098a
Staab, Steffen
bf48d51b-bd11-4d58-8e1c-4e6e03b30c49
Sengupta, Korok
72599c31-2af0-4bc4-961e-de785c13a69b
Bhattarai, Sabin
d35c8f9d-aba5-4804-ad17-28fca90e8c40
Sarcar, Sayan
7db408dd-2b88-47e5-86e8-de98c735fc03
MacKenzie, Scott
6cf71d46-4a6a-443e-bb37-d939c8a2098a
Staab, Steffen
bf48d51b-bd11-4d58-8e1c-4e6e03b30c49

Sengupta, Korok, Bhattarai, Sabin, Sarcar, Sayan, MacKenzie, Scott and Staab, Steffen (2020) Leveraging error correction in voice-based text entry by Talk-and-Gaze. Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems,, , Honululu, United States. 25 - 30 Apr 2020. pp. 1-11 . (doi:10.1145/3313831.3376579).

Record type: Conference or Workshop Item (Paper)

Abstract

We present the design and evaluation of Talk-and-Gaze (TaG), a method for selecting and correcting errors with voice and gaze. TaG uses eye gaze to overcome the inability of voiceonly systems to provide spatial information. The user’s point of gaze is used to select an erroneous word either by dwelling on the word for 800 ms (D-TaG) or by uttering a “select” voice command (V-TaG). A user study with 12 participants compared D-TaG, V-TaG, and a voice-only method for selecting and correcting words. Corrections were performed more than 20% faster with D-TaG compared to the V-TaG or voice-only methods. As well, D-TaG was observed to require 24% less selection effort than V-TaG and 11% less selection effort than voice-only error correction. D-TaG was well received in a subjective assessment with 66% of users choosing it as their preferred choice for error correction in voice-based text entry.

Text
CHI2020_TAG____VoiceGazeTextEdit-camera-ready-copy - Author's Original
Download (5MB)

More information

Accepted/In Press date: 11 January 2020
e-pub ahead of print date: April 2020
Published date: 21 April 2020
Additional Information: Funding Information: This work has been performed as part of the MAMEM9 project with funding from the European Union’s Horizon 2020 research and innovation program under grant agreement number 644780. We would like to thank Pooya Oladazimi and Tara Morovatdar (University of Koblenz-Landau) for their assistance during the evaluation phase and all the participants who took part in the evaluation studies and provided us with relevant feedback. Publisher Copyright: © 2020 ACM.
Venue - Dates: Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems,, , Honululu, United States, 2020-04-25 - 2020-04-30
Keywords: eye tracking, interaction design, multimodal, text entry, usability, voice

Identifiers

Local EPrints ID: 437207
URI: http://eprints.soton.ac.uk/id/eprint/437207
PURE UUID: 50b383bd-52e4-435b-afd0-eabadc15246e
ORCID for Steffen Staab: ORCID iD orcid.org/0000-0002-0780-4154

Catalogue record

Date deposited: 21 Jan 2020 17:36
Last modified: 13 Aug 2022 04:14

Export record

Altmetrics

Contributors

Author: Korok Sengupta
Author: Sabin Bhattarai
Author: Sayan Sarcar
Author: Scott MacKenzie
Author: Steffen Staab ORCID iD

Download statistics

Downloads from ePrints over the past year. Other digital versions may also be available to download e.g. from the publisher's website.

View more statistics

Atom RSS 1.0 RSS 2.0

Contact ePrints Soton: eprints@soton.ac.uk

ePrints Soton supports OAI 2.0 with a base URL of http://eprints.soton.ac.uk/cgi/oai2

This repository has been built using EPrints software, developed at the University of Southampton, but available to everyone to use.

We use cookies to ensure that we give you the best experience on our website. If you continue without changing your settings, we will assume that you are happy to receive cookies on the University of Southampton website.

×