The University of Southampton
University of Southampton Institutional Repository

Leveraging error correction in voice-based text entry by Talk-and-Gaze

Leveraging error correction in voice-based text entry by Talk-and-Gaze
Leveraging error correction in voice-based text entry by Talk-and-Gaze
We present the design and evaluation of Talk-and-Gaze (TaG), a method for selecting and correcting errors with voice and gaze. TaG uses eye gaze to overcome the inability of voiceonly systems to provide spatial information. The user’s point of gaze is used to select an erroneous word either by dwelling on the word for 800 ms (D-TaG) or by uttering a “select” voice command (V-TaG). A user study with 12 participants compared D-TaG, V-TaG, and a voice-only method for selecting and correcting words. Corrections were performed more than 20% faster with D-TaG compared to the V-TaG or voice-only methods. As well, D-TaG was observed to require 24% less selection effort than V-TaG and 11% less selection effort than voice-only error correction. D-TaG was well received in a subjective assessment with 66% of users choosing it as their preferred choice for error correction in voice-based text entry.
eye tracking, interaction design, multimodal, text entry, usability, voice
1-11
Sengupta, Korok
72599c31-2af0-4bc4-961e-de785c13a69b
Bhattarai, Sabin
d35c8f9d-aba5-4804-ad17-28fca90e8c40
Sarcar, Sayan
7db408dd-2b88-47e5-86e8-de98c735fc03
MacKenzie, Scott
6cf71d46-4a6a-443e-bb37-d939c8a2098a
Staab, Steffen
bf48d51b-bd11-4d58-8e1c-4e6e03b30c49
Sengupta, Korok
72599c31-2af0-4bc4-961e-de785c13a69b
Bhattarai, Sabin
d35c8f9d-aba5-4804-ad17-28fca90e8c40
Sarcar, Sayan
7db408dd-2b88-47e5-86e8-de98c735fc03
MacKenzie, Scott
6cf71d46-4a6a-443e-bb37-d939c8a2098a
Staab, Steffen
bf48d51b-bd11-4d58-8e1c-4e6e03b30c49

Sengupta, Korok, Bhattarai, Sabin, Sarcar, Sayan, MacKenzie, Scott and Staab, Steffen (2020) Leveraging error correction in voice-based text entry by Talk-and-Gaze. Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems,, , Honululu, United States. 25 - 30 Apr 2020. pp. 1-11 . (doi:10.1145/3313831.3376579).

Record type: Conference or Workshop Item (Paper)

Abstract

We present the design and evaluation of Talk-and-Gaze (TaG), a method for selecting and correcting errors with voice and gaze. TaG uses eye gaze to overcome the inability of voiceonly systems to provide spatial information. The user’s point of gaze is used to select an erroneous word either by dwelling on the word for 800 ms (D-TaG) or by uttering a “select” voice command (V-TaG). A user study with 12 participants compared D-TaG, V-TaG, and a voice-only method for selecting and correcting words. Corrections were performed more than 20% faster with D-TaG compared to the V-TaG or voice-only methods. As well, D-TaG was observed to require 24% less selection effort than V-TaG and 11% less selection effort than voice-only error correction. D-TaG was well received in a subjective assessment with 66% of users choosing it as their preferred choice for error correction in voice-based text entry.

Text
CHI2020_TAG____VoiceGazeTextEdit-camera-ready-copy - Author's Original
Download (5MB)

More information

Accepted/In Press date: 11 January 2020
e-pub ahead of print date: April 2020
Published date: 2020
Venue - Dates: Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems,, , Honululu, United States, 2020-04-25 - 2020-04-30
Keywords: eye tracking, interaction design, multimodal, text entry, usability, voice

Identifiers

Local EPrints ID: 437207
URI: http://eprints.soton.ac.uk/id/eprint/437207
PURE UUID: 50b383bd-52e4-435b-afd0-eabadc15246e
ORCID for Steffen Staab: ORCID iD orcid.org/0000-0002-0780-4154

Catalogue record

Date deposited: 21 Jan 2020 17:36
Last modified: 18 Feb 2021 17:25

Export record

Altmetrics

Contributors

Author: Korok Sengupta
Author: Sabin Bhattarai
Author: Sayan Sarcar
Author: Scott MacKenzie
Author: Steffen Staab ORCID iD

University divisions

Download statistics

Downloads from ePrints over the past year. Other digital versions may also be available to download e.g. from the publisher's website.

View more statistics

Atom RSS 1.0 RSS 2.0

Contact ePrints Soton: eprints@soton.ac.uk

ePrints Soton supports OAI 2.0 with a base URL of http://eprints.soton.ac.uk/cgi/oai2

This repository has been built using EPrints software, developed at the University of Southampton, but available to everyone to use.

We use cookies to ensure that we give you the best experience on our website. If you continue without changing your settings, we will assume that you are happy to receive cookies on the University of Southampton website.

×