The University of Southampton
University of Southampton Institutional Repository

Drivers of trust in generative AI-powered voice assistants: the role of references

Drivers of trust in generative AI-powered voice assistants: the role of references
Drivers of trust in generative AI-powered voice assistants: the role of references

The boom in generative artificial intelligence (AI) and continuing growth of Voice Assistants (VAs) suggests their trajectories will converge. This conjecture aligns with the development of AI-driven conversational agents, aiming to utilise advance natural language processing (NLP) methods to enhance the capabilities of voice assistants. However, design guidelines for VAs prioritise maximum efficiency by advocating for the use of concise answers. This poses a conflict with the challenges around generative AI, such as inaccuracies and misinterpretation, as shorter responses may not adequately provide users with meaningful information. AI-VA systems can adapt drivers of trust formation, such as references and authorship, to improve credibility. A better understanding of user behaviour when using the system is needed to develop revised design recommendations for AI-powered VA systems. This paper reports an online survey of 256 participants residing in the U.K. and nine follow-up interviews, where user behaviour is investigated to identify drivers of trust in the context of obtaining digital information from a generative AI-based VA system. Adding references is promising as a tool for increasing trust in systems producing text, yet we found no evidence that the inclusion of references in a VA response contributed towards the perceived reliability or trust towards the system. We examine further variables driving user trust in AI-powered VA systems.

Generative AI, Large language models (LLMs), Trust Drivers, Voice Assistants
110-119
Widjaya, Michael A.
e5564ebb-7d64-4216-a5fd-fddda3293a42
Bermúdez, Juan P.
39d9048a-d5e0-486c-b1bd-e5c6312c4969
Moradbakhti, Laura
91234c85-9415-4992-bc4c-c8e1015ec4f4
Calvo, Rafael A.
eee1801f-99e9-4730-a645-4a5df201b4b0
Widjaya, Michael A.
e5564ebb-7d64-4216-a5fd-fddda3293a42
Bermúdez, Juan P.
39d9048a-d5e0-486c-b1bd-e5c6312c4969
Moradbakhti, Laura
91234c85-9415-4992-bc4c-c8e1015ec4f4
Calvo, Rafael A.
eee1801f-99e9-4730-a645-4a5df201b4b0

Widjaya, Michael A., Bermúdez, Juan P., Moradbakhti, Laura and Calvo, Rafael A. (2023) Drivers of trust in generative AI-powered voice assistants: the role of references. 36th Annual British Human-Computer Interaction Conference, HCI 2023, , York, United Kingdom. 28 - 29 Aug 2023. pp. 110-119 . (doi:10.14236/ewic/BCSHCI2023.13).

Record type: Conference or Workshop Item (Paper)

Abstract

The boom in generative artificial intelligence (AI) and continuing growth of Voice Assistants (VAs) suggests their trajectories will converge. This conjecture aligns with the development of AI-driven conversational agents, aiming to utilise advance natural language processing (NLP) methods to enhance the capabilities of voice assistants. However, design guidelines for VAs prioritise maximum efficiency by advocating for the use of concise answers. This poses a conflict with the challenges around generative AI, such as inaccuracies and misinterpretation, as shorter responses may not adequately provide users with meaningful information. AI-VA systems can adapt drivers of trust formation, such as references and authorship, to improve credibility. A better understanding of user behaviour when using the system is needed to develop revised design recommendations for AI-powered VA systems. This paper reports an online survey of 256 participants residing in the U.K. and nine follow-up interviews, where user behaviour is investigated to identify drivers of trust in the context of obtaining digital information from a generative AI-based VA system. Adding references is promising as a tool for increasing trust in systems producing text, yet we found no evidence that the inclusion of references in a VA response contributed towards the perceived reliability or trust towards the system. We examine further variables driving user trust in AI-powered VA systems.

This record has no associated files available for download.

More information

Published date: 1 August 2023
Additional Information: Publisher Copyright: © Widjaya et al. Published by BCS Learning and Development Ltd.
Venue - Dates: 36th Annual British Human-Computer Interaction Conference, HCI 2023, , York, United Kingdom, 2023-08-28 - 2023-08-29
Keywords: Generative AI, Large language models (LLMs), Trust Drivers, Voice Assistants

Identifiers

Local EPrints ID: 495504
URI: http://eprints.soton.ac.uk/id/eprint/495504
PURE UUID: f71898bf-e07a-47d6-a65e-43fc8c3f3f3a
ORCID for Juan P. Bermúdez: ORCID iD orcid.org/0000-0001-5239-2980

Catalogue record

Date deposited: 14 Nov 2024 18:10
Last modified: 15 Nov 2024 03:12

Export record

Altmetrics

Contributors

Author: Michael A. Widjaya
Author: Juan P. Bermúdez ORCID iD
Author: Laura Moradbakhti
Author: Rafael A. Calvo

Download statistics

Downloads from ePrints over the past year. Other digital versions may also be available to download e.g. from the publisher's website.

View more statistics

Atom RSS 1.0 RSS 2.0

Contact ePrints Soton: eprints@soton.ac.uk

ePrints Soton supports OAI 2.0 with a base URL of http://eprints.soton.ac.uk/cgi/oai2

This repository has been built using EPrints software, developed at the University of Southampton, but available to everyone to use.

We use cookies to ensure that we give you the best experience on our website. If you continue without changing your settings, we will assume that you are happy to receive cookies on the University of Southampton website.

×