Drivers of trust in generative AI-powered voice assistants: the role of references
Drivers of trust in generative AI-powered voice assistants: the role of references
The boom in generative artificial intelligence (AI) and continuing growth of Voice Assistants (VAs) suggests their trajectories will converge. This conjecture aligns with the development of AI-driven conversational agents, aiming to utilise advance natural language processing (NLP) methods to enhance the capabilities of voice assistants. However, design guidelines for VAs prioritise maximum efficiency by advocating for the use of concise answers. This poses a conflict with the challenges around generative AI, such as inaccuracies and misinterpretation, as shorter responses may not adequately provide users with meaningful information. AI-VA systems can adapt drivers of trust formation, such as references and authorship, to improve credibility. A better understanding of user behaviour when using the system is needed to develop revised design recommendations for AI-powered VA systems. This paper reports an online survey of 256 participants residing in the U.K. and nine follow-up interviews, where user behaviour is investigated to identify drivers of trust in the context of obtaining digital information from a generative AI-based VA system. Adding references is promising as a tool for increasing trust in systems producing text, yet we found no evidence that the inclusion of references in a VA response contributed towards the perceived reliability or trust towards the system. We examine further variables driving user trust in AI-powered VA systems.
Generative AI, Large language models (LLMs), Trust Drivers, Voice Assistants
110-119
Widjaya, Michael A.
e5564ebb-7d64-4216-a5fd-fddda3293a42
Bermúdez, Juan P.
39d9048a-d5e0-486c-b1bd-e5c6312c4969
Moradbakhti, Laura
91234c85-9415-4992-bc4c-c8e1015ec4f4
Calvo, Rafael A.
eee1801f-99e9-4730-a645-4a5df201b4b0
1 August 2023
Widjaya, Michael A.
e5564ebb-7d64-4216-a5fd-fddda3293a42
Bermúdez, Juan P.
39d9048a-d5e0-486c-b1bd-e5c6312c4969
Moradbakhti, Laura
91234c85-9415-4992-bc4c-c8e1015ec4f4
Calvo, Rafael A.
eee1801f-99e9-4730-a645-4a5df201b4b0
Widjaya, Michael A., Bermúdez, Juan P., Moradbakhti, Laura and Calvo, Rafael A.
(2023)
Drivers of trust in generative AI-powered voice assistants: the role of references.
36th Annual British Human-Computer Interaction Conference, HCI 2023, , York, United Kingdom.
28 - 29 Aug 2023.
.
(doi:10.14236/ewic/BCSHCI2023.13).
Record type:
Conference or Workshop Item
(Paper)
Abstract
The boom in generative artificial intelligence (AI) and continuing growth of Voice Assistants (VAs) suggests their trajectories will converge. This conjecture aligns with the development of AI-driven conversational agents, aiming to utilise advance natural language processing (NLP) methods to enhance the capabilities of voice assistants. However, design guidelines for VAs prioritise maximum efficiency by advocating for the use of concise answers. This poses a conflict with the challenges around generative AI, such as inaccuracies and misinterpretation, as shorter responses may not adequately provide users with meaningful information. AI-VA systems can adapt drivers of trust formation, such as references and authorship, to improve credibility. A better understanding of user behaviour when using the system is needed to develop revised design recommendations for AI-powered VA systems. This paper reports an online survey of 256 participants residing in the U.K. and nine follow-up interviews, where user behaviour is investigated to identify drivers of trust in the context of obtaining digital information from a generative AI-based VA system. Adding references is promising as a tool for increasing trust in systems producing text, yet we found no evidence that the inclusion of references in a VA response contributed towards the perceived reliability or trust towards the system. We examine further variables driving user trust in AI-powered VA systems.
This record has no associated files available for download.
More information
Published date: 1 August 2023
Additional Information:
Publisher Copyright:
© Widjaya et al. Published by BCS Learning and Development Ltd.
Venue - Dates:
36th Annual British Human-Computer Interaction Conference, HCI 2023, , York, United Kingdom, 2023-08-28 - 2023-08-29
Keywords:
Generative AI, Large language models (LLMs), Trust Drivers, Voice Assistants
Identifiers
Local EPrints ID: 495504
URI: http://eprints.soton.ac.uk/id/eprint/495504
PURE UUID: f71898bf-e07a-47d6-a65e-43fc8c3f3f3a
Catalogue record
Date deposited: 14 Nov 2024 18:10
Last modified: 15 Nov 2024 03:12
Export record
Altmetrics
Contributors
Author:
Michael A. Widjaya
Author:
Juan P. Bermúdez
Author:
Laura Moradbakhti
Author:
Rafael A. Calvo
Download statistics
Downloads from ePrints over the past year. Other digital versions may also be available to download e.g. from the publisher's website.
View more statistics