Computational notebooks as co-design tools: engaging young adults living with diabetes, family carers, and clinicians with machine learning models
Computational notebooks as co-design tools: engaging young adults living with diabetes, family carers, and clinicians with machine learning models
Engaging end user groups with machine learning (ML) models can help align the design of predictive systems with people's needs and expectations. We present a co-design study investigating the benefits and challenges of using computational notebooks to inform ML models with end user groups. We used a computational notebook to engage young adults, carers, and clinicians with an example ML model that predicted health risk in diabetes care. Through co-design workshops and retrospective interviews, we found that participants particularly valued using the interactive data visualisations of the computational notebook to scaffold multidisciplinary learning, anticipate benefits and harms of the example ML model, and create fictional feature importance plots to highlight care needs. Participants also reported challenges, from running code cells to managing information asymmetries and power imbalances. We discuss the potential of leveraging computational notebooks as interactive co-design tools to meet end user needs early in ML model lifecycles.
Co-Design, Diabetes, Human-AI Interaction, Machine Learning
Association for Computing Machinery
Ayobi, Amid
83cefe47-631e-4a0b-bbf3-1e75f149972c
Hughes, Jacob
d777a5a0-bfc6-4bac-a4f5-5fc6133def4c
Duckworth, Christopher J
992c216c-8f66-48a8-8de6-2f04b4f736e6
Dylag, Jakub J.
419a56cd-af18-401e-bd4a-070a4d76270b
James, Sam
4eb979e8-1ff6-4942-8abc-3d406813f366
Marshall, Paul
864b012f-09b6-49cf-a442-dde2ea28a2d7
Guy, Matthew
1a40b2ed-3aec-4fce-9954-396840471c28
Kumaran, Anitha
c7880b22-4f22-4d76-9272-0b21f7778192
Chapman, Adriane
721b7321-8904-4be2-9b01-876c430743f1
Boniface, Michael
f30bfd7d-20ed-451b-b405-34e3e22fdfba
O'Kane, Aisling Ann
a82808f1-6756-4eb8-a8b2-3b3d049d78ea
19 April 2023
Ayobi, Amid
83cefe47-631e-4a0b-bbf3-1e75f149972c
Hughes, Jacob
d777a5a0-bfc6-4bac-a4f5-5fc6133def4c
Duckworth, Christopher J
992c216c-8f66-48a8-8de6-2f04b4f736e6
Dylag, Jakub J.
419a56cd-af18-401e-bd4a-070a4d76270b
James, Sam
4eb979e8-1ff6-4942-8abc-3d406813f366
Marshall, Paul
864b012f-09b6-49cf-a442-dde2ea28a2d7
Guy, Matthew
1a40b2ed-3aec-4fce-9954-396840471c28
Kumaran, Anitha
c7880b22-4f22-4d76-9272-0b21f7778192
Chapman, Adriane
721b7321-8904-4be2-9b01-876c430743f1
Boniface, Michael
f30bfd7d-20ed-451b-b405-34e3e22fdfba
O'Kane, Aisling Ann
a82808f1-6756-4eb8-a8b2-3b3d049d78ea
Ayobi, Amid, Hughes, Jacob, Duckworth, Christopher J, Dylag, Jakub J., James, Sam, Marshall, Paul, Guy, Matthew, Kumaran, Anitha, Chapman, Adriane, Boniface, Michael and O'Kane, Aisling Ann
(2023)
Computational notebooks as co-design tools: engaging young adults living with diabetes, family carers, and clinicians with machine learning models.
Schmidt, Albrecht, Väänänen, Kaisa, Goyal, Tesh, Kristensson, Per Ola, Peters, Anicia, Mueller, Stefanie, Williamson, Julie R. and Wilson, Max L.
(eds.)
In CHI'23: Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems.
Association for Computing Machinery.
20 pp
.
(doi:10.1145/3544548.3581424).
Record type:
Conference or Workshop Item
(Paper)
Abstract
Engaging end user groups with machine learning (ML) models can help align the design of predictive systems with people's needs and expectations. We present a co-design study investigating the benefits and challenges of using computational notebooks to inform ML models with end user groups. We used a computational notebook to engage young adults, carers, and clinicians with an example ML model that predicted health risk in diabetes care. Through co-design workshops and retrospective interviews, we found that participants particularly valued using the interactive data visualisations of the computational notebook to scaffold multidisciplinary learning, anticipate benefits and harms of the example ML model, and create fictional feature importance plots to highlight care needs. Participants also reported challenges, from running code cells to managing information asymmetries and power imbalances. We discuss the potential of leveraging computational notebooks as interactive co-design tools to meet end user needs early in ML model lifecycles.
Text
3544548.3581424
- Version of Record
Restricted to Repository staff only
Request a copy
More information
e-pub ahead of print date: 19 April 2023
Published date: 19 April 2023
Additional Information:
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from permissions@acm.org.
Venue - Dates:
CHI '23: CHI Conference on Human Factors in Computing Systems, , Hamburg, Germany, 2023-04-23 - 2023-04-28
Keywords:
Co-Design, Diabetes, Human-AI Interaction, Machine Learning
Identifiers
Local EPrints ID: 481270
URI: http://eprints.soton.ac.uk/id/eprint/481270
PURE UUID: 19b6e422-3d1b-4285-a37c-dee3896b48df
Catalogue record
Date deposited: 22 Aug 2023 16:33
Last modified: 16 Nov 2024 03:08
Export record
Altmetrics
Contributors
Author:
Amid Ayobi
Author:
Jacob Hughes
Author:
Christopher J Duckworth
Author:
Jakub J. Dylag
Author:
Sam James
Author:
Paul Marshall
Author:
Matthew Guy
Author:
Anitha Kumaran
Author:
Aisling Ann O'Kane
Editor:
Albrecht Schmidt
Editor:
Kaisa Väänänen
Editor:
Tesh Goyal
Editor:
Per Ola Kristensson
Editor:
Anicia Peters
Editor:
Stefanie Mueller
Editor:
Julie R. Williamson
Editor:
Max L. Wilson
Download statistics
Downloads from ePrints over the past year. Other digital versions may also be available to download e.g. from the publisher's website.
View more statistics