The University of Southampton
University of Southampton Institutional Repository

Characterising user engagement with mHealth for chronic disease self-management and impact on machine learning performance

Characterising user engagement with mHealth for chronic disease self-management and impact on machine learning performance
Characterising user engagement with mHealth for chronic disease self-management and impact on machine learning performance

Mobile Health (mHealth) has the potential to be transformative in the management of chronic conditions. Machine learning can leverage self-reported data collected with apps to predict periods of increased health risk, alert users, and signpost interventions. Despite this, mHealth must balance the treatment burden of frequent self-reporting and predictive performance and safety. Here we report how user engagement with a widely used and clinically validated mHealth app, myCOPD (designed for the self-management of Chronic Obstructive Pulmonary Disease), directly impacts the performance of a machine learning model predicting an acute worsening of condition (i.e., exacerbations). We classify how users typically engage with myCOPD, finding that 60.3% of users engage frequently, however, less frequent users can show transitional engagement (18.4%), becoming more engaged immediately (< 21 days) before exacerbating. Machine learning performed better for users who engaged the most, however, this performance decrease can be mostly offset for less frequent users who engage more near exacerbation. We conduct interviews and focus groups with myCOPD users, highlighting digital diaries and disease acuity as key factors for engagement. Users of mHealth can feel overburdened when self-reporting data necessary for predictive modelling and confidence of recognising exacerbations is a significant barrier to accurate self-reported data. We demonstrate that users of mHealth should be encouraged to engage when they notice changes to their condition (rather than clinically defined symptoms) to achieve data that is still predictive for machine learning, while reducing the likelihood of disengagement through desensitisation.

2398-6352
Duckworth, Christopher
992c216c-8f66-48a8-8de6-2f04b4f736e6
Cliffe, Bethany
dff693df-9697-4446-aebc-66c3bcfea632
Pickering, Brian
225088d0-729e-4f17-afe2-1ad1193ccae6
Ainsworth, Ben
b02d78c3-aa8b-462d-a534-31f1bf164f81
Blythin, Alison
62fddce4-e5e4-4a28-81fc-3aee38e89fdb
Kirk, Adam
9c1e0bbe-06c2-4da9-aa19-e36b7a4d7f0f
Wilkinson, Thomas M.A.
8c55ebbb-e547-445c-95a1-c8bed02dd652
Boniface, Michael j.
f30bfd7d-20ed-451b-b405-34e3e22fdfba
et al.
Duckworth, Christopher
992c216c-8f66-48a8-8de6-2f04b4f736e6
Cliffe, Bethany
dff693df-9697-4446-aebc-66c3bcfea632
Pickering, Brian
225088d0-729e-4f17-afe2-1ad1193ccae6
Ainsworth, Ben
b02d78c3-aa8b-462d-a534-31f1bf164f81
Blythin, Alison
62fddce4-e5e4-4a28-81fc-3aee38e89fdb
Kirk, Adam
9c1e0bbe-06c2-4da9-aa19-e36b7a4d7f0f
Wilkinson, Thomas M.A.
8c55ebbb-e547-445c-95a1-c8bed02dd652
Boniface, Michael j.
f30bfd7d-20ed-451b-b405-34e3e22fdfba

Duckworth, Christopher, Cliffe, Bethany and Pickering, Brian , et al. (2024) Characterising user engagement with mHealth for chronic disease self-management and impact on machine learning performance. npj Digital Medicine, 7 (1), [66]. (doi:10.1038/s41746-024-01063-2).

Record type: Article

Abstract

Mobile Health (mHealth) has the potential to be transformative in the management of chronic conditions. Machine learning can leverage self-reported data collected with apps to predict periods of increased health risk, alert users, and signpost interventions. Despite this, mHealth must balance the treatment burden of frequent self-reporting and predictive performance and safety. Here we report how user engagement with a widely used and clinically validated mHealth app, myCOPD (designed for the self-management of Chronic Obstructive Pulmonary Disease), directly impacts the performance of a machine learning model predicting an acute worsening of condition (i.e., exacerbations). We classify how users typically engage with myCOPD, finding that 60.3% of users engage frequently, however, less frequent users can show transitional engagement (18.4%), becoming more engaged immediately (< 21 days) before exacerbating. Machine learning performed better for users who engaged the most, however, this performance decrease can be mostly offset for less frequent users who engage more near exacerbation. We conduct interviews and focus groups with myCOPD users, highlighting digital diaries and disease acuity as key factors for engagement. Users of mHealth can feel overburdened when self-reporting data necessary for predictive modelling and confidence of recognising exacerbations is a significant barrier to accurate self-reported data. We demonstrate that users of mHealth should be encouraged to engage when they notice changes to their condition (rather than clinically defined symptoms) to achieve data that is still predictive for machine learning, while reducing the likelihood of disengagement through desensitisation.

Text
s41746-024-01063-2 - Version of Record
Available under License Creative Commons Attribution.
Download (1MB)

More information

Accepted/In Press date: 22 February 2024
e-pub ahead of print date: 12 March 2024
Published date: 12 March 2024
Additional Information: Publisher Copyright: © The Author(s) 2024.

Identifiers

Local EPrints ID: 488239
URI: http://eprints.soton.ac.uk/id/eprint/488239
ISSN: 2398-6352
PURE UUID: dd8ee304-bd6e-496d-b16c-2fe7254b6844
ORCID for Christopher Duckworth: ORCID iD orcid.org/0000-0003-0659-2177
ORCID for Brian Pickering: ORCID iD orcid.org/0000-0002-6815-2938
ORCID for Ben Ainsworth: ORCID iD orcid.org/0000-0002-5098-1092
ORCID for Michael j. Boniface: ORCID iD orcid.org/0000-0002-9281-6095

Catalogue record

Date deposited: 19 Mar 2024 17:35
Last modified: 02 May 2024 01:58

Export record

Altmetrics

Contributors

Author: Christopher Duckworth ORCID iD
Author: Bethany Cliffe
Author: Brian Pickering ORCID iD
Author: Ben Ainsworth ORCID iD
Author: Alison Blythin
Author: Adam Kirk
Corporate Author: et al.

Download statistics

Downloads from ePrints over the past year. Other digital versions may also be available to download e.g. from the publisher's website.

View more statistics

Atom RSS 1.0 RSS 2.0

Contact ePrints Soton: eprints@soton.ac.uk

ePrints Soton supports OAI 2.0 with a base URL of http://eprints.soton.ac.uk/cgi/oai2

This repository has been built using EPrints software, developed at the University of Southampton, but available to everyone to use.

We use cookies to ensure that we give you the best experience on our website. If you continue without changing your settings, we will assume that you are happy to receive cookies on the University of Southampton website.

×