Characterising user engagement with mHealth for chronic disease self-management and impact on machine learning performance
Characterising user engagement with mHealth for chronic disease self-management and impact on machine learning performance
Mobile Health (mHealth) has the potential to be transformative in the management of chronic conditions. Machine learning can leverage self-reported data collected with apps to predict periods of increased health risk, alert users, and signpost interventions. Despite this, mHealth must balance the treatment burden of frequent self-reporting and predictive performance and safety. Here we report how user engagement with a widely used and clinically validated mHealth app, myCOPD (designed for the self-management of Chronic Obstructive Pulmonary Disease), directly impacts the performance of a machine learning model predicting an acute worsening of condition (i.e., exacerbations). We classify how users typically engage with myCOPD, finding that 60.3% of users engage frequently, however, less frequent users can show transitional engagement (18.4%), becoming more engaged immediately (< 21 days) before exacerbating. Machine learning performed better for users who engaged the most, however, this performance decrease can be mostly offset for less frequent users who engage more near exacerbation. We conduct interviews and focus groups with myCOPD users, highlighting digital diaries and disease acuity as key factors for engagement. Users of mHealth can feel overburdened when self-reporting data necessary for predictive modelling and confidence of recognising exacerbations is a significant barrier to accurate self-reported data. We demonstrate that users of mHealth should be encouraged to engage when they notice changes to their condition (rather than clinically defined symptoms) to achieve data that is still predictive for machine learning, while reducing the likelihood of disengagement through desensitisation.
Duckworth, Christopher
992c216c-8f66-48a8-8de6-2f04b4f736e6
Cliffe, Bethany
dff693df-9697-4446-aebc-66c3bcfea632
Pickering, Brian
225088d0-729e-4f17-afe2-1ad1193ccae6
Ainsworth, Ben
b02d78c3-aa8b-462d-a534-31f1bf164f81
Blythin, Alison
62fddce4-e5e4-4a28-81fc-3aee38e89fdb
Kirk, Adam
9c1e0bbe-06c2-4da9-aa19-e36b7a4d7f0f
Wilkinson, Thomas M.A.
8c55ebbb-e547-445c-95a1-c8bed02dd652
Boniface, Michael j.
f30bfd7d-20ed-451b-b405-34e3e22fdfba
12 March 2024
Duckworth, Christopher
992c216c-8f66-48a8-8de6-2f04b4f736e6
Cliffe, Bethany
dff693df-9697-4446-aebc-66c3bcfea632
Pickering, Brian
225088d0-729e-4f17-afe2-1ad1193ccae6
Ainsworth, Ben
b02d78c3-aa8b-462d-a534-31f1bf164f81
Blythin, Alison
62fddce4-e5e4-4a28-81fc-3aee38e89fdb
Kirk, Adam
9c1e0bbe-06c2-4da9-aa19-e36b7a4d7f0f
Wilkinson, Thomas M.A.
8c55ebbb-e547-445c-95a1-c8bed02dd652
Boniface, Michael j.
f30bfd7d-20ed-451b-b405-34e3e22fdfba
Duckworth, Christopher, Cliffe, Bethany and Pickering, Brian
,
et al.
(2024)
Characterising user engagement with mHealth for chronic disease self-management and impact on machine learning performance.
npj Digital Medicine, 7 (1), [66].
(doi:10.1038/s41746-024-01063-2).
Abstract
Mobile Health (mHealth) has the potential to be transformative in the management of chronic conditions. Machine learning can leverage self-reported data collected with apps to predict periods of increased health risk, alert users, and signpost interventions. Despite this, mHealth must balance the treatment burden of frequent self-reporting and predictive performance and safety. Here we report how user engagement with a widely used and clinically validated mHealth app, myCOPD (designed for the self-management of Chronic Obstructive Pulmonary Disease), directly impacts the performance of a machine learning model predicting an acute worsening of condition (i.e., exacerbations). We classify how users typically engage with myCOPD, finding that 60.3% of users engage frequently, however, less frequent users can show transitional engagement (18.4%), becoming more engaged immediately (< 21 days) before exacerbating. Machine learning performed better for users who engaged the most, however, this performance decrease can be mostly offset for less frequent users who engage more near exacerbation. We conduct interviews and focus groups with myCOPD users, highlighting digital diaries and disease acuity as key factors for engagement. Users of mHealth can feel overburdened when self-reporting data necessary for predictive modelling and confidence of recognising exacerbations is a significant barrier to accurate self-reported data. We demonstrate that users of mHealth should be encouraged to engage when they notice changes to their condition (rather than clinically defined symptoms) to achieve data that is still predictive for machine learning, while reducing the likelihood of disengagement through desensitisation.
Text
s41746-024-01063-2
- Version of Record
More information
Accepted/In Press date: 22 February 2024
e-pub ahead of print date: 12 March 2024
Published date: 12 March 2024
Additional Information:
Publisher Copyright:
© The Author(s) 2024.
Identifiers
Local EPrints ID: 488239
URI: http://eprints.soton.ac.uk/id/eprint/488239
ISSN: 2398-6352
PURE UUID: dd8ee304-bd6e-496d-b16c-2fe7254b6844
Catalogue record
Date deposited: 19 Mar 2024 17:35
Last modified: 02 May 2024 01:58
Export record
Altmetrics
Contributors
Author:
Christopher Duckworth
Author:
Bethany Cliffe
Author:
Ben Ainsworth
Author:
Alison Blythin
Author:
Adam Kirk
Corporate Author: et al.
Download statistics
Downloads from ePrints over the past year. Other digital versions may also be available to download e.g. from the publisher's website.
View more statistics