The University of Southampton
University of Southampton Institutional Repository

A framework for Analyzing and Measuring Usage and Engagement Data (AMUsED) in digital interventions: viewpoint

A framework for Analyzing and Measuring Usage and Engagement Data (AMUsED) in digital interventions: viewpoint
A framework for Analyzing and Measuring Usage and Engagement Data (AMUsED) in digital interventions: viewpoint
Trials of digital interventions can yield extensive, in-depth usage data, yet usage analyses tend to focus on broad descriptive summaries of how an intervention has been used by the whole sample. This paper proposes a novel framework to guide systematic, fine-grained usage analyses that better enables understanding of how an intervention works, when, and for whom. The framework comprises three stages to assist in the following: (1) familiarization with the intervention and its relationship to the captured data, (2) identification of meaningful measures of usage and specifying research questions to guide systematic analyses of usage data, and (3) preparation of datasheets and consideration of available analytical methods with which to examine the data. The framework can be applied to inform data capture during the development of a digital intervention and/or in the analysis of data after the completion of an evaluation trial. We will demonstrate how the framework shaped preparation and aided efficient data capture for a digital intervention to lower transmission of cold and flu viruses in the home, as well as how it informed a systematic, in-depth analysis of usage data collected from a separate digital intervention designed to promote self-management of colds and flu. The Analyzing and Measuring Usage and Engagement Data (AMUsED) framework guides systematic and efficient in-depth usage analyses that will support standardized reporting with transparent and replicable findings. These detailed findings may also enable examination of what constitutes effective engagement with particular interventions.
behavioral research, Internet, Health, patient engagement, Data analysis
1438-8871
1-13
Miller, Sascha
b1c434a6-041c-4771-8ed2-3d050eec6e5f
Ainsworth, Ben
b02d78c3-aa8b-462d-a534-31f1bf164f81
Yardley, Lucy
64be42c4-511d-484d-abaa-f8813452a22e
Milton, Alex
3516eab3-b72f-4b0d-ad30-560f57c94f0d
Weal, Mark
e8fd30a6-c060-41c5-b388-ca52c81032a4
Smith, Peter W.F.
961a01a3-bf4c-43ca-9599-5be4fd5d3940
Morrison, Leanne
920a4eda-0f9d-4bd9-842d-6873b1afafef
Miller, Sascha
b1c434a6-041c-4771-8ed2-3d050eec6e5f
Ainsworth, Ben
b02d78c3-aa8b-462d-a534-31f1bf164f81
Yardley, Lucy
64be42c4-511d-484d-abaa-f8813452a22e
Milton, Alex
3516eab3-b72f-4b0d-ad30-560f57c94f0d
Weal, Mark
e8fd30a6-c060-41c5-b388-ca52c81032a4
Smith, Peter W.F.
961a01a3-bf4c-43ca-9599-5be4fd5d3940
Morrison, Leanne
920a4eda-0f9d-4bd9-842d-6873b1afafef

Miller, Sascha, Ainsworth, Ben, Yardley, Lucy, Milton, Alex, Weal, Mark, Smith, Peter W.F. and Morrison, Leanne (2019) A framework for Analyzing and Measuring Usage and Engagement Data (AMUsED) in digital interventions: viewpoint. Journal of Medical Internet Research, 21 (2), 1-13. (doi:10.2196/10966).

Record type: Article

Abstract

Trials of digital interventions can yield extensive, in-depth usage data, yet usage analyses tend to focus on broad descriptive summaries of how an intervention has been used by the whole sample. This paper proposes a novel framework to guide systematic, fine-grained usage analyses that better enables understanding of how an intervention works, when, and for whom. The framework comprises three stages to assist in the following: (1) familiarization with the intervention and its relationship to the captured data, (2) identification of meaningful measures of usage and specifying research questions to guide systematic analyses of usage data, and (3) preparation of datasheets and consideration of available analytical methods with which to examine the data. The framework can be applied to inform data capture during the development of a digital intervention and/or in the analysis of data after the completion of an evaluation trial. We will demonstrate how the framework shaped preparation and aided efficient data capture for a digital intervention to lower transmission of cold and flu viruses in the home, as well as how it informed a systematic, in-depth analysis of usage data collected from a separate digital intervention designed to promote self-management of colds and flu. The Analyzing and Measuring Usage and Engagement Data (AMUsED) framework guides systematic and efficient in-depth usage analyses that will support standardized reporting with transparent and replicable findings. These detailed findings may also enable examination of what constitutes effective engagement with particular interventions.

Text
10966 Resubmission AMUsED Framework with Authors - Accepted Manuscript
Download (72kB)

More information

Accepted/In Press date: 30 October 2018
e-pub ahead of print date: 8 February 2019
Keywords: behavioral research, Internet, Health, patient engagement, Data analysis

Identifiers

Local EPrints ID: 426742
URI: https://eprints.soton.ac.uk/id/eprint/426742
ISSN: 1438-8871
PURE UUID: ffe5fb27-0e7e-429b-9d99-0cee9a2a1018
ORCID for Ben Ainsworth: ORCID iD orcid.org/0000-0002-5098-1092
ORCID for Mark Weal: ORCID iD orcid.org/0000-0001-6251-8786
ORCID for Peter W.F. Smith: ORCID iD orcid.org/0000-0003-4423-5410
ORCID for Leanne Morrison: ORCID iD orcid.org/0000-0002-9961-551X

Catalogue record

Date deposited: 11 Dec 2018 17:30
Last modified: 14 Mar 2019 05:01

Export record

Altmetrics

Download statistics

Downloads from ePrints over the past year. Other digital versions may also be available to download e.g. from the publisher's website.

View more statistics

Atom RSS 1.0 RSS 2.0

Contact ePrints Soton: eprints@soton.ac.uk

ePrints Soton supports OAI 2.0 with a base URL of https://eprints.soton.ac.uk/cgi/oai2

This repository has been built using EPrints software, developed at the University of Southampton, but available to everyone to use.

We use cookies to ensure that we give you the best experience on our website. If you continue without changing your settings, we will assume that you are happy to receive cookies on the University of Southampton website.

×