The University of Southampton
University of Southampton Institutional Repository

The effectiveness of fully automated digital interventions to promote mental well-being in the general population: A systematic review and meta-analysis

The effectiveness of fully automated digital interventions to promote mental well-being in the general population: A systematic review and meta-analysis
The effectiveness of fully automated digital interventions to promote mental well-being in the general population: A systematic review and meta-analysis

Background: Recent years have highlighted an increasing need to promote mental well-being in the general population. This has led to a rapidly growing market for fully automated digital mental well-being tools. Although many individuals have started using these tools in their daily lives, evidence on the overall effectiveness of digital mental well-being tools is currently lacking. Objective: This study aims to review the evidence on the effectiveness of fully automated digital interventions in promoting mental well-being in the general population. Methods: Following the preregistration of the systematic review protocol on PROSPERO, searches were carried out in MEDLINE, Web of Science, Cochrane, PsycINFO, PsycEXTRA, Scopus, and ACM Digital (initial searches in February 2022; updated in October 2022). Studies were included if they contained a general population sample and a fully automated digital intervention that exclusively used psychological mental well-being promotion activities. Two reviewers, blinded to each other’s decisions, conducted data selection, extraction, and quality assessment of the included studies. Narrative synthesis and a random-effects model of per-protocol data were adopted. Results: We included 19 studies that involved 7243 participants. These studies included 24 fully automated digital mental well-being interventions, of which 15 (63%) were included in the meta-analysis. Compared with no intervention, there was a significant small effect of fully automated digital mental well-being interventions on mental well-being in the general population (standardized mean difference 0.19, 95% CI 0.04-0.33; P=.02). Specifically, mindfulness-, acceptance-, commitment-, and compassion-based interventions significantly promoted mental well-being in the general population (P=.006); insufficient evidence was available for positive psychology and cognitive behavioral therapy–based interventions; and contraindications were found for integrative approaches. Overall, there was substantial heterogeneity, which could be partially explained by the intervention duration, comparator, and study outcomes. The risk of bias was high, and confidence in the quality of the evidence was very low (Grading of Recommendations, Assessment, Development, and Evaluations), primarily because of the high rates of study dropout (average 37%; range 0%-85%) and suboptimal intervention adherence (average 40%). Conclusions: This study provides a novel contribution to knowledge regarding the effectiveness, strengths, and weaknesses of fully automated digital mental well-being interventions in the general population. Future research and practice should consider these findings when developing fully automated digital mental well-being tools. In addition, research should aim to investigate positive psychology and cognitive behavioral therapy–based tools as well as develop further strategies to improve adherence and reduce dropout in fully automated digital mental well-being interventions. Finally, it should aim to understand when and for whom these interventions are particularly beneficial.

apps, digital, intervention, mental well-being, mobile phone, promotion, web-based
2368-7959
Groot, Julia
cc29dc97-a3aa-4036-a46a-a913828f2962
MacLellan, Alexander
7b231c9a-089a-44b6-9635-4c8d6a2dc290
Butler, Madeleine
4d630bc1-f04d-414a-99dc-a7fa1c2576d9
Todor, Elisa
56b9afdd-db88-4902-9921-e3f172826ca1
Zulfiqar, Mahnoor
19c433b7-fdfd-4d98-ae0f-e743f2678eb8
Thackrah, Tim
fcecbc35-0b5c-49a9-8260-43a32598328b
Clarke, Christopher
8e2db51d-c2a2-4a3c-abd3-a00657e3aecb
Brosnan, Mark
752fa25f-332e-47d4-9f9f-76862509e2cb
Ainsworth, Ben
b02d78c3-aa8b-462d-a534-31f1bf164f81
Groot, Julia
cc29dc97-a3aa-4036-a46a-a913828f2962
MacLellan, Alexander
7b231c9a-089a-44b6-9635-4c8d6a2dc290
Butler, Madeleine
4d630bc1-f04d-414a-99dc-a7fa1c2576d9
Todor, Elisa
56b9afdd-db88-4902-9921-e3f172826ca1
Zulfiqar, Mahnoor
19c433b7-fdfd-4d98-ae0f-e743f2678eb8
Thackrah, Tim
fcecbc35-0b5c-49a9-8260-43a32598328b
Clarke, Christopher
8e2db51d-c2a2-4a3c-abd3-a00657e3aecb
Brosnan, Mark
752fa25f-332e-47d4-9f9f-76862509e2cb
Ainsworth, Ben
b02d78c3-aa8b-462d-a534-31f1bf164f81

Groot, Julia, MacLellan, Alexander, Butler, Madeleine, Todor, Elisa, Zulfiqar, Mahnoor, Thackrah, Tim, Clarke, Christopher, Brosnan, Mark and Ainsworth, Ben (2023) The effectiveness of fully automated digital interventions to promote mental well-being in the general population: A systematic review and meta-analysis. JMIR Mental Health, 10 (1), [e44658]. (doi:10.2196/44658).

Record type: Article

Abstract

Background: Recent years have highlighted an increasing need to promote mental well-being in the general population. This has led to a rapidly growing market for fully automated digital mental well-being tools. Although many individuals have started using these tools in their daily lives, evidence on the overall effectiveness of digital mental well-being tools is currently lacking. Objective: This study aims to review the evidence on the effectiveness of fully automated digital interventions in promoting mental well-being in the general population. Methods: Following the preregistration of the systematic review protocol on PROSPERO, searches were carried out in MEDLINE, Web of Science, Cochrane, PsycINFO, PsycEXTRA, Scopus, and ACM Digital (initial searches in February 2022; updated in October 2022). Studies were included if they contained a general population sample and a fully automated digital intervention that exclusively used psychological mental well-being promotion activities. Two reviewers, blinded to each other’s decisions, conducted data selection, extraction, and quality assessment of the included studies. Narrative synthesis and a random-effects model of per-protocol data were adopted. Results: We included 19 studies that involved 7243 participants. These studies included 24 fully automated digital mental well-being interventions, of which 15 (63%) were included in the meta-analysis. Compared with no intervention, there was a significant small effect of fully automated digital mental well-being interventions on mental well-being in the general population (standardized mean difference 0.19, 95% CI 0.04-0.33; P=.02). Specifically, mindfulness-, acceptance-, commitment-, and compassion-based interventions significantly promoted mental well-being in the general population (P=.006); insufficient evidence was available for positive psychology and cognitive behavioral therapy–based interventions; and contraindications were found for integrative approaches. Overall, there was substantial heterogeneity, which could be partially explained by the intervention duration, comparator, and study outcomes. The risk of bias was high, and confidence in the quality of the evidence was very low (Grading of Recommendations, Assessment, Development, and Evaluations), primarily because of the high rates of study dropout (average 37%; range 0%-85%) and suboptimal intervention adherence (average 40%). Conclusions: This study provides a novel contribution to knowledge regarding the effectiveness, strengths, and weaknesses of fully automated digital mental well-being interventions in the general population. Future research and practice should consider these findings when developing fully automated digital mental well-being tools. In addition, research should aim to investigate positive psychology and cognitive behavioral therapy–based tools as well as develop further strategies to improve adherence and reduce dropout in fully automated digital mental well-being interventions. Finally, it should aim to understand when and for whom these interventions are particularly beneficial.

Text
preprint-44658-accepted - Author's Original
Restricted to Repository staff only
Request a copy
Text
Revised Ms - Accepted Manuscript
Available under License Creative Commons Attribution.
Download (234kB)

More information

Accepted/In Press date: 7 July 2023
Published date: 19 October 2023
Additional Information: Funding Information: The authors are grateful for the support of the librarians at the University of Bath and advice from Emma Fisher in conducting the meta-analysis. This work was supported by the Economic and Social Research Council (grant 2572559) and Cyberlimbic Systems Ltd. Funding Information: JG received partial funding for this research project from Cyberlimbic Systems Ltd. TT is the chief executive officer and cofounder of Cyberlimbic Systems Ltd. BA received funding from the National Institute of Health Research and the UK Research and Innovation on the topic of digital health interventions. BA also sits on the scientific advisory board of the Medito Foundation and earGym. The remaining authors have no conflicts of interest to declare. Publisher Copyright: © 2023 JMIR Publications Inc.. All rights reserved.
Keywords: apps, digital, intervention, mental well-being, mobile phone, promotion, web-based

Identifiers

Local EPrints ID: 479030
URI: http://eprints.soton.ac.uk/id/eprint/479030
ISSN: 2368-7959
PURE UUID: fe731eac-88a4-45db-b2bc-972cd0f76cbe
ORCID for Ben Ainsworth: ORCID iD orcid.org/0000-0002-5098-1092

Catalogue record

Date deposited: 18 Jul 2023 16:57
Last modified: 18 Mar 2024 03:13

Export record

Altmetrics

Contributors

Author: Julia Groot
Author: Alexander MacLellan
Author: Madeleine Butler
Author: Elisa Todor
Author: Mahnoor Zulfiqar
Author: Tim Thackrah
Author: Christopher Clarke
Author: Mark Brosnan
Author: Ben Ainsworth ORCID iD

Download statistics

Downloads from ePrints over the past year. Other digital versions may also be available to download e.g. from the publisher's website.

View more statistics

Atom RSS 1.0 RSS 2.0

Contact ePrints Soton: eprints@soton.ac.uk

ePrints Soton supports OAI 2.0 with a base URL of http://eprints.soton.ac.uk/cgi/oai2

This repository has been built using EPrints software, developed at the University of Southampton, but available to everyone to use.

We use cookies to ensure that we give you the best experience on our website. If you continue without changing your settings, we will assume that you are happy to receive cookies on the University of Southampton website.

×