The University of Southampton
University of Southampton Institutional Repository

Closing the gap Between experts and novices using analytics-as-a-service: An experimental study

Closing the gap Between experts and novices using analytics-as-a-service: An experimental study
Closing the gap Between experts and novices using analytics-as-a-service: An experimental study
Generating insights and value from data has become an important asset for organizations. At the same time, the need for experts in analytics is increasing and the number of analytics applications is growing. Recently, a new trend has emerged, i.e. analytics-as-a-service platforms, that makes it easier to apply analytics both for novice and expert users. In this study, the authors approach these new services by conducting a full-factorial experiment where both inexperienced and experienced users take on an analytics task with an analytics-as-a-service technology. The research proves that although experts in analytics still significantly outperform novices, these web-based platforms do offer an advantage to inexperienced users. Furthermore, the authors find that analytics-as-a-service does not offer the same benefits across different analytics tasks. That is, they observe better performance for supervised analytics tasks. Moreover, this study indicates that there are significant differences between novices. The most important distinction lies in the approach they take on the task. Novices who follow a more complex, although structured, workflow behave more similarly to experts and, thus, also perform better. The findings can aid managers in their hiring and training strategy with regards to both business users and data scientists. Moreover, it can guide managers in the development of an enterprise-wide analytics culture. Finally, the results can inform vendors about the design and development of these platforms.
2363-7005
Lismont, Jasmien
ae828817-8188-4686-89b3-2438fa3ee3aa
Van Calster, Tine
a3f3c605-89ad-4938-856e-c1fdb939a1b6
Óskarsdóttir, María
1622b6dd-5d25-4228-9418-a1729e9577e0
Vanden Broucke, Seppe
89c69367-232e-4c1e-9e57-531bf474e12d
Baesens, Bart
f7c6496b-aa7f-4026-8616-ca61d9e216f0
Lemahieu, Wilfried
be4bae3f-12b9-417a-91a1-c3c264ffe068
Vanthienen, Jan
6f3d818f-0fce-46fa-966b-160e645caf6d
Lismont, Jasmien
ae828817-8188-4686-89b3-2438fa3ee3aa
Van Calster, Tine
a3f3c605-89ad-4938-856e-c1fdb939a1b6
Óskarsdóttir, María
1622b6dd-5d25-4228-9418-a1729e9577e0
Vanden Broucke, Seppe
89c69367-232e-4c1e-9e57-531bf474e12d
Baesens, Bart
f7c6496b-aa7f-4026-8616-ca61d9e216f0
Lemahieu, Wilfried
be4bae3f-12b9-417a-91a1-c3c264ffe068
Vanthienen, Jan
6f3d818f-0fce-46fa-966b-160e645caf6d

Lismont, Jasmien, Van Calster, Tine, Óskarsdóttir, María, Vanden Broucke, Seppe, Baesens, Bart, Lemahieu, Wilfried and Vanthienen, Jan (2018) Closing the gap Between experts and novices using analytics-as-a-service: An experimental study. Business & Information Systems Engineering. (doi:10.1007/s12599-018-0539-z).

Record type: Article

Abstract

Generating insights and value from data has become an important asset for organizations. At the same time, the need for experts in analytics is increasing and the number of analytics applications is growing. Recently, a new trend has emerged, i.e. analytics-as-a-service platforms, that makes it easier to apply analytics both for novice and expert users. In this study, the authors approach these new services by conducting a full-factorial experiment where both inexperienced and experienced users take on an analytics task with an analytics-as-a-service technology. The research proves that although experts in analytics still significantly outperform novices, these web-based platforms do offer an advantage to inexperienced users. Furthermore, the authors find that analytics-as-a-service does not offer the same benefits across different analytics tasks. That is, they observe better performance for supervised analytics tasks. Moreover, this study indicates that there are significant differences between novices. The most important distinction lies in the approach they take on the task. Novices who follow a more complex, although structured, workflow behave more similarly to experts and, thus, also perform better. The findings can aid managers in their hiring and training strategy with regards to both business users and data scientists. Moreover, it can guide managers in the development of an enterprise-wide analytics culture. Finally, the results can inform vendors about the design and development of these platforms.

This record has no associated files available for download.

More information

Accepted/In Press date: 22 February 2018
e-pub ahead of print date: 3 May 2018
Published date: 3 May 2018

Identifiers

Local EPrints ID: 425578
URI: http://eprints.soton.ac.uk/id/eprint/425578
ISSN: 2363-7005
PURE UUID: a66a8840-a186-4bd2-a854-5506c1f6462e
ORCID for Bart Baesens: ORCID iD orcid.org/0000-0002-5831-5668

Catalogue record

Date deposited: 25 Oct 2018 16:30
Last modified: 08 Jan 2022 03:00

Export record

Altmetrics

Contributors

Author: Jasmien Lismont
Author: Tine Van Calster
Author: María Óskarsdóttir
Author: Seppe Vanden Broucke
Author: Bart Baesens ORCID iD
Author: Wilfried Lemahieu
Author: Jan Vanthienen

Download statistics

Downloads from ePrints over the past year. Other digital versions may also be available to download e.g. from the publisher's website.

View more statistics

Atom RSS 1.0 RSS 2.0

Contact ePrints Soton: eprints@soton.ac.uk

ePrints Soton supports OAI 2.0 with a base URL of http://eprints.soton.ac.uk/cgi/oai2

This repository has been built using EPrints software, developed at the University of Southampton, but available to everyone to use.

We use cookies to ensure that we give you the best experience on our website. If you continue without changing your settings, we will assume that you are happy to receive cookies on the University of Southampton website.

×