Accelerating online learning: Machine learning insights into the importance of cumulative experience, independence, and country setting
Accelerating online learning: Machine learning insights into the importance of cumulative experience, independence, and country setting
Cumulative experience is important for developing expertise through in-person learning, along with country setting and gender, but evidence is limited the role of these features in online learning. Yet, COVID-19 has catalysed the centrality of online learning, such that the efficacy of online learning is now highly relevant. Although the Pandemic triggered a surge of self-report and literature review research on stakeholder perceptions of online learning, less educational research has used big data to understand online learning. Therefore, the present research mined online learning data to identify features that are important for developing expertise in online learning. Data mining of 54,842,787 initial data points from one online learning platform was conducted by partnering theory with data in model development. Following examination of a theory-led machine learning model, a data-led approach was taken to reach a final model. The linear regression model was regularised with the Lasso penalty to enable data-driven feature selection. Twenty-six features were selected to form an extreme gradient boosting model that underwent hyper-parameter tuning. All cross-validation adopted the grid search approach. The final model was used to derive Shapley values for feature importance. As expected, cumulative experience, country differences, low-and-middle-income country status, and COVID-19 were important features for developing expertise through online learning. The data-led model development resulted in additional insights not examined in the initial, theory-led model: namely, the importance of meta-cognition and independent learner behaviour. Surprisingly, no male advantage was found in the potential for expertise development through online learning.
COVID-19, Country comparison, Developing expertise, Machine learning, Online learning
McIntyre, Nora
c9a9ecfb-10a7-4f59-b1f5-652f9db2f28f
10 November 2022
McIntyre, Nora
c9a9ecfb-10a7-4f59-b1f5-652f9db2f28f
McIntyre, Nora
(2022)
Accelerating online learning: Machine learning insights into the importance of cumulative experience, independence, and country setting.
Computers and Education: Artificial Intelligence, 3, [100106].
(doi:10.1016/j.caeai.2022.100106).
Abstract
Cumulative experience is important for developing expertise through in-person learning, along with country setting and gender, but evidence is limited the role of these features in online learning. Yet, COVID-19 has catalysed the centrality of online learning, such that the efficacy of online learning is now highly relevant. Although the Pandemic triggered a surge of self-report and literature review research on stakeholder perceptions of online learning, less educational research has used big data to understand online learning. Therefore, the present research mined online learning data to identify features that are important for developing expertise in online learning. Data mining of 54,842,787 initial data points from one online learning platform was conducted by partnering theory with data in model development. Following examination of a theory-led machine learning model, a data-led approach was taken to reach a final model. The linear regression model was regularised with the Lasso penalty to enable data-driven feature selection. Twenty-six features were selected to form an extreme gradient boosting model that underwent hyper-parameter tuning. All cross-validation adopted the grid search approach. The final model was used to derive Shapley values for feature importance. As expected, cumulative experience, country differences, low-and-middle-income country status, and COVID-19 were important features for developing expertise through online learning. The data-led model development resulted in additional insights not examined in the initial, theory-led model: namely, the importance of meta-cognition and independent learner behaviour. Surprisingly, no male advantage was found in the potential for expertise development through online learning.
Text
1-s2.0-S2666920X22000613-main
- Version of Record
More information
Accepted/In Press date: 1 November 2022
e-pub ahead of print date: 10 November 2022
Published date: 10 November 2022
Additional Information:
Funding Information:
Special thanks to Chun Pong Lau and Junaid Mubeen from Whizz Education for the continued support with obtaining the data necessary to conduct the present analyses. Part of the present research was conducted whilst the author was employed by the EdTech Hub with funding from the Foreign, Commonwealth and Development Office, UK.
Publisher Copyright:
© 2022
Keywords:
COVID-19, Country comparison, Developing expertise, Machine learning, Online learning
Identifiers
Local EPrints ID: 471537
URI: http://eprints.soton.ac.uk/id/eprint/471537
ISSN: 2666-920X
PURE UUID: bcd2e90e-b3e2-42e8-ada2-4b0e9e91ff34
Catalogue record
Date deposited: 10 Nov 2022 17:35
Last modified: 17 Mar 2024 04:07
Export record
Altmetrics
Download statistics
Downloads from ePrints over the past year. Other digital versions may also be available to download e.g. from the publisher's website.
View more statistics
