Who benefits from using Intelligent Tutoring Systems, and how much use is optimal? Examining the effects of school socioeconomic status and Intelligent Tutoring System use on student mathematics learning outcomes in Australian high schools
Who benefits from using Intelligent Tutoring Systems, and how much use is optimal? Examining the effects of school socioeconomic status and Intelligent Tutoring System use on student mathematics learning outcomes in Australian high schools
Intelligent Tutoring Systems (ITS) show promise for improving student outcomes, but their effectiveness may vary by school socioeconomic status (SES). This study asks who benefits from ITS platforms and how much use is optimal. Using learning analytics from an Australian mathematics ITS with 7,147 Year 7 students across 500 classes and 127 schools, we examined how internal ITS achievement scores relate to external standardised assessments (NAPLAN), and how these relationships shift with school SES and ITS usage. We first tested a Conditional Mediation Structural Equation Model of direct, indirect, and interaction effects among school SES, student ITS usage, and class-level outcomes, then estimated a Mixture Model with piecewise splines across known-class SES quartiles to capture non-linear usage effects. Across both analyses, student ITS achievement scores were positively associated with NAPLAN outcomes, but the strength of this relationship depended on school SES and student ITS usage intensity. Specifically, lower SES schools reached a point of diminishing returns in their usage of the ITS platform, far sooner than their high SES counterparts. These findings highlight two key contributions: first, that the benefits of ITS may not be uniform, but rather depend on who is using the platform; and second, that there are practical limits to how much ITS use may be beneficial.
Digital Divide, Educational Equality, Intelligent Tutoring Systems, Learning Analytics
11-21
Association for Computing Machinery
Hannan, Brody
e6b40a0e-ac22-4fbd-ba51-1fc844e73e76
Bokhove, Christian
7fc17e5b-9a94-48f3-a387-2ccf60d2d5d8
26 April 2026
Hannan, Brody
e6b40a0e-ac22-4fbd-ba51-1fc844e73e76
Bokhove, Christian
7fc17e5b-9a94-48f3-a387-2ccf60d2d5d8
Hannan, Brody and Bokhove, Christian
(2026)
Who benefits from using Intelligent Tutoring Systems, and how much use is optimal? Examining the effects of school socioeconomic status and Intelligent Tutoring System use on student mathematics learning outcomes in Australian high schools.
In LAK '26: Proceedings of the LAK26: 16th International Learning Analytics and Knowledge Conference.
Association for Computing Machinery.
.
(doi:10.1145/3785022.3785024).
Record type:
Conference or Workshop Item
(Paper)
Abstract
Intelligent Tutoring Systems (ITS) show promise for improving student outcomes, but their effectiveness may vary by school socioeconomic status (SES). This study asks who benefits from ITS platforms and how much use is optimal. Using learning analytics from an Australian mathematics ITS with 7,147 Year 7 students across 500 classes and 127 schools, we examined how internal ITS achievement scores relate to external standardised assessments (NAPLAN), and how these relationships shift with school SES and ITS usage. We first tested a Conditional Mediation Structural Equation Model of direct, indirect, and interaction effects among school SES, student ITS usage, and class-level outcomes, then estimated a Mixture Model with piecewise splines across known-class SES quartiles to capture non-linear usage effects. Across both analyses, student ITS achievement scores were positively associated with NAPLAN outcomes, but the strength of this relationship depended on school SES and student ITS usage intensity. Specifically, lower SES schools reached a point of diminishing returns in their usage of the ITS platform, far sooner than their high SES counterparts. These findings highlight two key contributions: first, that the benefits of ITS may not be uniform, but rather depend on who is using the platform; and second, that there are practical limits to how much ITS use may be beneficial.
Text
3785022.3785024
- Version of Record
More information
Published date: 26 April 2026
Venue - Dates:
The Sixteenth International Conference on Learning Analytics & Knowledge, , Bergen, Norway, 2026-04-27 - 2026-05-01
Keywords:
Digital Divide, Educational Equality, Intelligent Tutoring Systems, Learning Analytics
Identifiers
Local EPrints ID: 512214
URI: https://eprints.soton.ac.uk/id/eprint/512214
PURE UUID: 828e6aeb-b0cd-411f-9458-e7a6b9aa289c
Catalogue record
Date deposited: 19 Jun 2026 16:47
Last modified: 13 Sep 2026 15:49
Export record
Altmetrics
Contributors
Author:
Brody Hannan
Download statistics
Downloads from ePrints over the past year. Other digital versions may also be available to download e.g. from the publisher's website.
View more statistics