The University of Southampton
University of Southampton Institutional Repository

LBKT: a LSTM BERT-based knowledge tracing model for long-sequence data

LBKT: a LSTM BERT-based knowledge tracing model for long-sequence data
LBKT: a LSTM BERT-based knowledge tracing model for long-sequence data
The field of Knowledge Tracing (KT) aims to understand how students learn and master knowledge over time by analyzing their historical behaviour data. To achieve this goal, many researchers have proposed KT models that use data from Intelligent Tutoring Systems (ITS) to predict students' subsequent actions. However, with the development of ITS, large-scale datasets containing long-sequence data began to emerge. Recent deep learning based KT models face obstacles such as low efficiency, low accuracy, and low interpretability when dealing with large-scale datasets containing long-sequence data. To address these issues and promote the sustainable development of ITS, we propose a LSTM BERT-based Knowledge Tracing model for long sequence data processing, namely LBKT, which uses a BERT-based architecture with a Rasch model-based embeddings block to deal with different difficulty levels information and an LSTM block to process the sequential characteristic in students' actions. LBKT achieves the best performance on most benchmark datasets on the metrics of ACC and AUC.
Li, Zhaoxing
65935c45-a640-496c-98b8-43bed39e1850
Yang, Jujie
568355cd-4787-4876-8d54-c1b45d7b9e4b
Wang, Jindi
a5af917b-2ac6-4173-8435-c08963dc7ed7
Shi, Lei
3e73da43-5e7e-4544-a327-9de0046edfa2
Feng, Jiayi
2c955d5e-0116-49ff-8b7f-e56d9412e6a3
Stein, Sebastian
cb2325e7-5e63-475e-8a69-9db2dfbdb00b
Li, Zhaoxing
65935c45-a640-496c-98b8-43bed39e1850
Yang, Jujie
568355cd-4787-4876-8d54-c1b45d7b9e4b
Wang, Jindi
a5af917b-2ac6-4173-8435-c08963dc7ed7
Shi, Lei
3e73da43-5e7e-4544-a327-9de0046edfa2
Feng, Jiayi
2c955d5e-0116-49ff-8b7f-e56d9412e6a3
Stein, Sebastian
cb2325e7-5e63-475e-8a69-9db2dfbdb00b

Li, Zhaoxing, Yang, Jujie, Wang, Jindi, Shi, Lei, Feng, Jiayi and Stein, Sebastian (2024) LBKT: a LSTM BERT-based knowledge tracing model for long-sequence data. 20th International Conference on Intelligent Tutoring Systems: Generative Intelligence and ITS, War Museum, Thessaloniki, Greece. 10 - 13 Jun 2024. 10 pp .

Record type: Conference or Workshop Item (Paper)

Abstract

The field of Knowledge Tracing (KT) aims to understand how students learn and master knowledge over time by analyzing their historical behaviour data. To achieve this goal, many researchers have proposed KT models that use data from Intelligent Tutoring Systems (ITS) to predict students' subsequent actions. However, with the development of ITS, large-scale datasets containing long-sequence data began to emerge. Recent deep learning based KT models face obstacles such as low efficiency, low accuracy, and low interpretability when dealing with large-scale datasets containing long-sequence data. To address these issues and promote the sustainable development of ITS, we propose a LSTM BERT-based Knowledge Tracing model for long sequence data processing, namely LBKT, which uses a BERT-based architecture with a Rasch model-based embeddings block to deal with different difficulty levels information and an LSTM block to process the sequential characteristic in students' actions. LBKT achieves the best performance on most benchmark datasets on the metrics of ACC and AUC.

Text
2024ITS_CR (2) - Accepted Manuscript
Download (2MB)

More information

Published date: 10 June 2024
Venue - Dates: 20th International Conference on Intelligent Tutoring Systems: Generative Intelligence and ITS, War Museum, Thessaloniki, Greece, 2024-06-10 - 2024-06-13

Identifiers

Local EPrints ID: 489244
URI: http://eprints.soton.ac.uk/id/eprint/489244
PURE UUID: de75f932-3dcc-40f9-a0d6-2655f7e85e53
ORCID for Zhaoxing Li: ORCID iD orcid.org/0000-0003-3560-3461
ORCID for Sebastian Stein: ORCID iD orcid.org/0000-0003-2858-8857

Catalogue record

Date deposited: 18 Apr 2024 16:42
Last modified: 19 Apr 2024 02:07

Export record

Contributors

Author: Zhaoxing Li ORCID iD
Author: Jujie Yang
Author: Jindi Wang
Author: Lei Shi
Author: Jiayi Feng
Author: Sebastian Stein ORCID iD

Download statistics

Downloads from ePrints over the past year. Other digital versions may also be available to download e.g. from the publisher's website.

View more statistics

Atom RSS 1.0 RSS 2.0

Contact ePrints Soton: eprints@soton.ac.uk

ePrints Soton supports OAI 2.0 with a base URL of http://eprints.soton.ac.uk/cgi/oai2

This repository has been built using EPrints software, developed at the University of Southampton, but available to everyone to use.

We use cookies to ensure that we give you the best experience on our website. If you continue without changing your settings, we will assume that you are happy to receive cookies on the University of Southampton website.

×