LBKT: a LSTM BERT-based knowledge tracing model for long-sequence data
LBKT: a LSTM BERT-based knowledge tracing model for long-sequence data
The field of Knowledge Tracing (KT) aims to understand how students learn and master knowledge over time by analyzing their historical behaviour data. To achieve this goal, many researchers have proposed KT models that use data from Intelligent Tutoring Systems (ITS) to predict students' subsequent actions. However, with the development of ITS, large-scale datasets containing long-sequence data began to emerge. Recent deep learning based KT models face obstacles such as low efficiency, low accuracy, and low interpretability when dealing with large-scale datasets containing long-sequence data. To address these issues and promote the sustainable development of ITS, we propose a LSTM BERT-based Knowledge Tracing model for long sequence data processing, namely LBKT, which uses a BERT-based architecture with a Rasch model-based embeddings block to deal with different difficulty levels information and an LSTM block to process the sequential characteristic in students' actions. LBKT achieves the best performance on most benchmark datasets on the metrics of ACC and AUC.
Li, Zhaoxing
65935c45-a640-496c-98b8-43bed39e1850
Yang, Jujie
568355cd-4787-4876-8d54-c1b45d7b9e4b
Wang, Jindi
a5af917b-2ac6-4173-8435-c08963dc7ed7
Shi, Lei
3e73da43-5e7e-4544-a327-9de0046edfa2
Feng, Jiayi
2c955d5e-0116-49ff-8b7f-e56d9412e6a3
Stein, Sebastian
cb2325e7-5e63-475e-8a69-9db2dfbdb00b
10 June 2024
Li, Zhaoxing
65935c45-a640-496c-98b8-43bed39e1850
Yang, Jujie
568355cd-4787-4876-8d54-c1b45d7b9e4b
Wang, Jindi
a5af917b-2ac6-4173-8435-c08963dc7ed7
Shi, Lei
3e73da43-5e7e-4544-a327-9de0046edfa2
Feng, Jiayi
2c955d5e-0116-49ff-8b7f-e56d9412e6a3
Stein, Sebastian
cb2325e7-5e63-475e-8a69-9db2dfbdb00b
Li, Zhaoxing, Yang, Jujie, Wang, Jindi, Shi, Lei, Feng, Jiayi and Stein, Sebastian
(2024)
LBKT: a LSTM BERT-based knowledge tracing model for long-sequence data.
20th International Conference on Intelligent Tutoring Systems: Generative Intelligence and ITS, War Museum, Thessaloniki, Greece.
10 - 13 Jun 2024.
10 pp
.
Record type:
Conference or Workshop Item
(Paper)
Abstract
The field of Knowledge Tracing (KT) aims to understand how students learn and master knowledge over time by analyzing their historical behaviour data. To achieve this goal, many researchers have proposed KT models that use data from Intelligent Tutoring Systems (ITS) to predict students' subsequent actions. However, with the development of ITS, large-scale datasets containing long-sequence data began to emerge. Recent deep learning based KT models face obstacles such as low efficiency, low accuracy, and low interpretability when dealing with large-scale datasets containing long-sequence data. To address these issues and promote the sustainable development of ITS, we propose a LSTM BERT-based Knowledge Tracing model for long sequence data processing, namely LBKT, which uses a BERT-based architecture with a Rasch model-based embeddings block to deal with different difficulty levels information and an LSTM block to process the sequential characteristic in students' actions. LBKT achieves the best performance on most benchmark datasets on the metrics of ACC and AUC.
Text
2024ITS_CR (2)
- Accepted Manuscript
More information
Published date: 10 June 2024
Venue - Dates:
20th International Conference on Intelligent Tutoring Systems: Generative Intelligence and ITS, War Museum, Thessaloniki, Greece, 2024-06-10 - 2024-06-13
Identifiers
Local EPrints ID: 489244
URI: http://eprints.soton.ac.uk/id/eprint/489244
PURE UUID: de75f932-3dcc-40f9-a0d6-2655f7e85e53
Catalogue record
Date deposited: 18 Apr 2024 16:42
Last modified: 19 Apr 2024 02:07
Export record
Contributors
Author:
Zhaoxing Li
Author:
Jujie Yang
Author:
Jindi Wang
Author:
Lei Shi
Author:
Jiayi Feng
Author:
Sebastian Stein
Download statistics
Downloads from ePrints over the past year. Other digital versions may also be available to download e.g. from the publisher's website.
View more statistics