TY - JOUR
T1 - Enhanced deep knowledge tracing via synthetic embeddings
AU - Shi, Si
AU - Luo, Wuman
AU - Pau, Giovanni
N1 - Publisher Copyright:
© The Author(s), under exclusive licence to Springer-Verlag GmbH Germany, part of Springer Nature 2026.
PY - 2026/6
Y1 - 2026/6
N2 - Knowledge tracing, a mission to estimate a learner’s knowledge level over time, can be simulated by a machine. With the booming of artificial intelligence, more powerful machine learning-driven models have emerged. Plenty of them show satisfactory results. However, inner dynamic relationships among learning components, proper hardness design, and comprehensive consideration of structures remain to be tackled. In this paper, we designed a novel knowledge tracing architecture called synthetic separated self-attentive neural knowledge tracing (SYNSAINT) which mined inner relations among skills with synthesized latent necessary embeddings. It contains an intelligent knowledge system including five synthetic embeddings: skill, hardness, position, elapsed time, and response. Specifically, we mapped questions into a graph and harnessed the power of unsupervised graph representation learning with clustering techniques to obtain the skillcluster embedding. Moreover, we utilized a sub-neural network method to assign a random weight for each item in the hardness measurement. We built deep sequential attentive structures and verified the method on two representative open-source knowledge tracing datasets. To the best of our knowledge, our approach was proven superior to other state-of-the-art knowledge tracing methods. We also implemented abundant ablation studies to demonstrate the effects of our proposed architecture and a case study to depict its dynamic tracing effects.
AB - Knowledge tracing, a mission to estimate a learner’s knowledge level over time, can be simulated by a machine. With the booming of artificial intelligence, more powerful machine learning-driven models have emerged. Plenty of them show satisfactory results. However, inner dynamic relationships among learning components, proper hardness design, and comprehensive consideration of structures remain to be tackled. In this paper, we designed a novel knowledge tracing architecture called synthetic separated self-attentive neural knowledge tracing (SYNSAINT) which mined inner relations among skills with synthesized latent necessary embeddings. It contains an intelligent knowledge system including five synthetic embeddings: skill, hardness, position, elapsed time, and response. Specifically, we mapped questions into a graph and harnessed the power of unsupervised graph representation learning with clustering techniques to obtain the skillcluster embedding. Moreover, we utilized a sub-neural network method to assign a random weight for each item in the hardness measurement. We built deep sequential attentive structures and verified the method on two representative open-source knowledge tracing datasets. To the best of our knowledge, our approach was proven superior to other state-of-the-art knowledge tracing methods. We also implemented abundant ablation studies to demonstrate the effects of our proposed architecture and a case study to depict its dynamic tracing effects.
KW - Attention mechanism
KW - Data mining
KW - Deep knowledge tracing
KW - Synthetic embeddings
KW - Unsupervised graph representation
UR - https://www.scopus.com/pages/publications/105037429548
U2 - 10.1007/s13042-026-03104-6
DO - 10.1007/s13042-026-03104-6
M3 - Article
AN - SCOPUS:105037429548
SN - 1868-8071
VL - 17
JO - International Journal of Machine Learning and Cybernetics
JF - International Journal of Machine Learning and Cybernetics
IS - 6
M1 - 279
ER -