TY - GEN
T1 - Tracing Students' Learning Performance on Multiple Skills using Bayesian Methods
AU - Chan, Ka Ian
AU - Tse, Rita
AU - Lei, Philip I.S.
N1 - Publisher Copyright:
© 2022 ACM.
PY - 2022/7/13
Y1 - 2022/7/13
N2 - Knowledge tracing (KT) is a research field of growing importance in technology enhanced education. It models students' mastery levels of skills and predicts their performance in question answering through an Intelligent Tutoring System (ITS). Traditionally, Bayesian methods like Bayesian Knowledge Tracing (BKT) and Weakest Knowledge Tracing (WKT) apply Hidden Markov Model to model the latent learning process of individual skills. With the advent of recent advances in Deep Learning (DL), DL based KT methods achieve better prediction performance by exploiting the temporal dependencies between consecutive exercises on different skills. However, Bayesian methods are still valuable with a simpler, more intuitive and interpretable model of learning. This paper proposes a new Bayesian method called Corrigible Knowledge Tracing (CKT) which assumes students can learn from mistakes in answering multi-skill questions. In addition, the combinations of high occurrence skills are considered, so that integrated abilities are more fully recognised. In evaluation, the harmonic mean is suggested for combining the predicted probabilities, and accuracy is chosen to be the performance metric. The proposed method is compared with both Bayesian methods and DL approaches by using the conventional question-solving records from a modern large-scale educational data mining dataset called EdNet. Experiment results show that the performance of CKT is on par with state-of-the-art DL approaches. The overall improvement from WKT to the proposed method is substantial.
AB - Knowledge tracing (KT) is a research field of growing importance in technology enhanced education. It models students' mastery levels of skills and predicts their performance in question answering through an Intelligent Tutoring System (ITS). Traditionally, Bayesian methods like Bayesian Knowledge Tracing (BKT) and Weakest Knowledge Tracing (WKT) apply Hidden Markov Model to model the latent learning process of individual skills. With the advent of recent advances in Deep Learning (DL), DL based KT methods achieve better prediction performance by exploiting the temporal dependencies between consecutive exercises on different skills. However, Bayesian methods are still valuable with a simpler, more intuitive and interpretable model of learning. This paper proposes a new Bayesian method called Corrigible Knowledge Tracing (CKT) which assumes students can learn from mistakes in answering multi-skill questions. In addition, the combinations of high occurrence skills are considered, so that integrated abilities are more fully recognised. In evaluation, the harmonic mean is suggested for combining the predicted probabilities, and accuracy is chosen to be the performance metric. The proposed method is compared with both Bayesian methods and DL approaches by using the conventional question-solving records from a modern large-scale educational data mining dataset called EdNet. Experiment results show that the performance of CKT is on par with state-of-the-art DL approaches. The overall improvement from WKT to the proposed method is substantial.
KW - Bayesian Knowledge Tracing (BKT)
KW - Corrigible Knowledge Tracing (CKT)
KW - Education
KW - Educational Data Mining (EDM)
KW - Intelligent Tutoring System (ITS)
KW - Knowledge Tracing (KT)
KW - Language Learning
KW - Prediction
KW - Student Modelling
KW - Students Performance
KW - Weakest Knowledge Tracing (WKT)
UR - http://www.scopus.com/inward/record.url?scp=85142826162&partnerID=8YFLogxK
U2 - 10.1145/3551708.3556202
DO - 10.1145/3551708.3556202
M3 - Conference contribution
AN - SCOPUS:85142826162
T3 - ACM International Conference Proceeding Series
SP - 84
EP - 89
BT - ICEMT 2022 - 2022 6th International Conference on Education and Multimedia Technology
PB - Association for Computing Machinery
T2 - 6th International Conference on Education and Multimedia Technology, ICEMT 2022
Y2 - 13 July 2022 through 15 July 2022
ER -