Enhance Learning Performance Predictions with Explainable Machine Learning

Wan Chong Choi, Chan Tong Lam, António José Mendes

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

Abstract

This Research Full Paper focuses on predicting learning performance using machine learning algorithms and interpreting the results using Explainable Machine Learning (EML) techniques. The study compared a comprehensive set of machine learning algorithms, including Logistic Regression, Decision Trees, AdaBoost, XGBoost, SVM, and KNN. The performance of these algorithms in predicting students' final grades in a course was accessed using various evaluation metrics. Our study used feature selection to identify the most relevant predictors to enhance predictive accuracy, implemented the Synthetic Minority Over-sampling Technique (SMOTE) to address class imbalance, and performed hyperparameter optimization to find the most effective model settings. This comprehensive approach improved the predictive accuracy of our models over previous studies. Additionally, the importance of early prediction in identifying at-risk students was explored, with models demonstrating promising accuracy at the first checkpoint of the course. Departing from traditional machine learning research that often focused on model performance, our study integrated the EML technique of Shapley Additive exPlanations (SHAP), which is grounded on the theoretical framework of Game Theory, to facilitate the interpretation of the predictive outcomes. This approach offered an explanatory perspective on the key factors influencing model decisions. By contributing to the predictability and interpretability of student performance, this research enriched the field of Educational Data Mining (EDM) and enhanced the understanding of student learning trajectories.

Original languageEnglish
Title of host publication2024 IEEE Frontiers in Education Conference, FIE 2024 - Proceedings
PublisherInstitute of Electrical and Electronics Engineers Inc.
ISBN (Electronic)9798350351507
DOIs
Publication statusPublished - 2024
Event54th IEEE Frontiers in Education Conference, FIE 2024 - Washington, United States
Duration: 13 Oct 202416 Oct 2024

Publication series

NameProceedings - Frontiers in Education Conference, FIE
ISSN (Print)1539-4565

Conference

Conference54th IEEE Frontiers in Education Conference, FIE 2024
Country/TerritoryUnited States
CityWashington
Period13/10/2416/10/24

Keywords

  • EDM
  • Educational data mining
  • Explainable machine learning
  • Learning performance prediction
  • SHapley Additive exPlanations

Fingerprint

Dive into the research topics of 'Enhance Learning Performance Predictions with Explainable Machine Learning'. Together they form a unique fingerprint.

Cite this