Evaluation of e-learning platforms using artificial intelligence (AI) robots: Are the AI robots consistent

研究成果: Conference contribution同行評審

摘要

This article aims to explore the consistency between a few popular generative AI robots in the evaluation of e-learning platforms. The three robots adopted in the study were GPT-4, Sage, and Dragonfly, which were requested to award rating scores to the six major dimensions, namely (1) features and capabilities, (2) ease of use and customization, (3) cost, (4) security, (5) customer support, and (6) scalability, of 10 to 20 currently most popular e-learning platforms. For each of the three robots, the minimum, the maximum, the range, and the standard deviation of the rating scores for each of the six dimensions were computed across all the e-learning platforms. The rating score difference for each of the six dimensions between any pair of robots was calculated for each platform. The mean of the absolute value, the minimum, the maximum, the range, and the standard deviation of the differences for each dimensions between each pair of robots were calculated across all platforms. Finally, a Cronbach alpha coefficient of the rating scores was computed for each of the six dimensions between all the three robots across all the e-learning platforms. The computational results were to reveal whether the three robots accorded discrimination in evaluating each dimension across the platforms and whether there was consistency between the three robots in evaluating each dimension across the platforms. Among some auxiliary results, it was found that the evaluation by the three robots was severely inconsistent for the two dimensions cost and security, inconsistent to a lesser extent for the dimension scalability, and consistent for the remaining three dimensions.

原文English
主出版物標題ICEMT 2023 - 7th International Conference on Education and Multimedia Technology
發行者Association for Computing Machinery
頁面96-100
頁數5
ISBN(電子)9798400709142
DOIs
出版狀態Published - 29 8月 2023
事件7th International Conference on Education and Multimedia Technology, ICEMT 2023 - Tokyo, Japan
持續時間: 29 8月 202331 8月 2023

出版系列

名字ACM International Conference Proceeding Series

Conference

Conference7th International Conference on Education and Multimedia Technology, ICEMT 2023
國家/地區Japan
城市Tokyo
期間29/08/2331/08/23

指紋

深入研究「Evaluation of e-learning platforms using artificial intelligence (AI) robots: Are the AI robots consistent」主題。共同形成了獨特的指紋。

引用此