TY - GEN
T1 - Convergent Validity of Non-Invigilated, Formative Online Assessments in Business Mathematics Courses and Students' Comparative Performance in Online and Offline Assessments
AU - Chan, Victor K.Y.
N1 - Publisher Copyright:
© 2022 ACM.
PY - 2022/7/13
Y1 - 2022/7/13
N2 - The validity and specifically the convergent validity of a course's online assessments (i.e. the extent to which the online assessments really measure what is measured by other assessments meant to measure the constructs of the course's learning outcomes) hitherto only receive limited attention, especially for courses in the business mathematics discipline. Using the data of a business mathematics course at the author's university, this article attempts to verify the convergent validity of a series of non-invigilated, formative online assessments or equivalently to evaluate the extent to which these online assessments measure what is measured by an invigilated, summative offline assessment meant to measure the construct of the course's learning outcomes. Besides, this article aims to reveal whether the students scored more highly in these online assessments than in the offline assessment or vice versa. Findings were that such convergent validity was moderately acceptable and slightly on the high end and that students considerably scored more highly in these online assessments than in the offline assessment. Reasons suggested for the findings include students' computer anxiety, perceptions of and attitudes towards online assessments as well as some distinctive features of online assessments in mathematical courses.
AB - The validity and specifically the convergent validity of a course's online assessments (i.e. the extent to which the online assessments really measure what is measured by other assessments meant to measure the constructs of the course's learning outcomes) hitherto only receive limited attention, especially for courses in the business mathematics discipline. Using the data of a business mathematics course at the author's university, this article attempts to verify the convergent validity of a series of non-invigilated, formative online assessments or equivalently to evaluate the extent to which these online assessments measure what is measured by an invigilated, summative offline assessment meant to measure the construct of the course's learning outcomes. Besides, this article aims to reveal whether the students scored more highly in these online assessments than in the offline assessment or vice versa. Findings were that such convergent validity was moderately acceptable and slightly on the high end and that students considerably scored more highly in these online assessments than in the offline assessment. Reasons suggested for the findings include students' computer anxiety, perceptions of and attitudes towards online assessments as well as some distinctive features of online assessments in mathematical courses.
KW - Formative online assessment
KW - comparative performance
KW - mathematics courses
KW - non-invigilated
KW - offline assessment
UR - http://www.scopus.com/inward/record.url?scp=85142772447&partnerID=8YFLogxK
U2 - 10.1145/3551708.3551760
DO - 10.1145/3551708.3551760
M3 - Conference contribution
AN - SCOPUS:85142772447
T3 - ACM International Conference Proceeding Series
SP - 214
EP - 218
BT - ICEMT 2022 - 2022 6th International Conference on Education and Multimedia Technology
PB - Association for Computing Machinery
T2 - 6th International Conference on Education and Multimedia Technology, ICEMT 2022
Y2 - 13 July 2022 through 15 July 2022
ER -