An exploration on effectiveness of anonymous peer assessment strategy in online formative assessments

Kumar, Krishan and Sharma, Bibhya N. and Khan, Gavin J. and Nusair, Salsabil A. and Raghuwaiya, Krishna (2020) An exploration on effectiveness of anonymous peer assessment strategy in online formative assessments. [Conference Proceedings]

PDF - Published Version Restricted to Repository staff only Download (335kB) | Request a copy

Abstract

This Research in Practice WIP paper presents findings to quantify the effectiveness of using online peer assessment strategy through Moodle workshop tool in a Communications and Information Technology online and blended course. The study focused on the reliability and validity of grades given by graders using Moodle workshop tool. All assessments were also manually graded by facilitators as independent variable for comparison with final Moodle grade allocated by Moodle workshop tool. The quasi-experimental study was conducted in a compulsory undergraduate course across 14 campuses on formative procedural knowledge assessment. Assessments from five graders were considered for analysis where students were also allowed to self-assess their work as one of the graders. The methods used for data analysis were descriptive statistics, correlation, interrater reliability tests and validity tests applied at 95 confidence level. The findings for peer assessment activity were reliable and valid within 0.8 inter-rater agreement with self-assessment and without self-assessment. Furthermore, the final peer assessment grade allocated by Moodle workshop tool was consistent with the facilitator grade. However, Mann Whitney-U test revealed a significant difference between Moodle grade and facilitator grade for online and blended modes mostly due to: the understanding of the online students on the assessment itself, assess to ICT tools and internet connection facilities while grading peers work and the marking variance of the facilitators.

Item Type:	Conference Proceedings
Additional Information:	DOI: 10.1109/FIE44824.2020.9274162
Uncontrolled Keywords:	Tools;Reliability;Conferences;Education;Standards;Information and communication technology;Training;peer assessment;self-assessment;online course;blended course
Subjects:	L Education > L Education (General) Q Science > QA Mathematics > QA76 Computer software T Technology > T Technology (General)
Divisions:	School of Pacific Arts, Communication and Education (SPACE) School of Information Technology, Engineering, Mathematics and Physics (STEMP)
Depositing User:	Fulori Nainoca - Waqairagata
Date Deposited:	12 Jan 2021 20:54
Last Modified:	29 Jun 2021 05:59
URI:	https://repository.usp.ac.fj/id/eprint/12550

Actions (login required)

View Item