USP Electronic Research Repository

An exploration on effectiveness of anonymous peer assessment strategy in online formative assessments

Kumar, Krishan and Sharma, Bibhya N. and Khan, Gavin J. and Nusair, Salsabil A. and Raghuwaiya, Krishna (2020) An exploration on effectiveness of anonymous peer assessment strategy in online formative assessments. [Conference Proceedings]

[img] PDF - Published Version
Restricted to Repository staff only

Download (327Kb)

    Abstract

    This Research in Practice WIP paper presents findings to quantify the effectiveness of using online peer assessment strategy through Moodle workshop tool in a Communications and Information Technology online and blended course. The study focused on the reliability and validity of grades given by graders using Moodle workshop tool. All assessments were also manually graded by facilitators as independent variable for comparison with final Moodle grade allocated by Moodle workshop tool. The quasi-experimental study was conducted in a compulsory undergraduate course across 14 campuses on formative procedural knowledge assessment. Assessments from five graders were considered for analysis where students were also allowed to self-assess their work as one of the graders. The methods used for data analysis were descriptive statistics, correlation, interrater reliability tests and validity tests applied at 95 confidence level. The findings for peer assessment activity were reliable and valid within 0.8 inter-rater agreement with self-assessment and without self-assessment. Furthermore, the final peer assessment grade allocated by Moodle workshop tool was consistent with the facilitator grade. However, Mann Whitney-U test revealed a significant difference between Moodle grade and facilitator grade for online and blended modes mostly due to: the understanding of the online students on the assessment itself, assess to ICT tools and internet connection facilities while grading peers work and the marking variance of the facilitators.

    Item Type: Conference Proceedings
    Additional Information: DOI: 10.1109/FIE44824.2020.9274162
    Uncontrolled Keywords: Tools;Reliability;Conferences;Education;Standards;Information and communication technology;Training;peer assessment;self-assessment;online course;blended course
    Subjects: L Education > L Education (General)
    Q Science > QA Mathematics > QA76 Computer software
    T Technology > T Technology (General)
    Divisions: School of Pacific Arts, Communication and Education (SPACE)
    School of Information Technology, Engineering, Mathematics and Physics (STEMP)
    Depositing User: Fulori Nainoca - Waqairagata
    Date Deposited: 13 Jan 2021 09:54
    Last Modified: 29 Jun 2021 17:59
    URI: http://repository.usp.ac.fj/id/eprint/12550
    UNSPECIFIED

    Actions (login required)

    View Item

    Document Downloads

    More statistics for this item...