Blogs (4) >>
Fri 22 Mar 2024 13:45 - 14:10 at Meeting Room E146 - Grading & Teams Chair(s): Alvaro Monge

Peer grading is widely used in high education as effective active learning but still faces challenges. We present the peer grading approach for Open-ended Programming Projects based on the binary and Swiss systems. First, we design a grading specification to improve the accuracy of scoring. Second, to make grading easier for inexperienced students, we utilize a pairwise comparison system based on the binary system. Third, we propose a score calculation algorithm based on Technique for Order Preference by Similarity to an Ideal Solution (TOPSIS) to improve grading accuracy. We developed an online peer review tool called Peer Review Studio (PRS) based on the approach. We carry out the method in the undergraduate programming course of 2023. We collect and analyze the learning data between 2022 and 2023. When measured by Krippendorff’s alpha, the inter-rater reliability between instructor and peer grading is in good agreement. When measured by Kruskal-Wallis, students’ project performance and learning engagement significantly improve in the first year of peer grading. The course questionnaire 2023 shows that most students approve of the peer review approach.

Fri 22 Mar

Displayed time zone: Pacific Time (US & Canada) change

13:45 - 15:00
Grading & TeamsPapers at Meeting Room E146
Chair(s): Alvaro Monge Northeastern University, USA
13:45
25m
Talk
A Peer Grading Approach for Open-ended Programming Projects Based on Binary System and Swiss SystemOnlineIn-Person
Papers
Liang Zhang Beihang University, Tianyi Chen Beihang University, Yue Zong Beihang University, Xiaopeng Gao Beihang University
DOI
14:10
25m
Talk
Clearn: a cost-conscious student-led online judge for a large programming courseOnlineGlobalIn-Person
Papers
Valeria Herskovic Pontificia Universidad Católica de Chile, Jorge Munoz-Gama Pontificia Universidad Católica de Chile, Fernando Balladares Pontificia Universidad Católica de Chile, Pablo Flores Pontificia Universidad Católica de Chile, Nicolas Quiroz Pontificia Universidad Católica de Chile
DOI
14:35
25m
Talk
Attribution of Work in Programming Teams with Git ReporterOnlineIn-Person
Papers
Michael Guttmann Graz University of Technology, Aleksandar Karakaš Graz University of Technology, Denis Helic Modul University Vienna GmbH
DOI