Can Peer Assessment Be Reliable as an Evaluating Instrument?

Rumondang Miranda Marsaulina

Abstract


Discourses asserting peer assessment on English learning process particularly regarding its either effectiveness or downfalls as an alternative evaluation method for English as a Foreign Language (EFL) learners have been disseminated. However, doubts on the lack of peer assessment’s capacity as an evaluating tool remains to need more validation by a study examining its reliability in a wider learning context to ensure if the method could be as reliable as teacher’s grading leading to a theory that peer assessment can serve for reducing teacher’s load especially for big classes. In that connection, this study aims to examine the reliability of peer assessment for a big class of first-year non-native English speaking university students majoring in software engineering but already passing English grammar and vocabulary for composing short text genres in their earlier semester. Methods used for collecting and analyzing the data were Wilcoxon reliability and Bivariate Pearson Correlation tests to compare students’ peer assessment and lecturer grading on narrative texts written by 56 software engineering students. The finding shows peer assessment as a tool for evaluating students’ writing quality has been in low reliability indicated from the incompatibility between the students’ peer assessment quality and the lecturer’s grading result. This study contributes to present evidence that peer assessment should be out of consideration as an instrument for evaluating the writing produced by non-native English speaking students despite their passing subjects expected to have enabled them to compose a narrative writing. The conclusion is peer assessment is weak in effect on relieving teacher’s assessment load in a big writing class of English for Foreign Learning (EFL) students in spite of their English grammar and vocabulary acquisition at a certain level, though the method might serve for giving non-grading related advantages such as promoting students’ metacognition.


Keywords


Lecturer Grading; Peer Assessment; Reliability; Results

Full Text:

PDF

References


Adachi, C., Tai, J., & Dawson, P. (2018a). Academics’ perceptions of the benefits and challenges of self and peer assessment in higher education. Assessment & Evaluation in Higher Education, 43(2), 294–306. https://doi.org/10.1080/02602938.2017.1339775

Corder, G. W., & Foreman, D. I. (2009). Nonparametric statistics for non-statisticians: A step-by-step approach. New Jersey, NJ: John Wiley & Sons.

Damanik, J. Y. (2022). Peer feedback to improve Indonesian adult learners’ writing skills: A Review. JET (Journal of English Teaching), 8(1), 49–58. https://doi.org/10.33541/jet.v8i1.3253

Double, K. S., McGrane, J. A., & Hopfenbeck, T. N. (2020). The impact of peer assessment on academic performance: A meta-analysis of control group studies. Educational Psychology Review, 32(2), 481–509. https://doi.org/10.1007/s10648-019-09510-3

Fleckney, P., Thompson, J., & Vaz-Serra, P. (2024). Designing effective peer assessment processes in higher education: a systematic review. Higher Education Research & Development, 1–16. https://doi.org/10.1080/07294360.2024.2407083

Gupta, S. D., Abdullah, F., Li, G., & Xueshuang, Y. (2019). Peer Assessment in Writing: A Critical Review of Previous Studies. Journal of Advances in Linguistics, 10, 1478–1487. https://doi.org/10.24297/jal.v10i0.7992

Halim, S.W. (2021). Peer Assessment in University Level: A Preliminary Study on the Reliability. CaLLs, 7(1), pp 1-14.

Intellectus Consulting. (n.d.). Pearson’s Correlation Coefficient: A Comprehensive Overview. https://www.statisticssolutions.com/free-resources/directory-of-statistical-analyses/pearsons-correlation-coefficient/

Jongsma, M. V., Scholten, D. J., van Muijlwijk-Koezen, J. E., & Meeter, M. (2023). Online versus offline peer feedback in higher education: A meta-analysis. Journal of Educational Computing Research, 61(2), 329–354. https://doi.org/10.1177/07356331221114181

Laerd Statistics. (2018). Wilcoxon signed rank test in SPSS statistics - Procedure, output and interpretation of output using a relevant example. Laerd.com. https://statistics.laerd.com/spss-tutorials/wilcoxon-signed-rank-test-using-spss-statistics.php

Li, H. L., Xiong, Y., Hunte, C. V., Guo, X. Y., & Tywoniw, R. (2020). Does peer assessment promote student learning? A meta-analysis. Assessment & Evaluation in Higher Education, 45(2), 193–211. https://doi.org/10.1080/02602938.2019.1620679

Meletiadou, E. & Tsagari, D. (2014). An Exploration of the Reliability and Validity of Peer Assessment of Writing in Secondary Education. Language Learning/Teaching - Education. https://www.degruyter.com/document/doi/10.2478/9788376560915.p14/pdf?srsltid=AfmBOoqA2fhFFl2-d0iYl50OTWThcoIdPXUtm6iXxhoDS_eaNv6br7XM

Nicol, D., Thomson, A., & Breslin, C. (2014). Rethinking feedback practices in higher education: A peer review perspective. Assessment & Evaluation in Higher Education, 39(1), 102–122. https://doi.org/10.1080/02602938.2013.795518

Poverjuc, O., Brooks, V., & Wray, D. (2012). Using peer feedback in a master's programme: A multiple case study. Teaching in Higher Education, 17(4), 465–477. https://doi.org/10.1080/13562517.2011.641008

Raharjo, S. (2014-2025). Panduan Lengkap Cara Melakukan Uji Wilcoxon dengan SPSS. SPSS Indonesia: Olah Data Statistik dengan SPSS. https://www.spssindonesia.com/2017/04/cara-uji-wilcoxon-spss.html

Reddy, K., Harland, T., Wass, R., & Wald, N. (2021). Student peer review as a process of knowledge creation through dialogue. Higher Education Research & Development, 40(4), 825–837. https://doi.org/10.1080/07294360.2020.1781797

Salehi, Mohammad & Sayyar, Zahra. (2017). An investigation of the reliability and validity of peer, self-, and teacher assessment. Southern African Linguistics and Applied Language Studies. 35. 1-15. 10.2989/16073614.2016.1267577.

Wagner, S. M. (2016) “Peer feedback: moving from assessment of learning to assessment for learning”, Journal of Learning Development in Higher Education. doi: 10.47408/jldhe.v0i0.335.

Widyawati, W. Y. (2018). Peer assessment for improving writing descriptive text of the tenth graders of senior high school setia budhi Semarang. ETERNAL (English Teaching Journal), 7(2). https://doi.org/10.26877/eternal.v7i2.2168

Wilson, M. J., Diao, M. M., & Huang, L. (2015). ‘I’m not here to learn how to mark someone else’s stuff’: An investigation of an online peer-to-peer review workshop tool. Assessment & Evaluation in Higher Education, 40(1), 15–32. https://doi.org/10.1080/02602938.2014.881980

Yin, S., Chen, F., & Chang, H. (2022). Assessment as Learning: How Does Peer Assessment Function in Students’ Learning? Frontiers in Psychology. 13 (912568), 1-14. https://doi.org/10.3389/fpsyg.2022.912568

Yucel, R., Bird, F. L., Young, J., & Blanksby, T. (2014). The road to self-assessment: Exemplar marking before peer review develops first-year students’ capacity to judge the quality of a scientific report. Assessment & Evaluation in Higher Education, 39(8), 971–986. https://doi.org/10.1080/02602938.2014.880400

Zhang, F., Schunn, C., Li, W., & Long, M. (2020). Changes in the reliability and validity of peer assessment across the college years. Assessment & Evaluation in Higher Education, 45(8), 1073–1087. https://doi.org/10.1080/02602938.2020.1724260




DOI: https://doi.org/10.31004/jele.v10i4.1255

Refbacks

  • There are currently no refbacks.


Copyright (c) 2025 Rumondang Miranda Marsaulina

Creative Commons License
This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.