Bias in grading: A meta-analysis of experimental research findings

Title
Bias in grading: A meta-analysis of experimental research findings
Publication Date
2016
Author(s)
Malouff, John M
( author )
OrcID: https://orcid.org/0000-0001-6728-7497
Email: jmalouff@une.edu.au
UNE Id une-id:jmalouff
Thorsteinsson, Einar B
( author )
OrcID: https://orcid.org/0000-0003-2065-1989
Email: ethorste@une.edu.au
UNE Id une-id:ethorste
Type of document
Journal Article
Language
en
Entity Type
Publication
Publisher
Sage Publications Ltd
Place of publication
United Kingdom
DOI
10.1177/0004944116664618
UNE publication id
une:19891
Abstract
This article provides a meta-analysis of experimental research findings on the existence of bias in subjective grading of student work such as essay writing. Twenty-three analyses, from 20 studies, with a total of 1935 graders, met the inclusion criteria for the meta-analysis. All studies involved graders being exposed to a specific type of information about a student other than the student's performance on a task. The hypothesized biasing characteristics included different race/ethnic backgrounds, education-related deficiencies, physical unattractiveness and poor quality of prior performance. The statistically significant overall between-groups effect size was g = 0.36. Moderator analyses showed no significant difference in effect size related to whether the work graded was from a primary school student or a university student. No one type of biasing characteristic showed a significantly higher effect size than other types. The results suggest that bias can occur in subjective grading when graders are aware of irrelevant information about the students.
Link
Citation
Australian Journal of Education, 60(3), p. 245-256
ISSN
2050-5884
0004-9441
Start page
245
End page
256

Files:

NameSizeformatDescriptionLink