TITLE:
Brunswik’s Lens Model: This Is How to Inspire Accurate Raters
AUTHORS:
Muhamad Firdaus bin Mohd Noh, Mohd Effendi Ewan bin Mohd Matore
KEYWORDS:
Rater Accuracy, Brunswik’s Lens Model, High-Stakes Assessment, Quality Raters
JOURNAL NAME:
Creative Education,
Vol.10 No.12,
November
29,
2019
ABSTRACT: Rating
accuracy is one of the fundamental standards in educational assessment to
ensure the quality and integrity.
Inaccuracy in academic assessment engenders negative implications towards student’s motivation and raters’
credibility. Therefore, this paper seeks to provide a discussion on rating accuracy in educational assessment based
on Brunswik’s lens model. The model contends that raters’ ratings are not completed directly but through the existence
of many factors including raters’ variability, rating scales and domains
assessed. Raters’ idiosyncrasy is scrutinized by describing varied sources that
can threaten rating accuracy. This model explains how intervening factors
moderate the relationship between candidates’ capabilities and observed scores.
The discussion may shed some light on the endeavors to inspire raters to be
effective and uphold the values of reliable raters through the implementation
of thoughtful rater training that incorporates scoring practices, exposure on
rater bias and self-directed reflection. Future attempts are necessary for understanding the
interaction among intervening factors that influence raters and differences of rating accuracy produced by internal and
external raters.