TITLE:
Native vs. Nonnative Raters in Second Language Pronunciation Assessment of Guttural Sounds
AUTHORS:
Mahmoud S. Al Mahmoud
KEYWORDS:
Inter-Rater Reliability, L2 Pronunciation, Assessment, Arabic Gutturals, Nonnative Rating
JOURNAL NAME:
Open Journal of Modern Linguistics,
Vol.10 No.5,
September
30,
2020
ABSTRACT: This short paper examines inter-rater reliability of native vs. nonnative raters in their assessment of L2 Arabic speech by American learners. It is predicted that ratings provided by native speakers of Arabic would be more consistent and show less variance as opposed to ratings provided by nonnative speakers of Arabic. In a rating experiment, native and nonnative raters evaluated the “nativeness” of American learners’ production of Arabic guttural consonants. A Pearson’s correlation coefficient shows a significant strong inter-rater reliability in the judgments of native raters, and a poor one, although insignificant, in the judgments provided by the nonnative raters. Findings also indicate that overall native and nonnative rater groups produced comparable ratings, although no strong correlation could be established.