TY  - JOUR
TI  - A RASCH ANALYSIS OF RATER BEHAVIOUR IN SPEAKING ASSESSMENT
AB  - The assessment of speaking skills in foreign language testing has always had some pros(testing learners’ speaking skills doubles the validity of any language test) and cons (many testrelevant/irrelevant variables interfere) since it is a multi-dimensional process. In the meantime,exploring grader behaviours while scoring learners’ speaking skills is necessary not only forinter/intra-rater reliability estimations but also for identifying the potential stringent and lenientgraders in the rater-group to act accordingly to settle the best matches for graders when pairedrater-scorings or cross-marking-gradings are preferred for increasing the objectivity. In thisexploratory study, which was implemented in 2019, 6 expert speaking graders scored 24English language learners’ speaking interviews from their video recordings including anindividual and a pair discussion task for each student. A Rasch model in which MFRM (ManyFaceted Rasch Measurement) was utilised to explore the scoring behaviours of the expertgraders in terms of stringency and find out if their grading habits significantly affect languagelearners’ overall speaking performances. The results of the present research showed thatgraders had significant score differences among each other and some of them scored tooleniently or too stringently that might affect learners’ speaking grades significantly.
AU  - AKAY, Murat POLAT Emel
PY  - 2020
JO  - IOJET
VL  - 7
IS  - 3
SN  - 2148-225X
SP  - 1126
EP  - 1141
DB  - TRDizin
UR  - http://search/yayin/detay/376514
ER  -