TY - JOUR
T1 - Rating scales for interpreting performance assessment
AU - Lee, Jieun
PY - 2008
Y1 - 2008
N2 - This paper explores the use of rating scales as a tool for assessing interpreting performance. Drawing on common quality criteria in the interpreting literature, the researcher's intuitive understanding of different levels of interpreting quality, as well as the rating scales used in second language assessment, a rating scale with three criteria was developed a priori and trialled by a group of raters. Two groups of raters - experienced professional interpreters and novice interpreters - rated fve interpreting students' consecutive interpreting performance using these scales and provided their feedback on the rating scales. The raters' feedback suggests that this type of rating scale might be useful in multiple interpreting performance assessment, particularly as a means to enhance rating consistency. However, the marks produced by raters yielded mixed results. In both groups of raters, the single measure intra-class coeffcient was high in accuracy assessment, but not in TL quality and delivery assessment. Further research is required before meaningful conclusions about the reliability of rating scale-based assessment can be drawn.
AB - This paper explores the use of rating scales as a tool for assessing interpreting performance. Drawing on common quality criteria in the interpreting literature, the researcher's intuitive understanding of different levels of interpreting quality, as well as the rating scales used in second language assessment, a rating scale with three criteria was developed a priori and trialled by a group of raters. Two groups of raters - experienced professional interpreters and novice interpreters - rated fve interpreting students' consecutive interpreting performance using these scales and provided their feedback on the rating scales. The raters' feedback suggests that this type of rating scale might be useful in multiple interpreting performance assessment, particularly as a means to enhance rating consistency. However, the marks produced by raters yielded mixed results. In both groups of raters, the single measure intra-class coeffcient was high in accuracy assessment, but not in TL quality and delivery assessment. Further research is required before meaningful conclusions about the reliability of rating scale-based assessment can be drawn.
KW - Assessment
KW - Interpreting
KW - Quality
KW - Rating scales
KW - Reliability
UR - http://www.scopus.com/inward/record.url?scp=77950713123&partnerID=8YFLogxK
U2 - 10.1080/1750399X.2008.10798772
DO - 10.1080/1750399X.2008.10798772
M3 - Article
AN - SCOPUS:77950713123
SN - 1750-399X
VL - 2
SP - 165
EP - 184
JO - Interpreter and Translator Trainer
JF - Interpreter and Translator Trainer
IS - 2
ER -