A Report on the Training of Markers
Abstract
This paper report on the attempt made by the Department of
Foreign Language and Literature to promote the training of markers in
the scoring of open-ended writing tasks.
A et of data from a training workshop is analysed according to a
criterion to investigate the extent of consistency with which marker
cored student script .
The 0 erall picture gained from the anlaysis shows that there is a
reasonably acceptable level of agreement: 67%, 70%, and 68% uniform
marking was observed in essions one, two, and three respectively. In
addition. the examiner marked the script with lightly better
con istency when u ing the analytic instead of the impre ionistic
marking cheme.
The results of the analysis also show ca es of deviations from the group
consensus and fluctuation between trict and lenient marking.
Given the level of agreemef!.t and the ca es of deviation and fluctuation
observed, it is noted that there i still room for improvement in uniform
marking. In other words, the re ults of the analy i in this paper clearly
show the need for continued concern in marker reliability.