Abstract
In this study, an analytical rubric which has a five dimensional scoring key was developed. It was used to evaluate paragraph-level written texts which were written by the students attending process writing activities in B1 optional preparatory classes in Muğla Sıtkı Koçman University School of Foreign Languages. The development stages of rubric are as follows: establishing the dimensions of the rubric, establishing the performance levels, cells (the criteria of the rubric) and the performance level score ranges of the rubric, examining the usability of the rubric by forming sample texts, the trial of the rubric, the validity and the reliability of the rubric. In the development stages of the rubric; for the pilot study, 60 university students in the optional B1 English preparatory program at Muğla Sıtkı Koçman School of Foreign Languages and an English language lecturer were included. Also, the opinions of three English language lecturers’ and two experts’ who are in the field of education sciences and one instructor’s who is in the field of Turkish language and literature were taken, to estimate the inter-rater reliability two English language lecturers were included. When Kappa coefficients of the dimensions of the rubric were examined, it can be said that there was a moderate and strong agreement among the raters in terms of assessing all dimensions in the rubric.
Highlights
Foreign language learning in Turkey is gaining more importance due to the global developments in the world and is included in school programs at the primary school education level
In the development of the rubric; for the pilot study, opinions were taken from 60 university students and a lecturer with English language education from the optional B1 English Preparatory Program of Muğla Sıtkı Koçman School of Foreign Languages, and two lecturers from the English language education branch in order to test the compatibility between the evaluators, and within the scope of the reliability study in the stage of determining the dimensions and performance levels and criteria of the rubric, from three lecturers from the English language education branch, two experts in the field of educational sciences, and a lecturer from the Turkish branch for assessing in terms of grammar
During the rubric's trial phase, a pilot study was carried out with the students of B1 optional English preparatory class students who continued their education in Muğla Sıtkı Koçman School of Foreign Languages in 2016-2017 academic year, and within this study's scope, the texts written by the students were assessed in terms of usability with the rubric developed, and its deficiencies and defective aspects were determined and corrected
Summary
Şebnem İlhan Agan, Sabahattin Deniz2 1Muğla Sıtkı Koçman University, School of Foreign Languages, Turkey 2İzmir Demokrasi University, Faculty of Education, Turkey Correspondence: Şebnem İlhan Agan, Muğla Sıtkı Koçman University, School of Foreign Languages, Turkey
Sign-in/Register to view highlights & summary Sign-in/Register to access full text options 
Talk to us
Join us for a 30 min session where you can share your feedback and ask us any queries you have
Schedule a callDisclaimer: All third-party content on this website/platform is and will remain the property of their respective owners and is provided on "as is" basis without any warranties, express or implied. Use of third-party content does not indicate any affiliation, sponsorship with or endorsement by them. Any references to third-party content is to identify the corresponding services and shall be considered fair use under The CopyrightLaw.
