Abstract
ABSTRACT The present study was designed to test the reliability of traditional essay type questions and to see the effect of ‘structuring’ on the reliability of those questions. Sixty‐two final MBBS students were divided into two groups of 31 each. Group A was administered a 2‐hour test containing five traditional essay questions picked up from previous university papers, while Group B was administered the same questions in a structured format. The answer sheets were xeroxed and evaluated independently by seven examiners. The dispersion of marks was significantly greater in Group A, as was the variance between marks awarded by the seven examiners to each student. Correlation of individual marks awarded was also poor for Group A scripts. The internal consistency for Group A was 0.31 (p > 0.05) while that for Group B was 0.69 (p < 0.05). Inter‐examiner agreement on ranks awarded was better for Group B. These findings suggest that reliability of traditional essay questions can be improved by structuring them.
Sign-in/Register to access full text options 
Talk to us
Join us for a 30 min session where you can share your feedback and ask us any queries you have
Schedule a callMore From: Assessment in Education: Principles, Policy & Practice
Disclaimer: All third-party content on this website/platform is and will remain the property of their respective owners and is provided on "as is" basis without any warranties, express or implied. Use of third-party content does not indicate any affiliation, sponsorship with or endorsement by them. Any references to third-party content is to identify the corresponding services and shall be considered fair use under The CopyrightLaw.
