Discriminant Validity and Reliability of Scores of Multiple Choice and Short Essay Questions

Abstract

<p><strong>Background and Objective:</strong> Assessment of learning plays a vital role in curriculum allowing faculty to evaluate the achievement of student and educational process. Quality assurance of the assessments is done to assess the quality of teaching and learning. A study is therefore conducted to find the discriminant validity and reliability of scores of Multiple Choices and Short Answer Questions.<br /><strong>Methods:</strong> A correlation study was conducted on 272 second year MBBS students of Fatima Memorial College of Medicine and Dentistry, Lahore from 2016 – 2017. Students were assessed in end of year examination with multiple choice questions (MCQs) and short essay questions and (SEQs) in the subjects of Physiology and Biochemistry. A total of 149 second-year MBBS students took thePhysiologyand143 studentstook the end of year Biochemistry examination with 50% minimum passing level. The mean and standard deviation of the scores were calculated and the scores of MCQs and SEQs were correlated by applying Pearson’s correlation. Reliability was determined by Cronbach’s alpha. Discriminant validity of scores (MCQS and SEQS) was analyzed by Pearson’s correlation.<br /><strong>Results:</strong> Students scored significantly higher in MCQsthan SEQsin end of year examination of Biochemistry and Physiology. Positive significant correlation of scores (MCQs and SEQs) was obtained in Biochemistry while correlation was positive but non-significant in Physiology. The reliability assessed by Cronbach’s alpha was moderate in Biochemistry and Physiology assessments. Discriminant validity was determined in both subjects by determining the correlation between the scores of the MCQs and SEQs, constructed  according to the same module.<br /><strong>Conclusion:</strong> The internal assessment of students based on end of year examinations in the subjects of Physiology and Biochemistry scored moderate in terms of reliability and discriminant validity was found between scores of MCQs and SEQs in each module.</p>