Korean Medical Licensing Examination Research Articles

Factors associated with academic performance among medical students at a medical school in South Korea: A retrospective cohort study.

Longitudinal research has provided systematic empirical data on the short- and long-term outcomes of admissions policies, curricular innovations, and complex decisions on students' academic progress. This study aimed to investigate the academic performance of medical students and related factors using cohort database collected from a medical school. The study participants included 134 medical students who graduated from Chonnam National University Medical School in 2022. The medical school's cohort database was used to collect data on demographics, admission, academic performance, extracurricular activities, and performance on the National Korean Medical Licensing Examination (KMLE). Participating in club activities had a significant association with medical students' academic advancement delay or leave of absence during the entire course of medical school (P = 0.007). Logistic regression analysis indicated that the nationwide clinical knowledge mock examination during the fourth year of medical school was significantly associated with passing the KMLE (adjusted odds ratio 1.12, 95% confidence interval 1.02-1.22; P = 0.014). Extracurricular school activities (a non-cognitive student attribute) and a wide range of cognitive student attributes captured from the cohort database were associated with medical students' academic performance. In conclusion, this study can reinforce a strong emphasis on the inclusion of cognitive and non-cognitive information in medical school curricula and assessments in order to improve medical education programs and future postgraduate performance.

Establishing and Operating Cohort Evaluation at Kosin University College of Medicine

Multiple cohorts (e.g., current students and graduates) were formed to collect information on the entire educational process from admission to graduation regarding students’ educational performances at Kosin University College of Medicine. Data that had already been collected and analyzed by different committees for different purposes were grouped into a more systematic and comprehensive system called the cohort system, enabling the necessary data to be collected promptly and analyzed in accordance with the purpose of providing meaningful information in each area of the educational process. Therefore, comprehensive cohort data that can be used for mission statement revision, curriculum development and improvement, student counseling, and student selection were established and utilized. The cohort data were collected from performance evaluation indicators including self-evaluation surveys, evaluation tools for learning outcomes, academic achievement, results of the Korean Medical Licensing Examination, and career placement. Based on the results obtained by analyzing cohort data, a comprehensive cohort report has been published. The data analyzed through the cohort were reported to each committee and used in various ways. Currently, however, only some data have been analyzed and used. In the future, after complete data collection, the cohort data can be used as meaningful basic data for achieving the institution’s mission and educational goals, developing and improving the curriculum, counseling students, and selecting students through the analysis of learning performance data from student admission to graduation and after graduation.

Analysis of Basic Medicine-Related Questions in the Korean Medical Licensing Examination (2016–2018)

Basic medical education is important for developing the competencies of medical doctors, and it includes basic biomedical sciences, preventive medicine, medical ethics, and clinical science. This study aimed to reveal the current status of the Korean Medical Licensing Examination (KMLE) regarding its evaluation of competencies in basic biomedical sciences. The basic science-related questions were screened and selected from the test forms of the KMLE (2016–2018) by personnel conducting basic biomedical science education, and the selected questions were evaluated with three independent groups of undergraduate students at Chonnam National University Medical School in terms of the learning outcomes of basic medical education. The study scope includes the proportion of basic medicine-related questions, which consist of basic medicine questions and basic medicine-related clinical medicine questions, and its annual change, discipline distribution, and associated learning outcomes. The average proportions of basic biomedical sciences, preventive medicine and medical law, and clinical sciences were 2.3%, 5.8%, and 91.9% of all questions, respectively. The proportion of basic medicine-related questions, except those on preventive medicine and medical law, was 22.0% of the total, and questions on pharmacology and microbiology accounted for 83.0% of the basic medicine-related questions. The proportion of sub-enabling learning outcomes linked with basic medicine-related questions comprised 14.0% of the total outcomes for basic biomedical sciences and 30.4% for preventive medicine and medical law. It is concluded that the KMLE questions may not sufficiently cover the essential competencies of basic medical education for medical doctors, and the KMLE may need to be improved with regard to competencies in basic biomedical sciences.

Possibility of independent use of the yes/no Angoff and Hofstee methods for the standard setting of the Korean Medical Licensing Examination written test: a descriptive study.

This study aims to apply the yes/no Angoff and Hofstee methods to actual Korean Medical Licensing Examination (KMLE) 2022 written examination data to estimate cut scores for the written KMLE. Fourteen panelists gathered to derive the cut score of the 86th KMLE written examination data using the yes/no Angoff method. The panel reviewed the items individually before the meeting and shared their respective understanding of the minimum-compatibility physician. The standard setting process was conducted in 5 rounds over a total of 800 minutes. In addition, 2 rounds of the Hofstee method were conducted before starting the standard setting process and after the second round of yes/no Angoff. For yes/no Angoff, as each round progressed, the panel's opinion gradually converged to a cut score of 198 points, and the final passing rate was 95.1%. The Hofstee cut score was 208 points out of a maximum 320 with a passing rate of 92.1% at the first round. It scored 204 points with a passing rate of 93.3% in the second round. The difference between the cut scores obtained through yes/no Angoff and Hofstee methods did not exceed 2% points, and they were within the range of cut scores from previous studies. In both methods, the difference between the panelists decreased as rounds were repeated. Overall, our findings suggest the acceptability of cut scores and the possibility of independent use of both methods.

Possibility of using the yes/no Angoff method as a substitute for the percent Angoff method for estimating the cutoff score of the Korean Medical Licensing Examination: a simulation study

The percent Angoff (PA) method has been recommended as a reliable method to set the cutoff score instead of a fixed cut point of 60% in the Korean Medical Licensing Examination (KMLE). The yes/no Angoff (YNA) method, which is easy for panelists to judge, can be considered as an alternative because the KMLE has many items to evaluate. This study aimed to compare the cutoff score and the reliability depending on whether the PA or the YNA standard-setting method was used in the KMLE. The materials were the open-access PA data of the KMLE. The PA data were converted to YNA data in 5 categories, in which the probabilities for a “yes” decision by panelists were 50%, 60%, 70%, 80%, and 90%. SPSS for descriptive analysis and G-string for generalizability theory were used to present the results. The PA method and the YNA method counting 60% as “yes,” estimated similar cutoff scores. Those cutoff scores were deemed acceptable based on the results of the Hofstee method. The highest reliability coefficients estimated by the generalizability test were from the PA method and the YNA method, with probabilities of 70%, 80%, 60%, and 50% for deciding “yes,” in descending order. The panelist’s specialty was the main cause of the error variance. The error size was similar regardless of the standard-setting method. The above results showed that the PA method was more reliable than the YNA method in estimating the cutoff score of the KMLE. However, the YNA method with a 60% probability for deciding “yes” also can be used as a substitute for the PA method in estimating the cutoff score of the KMLE.

Is it possible to introduce an interview to the Korean Medical Licensing Examination to assess professional attributes?: a survey-based observational study

PurposeThis study aimed to gather opinions from medical educators on the possibility of introducing an interview to the Korean Medical Licensing Examination (KMLE) to assess professional attributes. Specifically following topics were dealt with: the appropriate timing and tool to assess unprofessional conduct; the possiblity of prevention of unprofessional conduct by introducing an interview to the KMLE; and the possibility of implementation of an interview to the KMLE.MethodsA cross-sectional study approach based on a survey questionnaire was adopted. We analyzed 104 pieces of news about doctors’ unprofessional conduct to determine the deficient professional attributes. We derived 24 items of unprofessional conduct and developed the questionnaire and surveyed 250 members of the Korean Society of Medical Education 2 times. Descriptive statistics, cross-tabulation analysis, and Fisher’s exact test were applied to the responses. The answers to the open-ended questions were analyzed using conventional content analysis.ResultsIn the survey, 49 members (19.6%) responded. Out of 49, 24 (49.5%) responded in the 2nd survey. To assess unprofessional conduct, there was no dominant timing among basic medical education (BME), KMLE, and continuing professional development (CPD). There was no overwhelming assessment tool among written examination, objective structured clinical examination, practice observation, and interview. Response rates of “impossible” (49.0%) and “possible” (42.9%) suggested an interview of the KMLE prevented unprofessional conduct. In terms of implementation, “impossible” (50.0%) was selected more often than “possible” (33.3%).ConclusionProfessional attributes should be assessed by various tools over the period from BME to CPD. Hence, it may be impossible to introduce an interview to assess professional attributes to the KMLE, and a system is needed such as self-regulation by the professional body rather than licensing examination.

The accuracy and consistency of mastery for each content domain using the Rasch and deterministic inputs, noisy “and” gate diagnostic classification models: a simulation study and a real-world analysis using data from the Korean Medical Licensing Examination

PurposeDiagnostic classification models (DCMs) were developed to identify the mastery or non-mastery of the attributes required for solving test items, but their application has been limited to very low-level attributes, and the accuracy and consistency of high-level attributes using DCMs have rarely been reported compared with classical test theory (CTT) and item response theory models. This paper compared the accuracy of high-level attribute mastery between deterministic inputs, noisy “and” gate (DINA) and Rasch models, along with sub-scores based on CTT.MethodsFirst, a simulation study explored the effects of attribute length (number of items per attribute) and the correlations among attributes with respect to the accuracy of mastery. Second, a real-data study examined model and item fit and investigated the consistency of mastery for each attribute among the 3 models using the 2017 Korean Medical Licensing Examination with 360 items.ResultsAccuracy of mastery increased with a higher number of items measuring each attribute across all conditions. The DINA model was more accurate than the CTT and Rasch models for attributes with high correlations (>0.5) and few items. In the real-data analysis, the DINA and Rasch models generally showed better item fits and appropriate model fit. The consistency of mastery between the Rasch and DINA models ranged from 0.541 to 0.633 and the correlations of person attribute scores between the Rasch and DINA models ranged from 0.579 to 0.786.ConclusionAlthough all 3 models provide a mastery decision for each examinee, the individual mastery profile using the DINA model provides more accurate decisions for attributes with high correlations than the CTT and Rasch models. The DINA model can also be directly applied to tests with complex structures, unlike the CTT and Rasch models, and it provides different diagnostic information from the CTT and Rasch models.

Estimation of item parameters and examinees' mastery probability in each domain of the Korean medical licensing examination using deterministic inputs, noisy and gate(DINA) model.

PurposeThe deterministic inputs, noisy “and” gate (DINA) model is a promising statistical method for providing useful diagnostic information about students’ level of achievement, as educators often want to receive diagnostic information on how examinees did on each content strand, which is referred to as a diagnostic profile. The purpose of this paper was to classify examinees of the Korean Medical Licensing Examination (KMLE) in different content domains using the DINA model.MethodsThis paper analyzed data from the KMLE, with 360 items and 3,259 examinees. An application study was conducted to estimate examinees’ parameters and item characteristics. The guessing and slipping parameters of each item were estimated, and statistical analysis was conducted using the DINA model.ResultsThe output table shows examples of some items that can be used to check item quality. The probabilities of mastery of each content domain were also estimated, indicating the mastery profile of each examinee. The classification accuracy and consistency for 8 content domains ranged from 0.849 to 0.972 and from 0.839 to 0.994, respectively. As a result, the classification reliability of the diagnostic classification model was very high for the 8 content domains of the KMLE.ConclusionThis mastery profile can provide useful diagnostic information for each examinee in terms of each content domain of the KMLE. Individual mastery profiles allow educators and examinees to understand which domain(s) should be improved in order to master all domains in the KMLE. In addition, all items showed reasonable results in terms of item parameters.

Similarity of the cut score in test sets with different item amounts using the modified Angoff, modified Ebel, and Hofstee standard-setting methods for the Korean Medical Licensing Examination.

PurposeThe Korea Medical Licensing Exam (KMLE) typically contains a large number of items. The purpose of this study was to investigate whether there is a difference in the cut score between evaluating all items of the exam and evaluating only some items when conducting standard-setting.MethodsWe divided the item sets that appeared on 3 recent KMLEs for the past 3 years into 4 subsets of each year of 25% each based on their item content categories, discrimination index, and difficulty index. The entire panel of 15 members assessed all the items (360 items, 100%) of the year 2017. In split-half set 1, each item set contained 184 (51%) items of year 2018 and each set from split-half set 2 contained 182 (51%) items of the year 2019 using the same method. We used the modified Angoff, modified Ebel, and Hofstee methods in the standard-setting process.ResultsLess than a 1% cut score difference was observed when the same method was used to stratify item subsets containing 25%, 51%, or 100% of the entire set. When rating fewer items, higher rater reliability was observed.ConclusionWhen the entire item set was divided into equivalent subsets, assessing the exam using a portion of the item set (90 out of 360 items) yielded similar cut scores to those derived using the entire item set. There was a higher correlation between panelists’ individual assessments and the overall assessments.

Group randomized trial of teaching tobacco-cessation counseling to senior medical students: a peer role-play module versus a standardized patient module

BackgroundAn important barrier to smoking-cessation counseling for physicians is a lack of education at the undergraduate level. Interactive methods such as peer role-play (RP) or modules utilizing standardized patients (SPs) may be effective for medical students to enhance their performance on tobacco cessation counseling. This study compared the effectiveness of a module using SPs to that of a RP module for undergraduate medical students on tobacco cessation counseling.MethodsThis study was conducted over a single week of the family medicine clerkship. One hundred and thirteen fourth-year medical students were randomized into either the SP group or the RP group. A RP module involved a ten-minute encounter between the student doctor and the student patient followed by five minutes of feedback from the observer student using a group developed checklist. In a SP module, each student was asked to interview a SP portraying a smoker with willingness to quit. After the encounter, the SP provided five minutes of direct oral feedback to the student. In both modules, the total intervention lasted three-and-half hours and was supervised by faculty staff. Students’ objective structured clinical examination (OSCE) scores were evaluated to determine their tobacco cessation counseling skills. Four evaluation periods were conducted at baseline, postintervention, post-clerkship, and before receiving the Korean medical licensing examination (KMLE). Students’ smoking knowledge test scores and counseling self-confidence levels at pre- and post-intervention were also compared.ResultsIn both groups, post-intervention OSCE scores increased significantly compared to baseline (Cohen’s d 0.87, p < 0.001 in SP group; d 0.77, p < 0.001 in RP group). However, there were no differences between the two groups. Students achieved the highest OSCE score for smoking-cessation counseling before the KMLE. After training, student self-confidence and smoking-knowledge test scores increased significantly, regardless of the type of module. Self-confidence was higher in the SP group compared with the RP group (d 0.37, p = 0.01).ConclusionsPeer role-play may be equivalent to the SP method with regard to knowledge and skills reported during smoking-cessation counseling and SP method may be better in self-confidence. Cost and student self-confidence may be important factors when choosing among the teaching methods for smoking-cessation counseling.

Funding information of the article entitled "Post-hoc simulation study of computerized adaptive testing for the Korean Medical Licensing Examination".

Funding information of the article entitled "Post-hoc simulation study of computerized adaptive testing for the Korean Medical Licensing Examination".

Liner programming method to construct equated item sets for implementation of periodical computer-based testing of Korean medical licensing examination.

PurposeThis study aimed to identify the best way of developing equivalent item sets and to propose a stable and effective management plan for periodical licensing examinations. MethodsFive pre-equated item sets were developed based on the predicted correct answer rate of each item using linear programming. These pre-equated item sets were compared to the ones that were developed with a random item selection method based on the actual correct answer rate (ACAR) and difficulty from item response theory (IRT). The results with and without common items were also compared in the same way. ACAR and the IRT difficulty were used to determine whether there was a significant difference between the pre-equating conditions. ResultsThere was a statistically significant difference in IRT difficulty among the results from different pre-equated conditions. The predicted correct answer rate was divided using 2 or 3 difficulty categories, and the ACAR and IRT difficulty parameters of the 5 item sets were equally constructed. Comparing the item set conditions with and without common items, including common items did not make a significant contribution to the equating of the 5 item sets. ConclusionThis study suggested that the linear programming method is applicable to construct equated-item sets that reflect each content area. The suggested best method to construct equated item sets is to divide the predicted correct answer rate using 2 or 3 difficulty categories, regardless of common items. If pre-equated item sets are required to construct a test based on the actual data, several methods should be considered by simulation studies to determine which is optimal before administering a real test.

Post-hoc simulation study of computerized adaptive testing for the Korean Medical Licensing Examination.

PurposeComputerized adaptive testing (CAT) has been adopted in licensing examinations because it improves the efficiency and accuracy of the tests, as shown in many studies. This simulation study investigated CAT scoring and item selection methods for the Korean Medical Licensing Examination (KMLE).MethodsThis study used a post-hoc (real data) simulation design. The item bank used in this study included all items from the January 2017 KMLE. All CAT algorithms for this study were implemented using the ‘catR’ package in the R program.ResultsIn terms of accuracy, the Rasch and 2-parametric logistic (PL) models performed better than the 3PL model. The ‘modal a posteriori’ and ‘expected a posterior’ methods provided more accurate estimates than maximum likelihood estimation or weighted likelihood estimation. Furthermore, maximum posterior weighted information and minimum expected posterior variance performed better than other item selection methods. In terms of efficiency, the Rasch model is recommended to reduce test length.ConclusionBefore implementing live CAT, a simulation study should be performed under varied test conditions. Based on a simulation study, and based on the results, specific scoring and item selection methods should be predetermined.

Comparison of Patient-Physician Interaction Scores of Clinical Practice Examination between Checklists and Rating Scale.

BackgroundThe clinical practice examination (CPX) was introduced in 2010, and the Seoul-Gyeonggi CPX Consortium developed the patient-physician interaction (PPI) assessment tool in 2004. Both institutions use rating scales on classified sections of PPI but differ in their scoring of key components. This study investigated the accuracy of standardized patient scores across rating scales by comparing checklist methods and verified the concurrent validity of two comparable PPI rating tools.MethodsAn educational CPX module dyspepsia case was administered to 116 fourth-year medical students at Hanyang University College of Medicine. One experienced standardized patient rated exams using two different PPI scales. She scored checklists composed of 43 items related to the two original PPI scales through video clips of the same students. From these checklists, we calculated Pearson's correlation coefficient.ResultsThe correlations of total PPI score between the checklist and rating scale methods were 0.29 for the Korean Medical Licensing Examination (KMLE) tool and 0.30 for the consortium tool. The correlations between the KMLE and consortium tools were 0.74 for checklists and 0.83 for rating scales. In terms of section scores, the consortium tool showed only three significant correlations between the two methods out of seven sections and the KMLE tool showed only two statistically significant correlations out of five sections.ConclusionThe rating scale and checklist methods exhibited a weak relationship in the PPI assessment, but a high correlation between assessment tools using the same method. However, the current rating scale requires modification by reorganizing key scoring components through factor analysis.

Effects of Module Development and Role Play Course on Clinical Practice Examination Scores during a 4th Year Clerkship.

BackgroundAfter introduction of clinical skills assessment in the Korean Medical Licensing Examination, medical schools have reinforced both experiential learning with real patients and preparatory programs. This study was conducted to investigate whether a clinical practice examination (CPX) preparation program improves students' CPX score in terms of case specificity.MethodsOne hundred and thirteen senior students in a medical school participated in this study. During the fourth-year clerkship, 28 students (24.8%) from three rotation groups took a 3-day CPX preparation course consisting of module development, role play, and comprehensive physical exam skills training. Eleven rotation groups (n=85) were compared as control. Both the intervention and control group took two comprehensive CPXs before and after the clerkship was completed.ResultsThere was no significant difference in age, sex, and school type between the two groups. On pre-test CPX, there was no significant difference in total and sectional scores between the two groups. On post-test CPX, total scores of the intervention group were higher than those of the control groups (69.5±4.3 vs. 67.5±4.4, P<0.05). History taking scores were higher in intervention groups (70.0±6.0 vs. 66.0±6.6, P=0.01). The station scores of vaginal discharge with case similarity were higher in the intervention groups (73.0±6.3 vs. 68.9±9.3, P=0.03).ConclusionA short CPX preparation course improved history taking ability, but its effect was greater only in a specific case, similar to the pre-course case. Whether this effect was due to the test experience or true improvement in competency requires further investigation.

North Korean refugee doctors' preliminary examination scores.

PurposeAlthough there have been studies emphasizing the re-education of North Korean (NK) doctors for post-unification of the Korean Peninsula, study on the content and scope of such re-education has yet to be conducted. Researchers intended to set the content and scope of re-education by a comparative analysis for the scores of the preliminary examination, which is comparable to the Korean Medical Licensing Examination (KMLE).MethodsThe scores of the first and second preliminary exams were analyzed by subject using the Wilcoxon signed rank test. The passing status of the group of NK doctors for KMLE in recent 3 years were investigated. The multiple-choice-question (MCQ) items of which difficulty indexes of NK doctors were lower than those of South Korean (SK) medical students by two times of the standard deviation of the scores of SK medical students were selected to investigate the relevant reasons.ResultsThe average scores of nearly all subjects were improved in the second exam compared with the first exam. The passing rate of the group of NK doctors was 75%. The number of MCQ items of which difficulty indexes of NK doctors were lower than those of SK medical students was 51 (6.38%). NK doctors’ lack of understandings for Diagnostic Techniques and Procedures, Therapeutics, Prenatal Care, and Managed Care Programs was suggested as the possible reason.ConclusionThe education of integrated courses focusing on Diagnostic Techniques and Procedures and Therapeutics, and apprenticeship-style training for clinical practice of core subjects are needed. Special lectures on the Preventive Medicine are likely to be required also.

Quality Management Activities for Improving the Pap Smear Sampling Performance with Adequate Specimens among Family Medicine Residents

Background: The clinical skills test of the Korean Medical Licensing Examination has been driving medical schools to improve undergraduate education through clerkships and skills training on the published test topics, including Pap smear. There have been few studies evaluating the ability of family medicine residents to perform the Pap smear procedure. We conducted this study in order to investigate family medicine residents’ performance based on the requisition rate of endocervical cell/transformation zone (EC/TZ) in Pap smear specimens, and to evaluate the effects of quality improvement measures. Methods: A retrospective study was conducted reviewing the results from liquid-based cervical Pap smear tests performed at a university hospital health check-up center between March 2013 and June 2015. An obstetrics and gynaecology (OB/GYN) professor and 12 family residents were observed with action research and structured interview. Results: Of the total 6,462 cervical Pap smear tests performed, 2,573 (39.8%) were reported to be lacking an EC/TZ component. In 2013, the presence rate of an EC/TZ component in cytology specimens taken by family medicine residents improved from 37.0%±11.8% to 80.3%±8.8% after a quality improvement intervention. The presence rate of an EC/TZ component was higher in specimens taken by residents compared with those by an OB/ GYN specialist (69.3%±10.9% vs. 44.7%±5.0%, P=0.0002). The baseline individual monthly requisition rate of the EC/TZ component improved after quality management intervention (50.0%±18.3% vs. 75.8%±15.8%, P=0.01). The presence of an EC/TZ sample varied among residents. Transfer activities of the task, topic conferences, self-directed learning from online educational materials, gynecologic training, and self-monitoring of laboratory results had a positive effect on quality improvement. Conclusion: Quality management activities at the individual level of family medicine residents improved the requisition rate of the EC/TZ component in Pap smear specimens. Further studies are needed in order to develop more efficient educational modules for improving Pap smear sampling quality.

Perceptions on item disclosure for the Korean medical licensing examination

This study analyzed the perceptions of medical students and faculty regarding disclosure of test items on the Korean medical licensing examination. I conducted a survey of medical students from medical colleges and professional medical schools nationwide. Responses were analyzed from 718 participants as well as 69 faculty members who participated in creating the medical licensing examination item sets. Data were analyzed using descriptive statistics and the chi-square test. It is important to maintain test quality and to keep the test items unavailable to the public. There are also concerns among students that disclosure of test items would prompt increasing difficulty of test items (48.3%). Further, few students found it desirable to disclose test items regardless of any considerations (28.5%). The professors, who had experience in designing the test items, also expressed their opposition to test item disclosure (60.9%). It is desirable not to disclose the test items of the Korean medical licensing examination to the public on the condition that students are provided with a sufficient amount of information regarding the examination. This is so that the exam can appropriately identify candidates with the required qualifications.

Reforms of the Korean Medical Licensing Examination regarding item development and performance evaluation.

Purpose:The Korean Medical Licensing Examination (KMLE) has undergone a variety of innovative reforms implemented by the National Health Personnel Licensing Examination Board (NHPLEB) in order to make it a competency-based test. The purpose of this article is to describe the ways in which the KMLE has been reformed and the effect of those innovations on medical education in Korea.Methods:Changes in the KMLE were traced from 1994 to 2014 by reviewing the adoption of new policies by the NHPLEB and the relevant literature.Results:The most important reforms that turned the examination into a competency-based test were the following: First, the subjects tested on the exam were revised; second, R-type items were introduced; third, the proportion of items involving problem-solving skills was increased; and fourth, a clinical skills test was introduced in addition to the written test. The literature shows that the above reforms have resulted in more rigorous licensure standards and have improved the educational environment of medical schools in Korea.Conclusion:The reforms of the KMLE have led to improvements in how the competency of examinees is evaluated, as well as improvements in the educational system in medical schools in Korea.

Exploration of examinees' traits that affect the score of Korean Medical Licensing Examination.

Purpose:It aims to identify the effect of five variables to score of the Korean Medical Licensing Examinations (KMLE) for three consecutive years from 2011 to 2013.Methods:The number of examinees for each examination was 3,364 in 2011 3,177 in 2012, and 3,287 in 2013. Five characteristics of examinees were set as variables: gender, age, graduation status, written test result (pass or fail), and city of medical school. A regression model was established, with the score of a written test as a dependent variable and with examinees’ traits as variables.Results:The regression coefficients in all variables, except the city of medical school, were statistically significant. The variable’s effect in three examinations appeared in the following order: result of written test, graduation status, age, gender, and city of medical school.Conclusion:written test scores of the KMLE revealed that female students, younger examinees, and first-time examinees had higher performances.