Critical Synthesis Package: Script Concordance Testing (SCT)

Abstract

OPEN ACCESSAugust 14, 2013Critical Synthesis Package: Script Concordance Testing (SCT) Javarro Russell, PhD Javarro Russell, PhD National Board of Medical Examiners Google Scholar More articles by this author https://doi.org/10.15766/mep_2374-8265.9492 SectionsAbout ToolsDownload Citations ShareFacebookTwitterEmail AbstractThis Critical Synthesis Package contains: (1) a Critical Analysis of the psychometric properties and application to health sciences education for the Script Concordance Test (SCT), and (2) a copy of the SCT instrument and SCT Overview developed by Bernard Charlin, MD, PhD.The SCT provides a method for assessing clinical data interpretation skills. This method uses a written simulation item format to allow respondents to address ill-defined problems typical to clinical practice. The examinee is presented with ill-defined clinical scenarios. These scenarios are then followed by a set of hypotheses. For each hypothesis the examinee is provided with an additional piece of information. The examinee is then required to make judgments as to the likelihood of the hypothesis by selecting a Likert-type response option. Points awarded for the examinee's concordance with the judgments are provided by a panel of expert judges. The SCT has been used across many clinical domains and with examinees of varying levels of clinical experience. Research on the SCT has identified guidelines for developing quality test items. An advantage of using this item format is the use of expert panels to analyze and compare examinee responses. Disadvantages to using this item format include the lack of validity evidence for the response process and the complexity of the scoring process. Further research is needed to determine how best to use the SCT to improve teaching and learning, and to evaluate the thought process that is used in responding to the SCT items. Additionally, research is needed to identify how best to use examinee scores diagnostically. Current research has not obtained validity evidence for the use of scores to prescribe educational interventions to increase examinee knowledge. Educational Objectives To describe the purpose and basic properties of Script Concordance Testing (SCT), including psychometric properties;To describe the application of SCT to the field of health sciences education;To evaluate the relative strengths and weaknesses of SCT; andTo provide SCT and supplemental materials to aid in its administration. Sign up for the latest publications from MedEdPORTAL Add your email below FILES INCLUDEDReferencesRelatedDetails FILES INCLUDED Included in this publication: Critical Analysis of Script Concordance Testing.pdf Sample Script Concordance Test.docx Script Concordance Testing Overview.docx To view all publication components, extract (i.e., unzip) them from the downloaded .zip file. Download editor’s noteThis publication may contain technology or a display format that is no longer in use. CitationRussell J. Critical Synthesis Package: Script Concordance Testing (SCT). MedEdPORTAL. 2013;9:9492. https://doi.org/10.15766/mep_2374-8265.9492 Copyright & Permissions© 2013 Russell. This is an open-access publication distributed under the terms of the Creative Commons Attribution-NonCommercial-Share Alike license.KeywordsDirectory and Repository of Educational Assessment MeasuresSCTEducational MeasurementClinical ReasoningInstrument ValidationValidation StudiesDREAMScript Concordance Testing Disclosures None to report. Funding/Support None to report. Loading ...