Medical Education Research Study Quality Instrument Research Articles

Evidence-Based Practices for Interviewing Graduate Medical Education Applicants: A Systematic Review

Background Although the selection interview is a standard admission practice for graduate medical education (GME) programs in the United States, there is a dearth of recent reviews on optimizing the trainee interview process, which has low reliability, high cost, and major risk of bias. Objective To investigate the evidence base for different selection interview practices in GME. Methods We searched 4 literature databases from inception through September 2022. Two investigators independently conducted title/abstract screening, full-text review, data extraction, and quality assessment. Disagreements were mediated by discussion. We used backward reference searching of included articles to identify additional studies. We included studies of different interview methods and excluded literature reviews, non-GME related publications, and studies comparing different applicant populations. We examined study characteristics, applicant and interviewer preferences, and interview format. We evaluated study quality using the Medical Education Research Study Quality Instrument (MERSQI). Results Of 2192 studies, 39 (2%) met our inclusion criteria. The evidence base was rated as moderately low quality using MERSQI criteria. Applicants reported preferences for several one-on-one interviews lasting 15 to 20 minutes, interviews by current trainees, and interviews including social events with only trainees. Applicants had mixed perceptions of virtual versus in-person interviews and reported that virtual interviews saved costs. The multiple mini interview (MMI) required more applicant and interviewer time than individual interviews but demonstrated construct and predictive validity and was preferred by applicants and interviewers. Conclusions Based on moderately low-quality evidence, using the MMI, training interviewers, and providing applicants with basic program information in advance should be considered for GME selection interviews.

Effectiveness of virtual reality interactive simulation practice in prosthodontic education: A systematic review and meta-analysis.

Virtual reality-based interactive simulation (VRIS) provides a safe and controlled environment for dental students and professionals to develop skills and knowledge. This study aimed to investigate the effectiveness of using the VRIS for prosthodontic practice and to explore the trends, application areas, and users' attitudes towards VRIS. This review followed the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) guidelines for searching studies published until 21 March 2023 that reported quantitative or qualitative learning outcomes related to the use of VRIS for dental prosthodontic practice and clinical training. The quality of the included studies was assessed using the Medical Education Research Study Quality Instrument (MERSQI) and Newcastle-Ottawa Scale-Education (NOS-E) tools. A random-effects meta-analysis was conducted to compare the intervention group (utilizing VRIS) and the control group (employing conventional prosthodontic training methods) based on performance skill scores and task completion time, with a significance level set at <.05. The meta-analysis revealed that the utilization of VRIS generally improves students' performance scores (SMD = 1.04; 95% CI, -0.35 to 2.44; I2 > 50%; p = .13) and reduces task completion time (SMD = -0.03; 95% CI, 1.39-7.72; I2 > 50%; p = .93). Notably, using VRIS significantly enhanced the performance scores in implant surgery practice (SMD = 0.26; 95% CI, 0.09-0.42; p < .05). Additionally, the VRIS method significantly reduced task completion time in the cavity restorative preparation task (SMD = -1.19; 95% CI, -1.85 to -0.53; p < .05). Engaging in practice with VRIS has the potential to enhance learning proficiency in prosthodontic education. The advantages associated with VRIS encompass the provision of immediate feedback, decreased task completion time, heightened confidence and motivation, accelerated skill acquisition, improved performance scores, and increased learning engagement.

Assessing methodological quality in dental education research using MERSQI: Analysis of publications from two journals.

The Medical Education Research Study Quality Instrument (MERSQI) has been used frequently to assess the methodological quality of medical education but not for dental education. The present study aimed to assess the methodological quality using MERSQI scores of articles published in the Journal of Dental Education (JDE) and the European Journal of Dental Education (EJDE). A cross-sectional assessment of the quality of manuscripts published in 2012, 2017, and 2022 JDE and EJDE was conducted. MERSQI data, numbers of authors, first and corresponding author degrees, geographic origins, and funding information were also extracted for each included study. Descriptive and analytical statistics were conducted, and significance level was set at α<0.05. Four hundred ninety-five articles met the inclusion criteria. The most common study design was a single-group cross-sectional or single-group posttest and conducted in one institution for all studied years. In all journals and years, studies were assessed mainly by participants. The study outcome was mostly satisfaction, attitudes, perceptions, opinions, and general facts. The total mean MERSQI score for each journal and year varied. Year and geographic origin significantly affected the total MERSQI score. Papers originating from Asia had the highest score, followed by South America, Europe, North America, Oceania, and Africa. MERSQI score is applicable to the assessment of the methodological quality of dental educational research. The MERSQI score for most of the domains was similar for both journals. The MERSQI score was affected by publication years and geographic origins.

A Systematic Review of the Application of Simulation to Promote Empathy in Nursing Education.

This systematic review aimed to identify, appraise, and synthesize evidence for the effectiveness of simulation modalities in promoting nursing students' empathy. The Preferred Reporting Items for Systematic Reviews and Meta-Analysis was followed with 20 studies included. The Medical Education Research Study Quality Instrument (MERSQI) was used to evaluate the quality of the publications. The mean MERSQI score was 10.95 with an SD of 1.62, which was above the average in the literature.Five simulation modalities were identified: standardized patient, simulated suit, manikin, virtual simulation, and virtual reality simulation. Most of the studies (n = 15) reported significant differences in the measured outcomes after their simulation activities, including all 5 simulation modalities, but the most effective modality was the simulation suit. The simulation suit replicates the lived experiences of others, which enhances perspective taking by "turning the student into the patient" through the physical and sensory effects of simulated suits. However, outcome measures were limited to self-report instruments in the studies.

Medical education research study quality instrument: an objective instrument susceptible to subjectivity

ABSTRACT Background: The medical education research study quality instrument (MERSQI) was designed to appraise medical education research quality based on study design criteria. As with many such tools, application of the results may have unintended consequences. This study applied the MERSQI to published medical education research identified in a bibliometric analysis. Methods: A bibliometric analysis identified highly cited articles in medical education that two authors independently evaluated using the MERSQI. After screening duplicate or non-research articles, the authors reviewed 21 articles with the quality instrument. Initially, five articles were reviewed independently and results were compared to ensure agreed upon understanding of the instrument items. The remainder of the articles were independently reviewed. Overall scores for the articles were analyzed with a paired samples t-test and individual item ratings were analyzed for inter-rater reliability. Results: There was a significant difference in mean MERSQI score between reviewers. Inter-rater reliability for MERSQI items labeled response rate, validity and outcomes were considered unacceptable. Conclusions: Based on these results there is evidence that MERSQI items can be significantly influenced by interpretation, which lead to a difference in scoring. The MERSQI is a useful guide for identifying research methodologies. However, it should not be used to make judgments on the overall quality of medical education research methodology in its current format. The authors make specific recommendations for how the instrument could be revised for greater clarity and accuracy.

US medical school curriculum on opioid use disorder—a topic review of current curricular research and evaluation of winning student-designed opioid curricula for the 2021 Coalition on Physician Education in Substance Use Disorders curricular competition

The opioid crisis in the US severely affected and continues to affect population's health. The opioid crisis was in part fueled by inadequate pain management, which is in part due to the inadequate education in both pain and opioid use disorder (OUD) for health care professionals. In 2021, the Coalition on Physician Education in Substance Use Disorders (COPE) organized a curricular competition soliciting US medical students-designed OUD-related curricula. Twelve winning curricula were identified. Here, we first conducted a topic review regarding current US medical school OUD curricula. Then we evaluated the COPE winning curricula and compared them to the curricula identified in the topic review. For the topic review, ten relevant databases were searched up to December 31, 2021 using a combination of pre-determined keywords. Total of 25 peer-reviewed articles were selected based on the pre-determined criteria, which included 5 articles describing opioid curricular development at the state level (AZ, CA, MA, PA, and RI), 17 research articles evaluating a curriculum developed in a single institution, 2 literature reviews, and 1 article detailing curricular development and validation processes in a single institution. Although vary in organizations and formats, state-level curricula were comprehensive and could be adopted by other states or institutions with necessary local issue-based modifications. Faculty development and critical resources were major challenges for curricular implementation. The 17 research articles exhibited good scientific quality (Medical Education Research Study Quality Instrument (MERSQI) score = 11.94 ± 2.33 (maximal score = 18)). All research articles reported to some extent, the success of respective curriculum, in improving students' knowledge in and/or attitude towards OUD, based on primarily pre- and post- comparisons. Compared to these published curricula, winning students-designed curricula had more specific focuses, diverse learning activities, and varieties in assessment methods. For all curricula, long-term evaluations were lacking. Except for the state level curricula, majority of the other curricula did not emphasize specifically on chronic pain education or the biopsychosocial approach. Interprofessional education approach was also lacking. Our topic review and curricular evaluation highlighted the needs for integrating OUD and chronic pain medical curricula, developing long-term assessment tools, and more OUD curriculum research overall.

Interprofessional Climate Change Curriculum in Health Professional Programs: A Scoping Review

Background: We conducted this scoping review to (1) comprehensively compile the published literature on interprofessional education focused on climate change and health, (2) assess the quality and outcomes of the existing curriculum interventions, and (3) highlight potential areas for further growth. By evaluating published curricular interventions, our goal was to highlight effective and validated developments that could be utilized by health professional educators seeking to include topics on climate change in the curriculum. Methods: We searched Ovid MEDLINE databases (MEDLINE, In-Process, In-Data-Review and Other Non-Indexed Citations, and Epub Ahead of Print), Embase, Clarivate Web of Science, and EBSCOhost Education Abstracts from inception through March 2023. Resulting articles were screened for relevance, and data were extracted from the included studies. The Medical Education Research Study Quality Instrument (MERSQI) was used to assess the quality of each included study. Findings: We screened 688 unique articles, and 6 met inclusion criteria. Publications dated from 2013 to 2023. Three studies included students or healthcare professionals from at least three health profession education programs. The mean MERSQI score was 8·17 (SD = 1·34; range 6–10). Curricular interventions varied by study, and topics included effects of climate change on human health, effect of climate change on extreme weather events and infectious disease exposures, and role of health professionals in climate change communication. Studies did not utilize a two-group comparison design. Most studies used an assessment tool with content validity evidence, but no study provided evidence of validity for internal structure or relationships to other variables. Studies reported that curricular interventions improved outcomes related to both climate change and interprofessional education. Interpretation: Despite the growing call for health professional education focused on climate change and health, there remains a gap in the interprofessional curricular interventions that have been assessed.

Shared decision-making training in general practice: a rapid review.

Although shared decision-making (SDM) is key to providing patient-centred care, SDM is lacking in primary care. Training programmes seeking to improve GP SDM have yet to be reviewed. Therefore, a rapid review of the literature was conducted to evaluate GP SDM training methods and their outcomes. MEDLINE, EMBASE and CENTRAL were systematically searched. Results of the studies included were synthesised narratively. Study quality was appraised using the Medical Education Research Study Quality Instrument (MERSQI). Seven studies were identified. Study quality was high, with a mean MERSQI score of 17.2/18 (range 16-18). Theory/presentation was the most prevalent training method (n=6). Of the five studies assessing the impact of SDM training on patient outcomes, only one yielded positive results. Contrastingly, both studies assessing clinician behaviour produced positive results. SDM training improved GP behaviour but the effects on patient outcomes were lacking. SDM training programmes that utilised teaching methods targeting practical SDM skills, such as role play, observed some positive findings. However, because their prevalence was lacking, further research into these methods, and their cost-effectiveness, are needed.

Publication rates of congress abstracts is associated with abstract quality: Evaluation of Turkish National Medical Education Congresses and Symposia between 2010 and 2014 using MERSQI

There are many parameters that could be used to evaluate the quality of scientific meetings such as publication rates of meeting abstracts as full-text articles after the meeting or scoring with validated quality scales/tools that evaluate individual papers, project proposals, or submitted abstracts. This study aimed to determine the full-text publication rates for abstracts presented at Turkish National Medical Education Congresses and Symposia and to assess the quality of given abstracts. s presented at national medical education congresses and symposia between 2010 and 2014 in Türkiye were evaluated. Initially, the abstracts were evaluated if they were published as full-text articles in international and national peer-reviewed journals following the meeting. Secondly, the quality of presented abstracts was assessed with the Medical Education Research Study Quality Instrument (MERSQI) scale. Overall publication rate for the abstracts was 11.3%. The publication rate of oral and poster presentations were 26.6% and 8.1%, respectively. Oral presentations had a statistically higher publication rate than poster presentations (p = .000). The mean MERSQI score for abstracts was 7.73 ± 2.59. The oral presentations had higher MERSQI mean scores than poster presentations (8.28 ± 2.46 vs. 7.61 ± 2.6; p = .032). Similarly, published abstracts had a significantly higher score compared to unpublished abstracts (10.07 ± 2.74 vs. 7.43 ± 2.41; p = .000). Interestingly, there was no statistical difference between the mean MERSQI scores of the published oral and poster presentations (9.33 ± 2.45 vs. 10.61 ± 2.72; p = .101). This study showed that the main factor for a meeting abstract to be published as a full-text article is the scientific quality of the study. The quality of presentations at annual medical education meetings in Türkiye were low compared with international meetings which did not improve over five years. An institutional policy that would set quality standards for medical education research and increase the awareness of researchers on the topic might help improve the design, execution, and reporting of such studies in Türkiye. The MERSQI could be a valuable tool to monitor the quality of submitted abstracts and to increase the awareness of novice researchers on high quality research.

The Global Use of Artificial Intelligence in the Undergraduate Medical Curriculum: A Systematic Review.

Artificial intelligence (AI) is a rapidly advancing technology that has the potential to revolutionize medical education. AI can provide personalized learning experiences, assist with student assessment, and aid in the integration of pre-clinical and clinical curricula. Despite the potential benefits, there is a paucity of literature investigating the use of AI in undergraduate medical education. This study aims to evaluate the role of AI in undergraduate medical curricula worldwide and compare AI to current teaching and assessment methods. This systematic review was conducted using the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) reporting guidelines. Texts unavailable in English were excluded alongside those not focused on medical students alone or with little mention of AI. The key search terms were "undergraduate medical education," "medical students," "medical education," and "artificial intelligence." The methodological rigor of each study was assessed using the Medical Education Research Study Quality Instrument (MERSQI). A total of 36 articles were screened from 700 initial articles, of which 11 were deemed eligible. These were categorized into the following three domains: teaching (n = 6), assessing (n = 3), and trend spotting (n = 2). AI was shown to be highly accurate in studies that directly tested its ability. The mean overall MERSQI score for all selected papers was 10.5 (standard deviation = 2.3; range = 6 to 15.5) falling below the expected score of 10.7 due to notable weaknesses in study design, sampling methods, and study outcomes. AI performance was synergized with human involvement suggesting that AI would be best employed as a supplement to undergraduate medical curricula. Studies directly comparing AI to current teaching methods demonstrated favorable performance. While shown to have a promising role, there remains a limited number of studies in the field, and further research is needed to refine and establish clear foundations to assist in its development.

Optimizing Surgical Performance Using Preoperative Virtual Reality Planning: A Systematic Review.

Surgery is often a complex process that requires detailed 3-dimensional anatomical knowledge and rigorous interplay between team members to attain ideal operational efficiency or "flow." Virtual Reality (VR) represents a technology by which to rehearse complex plans and communicate precise steps to a surgical team prior to entering the operating room. The objective of this study was to evaluate the use of VR for preoperative surgical team planning and interdisciplinary communication across all surgical specialties. A systematic review of the literature was performed examining existing research on VR use for preoperative surgical team planning and interdisciplinary communication across all surgical fields in order to optimize surgical efficiency. MEDLINE, SCOPUS, CINAHL databases were searched from inception to July 31, 2022 using standardized search clauses. A qualitative data synthesis was performed with particular attention to preoperative planning, surgical efficiency optimization, and interdisciplinary collaboration/communication techniques determined a priori. Preferred Reporting Items for Systematic Review and Meta-Analysis guidelines were followed. All included studies were appraised for their quality using the Medical Education Research Study Quality Instrument (MERSQI) tool. One thousand and ninety-three non-duplicated articles with abstract and full text availability were identified. Thirteen articles that examined preoperative VR-based planning techniques for optimization of surgical efficiency and/or interdisciplinary communication fulfilled inclusion and exclusion criteria. These studies had a low-to-medium methodological quality with a MERSQI mean score of 10.04 out of 18 (standard deviation 3.61). This review demonstrates that time spent rehearsing and visualizing patient-specific anatomical relationshipsin VR may improve operative efficiency and communication across multiple surgical specialties.

Neurosurgical skills analysis by machine learning models: systematic review.

Machine learning (ML) models are being actively used in modern medicine, including neurosurgery. This study aimed to summarize the current applications of ML in the analysis and assessment of neurosurgical skills. We conducted this systematic review in accordance with the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) guidelines. We searched the PubMed and Google Scholar databases for eligible studies published until November 15, 2022, and used the Medical Education Research Study Quality Instrument (MERSQI) to assess the quality of the included articles. Of the 261 studies identified, we included 17 in the final analysis. Studies were most commonly related to oncological, spinal, and vascular neurosurgery using microsurgical and endoscopic techniques. Machine learning-evaluated tasks included subpial brain tumor resection, anterior cervical discectomy and fusion, hemostasis of the lacerated internal carotid artery, brain vessel dissection and suturing, glove microsuturing, lumbar hemilaminectomy, and bone drilling. The data sources included files extracted from VR simulators and microscopic and endoscopic videos. The ML application was aimed at classifying participants into several expertise levels, analysis of differences between experts and novices, surgical instrument recognition, division of operation into phases, and prediction of blood loss. In two articles, ML models were compared with those of human experts. The machines outperformed humans in all tasks. The most popular algorithms used to classify surgeons by skill level were the support vector machine and k-nearest neighbors, and their accuracy exceeded 90%. The "you only look once" detector and RetinaNet usually solved the problem of detecting surgical instruments - their accuracy was approximately 70%. The experts differed by more confident contact with tissues, higher bimanuality, smaller distance between the instrument tips, and relaxed and focused state of the mind. The average MERSQI score was 13.9 (from 18). There is growing interest in the use of ML in neurosurgical training. Most studies have focused on the evaluation of microsurgical skills in oncological neurosurgery and on the use of virtual simulators; however, other subspecialties, skills, and simulators are being investigated. Machine learning models effectively solve different neurosurgical tasks related to skill classification, object detection, and outcome prediction. Properly trained ML models outperform human efficacy. Further research on ML application in neurosurgery is needed.

Effectiveness of Flexible Bronchoscopy Simulation-Based Training: A Systematic Review

The implementation of simulation-based training (SBT) to teach flexible bronchoscopy (FB) skills to novice trainees has increased during the last decade. However, it is unknown whether SBT is effective to teach FB to novices and which instructional features contribute to training effectiveness. How effective is FB SBT and which instructional features contribute to training effectiveness? We searched Embase, Pubmed, Scopus and Web of Science for articles on FB SBT for novice trainees until November 10, 2022. We assessed methodological quality of included studies using a modified version of the Medical Education Research Study Quality Instrument (MERSQI), evaluated risk of bias with relevant tools depending on study design, assessed instructional features and intended to correlate instructional features to outcome measures. We identified 14 studies from an initial pool of 544 studies. Eleven studies reported positive effects of FB SBT on the majority of their outcome measures. However, risk of bias was moderate or high in 8 studies and only 6 studies were of high quality (modified MERSQI score ≥ 12.5). Moreover, instructional features and outcome measures varied highly across studies and only 4 studies evaluated intervention effects on behavioral outcome measures in the patient setting. Simulation training programs in studies with the highest methodological quality and most relevant outcome measures all included curriculum integration and range in task difficulty. Although most studies reported positive effects of simulation training programs on their outcome measures, definitive conclusions regarding training effectiveness on actual bronchoscopy performance in patients could not be made, due to heterogeneity of training features and the sparse evidence of training effectiveness on validated behavioral outcome measures in a patient setting.

Current status of virtual reality simulation education for orthopedic residents: the need for a change in focus.

Advances in technology are changing surgical education. Simulation provides an important adjunct to operative experience. This pedagogy has arguably become more important in light of the COVID-19 pandemic, with resultant reduction in operative exposure for trainees. Virtual reality (VR) simulators may provide significant contribution to experiential learning; however, much of the investigative focus to date has, correctly, been on establishing validity evidence for these constructs. The aim of this work was to perform a scoping review to assess the current status of VR simulation education to determine curricular development efforts for orthopedic residents. With a trained medical librarian, searches of PubMed, EMBASE, and Web of Science were conducted for all articles in the last 10years (September 2011-September 2021). Controlled vocabulary Medical Subject Headings (MeSH) terms and natural language developed with subject matter experts describing virtual reality or VR simulation and orthopedic training were used. Two trained reviewers evaluated all abstracts for inclusion. Exclusion criteria were all articles that did not assess VR simulation education involving orthopedic residents. Data were extracted from the included full-text articles including: study design, type of participants, type of VR simulation, simulated orthopedic skill, type of educational event, learner assessment including Kirkpatrick's level, assessment of quality using the Medical Education Research Study Quality Instrument (MERSQI), and level of effectiveness (LoE). Initial search identified 1,394 articles, of which 61 were included in the final qualitative synthesis. The majority (54%) were published in 2019- 2021, 49% in Europe. The commonest VR simulator was ArthroS (23%) and the commonest simulated skill was knee arthroscopy (33%). The majority of studies (70%) focused on simulator validation. Twenty-three studies described an educational module or curriculum, and of the 21 (34%) educational modules, 43% were one-off events. Most modules (18/21, 86%) assessed learners at Kirkpatrick level 2. With regard to methodological quality, 44% of studies had MERSQI 11.5-15 and 89% of studies had LoE of 2. Two studies had LoE of 3. Current literature pertaining to VR training for orthopedic residents is focused on establishing validity and rarely forms part of a curriculum. Where the focus is education, the majority are discrete educational modules and do not teach a comprehensive amalgam of orthopedic skills. This suggests focus is needed to embed VR simulation training within formal curricula efforts guided by the work of Kern, and assess the efficacy of these against patient outcomes.

Towards best practice in developing motor skills: a systematic review on spacing in VR simulator-based psychomotor training for surgical novices

ObjectiveRepeated practice, or spacing, can improve various types of skill acquisition. Similarly, virtual reality (VR) simulators have demonstrated their effectiveness in fostering surgical skill acquisition and provide a promising, realistic environment for spaced training. To explore how spacing impacts VR simulator-based acquisition of surgical psychomotor skills, we performed a systematic literature review.MethodsWe systematically searched the databases PubMed, PsycINFO, Psychology and Behavioral Sciences Collection, ERIC and CINAHL for studies investigating the influence of spacing on the effectiveness of VR simulator training focused on psychomotor skill acquisition in healthcare professionals. We assessed the quality of all included studies using the Medical Education Research Study Quality Instrument (MERSQI) and the risk of bias using the Cochrane Collaboration’s risk of bias assessment tool. We extracted and aggregated qualitative data regarding spacing interval, psychomotor task performance and several other performance metrics.ResultsThe searches yielded 1662 unique publications. After screening the titles and abstracts, 53 publications were retained for full text screening and 7 met the inclusion criteria. Spaced training resulted in better performance scores and faster skill acquisition when compared to control groups with a single day (massed) training session. Spacing across consecutive days seemed more effective than shorter or longer spacing intervals. However, the included studies were too heterogeneous in terms of spacing interval, obtained performance metrics and psychomotor skills analysed to allow for a meta-analysis to substantiate our outcomes.ConclusionSpacing in VR simulator-based surgical training improved skill acquisition when compared to massed training. The overall number and quality of available studies were only moderate, limiting the validity and generalizability of our findings.

A Modified Medical Education Research Study Quality Instrument (MMERSQI) developed by Delphi consensus

BackgroundThe Medical Education Research Study Quality Instrument (MERSQI) is widely used to appraise the methodological quality of medical education studies. However, the MERSQI lacks some criteria which could facilitate better quality assessment. The objective of this study is to achieve consensus among experts on: (1) the MERSQI scoring system and the relative importance of each domain (2) modifications of the MERSQI.MethodA modified Delphi technique was used to achieve consensus among experts in the field of medical education. The initial item pool contained all items from MERSQI and items added in our previous published work. Each Delphi round comprised a questionnaire and, after the first iteration, an analysis and feedback report. We modified the quality instruments’ domains, items and sub-items and re-scored items/domains based on the Delphi panel feedback.ResultsA total of 12 experts agreed to participate and were sent the first and second-round questionnaires. First round: 12 returned of which 11 contained analysable responses; second-round: 10 returned analysable responses. We started with seven domains with an initial item pool of 12 items and 38 sub-items. No change in the number of domains or items resulted from the Delphi process; however, the number of sub-items increased from 38 to 43 across the two Delphi rounds. In Delphi-2: eight respondents gave ‘study design’ the highest weighting while ‘setting’ was given the lowest weighting by all respondents. There was no change in the domains’ average weighting score and ranks between rounds.ConclusionsThe final criteria list and the new domain weighting score of the Modified MERSQI (MMERSQI) was satisfactory to all respondents. We suggest that the MMERSQI, in building on the success of the MERSQI, may help further establish a reference standard of quality measures for many medical education studies.

Design and Evaluation for Immersive Virtual Reality Learning Environment: A Systematic Literature Review

This systematic review broadly attempted to synthesize all relevant evidence residing in the Scopus, IEEE Xplore and MDPI databases, in order to inform the related Research Questions of this work. More precisely, the review protocol includes a broad and comprehensive search for eligible data sets from the Scopus, IEEE Xplore and MDPI databases, published from January 2017 to December 2022 by using inclusion/exclusion search criteria. Medical Education Research Study Quality Instrument (MERSQI) was commissioned to assess and analyze the quality of 69 quantitative studies. The findings generally received positive feedback and there was a discussion about the results. This work was an original contribution guided by pedagogical theory and the validity of the evaluation constitutes a proposal for future improvement.

A Narrative Review of Immersive Technology Enhanced Learning in Healthcare Education

Immersive technology is a growing field in healthcare education—attracting educationalists to evaluate its utility. There has been a trend of increasing research in this field; however, a lack of quality assurance surrounding the literature prompted the narrative review. Web Of Science database searches were undertaken from 2002 to the beginning of 2022. The studies were divided into three mixed reality groups: virtual reality (VR), augmented reality (AR), 360 videos, and learning theory subgroups. Appraising 246 studies with the Medical Education Research Study Quality Instrument (MERSQI) indicated a gap in the validation of measures used to evaluate the technology. Although, those conducted in VR or those detailing learning theories scored higher according to MERSQI. There is an educational benefit to immersive technology in the healthcare setting. However, there needs to be caution in how the findings are interpreted for application beyond the initial study and a greater emphasis on research methods.

Educational interventions to improve ergonomics in gastrointestinal endoscopy: a systematic review.

Background and study aims Endoscopists are at high risk of musculoskeletal pain and injuries (MSPI). Recently, ergonomics has emerged as an area of interest to reduce and prevent the incidence of MSPI in endoscopy. The aim of this systematic review was to determine educational interventions using ergonomic strategies that target reduction of endoscopist MSPI from gastrointestinal endoscopy. Methods In December 2020, we conducted a systematic search in MEDLINE, EMBASE, PsycINFO, Web of Science, Scopus, the Cochrane Central Register of Controlled Trials and the Cochrane Database of Systematic Reviews for articles published from inception to December 16, 2020. Studies were included if they investigated educational interventions aimed at changing knowledge and/or behaviors related to ergonomics in gastrointestinal endoscopy. After screening and full-text review, we extracted data on study design, participants, type of training, and assessment of primary outcomes. We evaluated study quality with the Medical Education Research Study Quality Instrument (MERSQI). Results Of the initial 575 records identified in the search, five met inclusion criteria for qualitative synthesis. We found that most studies (n = 4/5, 80 %) were single-arm interventional studies that were conducted in simulated and/or clinical settings. The most common types of interventions were didactic sessions and/or videos (n = 4/5, 80%). Two (40 %) studies used both standardized assessment studies and formal statistical analyses. The mean MERSQI score was 9.7. Conclusions There is emerging literature demonstrating the effectiveness of interventions to improve ergonomics in gastrointestinal endoscopy.

A Scoping Review and Appraisal of Extracorporeal Membrane Oxygenation Education Literature.

BackgroundDespite a recent rise in publications describing extracorporeal membrane oxygenation (ECMO) education, the scope and quality of ECMO educational research and curricular assessments have not previously been evaluated.ObjectiveThe purposes of this study are 1) to categorize published ECMO educational scholarship according to Bloom’s educational domains, learner groups, and content delivery methods; 2) to assess ECMO educational scholarship quality; and 3) to identify areas of focus for future curricular development and educational research.MethodsA multidisciplinary research team conducted a scoping review of ECMO literature published between January 2009 and October 2021 using established frameworks. The Medical Education Research Study Quality Instrument (MERSQI) was applied to assess quality.ResultsA total of 1,028 references were retrieved; 36 were selected for review. ECMO education studies frequently targeted the cognitive domain (78%), with 17% of studies targeting the psychomotor domain alone and 33% of studies targeting combinations of the cognitive, psychomotor, and affective domains. Thirty-three studies qualified for MERSQI scoring, with a median score of 11 (interquartile range, 4; possible range, 5–18). Simulation-based training was used in 97%, with 50% of studies targeting physicians and one other discipline.ConclusionECMO education frequently incorporates simulation and spans all domains of Bloom’s taxonomy. Overall, MERSQI scores for ECMO education studies are similar to those for other simulation-based medical education studies. However, developing assessment tools with multisource validity evidence and conducting multienvironment studies would strengthen future work. The creation of a collaborative ECMO educational network would increase standardization and reproducibility in ECMO training, ultimately improving patient outcomes.