Three-round Modified Delphi Process Research Articles

Career Advancement for Surgeon-Educators:Findings from a Modified Delphi Process

Reward and recognition of surgical education as an academic activity remains a highly variable process between institutions. The goal of this study is to provide expert consensus definition of an academic surgical educator, with focus on criteria for academic promotion. Following IRB approval, a Web-based modified Delphi process was used to generate prioritized academic promotion criteria for surgical educators. Participants were recruited nationally from a pool of senior academic surgeons who are members of the Society of University Surgeons and the Society of Surgical Chairs. Following a three-round modified Delphi process, the top domains of educational activity for promotion to associate professor and professor were scholarship, teaching, and administration; mentorship was also a priority category for promotion to professor. The top three activities described for promotion to Associate Professor were active participation in conferences/ departmental educational activities for medical students and residents; educational portfolio demonstrating commitment to activities as an educator; and clinical teaching excellence at their home institution. The three activities most highly scored items for promotion to Professor were mentorship of junior surgical educators; active participation in conferences/ departmental educational activities for medical students and residents; and a record of teaching excellence at the medical student and resident levels. These findings demonstrate a progression from teacher to scholar to leader across a surgical educator's career, with each level incorporating and building upon the prior activities. Identification of categories and criteria may meaningfully inform best practices to be incorporated into the career development and promotion processes for surgeons on an educator academic pathway.

South African guidelines on the determination of death.

Death is a medical occurrence that has social, legal, religious and cultural consequences requiring common clinical standards for its diagnosis and legal regulation. This document compiled by the Critical Care Society of Southern Africa outlines the core standards for determination of death in the hospital context. It aligns with the latest evidence-based research and international guidelines and is applicable to the South African context and legal system. The aim is to provide clear medical standards for healthcare providers to follow in the determination of death, thereby promoting safe practices and high-quality care through the use of uniform standards. Adherence to such guidelines will provide assurance to medical staff, patients, their families and the South African public that the determination of death is always undertaken with diligence, integrity, respect and compassion, and is in accordance with accepted medical standards and latest scientific evidence. The consensus guidelines were compiled using the AGREE II checklist with an 18-member expert panel participating in a three-round modified Delphi process. Checklists and advice sheets were created to assist with application of these guidelines in the clinical environment (https://criticalcare.org.za/resource/death-determination-checklists/). Key points • Brain death and circulatory death are the accepted terms for defining death in the hospital context. • Death determination is a clinical diagnosis which can be made with complete certainty provided that all preconditions are met. • The determination of death in children is held to the same standard as in adults but cannot be diagnosed in children <36 weeks' corrected gestation. • Brain-death testing while on extra-corporeal membrane oxygenation is outlined. • Recommendations are given on handling family requests for accommodation and on consideration of the potential for organ donation. • The use of a checklist combined with a rigorous testing process, comprehensive documentation and adequate counselling of the family are core tenets of death determination. This is a standard of practice to which all clinicians should adhere in end-of-life care.

South African guidelines on the determination of death.

Death is a medical occurrence that has social, legal, religious and cultural consequences requiring common clinical standards for its diagnosis and legal regulation. This document compiled by the Critical Care Society of Southern Africa outlines the core standards for determination of death in the hospital context. It aligns with the latest evidence-based research and international guidelines and is applicable to the South African context and legal system. The aim is to provide clear medical standards for healthcare providers to follow in the determination of death, thereby promoting safe practices and high-quality care through the use of uniform standards. Adherence to such guidelines will provide assurance to medical staff, patients, their families and the South African public that the determination of death is always undertaken with diligence, integrity, respect and compassion, and is in accordance with accepted medical standards and latest scientific evidence. The consensus guidelines were compiled using the AGREE II checklist with an 18-member expert panel participating in a three-round modified Delphi process. Checklists and advice sheets were created to assist with application of these guidelines in the clinical environment (https://criticalcare.org.za/resource/death-determination-checklists/). Brain death and circulatory death are the accepted terms for defining death in the hospital context.Death determination is a clinical diagnosis which can be made with complete certainty provided that all preconditions are met.The determination of death in children is held to the same standard as in adults but cannot be diagnosed in children <36 weeks' corrected gestation.Brain-death testing while on extra-corporeal membrane oxygenation is outlined.Recommendations are given on handling family requests for accommodation and on consideration of the potential for organ donation.The use of a checklist combined with a rigorous testing process, comprehensive documentation and adequate counselling of the family are core tenets of death determination. This is a standard of practice to which all clinicians should adhere in end-of-life care.

Motivation theory-based physical activity programme for older adults in residential care facility: A modified Delphi and single-group pretest-posttest study.

Physical inactivity exposes older adults living in long-term care institutions to a high risk of health deterioration. Developing effective behaviour change interventions based on a theoretical framework is a pressing concern. This study developed an 'Easy Walking' intervention programme based on the Wheel of Motivation and aimed to: (1) develop the intervention programme for promoting self-efficacy of older adults living in long-term care facilities; and (2) examine the perceived helpfulness of the intervention programme for encouraging walking behaviours. This study consisted of two stages. In the first stage, a three-round modified Delphi process was conducted with ten experts to rate the eight motivators in the Wheel of Motivation. The Easy Walking programme was designed accordingly. In the second stage, a single-group pretest-posttest study design was employed to evaluate the Easy Walking programme. Structured questionnaires were used to collect data on the changes in self-efficacy and on the perceived helpfulness regarding the programme. The Easy Walking intervention programme features eight factors that influence motivation. Thirty older adults participated in and evaluated the programme. The results showed a significant difference in self-efficacy (t=-7.02, p<.001) of the older adults. Regarding the perceived usefulness of the intervention, the mean scores for each item ranged from 3.73 to 4.93 points. 'Safe environment' was perceived to be the most helpful factor for encouraging walking behaviours. The Easy Walking programme enhanced the self-efficacy of institutionalised older adults and was perceived as helpful in physical activity engagement. Nursing professionals in long-term care institutions could implement the Easy Walking programme to be part of daily nursing activities.

Adaptation of the medical-nutrition therapy for patients with intestinal failure in a developing country: A modified Delphi survey

Intestinal Failure (IF) is a complex disease with huge impacts on our society due to complications. Therefore, in a developing country like Mexico without specialized IF clinics, health care professionals must provide evidence-based interventions for the IF patient. This study aims to achieve consensus on how to adapt the existing guidelines for IF to the local practices considering the available resources and local practices. A three-round modified Delphi process was used to build consensus on the most important interventions for our IF patients. For each round, data was collected and consensus was defined as ≥80% of agreement for each item. Descriptive statistics were used to determine whether a consensus was achieved. Ten content experts completed the three-round modified Delphi survey. Consensus was achieved for 98% of the items related to the hospitalized patient, ambulatory care management, and drug therapy. Some of these items are not included in the ESPEN guidelines for IF, but we considered that they are relevant in our clinical practice, like the calculation of fluids for patients with very low body weight, screening for refeeding syndrome and the use of some conventional drugs to promote intestinal rehabilitation. Using a three-round modified Delphi process, consensus was achieved for nearly all items. This represents a starting point for the improvement of our local practices towards this complex disease, leading to better outcomes and the implementation of evidence-based protocolized interventions which can have an important impact due to the lack of access to some of the most novel pharmacological therapies like the glucagon-like-peptide (GLP-2) analog.

Practice Recommendations for Transcranial Doppler Ultrasonography in Critically Ill Children in the Pediatric Intensive Care Unit: A Multidisciplinary Expert Consensus Statement.

Transcranial Doppler ultrasonography (TCD) is being used in many pediatric intensive care units (PICUs) to aid in the diagnosis and monitoring of children with known or suspected pathophysiological changes to cerebral hemodynamics. Standardized approaches to scanning protocols, interpretation, and documentation of TCD examinations in this setting are lacking. A panel of multidisciplinary clinicians with expertise in the use of TCD in the PICU undertook a three-round modified Delphi process to reach unanimous agreement on 34 statements and then create practice recommendations for TCD use in the PICU. Use of these recommendations will help to ensure that high quality TCD images are captured, interpreted, and reported using standard nomenclature. Furthermore, use will aid in ensuring reproducible and meaningful study results between TCD practitioners and across PICUs.

Core Outcome Measures for Research in Critically Ill Patients Receiving Extracorporeal Membrane Oxygenation for Acute Respiratory or Cardiac Failure: An International, Multidisciplinary, Modified Delphi Consensus Study.

Research evaluating outcomes in critically ill patients with acute respiratory and cardiac failure supported with extracorporeal membrane oxygenation has increased significantly. The objective was to identify a core set of outcomes that are essential to include in all clinical research evaluating the use of either venoarterial or venovenous extracorporeal membrane oxygenation in critically ill patients, particularly regarding safety and adverse events. A three-round modified Delphi process. Patients, caregivers, multidisciplinary clinicians, researchers, industry partners, and research funders were included. Participants represented key extracorporeal membrane oxygenation organizations, including the Extracorporeal Life Support Organization, the International Extracorporeal Membrane Oxygenation Network, clinicians from high volume extracorporeal membrane oxygenation centers, and extracorporeal membrane oxygenation researchers or former extracorporeal membrane oxygenation patients from five continents. We used recommended standards for the development of a core outcome set. Outcome measures identified from systematic reviews of the literature and from qualitative studies of survivors were mapped to the domains identified by the Core Outcome Measures in Effectiveness Trials initiative separately for venovenous extracorporeal membrane oxygenation and venoarterial extracorporeal membrane oxygenation. Participant response rates were 40 of 47 (85%), 35 of 37 (95%), and 64 of 69 (93%) for survey rounds 1, 2, and 3, respectively, with participants representing 10 different countries on five continents. After the third round survey, 8 outcome measures met consensus for both venovenous extracorporeal membrane oxygenation and venoarterial extracorporeal membrane oxygenation. This study identified core outcomes to assess in all research evaluating the use of extracorporeal membrane oxygenation, including adverse events specific to this intervention, permitting standardization of outcome reporting for the first time. Identifying appropriate measurement instruments to evaluate these outcomes is an important next step to enable synthesis of extracorporeal membrane oxygenation research.

Curated Collection for Educators: Five Key Papers About Second Victim Syndrome.

Second victim syndrome (SVS) is defined as the psychological or emotional suffering of healthcare workers as a result of a patient adverse, or near miss, event. Initially thought to be related to medical error, we now recognize that SVS can result from a much wider range of circumstances including adverse pediatric patient events, unanticipated deaths, or patients well known to the provider. Residents are particularly susceptible to SVS yet relatively little is written about this topic targeted at their educators. Since educators are positioned to help recognize and guide learners through the experience, this paper targets that reader audience. In this article, we identify and summarize five key papers relevant to educators interested in learning more about SVS as it relates to learners.We identified an extensive list of papers relevant to SVS via online discussions within the Academic Life in Emergency Medicine (ALiEM) Faculty Incubator. The Faculty Incubator is a digital community of practice providing professional development for educators. This list was augmented by an open call on Twitter seen by over 2000 people and yielding a list of 31 papers. We then conducted a three-round modified Delphi process within the authorship group, which included both junior and senior clinician educators, to identify the most impactful papers for educators interested in SVS.The three-round modified Delphi process ranked all papers submitted for review and used iterative rounds to select the five highest-rated papers for inclusion in this article. The group then summarized each of the five papers with specific consideration for junior faculty educators and faculty developers with an interest in SVS in learners.The five papers featured in this article serve as a key reading list for educators across specialties interested in SVS and our commentary provides context for medical educators using the articles.

Development of a simple, practice-based tool to assess quality of paediatric emergency care delivery in resource-limited settings: identifying critical actions via a Delphi study

ObjectiveProvision of timely, high-quality care for the initial management of critically ill children in African hospitals remains a challenge. Monitoring the completion of critical actions during resuscitations can inform efforts...

Identifying student learning competencies for urban underserved practice using a Delphi process

IntroductionThe pharmacy profession has a growing opportunity to provide high-quality patient care to urban underserved patients. The Accreditation Council for Pharmacy Education (ACPE) has also recognized the necessity of training pharmacy students to care for underserved patients within Standard 3.5 in Standards 2016. Despite this recognized need to train students to care for urban underserved patients, there is limited literature to guide schools and colleges of pharmacy in developing learning activities and curricula to meet this need. MethodsThis study utilized a three-round modified Delphi process to develop learning competencies. Participation was solicited from pharmacy practice faculty members of the American Association of Colleges of Pharmacy (AACP) Health Disparities and Cultural Competency Special Interest Group (SIG). This study used a proportion of experts rating agree or strongly agree at 80% to determine consensus. ResultsThe expert pool had a combined 235 years of pharmacy practice experience in urban underserved settings. Ten learning competencies were developed and finalized: Identified learning competencies related to the development of pharmaceutical and social knowledge base; development of pharmaceutical care and social skills; and building awareness of benefits and disadvantages of working with urban underserved patient populations. DiscussionThe learning competencies described in this study provide schools and colleges of pharmacy a tool to help guide learning activity and curricular development to educate students to provide high-quality and compassionate care to urban underserved patients. ConclusionsThis study is the first description of practice-based student learning competencies for urban underserved pharmacy practice in the literature.

Curated Collection for Educators: Five Key Papers about the Flipped Classroom Methodology.

The flipped classroom (FC) pedagogy is becoming increasingly popular in medical education due to its appeal to the millennial learner and potential benefits in knowledge acquisition. Despite its popularity and effectiveness, the FC educational method is not without challenges. In this article, we identify and summarize several key papers relevant to medical educators interested in exploring the FC teaching methodology.The authors identified an extensive list of papers relevant to FC pedagogy via online discussions within the Academic Life in Emergency Medicine (ALiEM) Faculty Incubator. This list was augmented by an open call on Twitter (utilizing the #meded, #FOAMed, and #flippedclassroom hashtags) yielding a list of 33 papers. We then conducted a three-round modified Delphi process within the authorship group, which included both junior and senior clinician educators, to identify the most impactful papers for educators interested in FC pedagogy.The three-round modified Delphi process ranked all of the selected papers and selected the five most highly-rated papers for inclusion. The authorship group reviewed and summarized these papers with specific consideration given to their value to junior faculty educators and faculty developers interested in the flipped classroom approach.The list of papers featured in this article serves as a key reading list for junior clinician educators and faculty developers interested in the flipped classroom technique. The associated commentaries contextualize the importance of these papers for medical educators aiming to optimize their understanding and implementation of the flipped classroom methodology in their teaching and through faculty development.

Editors’ Perspectives on Enhancing Manuscript Quality and Editorial Decisions Through Peer Review and Reviewer Development

Objectives. To identify peer reviewer and peer review characteristics that enhance manuscript quality and editorial decisions, and to identify valuable elements of peer reviewer training programs. Methods. A three-school, 15-year review of pharmacy practice and pharmacy administration faculty's publications was conducted to identify high-publication volume journals for inclusion. Editors-in-chief identified all editors managing manuscripts for participation. A three-round modified Delphi process was used. Rounds advanced from open-ended questions regarding actions and attributes of good reviewers to consensus-seeking and clarifying questions related to quality, importance, value, and priority. Results. Nineteen editors representing eight pharmacy journals participated. Three characteristics of reviews were rated required or helpful in enhancing manuscript quality by all respondents: includes a critical analysis of the manuscript (88% required, 12% helpful), includes feedback that contains both strengths and areas of improvement (53% required, 47% helpful), and speaks to the manuscript's utility in the literature (41% required, 59% helpful). Hands-on experience with review activities (88%) and exposure to good and bad reviews (88%) were identified as very valuable to peer reviewer development. Conclusion. Reviewers, individuals involved in faculty development, and journals should work to assist new reviewers in defining focused areas of expertise, building knowledge in these areas, and developing critical analysis skills.

Identifying and Prioritizing Gaps in Neuroendocrine Tumor Research: A Modified Delphi Process With Patients and Health Care Providers to Set the Research Action Plan for the Newly Formed Commonwealth Neuroendocrine Tumor Collaboration.

PurposeNeuroendocrine tumors (NETs) are a diverse group of malignancies that pose challenges common to all rare tumors. The Commonwealth Neuroendocrine Tumor Collaboration (CommNETS) was established in 2015 to enhance outcomes for patients with NETs in Canada, Australia, and New Zealand. A modified Delphi process was undertaken involving patients, clinicians, and researchers to identify gaps in NETs research to produce a comprehensive and defensible research action plan.MethodsA three-round modified Delphi process was undertaken with larger representation than usual for medical consensus processes. Patient/advocate and health care provider/researcher expert panels undertook Round 1, which canvassed 17 research priorities and 42 potential topics; in Round 2, these priorities were ranked. Round 3 comprised a face-to-face meeting to generate final consensus rankings and formulate the research action plan.ResultsThe Delphi groups consisted of 203 participants in Round 1 (64% health care providers/researchers, 36% patient/advocates; 52% Canadian, 32% Australian, and 17% New Zealander), of whom 132 participated in Round 2. The top eight priorities were biomarker development; peptide receptor radionuclide therapy optimization; trials of new agents in advanced NETs; functional imaging; sequencing therapies for metastatic NETs, including development of validated surrogate end points for studies; pathologic classification; early diagnosis; interventional therapeutics; and curative surgery. Two major areas were ranked significantly higher by patients/advocates: early diagnosis and curative surgery. Six CommNETS working parties were established.ConclusionThis modified Delphi process resulted in a well-founded set of research priorities for the newly formed CommNETS collaboration by involving a large, diverse group of stakeholders. This approach to setting a research agenda for a new collaborative group should be adopted to ensure that research plans reflect unmet needs and priorities in the field.