Hybrid Delphi Research Articles

Technological, Organizational, and Environmental Factors Affecting the Adoption of Electric Vehicle Battery Recycling

The rising usage of electric vehicle batteries (EVBs) has led to the unprecedented accumulation of battery waste—creating environmental problems and raw material shortages as the batteries approach their end of life (EOL). This article examines the critical enablers of EVB recycling adoption. Using a theoretical lens for technology adoption, the article further explains the enablers of EVB recycling by extending the technological, organizational, and environmental framework. The present article adopts a hybrid Delphi approach to explore the interdependent cause-and-effect relationships of the enablers. The integrated framework has been tested by obtaining data from multiple stakeholder groups consisting of academic researchers, practitioners, and policy planners in India. The framework is followed by a comparative assessment of the multiple stakeholder perceptions, highlighting the similarities and differences. A consensus among all stakeholders is observed regarding the significance of a business model with take-back systems to enable EVB recycling adoption. This article shows how organizational factors strongly enable favorable decisions more than the technological and environmental counterparts. Differences were observed between the practitioners favoring technological enablers over other dimensions, while the policy planners equitably considered all dimensions, and the academic researchers showed an intermediate perspective for EVB recycling innovations. The findings offer theoretical and practical insights to help managers, organizations, and policy planners prioritize their efforts to promote EVB recycling adoption.

Measures and Recommendations for Ensuring Adequate Inpatient Care Capacities for Pandemic Management within a Region: Results of a Hybrid Delphi Method

Since the beginning of the pandemic in spring 2020, inpatient healthcare has been under enormous burden, which is reflected especially in overworked staff, imprecise bed planning and/or data transfer. According to the recommendation of the Science Council, university clinics should play a controlling role in regional healthcare and act in conjunction with surrounding hospitals and practices. In September 2021, 31 representatives from 18 university hospitals were invited to a hybrid Delphi study with a total of 4 survey rounds to discuss criteria for effective inpatient care in a pandemic situation, which were extracted from previous expert interviews. Criteria that were classified as very important/relevant by≥75% of the participants in the first round of the survey (consensus definition) were then further summarized in 4 different small groups. In a third Delphi round, all participants came together again to discuss the results of the small group discussions. Subsequently, these were prioritized as Optional ("can"), Desirable ("should") or Necessary ("must") recommendations. Of the invited clinical experts, 21 (67.7%) participated in at least one Delphi round. In an online survey (1st Delphi round), 233 criteria were agreed upon and reduced to 84 criteria for future pandemic management in four thematic small group discussions (2nd Delphi round) and divided into the small groups as follows: "Crisis Management and Crisis Plans" (n=20), "Human Resources Management and Internal Communication" (n=16), "Regional Integration and External Communication" (n=24) and "Capacity Management and Case & Care" (n=24). In the following group discussion (3rd Delphi round), the criteria were further modified and agreed upon by the experts, so that in the end result, there were 23 essential requirements and recommendations for effective inpatient care in a pandemic situation. The results draw attention to key demands of clinical representatives, for example, comprehensive digitization, standardization of processes and better (supra) regional networking in order to be able to guarantee needs-based care even under pandemic conditions. The present consensus recommendations can serve as guidelines for future pandemic management in the inpatient care sector.

The Use of Sequential Surveys to Shorten Implementation Time for Healthcare System-Level Enhanced Recovery After Surgery (ERAS) Pathways.

Enhanced Recovery After Surgery (ERAS) pathways improve healthcare quality, safety, and cost-effectiveness. We hypothesized that the RAND Method (a hybrid Delphi approach), involving anonymous sequential surveys and face-to-face meetings, would allow for more rapid agreement and initiation of new ERAS pathways. Using the ERAS Society guidelines for cesarean section as a baseline, our institution's ERAS Leadership Team (ELT) compiled published literature and institutional practices to design a 32-component survey that was sent to obstetricians, nurse midwives, anesthesiologists, pharmacists, and nurses. Components that did not reach 90% consensus were included in a second survey the following week, and meetings were held to review results. At the conclusion of this process, time to agreement was retrospectively compared to the colorectal ERAS pathway process at this institution. ERAS pathway components were compiled and reviewed by 121 stakeholders at 7 hospitals using iterative surveys with review meetings over a 13-week period. Survey response rates were 61% and 50% in the initial and follow-up surveys, respectively. There was agreement on 28/32 and 32/32 items on the initial and follow-up surveys. Using the RAND Method, time to agreement decreased by 54.1% (24 vs 13weeks) compared to prior system-wide efforts to standardize the colorectal surgery ERAS pathway. With rapidly expanding healthcare systems, effective methods to gain consensus and adopt ERAS pathways are critical to implementation of ERAS guidelines. We demonstrate that the RAND Method allows for a transparent and efficient means of agreement across a diverse group of clinicians practicing in several settings.

Using a hybrid Delphi hierarchical process, the development of a holistic index to measure city competitiveness in Malaysia: a case study from Penang Island

Using a hybrid Delphi hierarchical process, the development of a holistic index to measure city competitiveness in Malaysia: a case study from Penang Island

Mental Health Peer Worker Perspectives on Resources Developed from Lived Experience Research Findings: A Delphi Study.

Lived experience research is potentially useful for assisting the recovery journeys of people experiencing mental health challenges, when presented in user-friendly formats. Consumer peer workers are ideally placed to introduce such resources to the people they work with. This study sought to explore the perspectives of expert consumer peer workers on the potential use of lived experience research resources in peer work practice. In particular: (1) what research topics would be most useful; and (2) what considerations are important for developing user-friendly and useful resources using findings from this research. A hybrid Delphi study was conducted. Eighteen expert peer workers participated in online group interviews, which included a semi-structured discussion and modified nominal group technique. These were followed by two rounds of surveys, which focused on prioritising the identified topics. Participants identified 47 topics suitable for lived experience research resources, 42 of which reached consensus as useful for consumers. A priority list of topics for use in peer work was identified through examination and grouping of peer worker rankings of the usefulness of resources for their work with consumers. The highest priority topics were as follows: developing and maintaining social networks; how peer workers can support consumers in their recovery journey; having choice with medications and participating in the decision-making process; and knowing your rights and responsibilities. Participants noted, however, that the usefulness of each topic ultimately depended on individual consumer’s needs. They highlighted that a variety of formats and presentation were required to reach diverse consumer groups.

An Integrated Fuzzy Goal Programming—Theory of Constraints Model for Production Planning and Optimization

Manufacturing companies are under constant pressure to optimize the economic sustainability of their production systems. Production planning and optimization is a well-established strategy for considering resource constraints and improving economic productivity. This study proposes an integrated fuzzy goal planning and the theory of constraints for production planning and optimization. To this end, a hybrid Delphi–Buckley method was used to identify the relevant goals and a paired matrix questionnaire was used to determine the fuzzy weights of the goals. Furthermore, a fuzzy bottleneck detection algorithm was used to deal with the bottlenecks. A case study in the cable industry is presented to demonstrate the applicability and exhibit the efficiency of the proposed model. The results indicate that production planning in the cable industry could experience less deviation, almost 11% less, from the goals by applying the fuzzy goal programming under the theory of constraints, compared to the traditional method or crisp-goal programming.

Development of a veterinary emergency open standard competency framework using a competency-based model of medical education.

To address the shortage of emergency veterinarians, the profession is exploring accelerated training pathways. We sought to contribute to the solution by developing the foundation for an open standard, competency-based veterinary emergency training curriculum for use by any program. We also developed a curricular delivery, tracking, and assessment system to demonstrate how the framework can be integrated into training programs. DESIGN: Hybrid Delphi method. SETTING: Academia and referral practice. ANIMALS: None. None. An emergency veterinary competency framework was developed by adapting the human Model of the Clinical Practice of Emergency Medicine, which aligns with the Competency-Based Veterinary Education framework, to produce 4 areas of core competency: Patient Care, Interpersonal/Communication, Professionalism, and Practice-based Learning/Improvement. A comprehensive list of veterinary emergency skills was generated and organized within the framework utilizing the hybrid Delphi method. An initial survey completed by 133 emergency and critical care specialists and emergency room clinicians produced data regarding the value of specific skills. An 11-member focus group consisting of survey participants iterated upon the survey results to produce a master library of skills and cases, including 56 Patient Care, 43 Interpersonal/Communication, 11 Practice-based Learning/Improvement, and 20 Professionalism skills, as well as 155 case types. The curricular delivery system tracks and assesses case management proficiency and development of knowledge and professional skills using a patient care eLearning program and simulation training environment. CONCLUSIONS: The increasing need for emergency veterinarians is a shared industry-wide challenge. To contribute toward a collective solution, we have undergone an evidence-based process to create the foundation for an open standard competency framework composed of a library of skills and cases. We offer this open standard framework to the veterinary profession and hope it continues to grow and evolve as we drive toward developing competency-based training programs that address the shortage of emergency veterinarians.

Identifying and Ranking Contractor Insurance Challenges in Construction Projects using Hybrid Delphi and Fuzzy Best-Worst Method

Contractors help the government in carrying out construction and service projects. To reduce the risks resulting from the preparation and implementation of construction projects, the insurance industries should cooperate to include risk management. Contractors are facing many challenges regarding their insurance. Therefore, in this study, significant attention has been paid to identifying and ranking the challenges of contractor insurance in construction projects. The required information has been collected through the Delphi method and the opinions of experts in contracting companies. To identify the challenges, an open-ended questionnaire was distributed among the experienced insurance officials and 38 challenges have been identified. The relevant challenges formed the basis of a closed-ended questionnaire and the respondents were asked to re-evaluate their accuracy. Then, the approved challenges were the basis of the fuzzy best-worst method for weighing and ranking the related challenges. The results showed that the failure to provide specific consultation to contractors regarding the legal obligations of social security is the most important challenge in the field of contract insurance.

Using Consensus Group Methods to Formulate Core Components of the Post‐Incarceration Engagement Program

Research ObjectiveFor successful implementation and spread of an intervention, identifying its core components is essential for fidelity, adaptation, replication, and evaluation. However, an intervention’s core components are often gradually refined, as the intervention’s outcomes are repeatedly examined alongside actually implemented components. When empirical evidence is limited, as is often the case with early implementation of innovative interventions, consensus group methods can be used to gather and synthesize expert opinions to determine and refine intervention core components. We used aspects of the Delphi method, hybrid Delphi method, and nominal group technique to determine an intervention’s initial core components.Study DesignThis approach was devised in the context of the VA’s Post‐Incarceration Engagement (PIE) intervention, which uses peer support to provide better linkage to health care and other needed services to veterans recently released from incarceration. Utilizing an iterative approach, a four‐person expert panel of PIE developers/implementers and a two‐person moderator team followed these steps: Panel members individually suggested PIE intervention core components using a worksheet. Moderators reviewed the suggested components, removing duplicates and consolidated them into a preliminary list of core components categorized by theme. Moderators facilitated a panel meeting to discuss and clarify overlapping/distinct suggestions. Moderators drafted an updated list of core components and their definitions, based on the facilitated panel meeting. Panel members individually suggested revisions to the list, using an updated structured worksheet. Moderators reviewed the suggested revisions, incorporating ones that were consistent across the panel and organizing suggestions into the list. To resolve inconsistent suggestions, moderators may facilitate another panel meeting for consensus reaching and then return to Step 4. If not, the latest list is considered to reflect the initial core components of the innovation. Population StudiedThe PIE intervention was conducted by two peer support specialists over a two‐year period in one state. The consensus process included an expert panel of four study team members and two moderators.Principal FindingsThe PIE intervention has three core aims: improve linkage, social support, and skill building for veterans returning to community after incarceration. The consensus effort identified 20 core components at preimplementation, implementation, and sustainment stages. The identified components were sorted into three domains: (i) onboarding of peers; (ii) peers’ veteran‐facing work; and (iii) ongoing peer supervision, coordination, and networking. Iterative review of components determined a final set of 21 core components, refined definitions of roles and tasks, and specified preconditions of implementation.ConclusionsThe iterative hybrid Delphi approach allowed the research team to determine the initial core components of a complex intervention. As scale‐up continues, analyzing modifications made to the intervention during its spread to other states will be essential to determining the stability of core components.Implications for Policy or PracticeWhen implementing an intervention, specifying the core components is critical to (i) assess the success of the implementation and (ii) prioritize components when resources are limited. The iterative hybrid Delphi approach offers steps toward determining core components of interventions that have yet to be tested.Primary Funding SourceDepartment of Veterans Affairs.

Mentee characteristics in inter-organizational mentoring for managers: a hybrid Delphi survey

PurposeInter-organizational mentoring (IOM) is a human resource development tool that is used when the mentor and mentee belong to different organizations. As mentees are the focus of the IOM process, the success of this type of program is highly reliant on their characteristics. Therefore, the purpose of this paper was to derive the most desirable characteristics for mentees in IOM.Design/methodology/approachAn intensive review of the literature on mentoring for managers and business professionals was carried out to identify mentee characteristics. These characteristics were then ranked for their importance to IOM using the Hybrid Delphi method (with 130 informants taking part in a Delphi survey and 19 expert IOM practitioners taking part in Focus Group and Nominal Group Technique sessions). An exploratory factor analysis identified the three main underlying factors behind the listed mentee characteristics.FindingsIn total, 17 relevant mentee characteristics were identified and ranked and then synthesized into three essential factors for the mentee. The results were discussed in the light of existing studies.Originality/valueThe mentee characteristics and factors identified in this study will be of great practical value to coordinators of IOM programs. Also, the review of the literature and the obtained results will help other researchers who wish to expand on this topic.

Quality Risk Management-A Role-Based Competency Model.

In collaboration with the Pharmaceutical Regulatory Science Team (PRST), a research team based at the Technological University Dublin (TU Dublin) in Ireland, a research study exploring the need for developing quality risk management (QRM) role-based competencies as fundamental elements to realizing QRM's benefits was conducted. The research study followed a hybrid Delphi research methodology of which elements are presented in the paper titled "Quality Risk Management Competency Model-Case for the need for QRM Competencies." This paper presents the second part of the Delphi research methodology, focusing on the results of a detailed technical and behavioral competencies questionnaire and a proposed QRM role-based competency model.

Estimating the Sustainability of Managed Natural Forests in Costa Rica—A Hybrid Delphi & Choice Experiment Approach

Management of natural forests in Costa Rica allows timber extraction in so far as it is guaranteed that the logging activities comply with diverse Sustainability Principles, Criteria and Indicators (PCIs). These are hierarchical and complex systems used, ex-ante in the formulation and approval of the Management Plan but have not been used for ex-post evaluation of managed forests. Development of sustainability evaluation systems that include few criteria is highly recommended. In that sense, the choice experiments contribute to simplification of the initial system of decision making, complementing a complex system of PCIs that permits detailed analysis of the management units. In this study, a choice experiment was included in a Delphi application and 5 key variables were identified to evaluate the sustainability of managed natural forests. These variables are, in order of importance—technical, legal and administrative conditions; external financing conditions; production performance; costs of preparing the Management Plan; and payment mechanisms for environmental services. The definition of these variables confirms not only that the technical, legal and administrative conditions are critical for sustainability but also that they could reflect the type of governance involved in sustainability forest management.

Quality Risk Management - A Role-Based Competency Model.

In collaboration with the Pharmaceutical Regulatory Science Team (PRST), a research team based at the Technological University Dublin (TU Dublin) in Ireland, a research study exploring the need for developing QRM role-based competencies, as fundamental elements to realizing Quality Risk Management 's benefits was conducted. The research study followed a hybrid Delphi research methodology of which elements are presented in paper titled ″Quality Risk Management Competency Model- Case for the need for QRM Competencies.″ This paper presents the second part of the Delphi research methodology, focusing on the results of a detailed technical and behavioral competencies questionnaire and a proposed QRM role-based competency model.

Application of a hybrid Delphi and aggregation–disaggregation procedure for group decision-making

A hybrid procedure for group multiple criteria decision analysis is introduced that consolidates a moderated Delphi process with an autonomous aggregation–disaggregation mechanism. The research is based on the assumption that both consolidated approaches can lead to synergistic effects when properly combined. The paper justifies the hybrid procedure by comparing the three approaches, and by assessing it with a preliminary case study that is based on several factors of a universal framework for the evaluation of group decision-making methods and systems. These factors address convergence of the decision-making process, conflict resolution and cognitive complexity. The paper aims to define the decision-making process completely and thoroughly, fully operationalize all steps of the hybrid procedure algorithmically and methodologically and provide an application of the procedure. The application shows that the process converges and imposes acceptable cognitive load on the decision-makers, which implies that the hybrid procedure is able to perform efficiently.

Quality Risk Management Competency Model-Case for the Need for QRM Competencies.

The Pharmaceutical Regulatory Science Team (PRST), a research team based at the Dublin Technological University (TU Dublin) in Ireland, recently conducted a Quality Risk Management (QRM) survey and a face-to-face focus group workshop to assess the level of formality of QRM roles in the biopharmaceutical sector. This was carried out as part of a research study, which identified the need for the development of QRM role-based competencies as fundamental to realizing QRM's benefits. The research study followed a hybrid Delphi research methodology composed of: (1) Survey 1, (2) focus group workshop, (3) Survey 2, and (4) competency model development. This paper presents the results of Survey 1 and the focus group workshop. Survey 1 explored the need for QRM role-based competencies and the subsequent face-to-face focus group workshop built on this to propose initial standard QRM roles, with a view to confirming these and developing associated competencies. This paper presents the findings from Survey 1 and the focus group workshop. The results of the follow-up research activities will be presented in a subsequent paper.LAY ABSTRACT: The publication of the ICH Q9 Quality Risk Management (QRM) guideline in 2005 has greatly impacted the biopharmaceutical sector. Fourteen years after Q9, the benefits of QRM are yet to be realized. The biopharmaceutical sector still struggles with the implementation of Q9 principles to effectively assess and manage product quality risks as a surrogate for patient safety.This paper looks at the need for standard QRM roles and the associated competencies for those roles.

An exploratory study of firm goals in the context of family firms: An institutional logics perspective

It is assumed that cross-firm behavioral differences are caused by the different goals owners and managers leave imprinted on their organizations. However, researchers have failed to come to agreement regarding what firm goals are, what types of firm goals exist, and to what extent one type of goal is superior to others. Therefore, the aim of this study is to address these gaps using the Hybrid Delphi methodology in the particular context of family firms. Our results provide a list of family business goals, an aggregation of family business goals based on institutional logics, and evidence of the coexistence of multiple goals.

Environmental and occupational health research and training needs in Colombia: A Delphi study.

Environmental factors contribute with 16% of the burden of disease in Colombia. A main obstacle in implementing national and regional environmental and occupational health policies is the limited knowledge on the local ability to study and control the impact of harmful exposures on health. To identify needs for research and training in environmental and occupational health in Colombia. We conducted a three-round hybrid Delphi study. A group of environmental and occupational health Colombian experts (n=16) from government agencies, universities, and research centers was recruited to participate in the study. Expert´s opinions on research and training needs were gathered through online questionnaires, followed by an in-person meeting. The percentage of agreement and the coefficient of variation were used to measure consensus. Air pollution and chemical products were considered the most important environmental and occupational exposures, due to their significant impact on chronic non-communicable diseases, such as respiratory diseases, cardiovascular diseases, and cancer. Research on the effects of outdoor air pollution on cardiovascular and respiratory diseases was considered of the greatest importance. Priority training areas included environmental and occupational health risk assessment, exposure modeling, advanced statistical methods, urban planning, occupational safety and hygiene, and epidemiology and toxicology. These findings provide a valuable input for the definition and implementation of national environmental and occupational health policies and for the development of a regional hub aimed at strengthening the capacity for research and training in Colombia.

Necesidades de investigación y formación en salud ambiental y ocupacional en Colombia: Un estudio Delphi

Introduction: Environmental factors contribute with 16% of the burden of disease in Colombia. A main obstacle in implementing national and regional environmental and occupational health policies is the limited knowledge on the local ability to study and control the impact of harmful exposures on health. Objective: To identify needs for research and training in environmental and occupational health in Colombia. Materials and methods: We conducted a three-round hybrid Delphi study. A group of environmental and occupational health Colombian experts (n=16) from government agencies, universities, and research centers was recruited to participate in the study. Expert’s opinions on research and training needs were gathered through online questionnaires, followed by an in-person meeting. The percentage of agreement and the coefficient of variation were used to measure consensus. Results: Air pollution and chemical products were considered the most important environmental and occupational exposures, due to their significant impact on chronic non-communicable diseases, such as respiratory diseases, cardiovascular diseases, and cancer. Research on the effects of outdoor air pollution on cardiovascular and respiratory diseases was considered of the greatest importance. Priority training areas included environmental and occupational health risk assessment, exposure modeling, advanced statistical methods, urban planning, occupational safety and hygiene, and epidemiology and toxicology. Conclusions: These findings provide a valuable input for the definition and implementation of national environmental and occupational health policies and for the development of a regional hub aimed at strengthening the capacity for research and training in Colombia

Initiatives for the improvement of continuous management training

Purpose. This work aims to present, from the company viewpoint, a structured account of management proposals and practices directed toward improving the intensity and effectiveness of continuous management training (CMT). Design/methodology/approach. The article takes as its main theoretical referents the Theory of Human Capital, the Resource-Based Vision and the contributions made via the new institutional economy with regard to the problems of information asymmetry between companies, employees and training providers and completes the proposals that derive from this theoretical approach. To do this, experience-based contributions are collected from a selection of company training and HR managers from twelve Basque companies characterised by their strong investment in management training. The methodology used was qualitative and obtained by different qualitative techniques: Focus Groups, Nominal Groups and the Delphi Method, which make up the so-called Hybrid Delphi. Findings and implications. The proposals are aimed at the main agents in training activity: training providers, associations and public agents engaged in management training and, particularly, companies themselves. The initiatives seek above all to increase training market transparency, to improve mutual commitments between companies and managers, and to link training and development with culture and strategic management, so that firms make optimal investment in management training. Originality/value. The methodology used is original, and the contributions are consistent with the theory, have a proven practical utility, and are presented in a hierarchy, which facilitates decision making.

An approach toward the development of core syllabuses for the anatomical sciences.

There is increasingly a call for clinical relevance in the teaching of the biomedical sciences within all health care programs. This presupposes that there is an understanding of what is "core" material within the curriculum. To date, the anatomical sciences have been poorly served by the development of core syllabuses, although there have been commendable attempts to define a core syllabus for gross anatomy in medicine and for some medical specialties. The International Federation of Associations of Anatomists and the European Federation for Experimental Morphology aim to formulate, on an international basis, core syllabuses for all branches of the anatomical sciences. This is being undertaken at the initial stage using Delphi Panels consisting of a team of anatomists, scientists, and clinicians who evaluate syllabus content and accord each element/topic "essential," "important," "acceptable," or "not required" status. Their initial conjectures, published on the International Federation of Associations of Anatomists' website, provide merely a framework to enable anatomical (and other cognate learned) societies and individual anatomists, clinicians, and students to comment upon the syllabuses. This article presents the concepts and methodological approaches underlying the hybrid Delphi process employed. Preliminary findings relating to the development of a neuroanatomy core syllabus are provided to illustrate the methods initially employed by a Delphi Panel. The approach is novel in that it is international in scope, is conceptually democratic, and is developmentally fluid in terms of availability for amendment. The aim is to set internationally recognized standards and thus to provide guidelines concerning anatomical knowledge when engaged in course development.