Delphi Survey Technique Research Articles

대학생 미래 리터러시 진단도구 개발 및 타당화

Objectives The purpose of this study is to develop and validate diagnostic tools for futures literacy. To achieve this, definitions of future literacy, identification of sub-elements, and diagnostic items were proposed. Methods Through analysis of previous research, the definition, components, and diagnostic items of future literacy were identified, and feasibility was reviewed through the Delphi survey technique targeting 11 experts. To ensure the construct validity and reliability of the items, data were collected from 244 college students. Exploratory factor analysis was performed on the collected data, and confirmatory factor analysis was performed using the AMOS program to specifically verify the model suitability and validity of the factors and items. Results Reflecting the results of the construct validity and reliability analysis of 68 items, a total of 39 items were deleted, and a diagnostic tool consisting of a total of 29 items was completed. When examining the results of factor analysis and reliability analysis for a total of 29 diagnostic items, the Bartlett sphericity test result was significant at p < .001, and KMO was .861, which was above .5, so it appeared to be a matrix suitable for factor analysis. Conclusions Ultimately, the definition and components of future literacy and 29 diagnostic items defined by factor were confirmed, which can be used as a quantified diagnostic inventory in planning and operating future literacy education programs.

A taxonomy of critical factors towards sustainable operations and supply chain management 4.0 in developing countries

AbstractSupply chain disruptions, intensified by black swan events such as the COVID-19 pandemic and the Russia-Ukraine war, have increased the interest in resilient supply chains, which can be achieved by adopting sustainable Industry 4.0 (I4.0) practices. However, the critical success factors (CSFs) for sustainable I4.0 in operations and supply chain management (S-OSCM4.0) are unclear, and there is a lack of a holistic and empirically validated taxonomy of CSFs from multiple stakeholders' perspectives to guide organizations in this transition. Moreover, developing countries face specific challenges that require prioritizing the proper set of CSFs for sustainable digitalization. Therefore, this paper aims to develop a CSFs-based taxonomy for S-OSCM4.0 to help organizations stay current in I4.0 adoption and integrate sustainability in OSCM. We first conducted a systematic literature review (SLR) of 131 papers using bibliometric and content analyses and synthesized the theoretical findings into an alpha taxonomy of CSFs following an inductive approach. Then, we employed a Delphi survey technique combining fuzzy logic to solicit experts' perceptions from a developing country to analyze and validate the taxonomy and determine the most pertinent CSFs, resulting in a beta taxonomy of CSFs for S-OSCM4.0. The developed taxonomy represents a pioneering managerial artefact that can guide sustainable development through an inclusive digital transformation with less environmental impact, contributing to decision-making in S-OSCM4.0, especially for operations in developing countries.

정신장애인 자립생활의 개념 및 구성요소에 관한 델파이 기법 연구

The purpose of this study is to elicit the concepts and components of independent living for people with psychiatric disabilities through the Delphi technique. The expert panel consisted of social workers (N=20) with at least five years of experience practicing independent living support services to people with mental disabilities on the front lines of the community and conducted three Delphi technique surveys. All delphi technique survey was performed by e-mail. as a Result, the concept of independent living for people with psychiatric disabilities were 6 domains, which were health of body, mental health, daily living skill, residence and economic activities, the use of community resources and leisure use, protection of rights and interests. Also, the component of Independent living for people with psychiatric disabilities were 44 items. All items of the concept and component were average, construct validity ratio, consensus and convergence for validity verification were proper. Finally, practical and policy implications and recommendations for independent living for people with mental disabilities are discussed based on the results of this study.

Feasibility of Conducting Comparative Effectiveness Research and Validation of a Clinical Disease Activity Score for Chronic Nonbacterial Osteomyelitis.

Prospective comparative effectiveness research (CER) in chronic nonbacterial osteomyelitis (CNO) is lacking. Our objectives were to (1) determine the use and safety of each consensus treatment plan (CTP) regimen for CNO, (2) assess the feasibility of using the Chronic Nonbacterial Osteomyelitis International Registry (CHOIR) data for CER, and (3) develop and validate a CNO clinical disease activity score (CDAS) using CHOIR. Consenting children or young adults with CNO were enrolled into CHOIR. Demographic, clinical, and imaging data were prospectively collected. The CNO CDAS was developed through a Delphi survey and nominal group technique. External validation surveys were administered to CHOIR participants. One hundred forty (78.2%) CHOIR participants enrolled between August 2018 and September 2020 received at least 1 CTP regimen. Baseline characteristics from different CTP groups were well matched. Patient pain, patient global assessment, and clinical CNO lesion count were key variables included in the CNO CDAS. The CDAS showed a strong correlation with patient/parent report of difficulty using a limb, back, or jaw and patient/parent report of disease severity, but a weak correlation with patient/parent report of fatigue, sadness, and worry. The change in CDAS was significant in patients reporting disease worsening or improvement (P < 0.001). The CDAS significantly decreased after initiating second-line treatments from median 12.0 (IQR 8.0-15.5) to 5.0 (IQR 3.0-12.0; P = 0.002). Although second-line treatments were well tolerated, psoriasis was the most common adverse event. The CNO CDAS was developed and validated for disease monitoring and assessment of treatment effectiveness. CHOIR provided a comprehensive framework for future CER.

Defining sustainability in agricultural water management using a Delphi survey technique

Abstract Sustainable water management measures are being developed to address the challenges posed by agriculture runoff and leaching on water resources. These measures are based on experts' opinions from various sectors and disciplines, ensuring that all stakeholders' perspectives are considered. For this, establishing a common understanding of 'sustainability' is essential to avoid misunderstandings, conflicts, and operational challenges. In this research, the Delphi survey technique was utilized to develop a definition of ‘sustainability’ in agricultural water management (SAWM) by considering the interdisciplinary group of experts from different parts of the world and those involved in a Horizon 2020 Research and Innovation Action. Twenty-six experts' perspectives on environmental, economic, and social dimensions of sustainability were assessed, and identified key concepts included climate change, water quality, water availability, stakeholder participation, capacity building, subsidies, and incentives. These concepts were used to define sustainability for multi/interdisciplinary project settings. The definition was validated with consortium members of the project in the regular consortium-wide meetings and used in the respective deliverables dealing with sustainability. The results serve as a foundation for communication between the involved actors and the project's definition of 'sustainability.' One recommendation from this work for broader policy formulation for SAWM in Europe is to prioritize farmer needs and focus on environmental sustainability.

Standardized administration and scoring guidelines for the Spinal Cord Independence Measure Version 3.0 (SCIM-III)

Qualitative studies. To develop clear and specific administration and scoring procedures for the Spinal Cord Independence Measure Version 3.0 as a performance-based and interview assessment. Research lab. Modified Delphi Technique survey methods were used in this study. Previously developed SCIM-III administration and scoring procedures for performance-based and interview versions were presented to clinicians experienced in SCI and SCIM-III using the Qualtrix (Qualtrics, Provo, UT) online survey platform. Summary and descriptive statistics were used to assess the percent agreement survey responses. Three survey rounds were necessary to achieve 80% agreement or above for the performance-based version. Two survey rounds were necessary to achieve 80% agreement or above on the interview version. This study describes the development of standardized administration and scoring procedures for the self-care and mobility sub-scales of the SCIM-III as a performance-based and interview version.

Toward a wild pollinator strategy for Canada: expert-recommended solutions and policy levers

Invertebrate pollinators are in trouble: particularly documented are declines among bees and butterflies. Interacting stressors include pesticides, pathogens, habitat loss, nonnative species, and climate change. Many governments have strategies to reduce negative pressures on pollinators, but Canada does not despite widespread public interest in pollinator health. This study serves as a needs assessment for science-based policy solutions for wild pollinator conservation in Canada. We designed a Policy Delphi survey technique to identify solutions that experts deem both desirable and feasible. Our secondary aim was to identify research priorities that would inform the implementation of these solutions. Sixty % of the 83 unique solutions were supported and feasible at a high consensus level (10% were “strongly” supported and “definitely” feasible). General themes included improving the Canadian government's approach in assessing pesticide risk to pollinators, curbing pathogen spillover/spillback between managed and wild pollinators, and reducing the reliance of Canadian agricultural systems on pesticides, among others. We discuss solutions in reference to pollinator conservation policies recommended by the broader scientific community and identify policy levers within the context of Canada's highly decentralized approach to biodiversity conservation/management and a political economy that uses high numbers of managed, mostly nonnative bees for pollination services.

Underrepresentation of Respiratory Therapists as Experts in Delphi Studies on Respiratory Practices and Research Priorities.

Delphi survey techniques are a common consensus method used to collect feedback from an expert panel to inform practices, establish guidelines, and identify research priorities. Collecting respiratory therapists' (RT) expertise and experiences as part of consensus-building methodologies is one way to ensure that they align with RT practices and to better influence respiratory care practice. This narrative review aimed to report the RT representation in expert panels of Delphi studies focused on respiratory therapy practices and research priorities. The research question that guided this review is: to what extent are RTs included as expert participants among published Delphi studies relate to respiratory therapy and research topics? We conducted a structured search of the literature and identified 23 papers that reported Delphi studies related to respiratory care practices and 15 that reported on respiratory-related research priorities. Delphi studies that focused on reporting consensus on respiratory care practices included the following: (1) mechanical ventilation, (2) high-flow nasal cannula therapy, (3) COVID-19 respiratory management, (4) home oxygen therapy, (5) cardiopulmonary monitoring, and (6) disease-specific guidelines. Delphi studies that focused on establishing respiratory research priorities included the following: (1) theory and practice-orientated knowledge gaps, and (2) priority research topics for empirical investigation. The results of this review suggest that RTs were rarely included as expert participants and, when involved, were minimally represented (5% to 33%). Given RTs' diverse and relevant experience in respiratory care, incorporating their perspectives to inform future education, respiratory care practices, and research priorities would allow evidence to better align with knowledge gaps deemed important for the respiratory therapy profession.

Consensus on the Best Practice Guidelines for Psychomotor Intervention in Preschool Children with Autism Spectrum Disorder.

Psychomotor intervention has been used to promote development by the enhancement of psychomotor and socio-emotional competence. However, studies with high-quality evidence, describing psychomotor-intervention processes and outcomes are scarce. Therefore, we aimed to generate expert consensus regarding psychomotor-intervention guidelines to support psychomotor therapists through the design and implementation of interventions for preschool (3−6 years old) children with autism spectrum disorder (ASD). A formal consensus process was carried out, using modified nominal group (phase I) and Delphi survey (phase II) techniques. We recruited 39 Portuguese experts in psychomotor intervention with preschool children with ASD in phase I. Experts participated in at least one of the five online meetings, discussing themes (e.g., objectives, methods, strategies) concerning psychomotor intervention with preschool children with ASD. A deductive thematic analysis from phase I resulted in 111 statements composing round 1 of the Delphi survey. Thirty-five experts completed round 1, and 23 round 2. The experts reached a consensus (agreement > 75%) on 88 statements, grouped under 16 sections, (e.g., intervention source, general setting, intended facilitation-style), reflecting generic psychomotor-intervention guidelines. Consensus guidelines may be used to support transparent and standard psychomotor interventions, although further studies should be undertaken to determine their efficacy.

Validation of content and structure of the Return-to-work assessment for post-stroke survivors.

Validation of an instrument consist of three main types: content, criterion and construct. Content validity needs to be determined in order for an instrument to be acceptable for use, validity establishes the fact that an instrument measures exactly what it proposes to measure. The Return-to-work assessment scale (RAS) was developed to measure three aspects of return to work: (Personal factors and/or issues, work issues and contextual factors) in 2021. To report on the processes followed in establishing the face and content validity of the RAS. Twenty participants took part in our study, they were selected purposively and conveniently from a pool of professionals and post stroke survivors. The Delphi survey technique was used to arrive at consensus and professional opinion on the items included in the RAS. Consensus was sought on the items, domains and subdomains included in the RAS that was used to assess return-to-work after a stroke. Our study was concluded after the third round. One item was remove out of the original 86, three (3) domains made up of eleven (11) subdomains were retained. The RAS had consensus of 100% after three rounds of scrutiny for all items. The RAS was found to be valid, thereby establishing its face and content validity. The RAS is valid and was recommended for psychometric testing which was the next stage after face and content validity.

Key Factors for Evaluating Visual Perception Responses to Social Media Video Communication

The purpose of this study was to investigate the key factors for creating a positive visual perception response evaluation for social media video communication. The aim of this study was to determine what factors of light sources impact visual perception to increase the interactions in social media video communication. First, the key factors of visual perception and response evaluation of visual effects in social media video communication were summarized and analyzed through an interview consultation panel of experts and scholars. Key factors were compiled into four dimensions (48 sub-dimensions), including (1) visual perception, with 12 sub-dimensions; (2) emotional perception, with 12 sub-dimensions; (3) preference perception, with 11 sub-dimensions; and (4) shape perception, with 13 sub-dimensions. Second, 12 experts and scholars were invited to form a panel to develop the Delphi technique questionnaire. After three Delphi technique questionnaires were conducted, the mean (M), mode (Mo), and standard deviation (SD) of each response were statistically analyzed, and the one-sample Kolmogorov–Smirnov test was used to analyze the appropriateness and consistency of the Delphi technique survey results. The results of this study indicate that 15 sub-dimensions met the criteria of appropriateness and consistency, which were used to establish 15 key factors for evaluating visual perception responses to social media visual communication. This study will provide a technical reference for the visual perception of digital messages in social media to improve the quality of visual perception of digital communication.

Nurse practitioner in Swedish municipal elderly care: ADelphi study of challenges and opportunities.

Worldwide, countries are struggling with strained healthcare systems, especially due to the growing number of frail elderly. Developing the role of nurse practitioner in the care of the frail elderly is therefore of interest to make the care chain more efficient. In Sweden, the role is in an early development phase, but more research is needed. The aim was to investigate how stakeholders at the national level express the challenges and opportunities of the evolving nurse practitioner role in Swedish municipal elderly care. A Delphi survey technique with three rounds of electronic questionnaires was used. Twenty-seven experts responded to the first questionnaire, containing two open questions; what opportunities respectively challenges do you see in developing and implementing the nurse practitioner role in municipal elderly care? The following questionnaires consisted of statements to rate using a four-grade Likert scale, and 20 and 17 responded to the second and third, respectively. The first round was analysed using content analysis, and the other two with descriptive statistics. Thirty-four statements about challenges and opportunities related to the nurse practitioner role in municipal elderly care were identified and rated as important. The findings provide knowledge that can contribute to discussions and decisions to refine the nurse practitioner role in Swedish municipal elderly care. The nurse practitioner role may contribute with much-needed competence to the elderly care. However, it is important to consider the challenges that need to be overcome before the development of the role. To solve this, it is necessary to have clear national guidelines concerning issues of education, title protection and the mandate and authority of the NP role.

Development of a Composite Project Performance Index for the New Engineering Contract (NECPPI) of construction projects in Hong Kong: a Delphi study

Over the past three decades, a basket of research studies on New Engineering Contract (NEC) has been conducted in the construction management discipline. In fact, there is adequate evidence that an increasing number of client organisations have been adopting a NEC approach to undertake their building and construction projects both locally and worldwide during the last three decades. With the perceived benefits that NEC brings about, research into the Key Performance Indicators (KPIs) to evaluate the success of NEC projects in construction becomes all the more important because it can help set a benchmark for measuring the overall performance level of NEC projects. Although there are some related studies and papers on this research area, few, if any, comprehensive and systematic studies have focused on developing a comprehensive, objective, reliable and practical performance evaluation model for NEC projects. A benchmarking model has been developed in this paper using the Delphi survey technique to objectively measure the performance of the Engineering and Construction Contract (ECC) of NEC projects in Hong Kong based on a consolidated KPIs’ conceptual framework for NEC projects. Four rounds of Delphi questionnaire survey were conducted with 16 construction experts in Hong Kong and the United Kingdom. The results revealed that the top seven weighted KPIs to evaluate the success of NEC projects in Hong Kong include: (1) time performance; (2) safety performance; (3) quality performance; (4) development of mutual trust and cooperation; (5) cost performance; (6) equitable risk management mechanism; and (7) project team satisfaction. A statistically significant consensus on the top seven weighted KPIs was also obtained. Finally, a composite Project Performance Index for NEC projects (NECPPI) in Hong Kong was derived to provide an all-round assessment of NEC project performance. Different NEC projects can now be assessed on the same basis for benchmarking purposes. Construction senior executives and project managers can thus use the Index to measure, evaluate and improve the performance of their NEC projects to strive for construction excellence. Although the NECPPI was established locally in Hong Kong, the research methodology could be replicated in other parts of the world such as the United Kingdom or other European countries to produce similar indices for international comparisons. Such and extension would aid the understanding of managing NEC projects across different geographic locations.

Prioritization of Contracting Methods for Water and Wastewater Projects Using the Fuzzy Analytic Hierarchy Process Method

This study uses the fuzzy analytical hierarchy process (FAHP) method to prioritize contracting methods to determine the most suitable contract option for water and wastewater projects (WWP). Content analysis, a two-round Delphi survey technique, and a series of validation and reliability tests helped establish the 18 key criteria for FAHP analysis. Consequently, data collected from experts through a pairwise comparison questionnaire form the basis for the inputs for the FAHP analysis. Consequently, the final weightings were derived for each of the key criteria and available contracting methods. The results indicate that the bilateral, cooperative, and trilateral contracting methods are the most suitable for WWP in Iran, with the highest weighting. The study provides useful guidance for the top management of project firms in selecting the optimal contracting method for their projects and offers significant contributions from theoretical and practical perspectives.

Probabilistic tunnel collapse risk evaluation model using analytical hierarchy process (AHP) and Delphi survey technique

Tunnel collapse hazard is a key issue in tunnel construction, which should be adequately assessed to prevent economic damage and casualty. The present study proposed a risk evaluation model for tunnel collapse based on a quantified grading system and influence factors that significantly affected the tunnel collapse hazard. For this purpose, 24 actual tunnel collapse cases were collected, and a database was established to select significant influence factors as the risk evaluation indices. The Analytic Hierarchy Process (AHP) technique and Delphi survey analysis were then adopted to quantify the influence factors and the grading system for the risk evaluation of tunnel collapse. The significant influence factors were selected using the grading guide based on the weight importance and rating score of each considered influence factor. As an evaluation criterion, the TR index based on the probability distribution of weighted influence factors was proposed to compare the risk of collapse using Monte-Carlo simulation. The proposed evaluation model and TR index were validated by comparing and analyzing the risk index calculated using the proposed grading system for actual tunnel cases with and without collapse. The evaluated risk indices were in good agreement with the measured result from field cases.

Blockchain goes to School: A mixed-method investigation to Blockchain adoption in HEIs

Extant research has established that technology-based innovation can trigger growth, increase productivity, efficiency, and induce better performance. BT can provide a platform for continuous innovation across industries, however, its application specifically in the education industry is still at its nascent stages. The aim of this study is to examine the connection between blockchain and higher education institutions (HEIs) by identifying the key drivers & their significance for adoption of blockchain in HEIs. A mixed-method investigation was carried out by collecting data from one developed country (Canada) and one developing country (India). Study 01 utilized Delphi survey technique to identify critical success factors that are then in Study 02 (Necessary Condition Analysis) was carried out to determine the critical levels that need to be present in order to achieve behavioural intention to adopt blockchain in HEIs. The outcomes indicated a new consideration for the combined role of technology, environment and organizational factors for Blockchain adoption in HEIs. Our analysis revealed that at differing levels, all the three conditions (technology, environment and organizational factors) are necessary for the adoption of blockchain technologies in HEIs.

Development and validation of the ethical challenges in clinical situations-questionnaire (ECCS-Q) by involving health-care providers from a tertiary care health setting

Background and rationale Clinicians often encounter a variety of ethical challenges in their routine clinical practice, and it varies across healthcare and cultural settings of their practice. Despite of this, there are no clear-cut available guidelines concerning the right course of action in a given ethically challenging situation. A validated instrument that could capture the health care providers’ (HCP’s) viewpoints in this regard is lacking from Indian settings. Thus, the current study aimed at developing an instrument to assess the HCP’s perspective regarding different ethically challenging situations encountered in the Indian settings. Methods The questionnaire was developed by involving 15 medical experts. A mixed-method approach, Delphi-technique, and online survey were used for item generation and validation. Results The questionnaire comprised of 11 items (accounts 57% variance; having an α = 0.68) representing four factors: health-resource constraints, medical responsibility of the HCP, obtaining patients/family members’ consent for the treatment, and treatment beyond the standard protocol. The gender and clinical disciplines of the participants were related to their level of endorsement for various domains of the ECCS-Q. Conclusions Ethical challenges in the clinical practice fall in different clusters. The clinicians’ course of action in such situations have many socio-demographic and professional determinants. Future studies are warranted to investigate these phenomena.

Identification of Sleep Medicine and Anesthesia Core Topics for Anesthesia Residency: A Modified Delphi Technique Survey.

Sleep disorders affect up to 25% of the general population and are associated with increased risk of adverse perioperative events. The key sleep medicine topics that are most important for the practice of anesthesiology have not been well-defined. The objective of this study was to determine the high-priority sleep medicine topics that should be included in the education of anesthesia residents based on the insight of experts in the fields of anesthesia and sleep medicine. We conducted a prospective cross-sectional survey of experts in the fields of sleep medicine and anesthesia based on the Delphi technique to establish consensus on the sleep medicine topics that should be incorporated into anesthesia residency curricula. Consensus for inclusion of a topic was defined as >80% of all experts selecting "agree" or "strongly agree" on a 5-point Likert scale. Responses to the survey questions were analyzed with descriptive statistical methods and presented as percentages or weighted mean values with standard deviations (SD) for Likert scale data. The topics that were found to have 100% agreement among experts were the influence of opioids and anesthetics on control of breathing and upper airway obstruction; potential interactions of wake-promoting/hypnotic medications with anesthetic agents; effects of sleep and anesthesia on upper airway patency; and anesthetic management of sleep apnea. Less than 80% agreement was found for topics on the anesthetic implications of other sleep disorders and future pathways in sleep medicine and anesthesia. We identify key topics of sleep medicine that can be included in the future design of anesthesia residency training curricula.

Faith Community Nursing: Using Spiritual Interventions in Diabetes Prevention.

As the incidence of diabetes rises in the United States, education on diabetes prevention and management is paramount. Diabetes programs offered in churches or community settings have reported positive outcomes such as weight loss and improved glucose control. Delphi Survey technique was used to identify spiritual interventions used by faith-based and community-based coaches in leading Diabetes Prevention Program (DPP) courses. Results showed that faith-based coaches reported using prayer, active listening, and emotional support in their DPP course; giving hope, incorporating humor, and using spiritual/sacramental activities were rated as important or very important by most coaches and can be used by faith community nurses in their practice.

Critical success factors for adopting building information modelling (BIM) and lean construction practices on construction mega-projects: a Delphi survey

PurposeThe purpose of this paper is to investigate critical success factors (CSFs) that enhance integration between building information modelling (BIM) and lean construction (LC) practices on construction mega-projects. BIM and LC have gained momentum in the past decade.Design/methodology/approachThe Delphi survey technique was used to gauge opinions of a panel of 16 experts through a two-round Delphi questionnaire survey. Panel responses were scrutinised using inferential and descriptive statistical techniques.FindingsIn total, 30 CSFs were identified in the literature. The top ranked factor out of 30 that supports LeanBIM synergy was “collaboration in design, construction works and engineering management”. Other top rated CSFs were centric on people, data and technology elements. The research findings are important for project stakeholders, organisations, contractors, engineers and local authorities who implement LC and BIM synergies in construction mega-projects.Originality/valueThe research findings are important for project stakeholders, organisations, contractors, engineers and local authorities who implement LC and BIM synergies in construction mega-projects. The research recommends further hands-on training to increase the integration of BIM and LC practices in the architecture, engineering and construction industry and to enrich the extant body of knowledge in construction of mega-projects.