Delphi Survey Of Experts Research Articles

Risk assessment method for civil aircraft approach and landing at high plateau based on QAR data

Civil aircraft approach and landing at high altitude is a high-risk stage of plateau flight. In order to effectively implement the risk identification and grade judgment of approach and landing at high altitude, an LSTM-DNN deep learning risk assessment method based on variable fuzzy recognition with weights removed is proposed. This method is first based on the high-altitude flight data recorded by the quick access recorder (QAR), and draws on the civil aircraft flight quality monitoring project specification (FOQA) consultation notice and industry QAR monitoring standards. Combined with the indicator importance analysis and Delphi expert survey, five key monitoring items are extracted as the risk assessment indicators of civil aircraft approach and landing at high altitude, including large heading change during landing, low track, large descent rate during 2000-1000 ft approach, vertical acceleration at touchdown, and large descent rate during 500-50ft approach. Then, in order to overcome the subjective bias of the evaluation indicator weight, the weight of the evaluation indicator is determined by the weight removal method, and the risk grade membership function is constructed based on the variable fuzzy recognition method. Finally, a risk assessment model for civil aircraft approach and landing at high altitude based on LSTM-DNN is established. Taking the Chengdu-Lhasa approach and landing segment as an example, the QAR data was extracted to train and test the risk assessment model, and the results were compared with those of Logistic multivariate regression, support vector machine (SVM) and other evaluation methods. The results show that the average recognition rate of the LSTM-DNN deep learning model based on variable fuzzy recognition with weights removed reaches 94.18%, and the highest can reach 94.79%, which verifies the objective effectiveness of the risk assessment method.

A Study on the Development of Information and Communication Technology-Based Oral Functional Rehabilitation Exercise Program Content for Elderly People.

Background/Objectives: This study was conducted to develop information and communication technology (ICT)-based oral functional rehabilitation exercise (OFRE) program content to effectively improve the oral function of the elderly people. Methods: After selecting evidence-based effective OFRE items through systematic review, the final items were constructed through the validity evaluation of detailed items through an expert Delphi survey. The items were composed in a simple content form that can be performed directly and applied to ICT-based mobile applications. Results: The final content items consisted of an oral functional motor-ability measurement, oral Pilates videos, and games. The first is to measure the maximum opening amount before and after exercise, and the opening amount was designed to be measured by eating the fruit displayed on the screen by opening and closing the lips. The second one consisted of eight exercises in the video, and each exercise was to be performed at least three times a day, with a total of two sets. The third is a salivary secretion function exercise that stimulates the salivary glands to stimulate the user's interest and enable them to perform oral movements on their own. It consists of a lip and respiratory muscle exercise that inflates the cheeks and bursts a balloon, and the image disappears when the word in the image presented on the screen is pronounced correctly. It consists of pronunciation exercises. Conclusions: This content development attempt can be expanded into new convergence research linked to ICT and can be used as basic data when developing related content as part of digital care for the elderly in the future.

행동기준 평정척도(BARS)를 적용한 대학생 핵심역량 측정도구 개발 및 타당화 연구: D대학의 의사소통역량을 중심으로

Objectives This study attempted to develop the core competency’s measurement tool and secure its validity by focusing on the D University’s communication capabilities and applying the behaviorally anchored rating scale based on experiences or behaviors closely related to students’ university education and life. Methods This study applied appropriate research methods according to a six-step’s systematic research procedure, including core competency analysis and competency modeling, analysis of behavioral characteristics of excellent students through FGI for professors and BEI for students, development of core competency’s measurement tool through expert council, validation through expert delphi survey, pilot test and analysis, and finalizations stage of system, definition, and measurement tool. Results The research results are as follows. First, the core competency’s system and definition with a high consistent were derived through a systematic competency modeling process. Second, the behavioral characteristics of hyperformers(high-performing students) were analyzed through interview with professors and students and reflected in the behaviorally anchored rating scale. Third, the core competency’s measurement tool(draft) with a high consistent were confirmed. Fourth, a core competency measurement tool(revised version) was tentatively derived by verifying its validity through two expert delphi surveys. Fifth, a pilot test was conducted to improve effectiveness of the core competency’s measurement tool, and reliability and validity were secured. Sixth, the finalizations stage was completed, and the system, definition, and measurement tool of core competencies were confirmed. Conclusions By developing a core competency’s measurement tool based on the behaviorally anchored rating scale focusing on D University’s communication capabilities and then revealing the process of securing reliability and validity, It could play a significant role in suggesting alternative methods to objectively measure the core competencies of each university.

A Framework for Measuring Neighborhood Walkability for Older Adults-A Delphi Consensus Study.

While mobility in older age is of crucial importance for health and well-being, it is worth noting that currently, there is no German language framework for measuring walkability for older adults that also considers the functional status of a person. Therefore, we combined the results of an expert workshop, a literature review, and a Delphi consensus survey. Through this, we identified and rated indicators relevant for walkability for older adults, additionally focusing on their functional status. The expert workshop and the review led to an extensive list of potential indicators, which we hope will be useful in future research. Those indicators were then adapted and rated in a three-stage Delphi expert survey. A fourth additional Delphi round was conducted to assess the relevance of each indicator for the different frailty levels, namely "robust," "pre-frail," and "frail." Between 20 and 28 experts participated in each round of the Delphi survey. The Delphi process resulted in a list of 72 indicators deemed relevant for walkability in older age groups, grouped into three main categories: "Built environment and transport infrastructure," "Accessibility and meeting places," and "Attractiveness and sense of security." For 35 of those indicators, it was suggested that functional status should be additionally considered. This framework represents a significant step forward in comprehensively covering indicators for subjective and objective walkability in older age, while also incorporating aspects of functioning relevant to older adults. It would be beneficial to test and apply the indicator set in a community setting.

Development of a Smart Home Modification Program: A Delphi Survey of Multidisciplinary Health Care Experts.

There is a critical gap between the potential of smart home technologies to enhance the lives of people with physical disabilities (PwPD) and their limited use because of complex interfaces, high costs, technical issues, and insufficient institutional support. To bridge this gap and ensure that PwPD can fully benefit from smart home advancements to improve their daily living and quality of life by developing a smart home modification program. A Delphi survey involving three rounds was conducted with experts in disability and smart home technologies. Online survey. Thirty multidisciplinary health care experts. Experts rated the level of relevance in smart home modification with each survey. Consensus was set at ≥75%, content validity (CVR) was ≥.33, and convergence was ≤.5. The first Delphi result selected 26 items, and the second included 59 items after adjusting for values that fell below a CVR of .33. In the third Delphi survey, 59 items were selected. The final Delphi study had an average CVR of .96 and a coefficient of variation of .10. The last survey's consensus point was .92, indicating a high level of agreement among participants. On the basis of expert consensus, the study provides a validated framework for smart home modifications to aid PwPD. Plain-Language Summary: This research highlights the role of smart home adaptations to promote responsible, independent living for people with physical disabilities. There is a critical gap between the potential of smart home technologies to improve the lives of people with physical disabilities and their limited use because of complex interfaces, high costs, technical issues, and insufficient institutional support. The study authors developed a smart home modification program with the goal of closing this gap and to ensure that people with physical disabilities can fully benefit from smart home advancements to improve their daily living and quality of life. Based on expert ratings, the study findings provide a validated framework that occupational therapists can use to recommend smart home modifications to help people with physical disabilities. The framework can also be used by occupational therapists to identify people who may need more extensive environmental modifications and interventions.

Establishing consensus on nutrition competencies for medicine: a Delphi study

BackgroundSignificant research, regulatory bodies and even governmental resolutions have identified meaningful nutrition education for medical and other healthcare professionals as a priority. Doctors are well placed to provide nutrition care,...

유아기 자녀를 둔 부모공감능력의 의미와 구성요인에 관한 델파이 연구

Objectives This study aims to clarify the meaning of parental empathy ability using the Delphi technique and to derive constituent and sub-factors. Methods To this end, the concept of parental empathy ability was defined through preceding research and liter-ature review, and the structuring factors of the ability were derived. An expert Delphi survey was conducted using the derived data to confirm the exploratory study of deriving the components of parental empathy ability. The data analysis method of the first Delphi survey questionnaire was conducted in order to define the concept of parental empathy and derive the structuring factors. A structured questionnaire, free-choice and open-ended questions were conducted with 13 experts in order to confirm the content validity. Using SPSS 25.0, the average value, standard deviation, skewness, agreement, convergence, and CVR ranges of each variable were calculated, and questions that did not meet each criterion were modified and deleted. Since the number of panels participating in the Delphi survey in this study is 13, if the CVR value is .554 or higher, it can be judged that the content validity is valid. The contents, were revised and supplemented with the experts, used to construct the second Delphi survey. It was used to construct the second questionnaire by reflecting the opinions of experts and revising and supplementing the contents. The second survey tool were gathered from the responses of the first survey. In or-der to clarify the opinions of each panel, structured questions with a 5-point rating scale were presented. Results First, the area of the scale consisted of three areas: ‘emotional empathy ability’, ‘cognitive empathy abil-ity’, and ‘behavioral empathy ability’, ‘emotional empathy ability’ consisted of perspective acceptance, cognitive empathy, and perspective acceptance, ‘cognitive empathy ability’ consisted of emotional response, emotional al-location, and emotional perception, and ‘behavioral empathy ability’ consisted of pseudo-movement, expression consistency, listening, and relationship formation. Conclusions The study is significant in that it derives categories and sub-factors of parental empathy ability that have recently come into focus. Furthermore, the study is significant in that it can be used as basic data for deriving the question composition through focus group interviews in the future.

Perceived barriers to implementing building information modeling in Iranian Small and Medium-Sized Enterprises (SMEs): a Delphi survey of construction experts

ABSTRACT Building information modeling (BIM) is a disruptive information technology tool in the construction sector. Although this technology had a significant impact on the manufacturing industries, it, like any other technology, encountered several challenges when applied to the construction sector. Conversely, small and medium-sized enterprises (SMEs) in developing economies often face significant impediments when using innovative technologies. Thus, this paper seeks to determine and investigate the perceived barriers to applying BIM in construction SMEs based in Iran. Three rounds of Delphi surveys were carried out with 15 BIM experts engaged in construction SMEs to identify the key barriers to BIM implementation in SMEs. An empirical survey questionnaire comprising these identified barriers was subsequently designed and disseminated to the invited experts. Altogether, 56 valid survey responses were received and analyzed. The study’s findings revealed SMEs management’s hesitancy to adopt BIM, stakeholders’ reluctance to change their established methods, and a lack of technical understanding as the critical impediments to BIM adoption in construction SMEs. Also, the study identified four barrier dimensions – technology, legal, management, and financial. These BIM implementation barrier dimensions can be employed to better allocate resources and financing for BIM deployment and construction innovation in SMEs. The study will assist major project stakeholders and SMEs make better-informed BIM adoption decisions, particularly in developing nations like Iran.

Conceptualizing community scientific literacy: Results from a systematic literature review and a Delphi method survey of experts

AbstractThe predominant conceptualization of scientific literacy occurs on the micro scale of an individual person. However, scientific literacy can also be exhibited at the meso scale by groups of people in communities of place, practice, or interest. What comprises this community level scientific literacy (CSL) is both understudied and undertheorized. In this paper, we utilized a systematic literature review to describe how CSL is characterized in the extant literature and a Delphi survey of experts to elicit more current thought. Guided by cultural‐historical activity theory, inductive and deductive analyses produced seven elements of CSL and their constituent characteristics: (1) resources, (2) attributes of those resources, (3) actors, (4) interactions between actors, (5) contexts, (6) topics, and (7) purposes. The typology created through this process is meant to be generative, serving as a starting point for continuing refinement within science education and other fields related to science learning and knowing.

디지털전환 시대의 직업훈련 교･강사 역량체계 개발 연구

The purpose of this study is to derive common core competencies of vocational training teachers and instructors and develop a competency framework that reflects changes in industrial and occupational trends due to digital transformation. The research procedure is carried out in three stages. In the initial phase, a preliminary competency framework for training instructors was developed through an analysis of prior research. Subsequently, validation was conducted via an expert Delphi survey, leading to the presentation of a competency framework for vocational training instructors. The research findings delineated five major competency domains comprising fundamental competencies, teaching, learning, and assessment competencies, learner support competencies, administrative competencies, and organizational management competencies. Across these five main domains, 23 sub-competencies were identified, each accompanied by operational definitions. This study establishes the groundwork for the development of competency assessment tools, incorporating contemporary demands such as AI and digital competencies within the framework for vocational training instructors. Future efforts should concentrate on aligning competency assessment tools with educational programs to enhance competencies based on this research. Additionally, ongoing updates to the competency framework are recommended for further investigation.

The Present State of Tourism English Education in Departments Related to the Tourism Industry and Expert Delphi Survey

The Present State of Tourism English Education in Departments Related to the Tourism Industry and Expert Delphi Survey

Validity assessment for competency development in clinical dental hygiene education based on dental hygiene process of care

Objectives: Before implementing a competency-based clinical dental hygiene curriculum, it is essential to establish competency development as a foundational educational objective. Therefore, this study aimed to develop the competency of clinical dental hygiene with secured validity using the Delphi survey method. Methods: Dental hygiene competencies were categorized within the dental hygiene process stages, and questions were formulated accordingly. A Delphi survey involving ten qualified experts was conducted to refine the final items based on their review opinions. Results: The expert Delphi survey confirmed that all items met stability criteria, with CVI values of 0.80 or higher, CVR values of 0.60 or higher, and a CV coefficient of variation of 0.5 or less. In total, 42 items were derived. Conclusions: Clinical dental hygiene can contribute to developing specialized dental hygienists if the competencies derived from this study are well applied to the standardized curriculum and operations.

이주민의 상호문화역량 측정도구 개발 연구

This study developed an assessment tool to measure the intercultural competence of immigrants living in Korea, which is transforming into a multicultural society. The content and data validity of each measurement item were verified through a Delphi survey of experts.
 More specifically, as an initial step, we conducted a literature review and identified three main components of intercultural competence: attitude, knowledge and understanding, skills and practice. And the subcomponents were specified as openness, respect, responsibility, communication skills, cultural awareness, self development skills, empathy, behavioral flexibility, and cooperation skills.
 Following this, we drafted a survey questionnaire to assess the intercultural competence of immigrants, and selected 59 questionnaire items through a survey of immigrants. Then, three Korean language education experts reviewed the composition and wording of the questionnaire items.
 In addition, the study conducted a Delphi survey involving two expert groups: multicultural society experts and Korean language education experts. This survey verified the validity of the survey items by analyzing the Content Validity Ratio (CVR) and data validity of the questionnaire items (convergence and consensus). As a result, we selected 53 questionnaire items with consensus from both expert groups, and developed scale survey questions suitable for assessing the intercultural competence of immigrants.
 In conclusion, this study presents scales to assess the intercultural competence of immigrants for effective and appropriate interaction in a new and unfamiliar environment with distinct cultural differences.

Validation of the DIGEST-FEES as a Global Outcome Measure for Pharyngeal Dysphagia in Parkinson’s Disease

Flexible Endoscopic Evaluation of Swallowing (FEES) is one of two diagnostic gold standards for pharyngeal dysphagia in Parkinson's disease (PD), however, validated global outcome measures at the patient level are widely lacking. The Dynamic Imaging Grade of Swallowing Toxicity for Flexible Endoscopic Evaluation of Swallowing (DIGEST-FEES) represents such an outcome measure but has been validated primarily for head and neck cancer collectives. The objective of this study was, therefore, to investigate the validity of the DIGEST-FEES in patients with PD. Content validity was evaluated with a modified Delphi expert survey. Subsequently, 66 FEES videos in PD patients were scored with the DIGEST-FEES. Criterion validity was determined using Spearman's correlation coefficient between the DIGEST-FEES and the Penetration-Aspiration Scale (PAS), the Yale-Residue-Rating-Scale, the Functional-Oral-Intake-Scale (FOIS), and the swallowing-related Unified-Parkinson-Disease-Rating-Scale (UPDRS) items. Inter-rater reliability was determined using 10 randomly selected FEES-videos examined by a second rater. As a result, the overall DIGEST-FEES-rating exhibited significant correlations with the Yale-Valleculae-Residue-Scale (r = 0.84; p < 0.001), the Yale-Pyriform-Sinus-Residue-Scale (r = 0.70; p < 0.001), the FOIS (r = − 0.55, p < 0.001), and the UPDRS-Swallowing-Item-Score (r = 0.42, p < 0.001). Further, the DIGEST-FEES-safety subscore correlated with the PAS (r = 0.63, p < 0.001). Inter-rater reliability was high for the overall DIGEST-FEES rating (quadratic weighted kappa of 0.82). Therefore, DIGEST-FEES is a valid and reliable score to evaluate overall pharyngeal dysphagia severity in PD. Nevertheless, the modified Delphi survey identified domains where DIGEST-FEES may need to be specifically adapted to PD or neurological collectives in the future.

OP103 What To Include In A Health Technology Assessment Of Artificial Intelligence-Based Technologies: Results Of A Delphi Expert Survey

IntroductionClinicians are increasingly relying on artificial intelligence (AI) generated technologies for support in diagnosis, therapeutic decision-making, and prediction. Despite the increased focus on AI in health, an agreed HTA model for AI technologies, including consensus on new domains and topics to be assessed, is lacking.MethodsA Delphi survey was sent to a multidisciplinary expert panel asking about the importance of including the nine domains and associated topics presented in the EUnetHTA Core Model, as well as 20 additional topics identified through literature reviews, when assessing AI-supported health technologies. The Delphi survey was repeated twice among the same panelists and a nine-point Likert scale was used to identify the perceived relevance of each domain and topic.ResultsThe survey was sent to 87 various experts, with a total 47 of experts completing both Delphi rounds. The majority of panelists was knowledgeable of HTA (80%), familiar with the EUnetHTA Core Model (61%), and had adequate or high-level knowledge of AI (65%). The EUnetHTA domains most often indicated as “critical to include” were clinical effectiveness (82%), ethical aspects (81%), and cost effectiveness (77%), whereas organizational (59%) and social aspects (63%) were less often perceived as critical to assess. For the additional 20 topics identified through literature reviews, bias in data, accuracy in the AI model, appropriateness, and trustworthiness emerged as some of the new topics deemed critical to include in HTAs (all above 85%), whereas there was a lack of agreement on the relevance of including environmental (51%) and social sustainability (55%).ConclusionsThe study investigated in detail which issues should be included in an AI HTA core model. Current models need some adjustment and revision. At the same time, it is essential to open the discussion on including new domains and topics.

지역 사회 세계시민 역량 지표 개발에 관한 델파이 조사 연구: 인천시 Y구 사례를 중심으로

The purpose of this study is to develop local community-level indicators that can monitor the capabilities of global citizens to measure the effectiveness of global citizenship education for adults amid the spread of global citizenship education. It followed the distinction of cognitive, social and emotional, and behavioral areas, which are the core competencies of global citizens presented by UNESCO. The categories were selected after reflecting the main conceptual words derived through prior research analysis and the preliminary survey results for related parties, and considering the major conceptual words necessary for Y-gu, Incheon. After that, an expert Delphi survey was conducted twice to develop indicators. The results of the study are as follows. A total of 46 indicators were developed, including 3 categories, 14 conceptual elements, and 17 questions in the cognitive domain, 3 categories, 13 concept elements, 15 questions in the social and emotional domain, and 3 categories, 10 concept elements, and 14 questions in the behavioral domain. Through this study, it was confirmed that global citizenship and local citizenship should be recognized from an integrated perspective, and that global problems should be viewed in connection with local daily lives. This study is meaningful in that it presented examples that can be appropriately used in other regions where global citizenship education is being conducted.

A Study on Mitigating the Disparity in Public Transportation Information Usage among the Elderly through Expert Delphi Survey

A Study on Mitigating the Disparity in Public Transportation Information Usage among the Elderly through Expert Delphi Survey

Validity Evaluation for Identifying Dental Hygiene Activities

Objectives: This study evaluated the validity of dental hygiene activities to improve the oral health of clients in the clinical field. Methods: A qualitative content analysis was performed to derive the dental hygiene domain and dental hygiene activities, which were reorganized via the researcher's internal review. Validity, homogeneity, mutual exclusivity, content validity, classification suitability, and clarity were evaluated through an expert Delphi survey. Results: The activities performed by dental hygienists were classified into a total of 15 areas and 156 activities. The homogeneity of the dental hygiene domain was 4.75±0.19, and the mutual exclusivity was 4.64±0.24. Classification of the dental hygiene activities CVI (Content Validity Index) was over 0.65 and CVR (Content Validity Ratio) was over 0.20. Conclusions: It was confirmed that dental hygiene activities contribute to the efficiency and quality of dental treatment, improve dental treatment satisfaction, take full responsibility for patient safety, and affect oral disease prevention, oral health promotion, and successful treatment results based on dental hygiene care. Therefore, in the future, according to the development of dental hygiene science and the dental hygienist system, dental hygiene activities should be continuously revised and supplemented through research, and discussions in the academic world should be carried out.

The German Revised version of the Niigata PPPD Questionnaire (NPQ-R): Development with patient interviews and an expert Delphi consensus.

Persistent postural-perceptual dizziness (PPPD) is a functional disorder of the nervous system and currently one of the most common types of chronic dizziness. Currently existing questionnaires do not fully assess patients' specific symptoms of PPPD. The Japanese Niigata PPPD Questionnaire (NPQ) was recently developed following consensus-based diagnosis criteria. The aim of this study was to translate it into German, evaluate its content with the help of experts and patients and, if necessary, revise the original version to allow for a comprehensive assessment of patients' PPPD-related symptoms. A 3-round expert Delphi survey and semi-structured patient interviews were conducted. 28 experts from Switzerland, Germany and Austria working in hospitals or outpatient centres were asked to complete a first questionnaire on various aspects of PPPD, on the translated, original NPQ and their own related experiences (Round one), a second questionnaire with statements regarding PPPD they could agree or disagree with using a 6-point Likert-scale (Round two), and a third survey to finally reach a consensus on statements to be integrated into the NPQ. In addition, eleven patients (mean age of 64.6±12.6 years; 6 females) were selected according to the criteria for the diagnosis of PPPD proposed by the Bárány Society and participated in a semi-structured interview asking for their opinion on the content of the original NPQ. All collected data were analysed using a descriptive evaluation and a qualitative content analysis based on verbatim transcripts. Seven new items were added to the NPQ based on expert and patient comments and ratings. Its revised version (NPQ-R) comprises 19 items divided into five subscales using a 7-point Likert-scale with two additional subscales relating to associated symptoms and symptom behaviour in PPPD. The new maximal score is 114 points compared to 72 for the NPQ. The NPQ-R is the first patient-reported outcome measurement for patients with PPPD in German. It should help to provide a comprehensive assessment of the intensity of PPPD in affected patients.

Definition and Classification of Dental Hygiene Interventions Based on the Dental Hygiene Process of Care: A Delphi Study.

This study aimed to conceptualize the dental hygiene intervention performed by dental hygienists based on the dental hygiene process of care. The dental hygiene intervention classification was conducted on the qualitative content analysis method. The contents of the primary dental hygiene intervention classification were refined after review by three internal experts. The final classification of dental hygiene interventions was derived through an expert Delphi survey conducted twice with 15 professors in charge of clinical dental hygiene. In the Delphi survey, the content validity and clarity were evaluated. As a result of the first and second expert Delphi surveys, the content validity ratio for all dental hygiene interventions and definitions was ≥0.60, and the content validity index was ≥0.80. The degree of agreement was a minimum of 0.80 and a maximum of 1.00. Thirty-eight dental hygiene interventions were conceptualized, and the essence of the dental hygienist was confirmed. Dental hygienists are oral health experts who help in preventing oral diseases and promoting oral health by providing evidence-based comprehensive preventive management through interaction with their clients, and they are a primary care worker who could contribute to health promotion. In the future, dental hygienists are expected to be actively involved in the primary care system and dental clinical sites and contribute to health promotion through practical discussions for this purpose.