Expert Review Research Articles

Development and validation of a measurement tool to assess student perceptions of using real patients in physical therapy education at the Rocky Mountain University, the United States: a methodological study.

This study aimed to develop and validate the Student Perceptions of Real Patient Use in Physical Therapy Education (SPRP-PTE) survey to assess physical therapy student (SPT) perceptions regarding real patient use in didactic education. This cross-sectional observational study developed a 48-item survey and tested the survey on 130 SPTs. Face and content validity were determined by an expert review and Content Validity Index (CVI). Construct validity and internal consistency reliability were determined via exploratory factor analysis (EFA) and Cronbach's Alpha. Three main constructs were identified (Value, Satisfaction, and Confidence), each having 4 subconstruct components (Overall, Cognitive, Psychomotor, and Affective Learning). Expert review demonstrated adequate face and content validity (CVI = 96%). The initial EFA of the 48-item survey revealed items with inconsistent loadings and low correlations, leading to the removal of 18 items. An EFA of the 30-item survey demonstrated 1-factor loadings of all survey constructs except Satisfaction and the entire survey. All constructs had adequate internal consistency (Cronbach's Alpha > 0.85). The SPRP-PTE survey provides a reliable and valid way to assess student perceptions of real patient use. Future studies are encouraged to validate the SPRP-PTE survey further.

Mapping design stages and methodologies for developing STEM concept inventories: a scoping review

BackgroundConcept inventories (CIs) have become widely used tools for assessing students’ learning and assisting with educational decisions. Over the past three decades, CI developers have utilized various design approaches and methodologies. As a result, it can be challenging for those developing new CIs to identify the most effective and appropriate methods and approaches. This scoping review aimed to identify and map key design stages, summarize methodologies, identify design gaps and provide guidance for future efforts in the development and validation of CI tools.MethodsA preliminary literature review combined theoretical thematic analysis (deductive, researcher-driven) focusing on specific data aspects, and inductive thematic analysis (data-driven), using emerging themes independent of specific research questions or theoretical interests. Expert discussions complemented the analysis process.ResultsThe scoping review analyzed 106 CI articles and identified five key development stages: define the construct, determine and validate content domain; identify misconceptions; item formation and response processes design; test item selection and validation; and test application and refinement. A descriptive design model was developed using a mixed-method approach, incorporating expert input, literature review, student-oriented analysis, and statistical tests. Various psychometric assessments were employed to validate the test and its items. Substantial gaps were noted in defining and determining the validity and reliability of CI tools, and in the evidence required to establish these attributes.ConclusionThe growing interest in utilizing CIs for educational purposes has highlighted the importance of identifying and refining the most effective design stages and methodologies. CI developers need comprehensive guidance to establish and evaluate the validity and reliability of their instruments. Future research should focus on establishing a unified typology of CI instrument validity and reliability requirements, as well as the types of evidence needed to meet these standards. This effort could optimize the effectiveness of CI tools, foster a cohesive evaluation approach, and bridge existing gaps.

Nonsurgical Interventions for Gender-Affirming Facial Feminization: A Scoping Review.

Importance: Systematic review will improve understanding of nonsurgical facial feminization techniques, which are useful alternatives or adjuncts to surgical gender affirmation. Objective: To determine the effectiveness of nonsurgical facial feminization techniques in patients seeking gender-affirming feminization by reviewing the literature for patient-reported, subjective, and objective outcomes of feminization. Evidence Review: A comprehensive database search was conducted through July 28, 2022. A total of 264 titles and abstracts were screened by two independent reviewers in Covidence. Of all, 48 met the inclusion criteria for full-text review, and 20 articles were included in the final data extraction. Findings: The most described nonsurgical facial feminization techniques were neurotoxins, fillers, and hair removal. Techniques were derived from cisgender cosmetic procedures to achieve feminine qualities. The most common study type was expert opinion or literature reviews. There were only two studies that analyzed measurable nonsurgical facial feminization techniques. Conclusions and Relevance: There is a lack of high-quality prospective research and randomized, controlled trials specific to the transgender patient population that evaluate outcomes, patient satisfaction, or complications. Such studies are needed to inform evidence-based practices.

Initial surgical management of injuries to the lower extremities in patients with multiple and/or severe injuries - A systematic review and clinical practice guideline update.

Our aim was to develop new evidence-based and consensus-based recommendations for the initial inhospital management of lower-extremity injuries in patients with multiple and/or severe trauma. This guideline topic is part of the 2022 update of the German Guideline on the Treatment of Patients with multiple and/or severe Injuries. MEDLINE and Embase were systematically searched to May 2021. Randomised controlled trials, prospective cohort studies, and comparative registry studies were included if they compared interventions for the initial surgical and non-surgical management of fractures, dislocations or vascular injuries of the lower extremities in patients with multiple and/or severe trauma. We considered patient-relevant clinical outcomes such as mortality, complication rates, length of stay, and function. Risk of bias was assessed using NICE 2012 checklists. The evidence was synthesised narratively, and expert consensus was used to develop recommendations and determine their strength. Eleven studies were identified. They addressed time to definitive fixation (n = 10 studies) and amputation (n = 1). Two new recommendations were developed, one was modified. All recommendations achieved strong consensus. This systematic literature review and subsequent expert consensus process resulted in the following new key recommendations. It is recommended that isolated and multiple lower-extremity fractures are managed with primary definitive fixation in patients whose condition is stable. Patients condition is not considered stable should be managed with primary temporary fixation. In addition, it is recommended that dislocations of the lower extremities are reduced and immobilised as early as possible.

National Health Education Standards: Model Guidance for Curriculum and Instruction (Third Edition).

Since the 1990s, national standards have been developed in K-12 subject areas. National standards in health education were first released in 1995 with a second set released in 2007. A third edition, the National Health Education Standards: Model Guidance for Curriculum and Instruction was developed in 2022 under the auspices of the National Consensus for School Health Education. The purpose of this article is to present an overview of the third edition including descriptions of the development process;the 8 standards and aligned performance expectations; considerations related to the translation, dissemination, and implementation of the standards; and projections for potential impact regarding teaching and student outcomes. To develop new standards, the National Consensus formed 3 groups: the Management, Development, and Expert Review Groups. These groups employed an iterative process that included the development of 3 drafts of the standards before finalization. This process included a review of each draft by the 3 groups. The second draft included additional qualitative feedback from over 500 school health education leaders, practitioners, and stakeholders. The third edition includes 8 standards with aligned performance expectations. A description and rationale are provided for each standard along with standard-specific teaching guidance. The third edition of the National Standards for School Health Education provides guidance to state departments of education and local schools in the development and implementation of health instruction that promotes meaningful learning to guide students in the promotion of their own health and the health of others.

Expert review of AI-generated responses to the top ten patient complaints in primary care

Expert review of AI-generated responses to the top ten patient complaints in primary care

Development and preliminary evaluation of a food literacy measure for use with young people in Canada

This paper presents the culmination of a multi-year research project aimed at creating a comprehensive food literacy framework and corresponding measure. Specifically, this paper documents the development and validation of a food literacy measure for young people facing social inequities. This study aimed to: 1) identify items to measure 12 attributes of food literacy 2) test the measure with the identified target groups, considering attribute, face, and content validity, inter-rater reliability and test-retest reliability; and 3) refine the measure. The study's design consisted of a five-phase approach, which included drafting the food literacy measure, expert review, cognitive interviews, pilot testing, and validity and reliability testing. Seven international experts provided feedback on the measure and 25 individuals aged 16-25 years old participated in cognitive interviews. Two-hundred and fifty-five (255) young people completed the test survey and 147 completed a retest survey two weeks later. These surveys identified food literacy factors. To further evaluate the validity of these factors. 193 participants completed a confirmatory test, which was used for confirmatory factor analysis (CFA) to assess the final model's fit. Interview participants were recruited from local programs and services from across Ontario, Canada, while survey participants were recruited from across Canada via social media. The research study was conducted between January 2018 and December 2019. The main outcome measures were validity and reliability scores for a food literacy measurement tool, which consisted of 50 questions across 10 attributes of food literacy. Interview analyses were guided by the four stages of cognitive processing. Exploratory factor analysis (EFA) was used to identify the factors that improved the Cronbach alpha of the food literacy measure. Test-retest reliability was assessed using percent agreement, Cohen Kappa, and weighted Kappa. Confirmatory factor analysis (CFA) was used to produce an acceptable final model with an RMSEA estimate. The final food literacy measure consisted of 50 questions addressing 10 food literacy attributes. EFA showed an improvement in Cronbach alpha when compared to the initial attribute construction. Test-retest reliability showed percent agreement ranging from 64% to 97%, with most items having fair (0.21-0.40) to moderate (0.41-0.60) Kappa values. CFA produced an acceptable final model with an RMSEA estimate of 0.0437. The food literacy measure is a comprehensive tool for assessing food literacy among young people. Additional research is needed to explore the measure's modularity, its use as an evaluation tool, and its suitability for use with diverse samples, including individuals from varied gender, geographic locations, ethnicities and cultural backgrounds.

The Determination of Factors for ICT Quality Assessment Model

Information and Communication Technology (ICT) is a crucial asset in business processes and high ICT quality allows for highly efficient business processes. Measuring ICT quality is identified as a crucial step towards ensuring high-quality ICT service. Over the years several ICT assessment models have been developed and each year the factors of measurement are constantly updated. This is due to constant change in technology trends and the user requirements. Thus, any existing factors within models developed previously require review and update if necessary. Therefore, the most relevant factors for ICT assessment model are investigated in this study. Through literature review a set of updated factors are developed and expert review were used to validate the factors. Factors determined in this study are: Software System and Application, Computing Hardware, Network and Communication, Lifelong Learning organizational Governance, Ecosystem Support, Security and Official Recognition. The updated and validated factors shall help future researchers in developing a model to assess ICT compliancy for measuring readiness in providing quality ICT services.

Evaluation of self-stigma in patients with epilepsy: Validation of the self-stigma scale to Spanish (ESSS-S).

The Epilepsy Self-Stigma Scale (ESSS) has been developed in Japan for patients with epilepsy (PWE). We aimed to validate the scale in Spanish and examine its validity and reliability. The transcultural adaptation of the ESSS was conducted using translation and back-translation, along with pilot testing and an expert panel review. An online questionnaire was used to assess construct validity, criterion validity, and internal consistency. A total of 260 out of 628 participants completed the questionnaires. We found a two-factor structure that explained 61.3% of the total variance: factor 1 "self-perceived discrimination" with a Cronbach's alpha of 0.80, and factor 2 "social isolation" with a Cronbach's alpha of 0.75. The reliability of overall ESSS-S 8-item scores was high (Cronbach's alpha = 0.74). Convergent validity was tested and demonstrated a significant correlation. P. Self-perceived discrimination scores were associated with higher anxiety and depression scores (r = 0.53/0.54; p < 0.001), lower self-esteem (-0.53; p < 0.001), and lower quality of life (r = -0.66; p < 0.001). Social isolation scores were associated with higher anxiety and depression scores (r = 0.41/0.33; p < 0.001), lower self-esteem (-0.34; p < 0.001), and lower quality of life (r = -0.35; p < 0.001). Temporal reliability was also tested, showing a test-retest ICC of 0.87. The mean self-stigma score in the Spanish population was 17.68 ± 5.45 out of 32 points. Invariance across gender and age groups indicated that there are no systematic response biases by gender or age, so stratified scores could be related to other constructs. The Spanish version of ESSS (ESSS-S) is a valid and reliable tool for the assessment of self-stigma in PWE among Spanish speakers. This study aimed to validate the Epilepsy Self-Stigma Scale (ESSS) for Spanish speakers (ESSS-S). We conducted transcultural adaptation of the scale. ESSS-S showed high reliability and strong validity, correlating with higher anxiety and depression, lower self-esteem, and quality of life. ESSS-S is a reliable and valid tool for assessing self-stigma in Spanish-speaking people with epilepsy.

Development, Validation, and Faking-Resistance of an Implicit Measure of Psychopathy in the Workplace

ABSTRACT Researchers have called for faking-resistant measures of psychopathic personality that can be self-administered in high-stakes contexts (e.g. hiring). We developed and validated an implicit measure of psychopathy contextualized in workplace situations. We first detail how the measure is framed, conceptualized, and rooted in psychopathy literature. We then describe the item development process, and Study 1 involves expert review and refining the item list. In Study 2 (N = 396), we examine internal consistency and factor structure for a 22-item version of the measure. In Study 3 (N = 251), we demonstrate test-retest reliability, construct-related validity, and provide initial evidence for criterion-related validity through a two-wave study. Study 4 analyzes the measure using item response theory, based on a sample of 6,746 job seekers, demonstrating effectiveness for measuring high levels of psychopathy. In Study 5 (N = 219) we provide evidence of faking-resistance and criterion-related validity with behavioral (two weeks later) and self-report (one year later) outcomes. Finally, Study 6 provides promising evidence of incremental validity using an organizational sample (N = 615). Overall, scores on this new implicit measure are reliable, with acceptable construct-related, criterion-related, and incremental validity, while also being faking-resistant. Implications for use in workplace settings are discussed.

The Use of Generative Artificial Intelligence for Business Decision-Making

The purpose of this study was to develop autonomous artificial intelligence agents capable of working as a cohesive group to solve intricate decision-making processes, ultimately pushing the boundaries of artificial intelligence’s applicability in high-stakes and real-world scenarios. An autonomous multi-agent model was designed and deployed using the Analytic Hierarchy Process (AHP) decision-making framework, with autonomous AI agents, such as CrewAI and AutoGen, orchestrating multiple stages of activities performed by four distinct agents leveraging generative AI (GenAI). These agents were applied to a use case for proof of concept. The agents used a qualitative dataset to generate management recommendations based on cost and market feasibility considerations. The model was tested with publicly available customer feedback data on oatmeal cookies. It synthesized 913 customer reviews, identified common complaints, provided a summary of potential solutions, and generated a summary of market opportunities, along with relevant challenges. Although a subject matter expert's review is necessary to evaluate the practicality and relevance of the recommendations, the results demonstrated the high potential of multi-agent models in synthesizing and distilling large datasets into actionable insights, thereby augmenting decision-making processes in business contexts. The model's modular design allows for enhancements in quality, accuracy, and practicality by incorporating additional datasets and new agents. This study underscores that the integration of GenAI within a multi-agent model empowers businesses to swiftly transform vast amounts of business intelligence data into practical recommendations.

Five principles and protocols for the clinician based on the 2021 ERS and BTS statements for treating sarcoidosis.

The European Respiratory Society (ERS) and the British Thoracic Society (BTS) have recently published their statements on the treatment of sarcoidosis. There are five key questions in sarcoidosis treatment that need to be addressed: when to treat, how to initiate treatment, how long to treat, when and how to change treatment, and how to treat relapses. Herein, we describe the principles and protocols to answer these questions based on the ERS and BTS statements and other expert reviews. Pulmonary or extrapulmonary sarcoidosis should be treated with anti-inflammatory therapy if it significantly impairs the quality of life (QoL), causes significant organ dysfunction, or threatens to cause organ damage, disability, or death. If treatment is initiated for improving the QoL alone, low-dose (10 mg/day) prednisone is a good initial treatment that can be tapered and stopped over 3 months. Disease that causes significant organ dysfunction needs to be treated with medium-dose glucocorticoids (initial daily dose, 20 mg of prednisone equivalent) tapered over a minimum duration of 6 months. Worsening of disease while tapering treatment indicates that longer (9-24 months) treatment may be necessary. If a daily prednisone dose of >10 mg is required for >6 months to maintain remission, it is best to use a second-line drug such as methotrexate or azathioprine. Anti-tumor necrosis factor agents, such as infliximab or adalimumab, may be used to treat inflammatory disease that persists on combination treatment with glucocorticoids and a second-line agent.

Unveiling the Forces driving expert Activity: The impact of information environment and peer behavior on expert reviewer engagement behavior

Unveiling the Forces driving expert Activity: The impact of information environment and peer behavior on expert reviewer engagement behavior

Chemosensory vocabulary in wine, perfume and food product reviews: Insights from language modeling

Chemosensory sensations are often hard to describe and quantify. Language models may facilitate a systematic understanding of sensory descriptions. We accessed consumer and expert reviews of wine, perfume, and food products (English language; about 68 million words in total) and analyzed their sensory descriptions. Using a novel data-driven method based on natural language data, we compared the three chemosensory vocabularies (wine, perfume, food) with respect to their vocabulary overlap and semantic properties, and explored their semantic spaces. The three vocabularies primarily differ with respect to domain specificity, concreteness, descriptor type preference and degree of gustatory vs. olfactory association. Wine vocabulary primarily distinguishes between white wine and red wine flavors and qualities. Food vocabulary separates drinkable and edible food products and ingredients, on the one hand, and savory and non-savory products, on the other. A salient distinction in all three vocabularies is between concrete and abstract/evaluative terms. Valence also plays a role in the semantic spaces of all three vocabularies, but valence is less prominent here than ingeneral olfactory vocabulary. Our method allows a systematic comparison of sensory descriptors in the three product domains and provides a data-driven approach to derive sensory lexicons that can be applied by sensory scientists.

음악과 개념기반 탐구학습 수업모형 개발 및 수업설계 방안 탐색

This study begins with the issue that existing models of concept-based inquiry processes generally fail to capture the distinctive characteristics of music education, which involves creation, practice, immersion, and expression. The aim of this research is to develop a music class model applicable to concept-based inquiry learning. To achieve this, we examined the features of concept-based curricula and the unique characteristics of music education, analyzed existing related instructional models to derive their features, and then developed a seven-stage instructional model. This model, which incorporates feedback from a music education research group and expert reviews, was applied to music classes centered around the concept of "change". The seven stages include: 'Observing', 'Exploring Contextual Information', 'Refining', 'Immersing and Expressing', 'Meaning Constructing', 'Transferring', and 'Reflecting'. The focus on 'Immersing and Expressing', a core characteristic of music education, is central to this model, with the structure allowing for flexible transitions to 'Immersing and Expressing' from other stages as needed. This model is suitable for forming music concepts and transferring them to other musical areas, thus promoting enriched musical experiences and practical applications in life. It is expected that this model will contribute to discussions on various applications of concept-based inquiry learning in music and practical approaches to instructional methods in the future.

Validity And Reliability Of Digital Health Education On Diabetic Foot Care Based On Health Belief Model Among Type Ii Diabetic Patients

The study aims to evaluate the effectiveness of digital health education on diabetic foot care among type II diabetic patients using the Health Belief Model (HBM). A total of 30 participants were recruited from local diabetes clinics to receive digital health education focused on diabetic foot care practices. To ensure the validity and reliability of the assessment tools, we employed multiple methods. Content validity was established through expert reviews, while construct validity was examined using Exploratory Factor Analysis (EFA) and Confirmatory Factor Analysis (CFA), which confirmed a good factor structure aligned with the HBM constructs. Reliability was assessed using Cronbach’s alpha for internal consistency, which showed acceptable values ranging from 0.67 to 0.84, and test-retest reliability with Intraclass Correlation Coefficients (ICC) ranging from 0.74 to 0.78. The results indicate that the digital health education program significantly improved the participants' understanding and practices related to diabetic foot care. These findings underscore the potential of digital education interventions for chronic disease management, particularly for enhancing self-care behaviors in diabetic patients. Future studies should consider larger sample sizes to further validate these tools and results. Overall, this study provides evidence supporting the effectiveness of digital health education for diabetic foot care and validates the reliability and validity of the instruments used.

Motor development and functional ability for children with cerebral palsy: A new tool for functional measure

The paucity of adequate tool available for documenting therapeutic effectiveness surfaces as major problem. An initiation is being taken to develop an appropriate tool which can evaluate motor development and functional ability of children with Cerebral palsy appropriate to Indian culture and society. Aim: To develop an assessment tool for analysing motor development and functional ability of children with Cerebral palsy. Objectives: (i) To develop Psychometric property and evaluate the psychometric property of the tool. (ii) To check the reliability and validity of the tool developed. Material and method: Tool development was conducted in three phases, Phase 1- development of 64 items in three domains. Expert review was undertaken and correction of the content was done through discussion with experts. Phase 2- content validity and face validity have been established. Phase 3 - concurrent validity, has been established by corelating with GMFM. Result: 64 items were generated under three stages: Infant (20), Toddler (36) and Preschooler (8). Content validity index at item level and Scale level were significantly high (&gt; 0.80) for agreement in Clarity, Essential and Relevancy. The face validity of the tool was evaluated. Each item was under full agreement category (90% -100%) in formatting, clarity, and appropriateness of the item for children with CP. Test-retest, interrater and concurrent validity of the tool is significantly acceptable. Conclusion: The new tool may be considered as an effective measure which is suitable in children with CP.

Translating and validating the Ghosting Questionnaire into Arabic: results from classical test theory and item response theory analyses

BackgroundGhosting refers to the sudden cessation of communication in interpersonal relationships. Ghosting has gained attention as a phenomenon commonly encountered in the context of digital communication. Earlier studies on ghosting mostly focused on Western societies while, in Arab societies, research into this practice has yet to be initiated. The current study aimed to address this gap by translating and validating the commonly used Ghosting Questionnaire (GHOST) into Arabic.MethodsThe translation process involved forward and back translation, expert review, and pilot testing to ensure linguistic and cultural equivalence. A convenience sample of 607 participants from Bahrain, Egypt, Jordan, Oman, and Tunisia completed the Arabic version of the GHOST. Statistical analyses, including reliability testing and confirmatory factor analysis, were conducted to assess the psychometric properties of the instrument.ResultsThe Arabic version of the GHOST demonstrated high reliability. The Cronbach’s alpha (α = 0.87) and McDonald’s omega (ω = 0.87) coefficients indicated strong internal consistency. Test-retest reliability coefficients confirmed the stability of the responses over time (ICC 0.89, p < 0.001). CFA supported a single-factor structure in alignment with the conceptual framework of the original English version.ConclusionsThe successful translation and validation of the GHOST into Arabic provide researchers with a reliable tool for investigating ghosting behavior within Arab societies. Future research endeavors can build upon these findings to explore the psychological implications of ghosting. Researchers can now also develop culturally sensitive understanding of online dating and related practices in Arab communities.

Design and evaluation of a questionnaire to assess learners’ understanding of quantum measurement in different two-state contexts: The context matters

The teaching and learning of quantum physics has recently become a topic of increasing interest in physics education research. In particular, the study of two-state systems is gaining importance as a means of teaching quantum physics at various educational levels. Meanwhile, a number of approaches have been developed that are also suitable for high school students. It can be assumed that the different approaches have different degrees of effectiveness in teaching central quantum concepts. However, suitable evaluation instruments to test this are still lacking. Therefore, as a first step, a short questionnaire on quantum measurement, suitable for both research and classroom use, was developed in several steps. First, a questionnaire with open and closed items was created and piloted with a total of N=120 learners. The responses were evaluated qualitatively using a comprehensive coding manual, which provided insights into learners’ conceptions. These results led to the development of an eight-item questionnaire that could be adapted to different teaching approaches. This questionnaire was subjected to expert review and, finally, successfully tested for its psychometric properties with a sample of N=201 learners. Overall, our results provide initial empirical evidence that context (i.e., which two-state approach is used) does matter for student learning, but in general, two-state approaches appear to be particularly conducive to learning quantum concepts (specified in this article for quantum measurement) compared to traditional instruction. Published by the American Physical Society 2024

Development of Digital Health Gender and Sexual Health Literacy scale

Abstract Introduction Health literacy, as the ability to obtain, process and understand health information, including gender and sexuality awareness, appears to be underdeveloped in terms of measurement tools and thematic materials. The literature indicates the existence of serious deficits in gender and sexual health literacy at all levels, with implications for relationships with citizens and patients. Methods Delphi study agreement was conducted and a pool of potential scale items was generated, reflecting a range of skills and abilities within each domain. Items were carefully worded to ensure clarity, cultural sensitivity and relevance to different gender identities and sexual orientations. Expert review and cognitive pre-testing were employed to refine item wording, assess content validity, and ensure that the 10-item scale was comprehensible and relevant to the target population. Results The theoretical development of the 10-item Digital Health Gender and Sexual Health Literacy Scale was successfully completed. The scale items were designed to provide a comprehensive measure of an individual’s ability to navigate the digital landscape for gender and sexual health information. Conclusions The theoretical validation of the Digital Health Gender and Sexual Health Literacy Scale (DiGeSHeL) provides the community with a promising tool to assess individuals’ confidence and ability to use digital technologies for sexual health information and resources. However, further research is needed to validate the scale and test its reliability with a diverse group of participants. Once validated, this scale could be a valuable tool for sexual health promotion programmes to identify gaps and evaluate the impact of digital literacy interventions. Key messages • Gender and sexual literacy are crucial for health. • Health literacy as six vital sign.