Expert Ratings Research Articles

Utilizing ChatGPT as a scientific reasoning engine to differentiate conflicting evidence and summarize challenges in controversial clinical questions.

Synthesizing and evaluating inconsistent medical evidence is essential in evidence-based medicine. This study aimed to employ ChatGPTas a sophisticated scientific reasoning engine to identify conflicting clinical evidence and summarize unresolved questions to inform further research. We evaluated ChatGPT's effectiveness in identifying conflicting evidence and investigated its principles of logical reasoning. An automated framework was developed to generate a PubMed dataset focused on controversial clinical topics. ChatGPT analyzed this dataset to identify consensus and controversy, and to formulate unsolved research questions. Expert evaluations were conducted 1) on the consensus and controversy for factual consistency, comprehensiveness, and potential harm and, 2) on the research questions for relevance, innovation, clarity, and specificity. The gpt-4-1106-preview model achieved a 90% recall rate in detecting inconsistent claim pairs within a ternary assertions setup. Notably, without explicit reasoning prompts, ChatGPT provided sound reasoning for the assertions between claims and hypotheses, based on an analysis grounded in relevance, specificity, and certainty. ChatGPT's conclusions of consensus and controversies in clinical literature were comprehensive and factually consistent. The research questions proposed by ChatGPT received high expert ratings. Our experiment implies that, in evaluating the relationship between evidence and claims, ChatGPT considered more detailed information beyond a straightforward assessment of sentimental orientation. This ability to process intricate information and conduct scientific reasoning regarding sentiment is noteworthy, particularly as this pattern emerged without explicit guidance or directives in prompts, highlighting ChatGPT's inherent logical reasoning capabilities. This study demonstrated ChatGPT's capacity to evaluate and interpret scientific claims. Such proficiency can be generalized to broader clinical research literature. ChatGPT effectively aids in facilitating clinical studies by proposing unresolved challenges based on analysis of existing studies. However, caution is advised as ChatGPT's outputs are inferences drawn from the input literature and could be harmful to clinical practice.

Validity and Reliability of the Swedish Version of the Gugging Swallowing Screen for use in Acute Stroke Care.

The purpose of this study was to cross-culturally validate the Swedish version of the Gugging Swallowing Screen (GUSS-S) for use in the acute phase of stroke. Further, to evaluate the inter-rater reliability between different healthcare professionals. GUSS was translated into Swedish using a forward-backward method followed by expert rating to obtain content validity. For criterion validity, the GUSS-S score was compared with Flexible Endoscopic Evaluation of Swallowing (FEES) assessed with the Penetration-Aspiration Scale (PAS) in acute stroke patients (≤ 96h after stroke onset). Convergent validity was calculated by comparison with the Functional Oral Intake Scale (FOIS) as per the comprehensive FEES assessment, the Standardized Swallowing Assessment (SSA), and the National Institutes of Health Stroke Scale (NIHSS). To evaluate inter-rater reliability, a nurse and a speech-language pathologist (SLP) independently assessed 30 patients. In total, 80 patients (32 women, median age 77 years (range 29-93) were included, mean 1.7 ± 0.9 days after admission. With a cut-off value of 14 points, the GUSS-S identified aspiration with a sensitivity of 100% and a specificity of 73% (area under the curve: 0.87, 95% CI 0.78-0.95). Spearman rank correlation showed very strong correlation between the GUSS-S and PAS (rs=-0.718, P = < 0.001) and FOIS (rs=0.720, P = 0.001) and strong correlation between the GUSS-S and SSA (rs=0.545, P = < 0.001) and NIHSS (rs=-0.447, P = 0.001). The inter-rater agreement for GUSS-S was substantial (Kw=0.67, P = < 0.001). The results indicate that the GUSS-S is a valid and reliable tool for the assessment of dysphagia in acute stroke patients by different healthcare professionals.

Validating a theory of planned behavior questionnaire for assessing changes in professional behaviors of medical students.

Teaching professionalism is a fundamental aspect of medical undergraduate education, delivering important domains of professional attitudes, ethics, and behaviors. The effects of educational interventions can be assessed by measuring the change in such domains, but validated assessment tools for these professionalism domains are lacking. In this study, we constructed and conducted expert validation of a modified theory of planned behavior (TPB) questionnaire to assess changes in professional behaviors (PBs) in medical students. To validate that, we modified an existing TPB questionnaire, and an 18-item questionnaire was subjected to expert panel evaluation using the content validation method. The clarity and relevance of items were assessed using a four-point rating scale (i.e., 1 = not relevant to 4 = highly relevant). Ratings of experts and free-text comments were analyzed. Quantitative evaluation of relevance and clarity was undertaken through analyses of the Item-level Content Validity Index (I-CVI) and Scale-level Content Validity Index (S-CVI). A qualitative assessment of the comments of experts was conducted to refine items, any disagreements were discussed, and a consensus decision was developed among authors for item changes. Quantitative evaluation of the Item-level Content Validity Index (I-CVI) scored 0.9-1 for relevance and 0.7-1 for clarity. Qualitative evaluation resulted in (i) changes to the wording of items (e.g., choices such as "worthless/worthwhile" were replaced with "not important/important"); and (ii) suggestion of the addition of social media in the construct of subjective norms. The proposed tool exhibits content validity and can assess TPB constructs in professionalism education. This study of content validity may help to ensure the modified TPB questionnaire accurately measures the TPB constructs, ensuring its effectiveness in accurately measuring the TPB constructs for PB in diversified educational medical institutions.

Personality Functioning Improvement during Psychotherapy Is Associated with an Enhanced Capacity for Affect Regulation in Dreams: A Preliminary Study.

Clinical case illustrations of patients with an impairment of personality functioning (IPF) have repeatedly reported that progress during psychotherapy is reflected by alterations in dream content. However, quantitative studies based on samples of psychotherapy patients are scarce. As a core component of both personality functioning and contemporary psychodynamic dream theory, the construct of affect regulation is of specific significance in this context. To test if improvement in personality functioning in the course of psychotherapy is associated with an increasing ability to regulate affects in dreams. In a longitudinal design, affect regulation was compared in N = 94 unsolicited dream reports from the first vs. last third of long term psychotherapy of ten patients with initial IPF. Dream reports were transcribed from recordings of the sessions. Expert ratings of the level of personality functioning were obtained using the Scales of Psychological Capacities. The capacity for affect regulation was assessed using the Zurich Dream Process Coding System. Group differences were assessed using linear mixed models, controlling for dream length as well as the nested structure of this data set. Patients demonstrated an increased capacity for affect regulation in dreams that was primarily evident in three core features: the complexity of dream elements (cf., e.g., parameter attributes, p = 0.024); the extent of affective involvement in the dream ego (cf., e.g., parameter subject feeling, p = 0.014); and the flexibility to regulate the dynamics of safety/involvement processes (p ≤ 0.001). This pattern was especially prominent in a subgroup (n = 7) of patients with more pronounced improvements in personality functioning. These findings support the hypotheses that decreasing IPF during psychotherapy is associated with increases in the capacity for affect regulation in dreams. Thus, researchers and therapists can utilize dream reports to illuminate the important aspects of treatment progress in clinical practice.

ROMPER: The RAND/USC OPTIC Method for Policy Expert Ratings

We developed an expert panel approach for identifying expert views on the effectiveness and implementability of population-level policy interventions. ROMPER—the RAND/USC OPTIC Method for Policy Expert Ratings—involves an online, three-round, modified-Delphi process:•Experts rate and comment on policies according to domains of the Grading of Recommendations Assessment, Development and Evaluation (GRADE) Evidence-to-Decision framework.•To identify consensus on policy effectiveness and implementability, expert ratings are analyzed using the Inter-Percentile Range Adjusted for Symmetry (IPRAS) technique from the RAND/UCLA Appropriateness Method and visualized using a forest plot. To explain consensus, expert comments are analyzed using reflexive thematic analysis and reported following the Standards for Reporting Qualitative Research.•To provide actionable information for decisionmakers, each policy is summarized in a “Policy Profile” adapted from GRADEPro Evidence-to-Decision tables.We validated ROMPER in two studies that successfully recruited the targeted sample size, retained experts through all three rounds, and examined consensus on which policies are (not) effective and implementable. ROMPER protocols, materials, data, and code are openly available on the Open Science Framework with Creative Commons licensing for replication and reuse. ROMPER provides a validated, replicable, open access approach for eliciting expert views on both policy effectiveness and implementability—and for summarizing (lack of) consensus specifically for policymakers.

Towards Improved Auditory-Perceptual Assessment of Timbres: Comparing Accuracy and Reliability of Four Deconstructed Timbre Assessment Models

Timbre is a central quality of singing, yet remains a complex notion poorly understood in psychoacoustic studies. Previous studies note how no single acoustic variable or combinations of variables consistently predict timbre dimensions. Timbre varies on a continuum from darkest to lightest. These extremes are associated with laryngeal and vocal tract adjustments related to smaller and larger vocal tract area and variations in vocal fold vibratory characteristics. Perceptually, timbre assessment is influenced by spectral characteristics and formant frequency adjustments, though these dimensions are not independently perceived. Perceptual studies repeatedly demonstrate difficulties in correlating variations in timbre stimuli to specific measures. A recent study demonstrated how acoustic predictive salience of voice category and voice weight across pitches contribute to timbre assessments and concludes that timbre may be related to as-of-yet unknown factor(s). The purpose of this study was to test four different models for assessing timbre; one model focused on specific anatomy, one on listener intuition, one utilising auditory anchors, and one using expert raters in a deconstructed timbre model with 5 specific dimensions. MethodsFour independent panels were conducted with separate cohorts of professional singing teachers. 41 assessors took part in the anatomically focused panel, 54 in the intuition-based panel, 30 in the anchored panel, and 12 in the expert listener panel. Stimuli taken from live performances of well-known singers were used for all panels, representing all genders, genres, and styles across a large pitch range. All stimuli are available as supplementary materials. Fleiss’ kappa values, descriptive statistics, and significance tests are reported for all panel assessments. ResultsPanel 1 through 4 varied in overall accuracy and agreement. The intuitionbased model showed overall 45% average accuracy (SD ±4%), k=0.289 (<0.001) compared to overall 71% average accuracy (SD ±3%), k=0.368 (<0,001) of the anatomical focused panel. The auditory-anchored model showed overall 75% average accuracy (SD ±8%), k=0.54 (<0.001) compared with overall 83% average accuracy and agreement of k=0.63 (<0.001) for panel 4. Results revealed that highest accuracy and reliability was achieved in a deconstructed timbre model and that providing anchoring improved reliability but with no further increase in accuracy. ConclusionDeconstructing timbre into specific parameters improved auditory perceptual accuracy and overall agreement. Assessing timbre along with other perceptual dimensions improves accruacy and reliability. Panel assessors’ expert level of listening skills remain an important factor in obtaining reliable and accurate assessments of auditory stimuli for timbre dimensions. Anchoring improved reliability but with no further increase in accuracy. The study suggests that timbre assessment can be improved by approaching the percept through a prism of 5 specific dimensions each related to specific physiology and auditory-perceptual subcategories. Further tests are needed with framework-naïve listeners, non-musically educated listeners, artificial intelligence comparisons, and synthetic stimuli to further test the reliability.

Self-Guided DMT: Exploring a Novel Paradigm of Dance Movement Therapy in Mixed Reality for Children with ASD.

Children diagnosed with Autism Spectrum Disorder (ASD) often exhibit motor disorders. Dance Movement Therapy (DMT) has shown great potential for improving the motor control ability of children with ASD. However, traditional DMT methods often lack vividness and are difficult to implement effectively. To address this issue, we propose a Mixed Reality DMT approach, utilizing interactive virtual agents. This approach offers immersive training content and multi-sensory feedback. To improve the training performance of children with ASD, we introduce a novel training paradigm featuring a self-guided mode. This paradigm enables the rapid creation of a virtual twin agent of the child with ASD using a single photo to embody oneself, which can then guide oneself during training. We conducted an experiment with the participation of 24 children diagnosed with ASD (or ASD propensity), recording their training performance under various experimental conditions. Through expert rating, behavior coding of training sessions, and statistical analysis, our findings revealed that the use of the twin agent for self-guidance resulted in noticeable improvements in the training performance of children with ASD. These improvements were particularly evident in terms of enhancing movement quality and refining overall target-related responses. Our study holds clinical potential in the field of medical treatment and rehabilitation for children with ASD.

Attributes, Quality, and Downloads of Dementia-Related Mobile Apps for Patients With Dementia and Their Caregivers: App Review and Evaluation Study.

The adoption of mobile health (mHealth) apps among older adults (>65 years) is rapidly increasing. However, use of such apps has not been fully effective in supporting people with dementia and their caregivers in their daily lives. This is mainly attributed to the heterogeneous quality of mHealth apps, highlighting the need for improved app quality in the development of dementia-related mHealth apps. The aims of this study were (1) to assess the quality and content of mobile apps for dementia management and (2) to investigate the relationship between app quality and download numbers. We reviewed dementia-related mHealth apps available in the Google Play Store and Apple App Store in Taiwan. The identified mobile apps were stratified according to a random sampling approach and evaluated by five independent reviewers with sufficient training and proficiency in the field of mHealth and the related health care sector. App quality was scored according to the user version of the Mobile Application Rating Scale. A correlation analysis was then performed between the app quality score and number of app downloads. Among the 17 apps that were evaluated, only one was specifically designed to provide dementia-related education. The mean score for the overall app quality was 3.35 (SD 0.56), with the engagement (mean 3.04, SD 0.82) and information (mean 3.14, SD 0.88) sections of the scale receiving the lowest ratings. Our analyses showed clear differences between the top three- and bottom three-rated apps, particularly in the entertainment and interest subsections of the engagement category where the ratings ranged from 1.4 to 5. The top three apps had a common feature in their interface, which included memory, attention, focus, calculation, and speed-training games, whereas the apps that received lower ratings were found to be deficient in providing adequate information. Although there was a correlation between the number of downloads (5000 or more) and app quality (t15=4.087, P<.001), this may not be a significant determinant of the app's perceived impact. The quality of dementia-related mHealth apps is highly variable. In particular, our results show that the top three quality apps performed well in terms of engagement and information, and they all received more than 5000 downloads. The findings of this study are limited due to the small sample size and possibility of disregarding exceptional occurrences. Publicly available expert ratings of mobile apps could help people with dementia and their caregivers choose a quality mHealth app.

Оценка индивидуально-психологических характеристик и уровня доверия по фотоизображению лица незнакомого человека до и после непосредственного перцептивного взаимодействия

&lt;p&gt;The article presents the results of a study of the influence of direct perceptual interaction on the assessment of the individual psychological characteristics of a stranger and the level of trust/distrust in him. The problem of the influence of direct perceptual interaction in conditions of interpersonal perception still remains relevant and requires thorough experimental study. The main assumption of the work is that ideas about a stranger, including a complex dialectical interaction of trust/distrust, will differ significantly before and after direct perceptual interaction. The assessment of individual psychological characteristics was carried out using the &amp;ldquo;Personal Differential&amp;rdquo; technique, trust/distrust using the &amp;ldquo;Perceptive Trust Assessment Test&amp;rdquo;. The results show that the experience of brief nonverbal face-to-face interaction reduces the number of significant differences in the ratings of naive observers with the ratings of experts. Regardless of the facial morphotype, after the experience of interaction, all sitters are perceived by observers with a bias towards socially desirable individual psychological characteristics, with the exception of the only characteristic (stubborn) in the assessments of the round morphotype. The experience of non-verbal face-to-face interaction has a significant impact on the formation of a more trusting attitude towards a stranger in an outside observer, in contrast to the level of trust formed from a photograph.&lt;/p&gt;

Behavioral activation for depression in groups embedded in psychosomatic rehabilitation inpatient treatment: a quasi-randomized controlled study.

Behavioral activation (BA) and cognitive-behavioral therapy (CBT) have shown to be efficacious treatment methods for depression. Previous studies focused mostly on the outpatient treatment either in group or individual setting. The present study aimed at comparing the efficacy of group treatment BA vs. CBT, when embedded in inpatient psychosomatic rehabilitation treatment. 375 inpatients were randomly assigned to either BA (N = 174) or CBT (N = 201). We used established scales for depression such as the Beck Depression Inventory II (BDI-II, self-rating), the Quick Inventory of Depressive Symptomatology (QIDS; expert rating) and the Behavioral Activation for Depression Scale (BADS) to assess changes over the course of the treatment and at follow-up (4 to 6 months). In addition, we measured disability-related functioning with the Mini-ICF-APP, a rating scale built in reference to the International Classification of Functioning, Disability and Health (ICF). Multilevel models with repeated measures were conducted to examine the differences between groups in relation to change over time with patients' random effects. Both group formats showed substantial reduction in depressive symptoms at the end of treatment (d= 0.83 BA vs. d= 1.08 CBT; BDI-II) and at follow-up after 4 to 6 months (d = 0.97 BA vs. d = 1.33 CBT, BDI-II; and d = 1.17 BA vs. d = 1.09 CBT, QIDS). There were no significant differences between treatment approaches. At least 50% symptom reduction was achieved by 53.7% and 54.2% in BA vs. CBT respectively. Reported activation levels increased from pre- to posttreatment (d = 0.76 BA vs. d = 0.70CBT), while showing loss of increment between the end of the treatment until follow up in both formats (d = 0.28 BA vs. d = 0.29 CBT). Both modalities led to significant improvement of symptomatology and functioning at the end of the treatment and at follow-up, thus for the first time demonstrating the practicability of BA in rehabilitation clinics. Considering its lower requirements regarding cognitive abilities and its easier implementation, BA proved to be a good alternative to other psychotherapeutic treatments.

Orthodontic patient satisfaction: Validation of an Arabic patient satisfaction questionnaire

Objectives: Orthodontic patient satisfaction is a primary aim of orthodontic treatment. Satisfaction is a multidimensional concept, requiring multi-item questionnaires for it to be adequately assessed. A 58-item, orthodontic patient satisfaction questionnaire (PSQ) was developed to assess orthodontic patient satisfaction. Appropriately adapted assessment tools are needed to assess orthodontics patient satisfaction in different populations. The validity and reliability of such tools should be demonstrated before their use for each target population. The PSQ was yet to be validated in Arabic. Therefore, the objective of this study was to translate, adapt, and validate an Arabic orthodontic PSQ. Material and Methods: The 58-item English PSQ was translated to Arabic through translation and back-translation. An expert panel examined the relevance of PSQ items. The questionnaire was circulated through social media to recruit responses from Arabic-speaking orthodontic patients who completed orthodontic treatment. Cronbach’s alpha, item-total correlation (I-TC), and kappa reliability coefficient were calculated. The analysis of variance test was used to compare satisfaction scores between genders and different orthodontic treatment appliances. Results: Ten items were removed based on expert ratings. The questionnaire was filled by 327 patients (55.6% females, mean age = 28.5 ± 7.2, 59.8% on metal braces, 35.3% on clear aligners, and 5.2% on tooth-colored braces). Nine questionnaire items were removed because of low I-TC (&lt;0.3). The resulting 39-item questionnaire had a Cronbach alpha of 0.79 and a kappa coefficient of 0.82. The mean total PSQ score of the sample was 167.61 ± 21.45. Items with the top ten highest I-TC correlations had a Cronbach’s alpha of 0.90. Patients on metal braces had a highest mean total PSQ score (P = 0.004). Among these patients, satisfaction with situational aspects was lower but satisfaction with dentofacial, psychosocial, and dental improvements were all higher compared to other orthodontic treatments (P &lt; 0.001). Conclusion: The 39-item Arabic PSQ is valid and reliable. A shorter collection of 10 items with high validity were identified. Patients on metal braces had better outcomes, driving higher satisfaction. Studies collecting satisfaction data using the PSQ from orthodontic clinics are needed.

Rating accuracy, leniency, and rater perceptions when using the RPM and BARS

AbstractResearchers have argued that social‐comparative rating formats hold important psychometric advantages over traditional absolute ratings. We asked 152 participants to observe and assess the videotaped performance of individuals completing a task using a social‐comparative (Relative Percentile Method; RPM) and absolute rating (Behaviorally Anchored Rating Scale; BARS) formats. After collecting expert ratings on the same set of videos, we calculated accuracy indices and leniency. Additionally, we collected rater perceptions of accuracy and fairness for both formats. Our study revealed that the BARS was perceived as more accurate and fairer than the RPM. However, the RPM was found to be better at combating rater leniency. We discuss the implications of these findings.

Validation and reliability of Arabic version of Children’s Hand-use Experience Questionnaire (CHEQ) for children with hemiparetic cerebral palsy

The aim was to assess validation and reliability of Arabic version of Children’s Hand-use Experience Questionnaire (CHEQ) for children with hemiparetic cerebral palsy (HCP). Ninety-nine children aged 6–18 years diagnosed with HCP participated in the study. The CHEQ was used to evaluate the hand-use experiences of children with cerebral palsy (CP). In the expert opinion questionnaire, the average percentage score of agreement on grasp efficacy was 91.5%. The highest percentage (93.3%) was for time taken. Agreement on CHEQ ranged from 91.5 to 93.3% indicating that the content validity of the prototype is supported by the expert ratings. Fitting indices showed that the one-factor structure of the CHEQ has a good and acceptable fit in children with HCP aged 6–18 years. All factor loads of the CHEQ items were greater than 0.7 and significant. Cronbach’s alpha coefficient in this study was 0.921, thus showing that the questionnaire had high internal consistency.

The reliability and concurrent validity of goniometric and visual estimation in participants with unilateral shoulder pain

IntroductionThe Constant-Murley Score (CMS) uses universal goniometry (UG), and the Shoulder Functional Reach Score (SFRS) uses visual estimation (VE). The CMS has validity challenges, and the SFRS has been critiqued for using VE. This study sought to determine the reliability and concurrent validity of VE when compared to the UG for shoulder flexion and abduction. Differences between symptomatic and asymptomatic shoulder and expert and novice raters were also explored. MethodsParticipants were included if they were at least 18 years old with unilateral, symptomatic shoulder pain, with no post-surgical contraindications. All conditions were randomized, and raters were blinded. ResultsThe intertester reliability for UG had Intraclass Correlation Coefficient (ICC) values of 0.76–0.91 at visit one. VE had ICC values that ranged from 0.87 to 0.92 at visit one. VE test-retest reliability had ICC values from 0.81 to 0.94. At visit one, concurrent validity was demonstrated by rho values from 0.84 to 0.89. There were statistically significant differences between the shoulders (P ≤ 0.0448), and there were no differences between the raters (P ≥ 0.0960). DiscussionUG and VE of active shoulder flexion and abduction are reliable and concurrently valid. Additionally, there were differences between symptomatic and asymptomatic shoulders, and there were no differences between novice and expert raters. ConclusionThe SFRS may be reliable and valid for measuring shoulder motion using VE within and between treatment sessions. Future research should examine this in larger, more diverse participant populations.

Assessing the Accuracy of Generative Conversational Artificial Intelligence in Debunking Sleep Health Myths: Mixed Methods Comparative Study With Expert Analysis.

Adequate sleep is essential for maintaining individual and public health, positively affecting cognition and well-being, and reducing chronic disease risks. It plays a significant role in driving the economy, public safety, and managing health care costs. Digital tools, including websites, sleep trackers, and apps, are key in promoting sleep health education. Conversational artificial intelligence (AI) such as ChatGPT (OpenAI, Microsoft Corp) offers accessible, personalized advice on sleep health but raises concerns about potential misinformation. This underscores the importance of ensuring that AI-driven sleep health information is accurate, given its significant impact on individual and public health, and the spread of sleep-related myths. This study aims to examine ChatGPT's capability to debunk sleep-related disbeliefs. A mixed methods design was leveraged. ChatGPT categorized 20 sleep-related myths identified by 10 sleep experts and rated them in terms of falseness and public health significance, on a 5-point Likert scale. Sensitivity, positive predictive value, and interrater agreement were also calculated. A qualitative comparative analysis was also conducted. ChatGPT labeled a significant portion (n=17, 85%) of the statements as "false" (n=9, 45%) or "generally false" (n=8, 40%), with varying accuracy across different domains. For instance, it correctly identified most myths about "sleep timing," "sleep duration," and "behaviors during sleep," while it had varying degrees of success with other categories such as "pre-sleep behaviors" and "brain function and sleep." ChatGPT's assessment of the degree of falseness and public health significance, on the 5-point Likert scale, revealed an average score of 3.45 (SD 0.87) and 3.15 (SD 0.99), respectively, indicating a good level of accuracy in identifying the falseness of statements and a good understanding of their impact on public health. The AI-based tool showed a sensitivity of 85% and a positive predictive value of 100%. Overall, this indicates that when ChatGPT labels a statement as false, it is highly reliable, but it may miss identifying some false statements. When comparing with expert ratings, high intraclass correlation coefficients (ICCs) between ChatGPT's appraisals and expert opinions could be found, suggesting that the AI's ratings were generally aligned with expert views on falseness (ICC=.83, P<.001) and public health significance (ICC=.79, P=.001) of sleep-related myths. Qualitatively, both ChatGPT and sleep experts refuted sleep-related misconceptions. However, ChatGPT adopted a more accessible style and provided a more generalized view, focusing on broad concepts, while experts sometimes used technical jargon, providing evidence-based explanations. ChatGPT-4 can accurately address sleep-related queries and debunk sleep-related myths, with a performance comparable to sleep experts, even if, given its limitations, the AI cannot completely replace expert opinions, especially in nuanced and complex fields such as sleep health, but can be a valuable complement in the dissemination of updated information and promotion of healthy behaviors.

E-Moticon's Effective Curriculum Revolutionizes Technical Education

This research focuses on developing an E-Moticon E-Module as a digital learning tool for classroom use in the field of basic computer network and telecommunications. Utilizing the ADDIE method, the study includes expert validation and student trials to assess the media's effectiveness. Results show an 84.31% approval rate from experts and an 82.14% acceptance rate from students, indicating high feasibility and positive reception. This E-Module addresses a knowledge gap in tailored technical learning resources and highlights the potential impact of digital media integration in enhancing classroom learning experiences. Further research is recommended to validate its broader applicability and effectiveness in larger-scale classroom settings. Highlight: Tailored Technical Resource: E-Moticon fills gaps in technical learning for classrooms. High Feasibility: Expert and student approval rates exceed 80%, validating effectiveness. Structured Development: ADDIE method ensures systematic and effective media creation. Keyword: E-Moticon, E-Module, Digital Learning, Classroom Integration, ADDIE Method

Междисциплинарный подход к оказанию услуг в сфере здравоохранения: российские практики в экспертных оценках в кейсе паллиативной помощи

Public innovations in the development of palliative care within the framework of an interdisciplinary approach introduced by the Federal Law № 18-FZ dated 06.03.2019 "On Amendments to the Federal Law "On the Basics of Public Health Protection in the Russian Federation" on palliative care" require expert assessments, which determines the relevance of the research topic and goal setting – to describe the state and identify changes in the organization of palliative care in the Russian Federation in expert assessments in connection with the introduced public innovations. The research methods are: secondary analysis of foreign model of palliative care organization and longitudinal study with the method of expert assessments of 2017, 2023. The results of the study are as follows. Firstly, it is revealed that under modern conditions, interdisciplinary approach is becoming a methodological basis for ensuring health systems sustainability. Secondly, the results of longitudinal study show that introduced public innovations in transformation of the Russian palliative care model increase expert assessments to satisfactory positioning concerning most components of palliative care organization, which was characterized as "very low" and "low" in 2017. Thirdly, such a component as "exemption from work for persons caring for a seriously ill family member (sick leave for care)", which received low expert ratings, is the growing point in the organizational model of palliative care.

Perception of ‘broad’ and ‘narrow’ fluency in the EFL performance of student interpreters

The oral fluency of non-native speakers is an important measure in evaluating a person’s second language (L2) proficiency. The present study investigates the relationship between the perception of fluency in its broad sense, meaning overall speaking proficiency, and in the narrow sense, in which flow and smoothness as well as grammar and vocabulary are evaluated. An experiment was conducted in which the speech fluency of 25 interpreter trainees was rated by 12 raters – three native experts, three native non-experts, three non-native experts and three non-native non-experts – in the narrow and broad senses, and then again after one month’. The results of the study showed that the raters’ judgements of fluency in the narrow sense were significantly lower than that of broad fluency. The expert raters were significantly less lenient than the non-experts overall, and more so when using the narrow definition of fluency. There was no statistically significant difference found in the scores of the native and non-native raters. It is suggested that interpreter trainees develop both broad and narrow fluency skills through training and practice. This can include improving their linguistic knowledge as well as practicing speaking skills.

Focus of attention in musical learning and music performance: a systematic review and discussion of focus instructions and outcome measures.

The topic of attentional focus (focus of attention, FOA) in musical learning and performance has recently received increasing interest, as the growing number of empirical studies inspired by the established FOA paradigm in sports by Wulf and colleagues in 1998. The current systematical review aims at collecting, abstracting, and categorizing relevant data to show which kinds of FOA instructions were applied in experimental designs and what kinds of dependent variables were used to measure the effects of FOA instruction on musical performance. The three main inclusion criteria in the selection process were experimental design, detailed descriptions of FOA instructions, and outcome measures (OMs). A systematic search was conducted with a complex search term in four scientific databases in March 2023. For presenting and synthesizing results, we used data collection and an inductive-deductive data categorization. Fifteen studies with a total sample size of 401 participants were included out of 387 records initially identified. We collected 53 different FOA instruction citations from the 15 studies and classified them into 9 FOA subcategories, of which the most applied were bodily focus (21%), sound focus (15%), and visual focus (14%). Selected studies used 63 OMs that were abstracted to 10 different OM categories with expert ratings (27%) and acoustical analysis (22%) as the most applied dependent variables. Data categorization and abstraction of additional study information show multiple combinations of FOA instructions, OMs, participants' instruments and expertise, and musical tasks. Finally, studies show no consistent results of superiority of either external or internal or otherwise different FOA considering positive effects on musical performance. Limitations of the review lie in the small study sample, possible criticism of applied eligibility criteria, and subjectivity of data categorization. We propose a research agenda with a more exploratory approach that comprehensively and qualitatively examines the dimensions of musical goals to create a database that could provide a foundation for developing a music-specific FOA model.

Design and validation of a diagnostic suspicion checklist to differentiate epileptic from psychogenic nonepileptic seizures (PNES-DSC)

ObjectivePsychogenic non-epileptic seizures (PNES) are complex clinical manifestations and misdiagnosis as status epilepticus remains high, entailing deleterious consequences for patients. Video-electroencephalography (vEEG) remains the gold-standard method for diagnosing PNES. However, time and economic constraints limit access to vEEG, and clinicians lack fast and reliable screening tools to assist in the differential diagnosis with epileptic seizures (ES). This study aimed to design and validate the PNES-DSC, a clinically based PNES diagnostic suspicion checklist with adequate sensitivity (Se) and specificity (Sp) to discriminate PNES from ES. MethodsA cross-sectional study with 125 patients (n = 104 drug-resistant epilepsy; n = 21 PNES) admitted for a vEEG protocolised study of seizures. A preliminary PNES-DSC (16-item) was designed and used by expert raters blinded to the definitive diagnosis to evaluate the seizure video recordings for each patient. Cohen's kappa coefficient, leave-one-out cross-validation (LOOCV) and balance accuracy (BAC) comprised the main validation analysis. ResultsThe final PNES-DSC is a 6-item checklist that requires only two to be present to confirm the suspicion of PNES. The LOOCV showed 71.4% BAC (Se = 45.2%; Sp = 97.6%) when the expert rater watched one seizure video recording and 83.4% BAC (Se = 69.6%; Sp = 97.2%) when the expert rater watched two seizure video recordings. ConclusionThe PNES-DSC is a straightforward checklist with adequate psychometric properties. With an integrative approach and appropriate patient history, the PNES-DSC can assist clinicians in expediting the final diagnosis of PNES when vEEG is limited. The PNES-DSC can also be used in the absence of patients, allowing clinicians to assess seizure recordings from smartphones.