Psychometric Properties Of Measure Research Articles

Psychometric validation of the Danish version of the Major Depression Inventory using data from the Lolland-Falster health study (LOFUS)

Purpose The Major Depression Inventory (MDI) is a widely used self-rating depression scale commonly in primary care in Denmark. It has not been subject to robust psychometric validation in a general population setting. The aim of this study was to evaluate the psychometric measurement properties of the MDI when applied in the general population. Methods We evaluated statistical psychometric validity using modern test theory (confirmatory factor analysis, item response theory models and Rasch measurement theory) testing local independence and differential item function across groups defined by gender, age, education, and chronic disease status. Separate analyses across different strata and across different statistical models were employed. Results Regarding structural validity we consistently identified local dependence for the item two pairs (MDI2,MDI3) and (MDI4,MDI5) across strata. This result was confirmed by bifactor CFA models and item screening. We further identified substantial differential item functioning with respect to age group and with respect to chronic disease. We identified quantified the magnitude of this lack of measurement invariance. Conclusion The MDI is psychometrically valid in homogenous sub populations, but the disclosed evidence of local dependence means that published estimates of its reliability cannot be trusted. The lack of measurement invariance means that the instrument cannot be used to compare individuals or groups unless they are similar in terms of age group and chronic disease status.

Factor Structure, Reliability, and Convergent Validity of an Ecological Momentary Assessment Binge-Eating Symptoms Scale.

Ecological momentary assessment (EMA) of binge-eating symptoms has deepened our understanding of eating disorders. However, there has been a lack of attention on the psychometrics of EMA binge-eating symptom measures. This paper focused on evaluating the psychometric properties of a four-item binge-eating symptom measure, including multilevel factor structure, reliability, and convergent validity. Forty-nine adults with binge-eating disorder and/or food addiction completed baseline questionnaires and a 10-day EMA protocol. During EMA, participants completed assessments of eating episodes, including four binge-eating symptom items. Analyses included multilevel exploratory factor analysis, computation of omega and intraclass correlation coefficients, and multilevel structural equation models of associations between contextual factors and binge-eating symptoms. A one within-subject factor solution fit the data and showed good multilevel reliability and adequate within-subjects variability. EMA binge-eating symptoms were associated with baseline binge-eating measures as well as relevant EMA eating characteristics: including greater unhealthful food and drink intake; higher perceived taste of food; lower likelihood to be planned eating; and lower likelihood of eating to occur at work/school and other locations and greater likelihood to occur at restaurants compared to home. In conclusion, the study findings support the psychometrics of a 4-item one-factor EMA measure of binge-eating symptoms.

Internal and external self-affirmation resources: validation and assessment of psychometric properties of the spontaneous self-affirmation measure using structural equation modeling.

People use coping strategies such as self-affirmation to manage threats to their self-esteem. In empirical research, self-affirmation often involves recalling personal values, strengths, or relationships to restore moral integrity. Research shows it improves attitude adjustment, resolves cognitive dissonance, and enhances well-being. Some studies stress the importance of distinguishing between different aspects of self-affirmation, like strengths or social relations. These aspects align with concepts in psychotherapy that differentiate between internal and external resource activation, benefiting health, self-esteem, and resilience. The aim of the current study was twofold: first, to independently test the three-factor structure of the Spontaneous Self-affirmation Measure (SSAM), and second, to integrate self-affirmation strategies into a broader resource activation framework as resilience factors. It also examined associations with self-esteem and effects of age, gender, and education on spontaneous self-affirmation. 1,100 participants (72% female, age 18-65) were recruited online. The original three-factor structure of the SSAM (with the factors Strengths, Values and Social relations) was examined using structural equation modeling. Further, a theory driven two-factor structure applying an internal and external resources framework was examined, integrating the factors of the SSAM into the taxonomy of resource activation (Internal resources: Strengths and Values; External resources: Social relations). The results of confirmatory factor analyses showed that both the original three-factor structure and the complementary two-factor structure with an Internal resources and External resources factor fit the data appropriately. All three factors of the original factor model showed a high reliability (Strengths: = 0.91, Values: = 0.91, Social relations: = 0.92). We also found measurement invariance across age, gender, and education. Furthermore, group differences regarding gender, education and ethnicity in the utilization of spontaneous self-affirmation strategies were apparent. Finally, it was demonstrated that the Internal resources factor of the complementary two-factor model is significantly more strongly correlated with self-esteem than the External Resources factor [z = 12.80, p < 0.001, 95%CIdiff (0.24, 0.33)]. The study confirms the validity of both the three-factor and two-factor structures of the SSAM. Integrating self-affirmation into the resource activation framework may facilitate applying findings from self-affirmation studies to clinical contexts.

Validity and reliability of outcome measures to assess dysfunctional breathing: a systematic review

ObjectiveThis study aimed to systematically review the psychometric properties of outcome measures that assess dysfunctional breathing (DB) in adults.MethodsStudies on developing and evaluating measurement properties to assess DB were included....

Development and validation of the CARE-FCR: A caregiver-specific measure of fear of cancer recurrence and progression.

Fear of cancer recurring or progressing (FCR) is a concern reported by people living with cancer and caregivers alike. Whilst advances in survivor FCR have been made, less is known about caregiver FCR. As a result, measurement of caregiver FCR has relied on instruments developed for survivor populations. Findings from qualitative research indicate caregiver experiences of FCR differ. This study aimed to develop and evaluate the psychometric properties of a caregiver specific measure of FCR (CARE-FCR). Four-hundred and thirty-eight caregivers (56% female, Mage= 50.53years, SD=17.38) completed the online survey including demographic questions, information about care provided, the person they care for, as well as the CARE-FCR. Convergent validity was assessed using pre-existing measures of fear of recurrence and progression, depression, anxiety, death anxiety and meta-cognitions. The extraversion dimension of the Big Five Personality Trait questionnaire was used to assess divergent validity. The survey was completed 2weeks later to assess test-retest reliability. Exploratory factor analysis (EFA) was used to determine factor structure, followed by confirmatory factor analysis. EFA indicated a 3-factor structure: progression, recurrence, and communication. Evidence for convergent, divergent, and test-retest reliability was adequate. Internal consistency for the CARE-FCR was strong, overall Cronbach's α=0.96 (progression=0.94, recurrence=0.92 and communication=0.78). We present a theoretically informed and psychometrically robust measure of caregiver FCR. The CARE-FCR facilitates quantification of caregiver FCR, capturing unique aspects specific to this population.

Measurement Instruments Assessing Multi-Faceted Stigma Regarding Sexual and Gender Minorities: A Systematic Review of Psychometric Properties.

Stigma against sexual and gender minorities (SGM) populations has serious negative health effects for SGM populations. Despite the growing need for accurate stigma measurement in SGM, there are insufficient valid measurement instruments. Moreover, the lack of consistency in construct usage makes comparisons across studies particularly challenging. A critical review and comparative evaluation of the psychometric properties of the various stigma measures for SGM is necessary to advance our understanding regarding stigma measurement against/among SGMs. Based on the PRISMA (Preferred Reporting Items for Systematic Reviews and Meta-Analyses) guidelines, a comprehensive search was conducted in 4 bibliographic databases (MEDLINE, PsycINFO, CINAHL, and Web of Science) for empirical articles published from 2010 to 2022 that evaluated the psychometrics properties of measurement instruments assessing stigma against SGMs. The screening, extraction, and scoring of the psychometric properties and methodological quality of selected instruments were performed by following the established standards and COSMIN (Consensus-based Standards for the selection of health Measurement Instruments) checklist, respectively. Of the 2031 studies identified, 19 studies were included that reported psychometric properties of 17 measurement instruments. All instruments, except two, were developed for SGMs (n = 15/17). Most instruments included men who have sex with men (MSM) or gay men (n = 11/15), whereas less than half of the instruments assessed stigma among SGM women (n = 6/15). Internal consistency (Cronbach's alpha) and content validity was reported for all instruments (n = 17); construct and structural validity was also reported for majority of the instruments (n = 15 and 10, respectively). However, test-retest reliability and criterion validity was reported for very few instruments (n = 5 each). Based on the COSMIN checklist, we identified the most psychometrically and methodologically robust instruments for each of the five stigma types: combined stigma, enacted stigma, internalized stigma, intersectional stigma, and perceived stigma. For each stigma type, except anticipated stigma, at least one instrument demonstrated strong promise for use in empirical research; however, the selection of instrument depends on the target population and context of the study. Findings indicated a growing use of instruments assessing multiple stigma types. Future studies need to develop intersectional stigma instruments that account for the multiple and intersecting social identities of SGMs. Additionally, most existing instruments would benefit from further psychometric testing, especially on test-retest reliability, criterion validity, adaptability to different LGBTQIA + populations and cultures.

Through each other's eyes: initial results and protocol for the co-design of an observational measure of adolescent-parent interaction using first-person perspective

BackgroundCurrent observational methods to understand adolescent-parent interaction are limited in terms of ecological and content validity. We outline initial results and a protocol for future work from a programme of work to: (1) establish a new method for data capture of adolescent-parent interaction at home using wearable cameras and; (2) develop a new relevant and comprehensive observational micro-coding scheme. In Part 1, we report our completed preliminary work, comprised of an initial scoping review, and public engagement work. In Part 2, we present a protocol for the development of the new measure.MethodsPart 1—We searched Pubmed for existing observational measures of adolescent-parent interaction for the scoping review. We also undertook public engagement work utilising a mobile research van, taken to multiple locations around Bristol, UK to engage with a variety of populations through interactive methods. Part 2—Our protocol describes plans for: (1) A systematic review of the psychometric properties of observational measures of adolescent-parent interaction; (2) Focussed public engagement workshops; (3) Harmonisation of information from existing coding schemes and literature with information from public engagement with adolescents and parents; (4) A pilot study to assess the acceptability and feasibility of the method; (5) Development of a coding scheme in consultation with expert and lay panels, and through real-life application to recorded videos from a pilot sample.ResultsScoping review: we identified 21 adolescent-parent observational schemes, of which eight used micro-coding and 13 used globalcoding schemes. The majority of micro-coding schemes were not developed specifically for adolescents. Most studies used conflict or problem-solving tasks, which may not adequately capture positive adolescent-parent interactions. The mobile van event received views from 234 young people and/or parents. Families were positive about taking part in research using headcams. “Trust” and “understanding” were most frequently reported as important adolescent-parent relationship constructs.ConclusionsThis work represents the first attempt to truly co-design a method to assess parenting in adolescence. We hope to develop an observational measure using novel technological methods that can be used across a range of research and therapeutic settings.

Psychometric properties of the COVID-19 safety measures questionnaire in the employees of the radiation therapy center.

Due to the effect of coronavirus disease 2019 (COVID-19) outbreak on the continuation, schedule, and efficiency of radiation therapy, this study aimed to investigate the reliability and validity of the COVID-19 Safety Measures (CSM) questionnaire at the radiation therapy center. In this analytical cross-sectional study, which all personnel of the radiation therapy center (20 people) participated, the validity and reliability of the 16-item CSM questionnaire were investigated. Cultural adaptation, face validity, content validity, test-retest reliability, and internal consistency were evaluated. For face and content validity, impact score, content validity ratio, and content validity index (CVR and CVI) were calculated, respectively. Also, internal consistency and stability reliability were calculated with Kuder-Richardson (KR20) alpha and Pearson correlation coefficient and intraclass correlation (ICC), respectively. Data analysis was performed using Statistical Package for the Social Sciences (SPSS) 24 with a significant level of 5%. Out of 20 employees, 70% (14 people) were female, 75% (15 people) were married and the mean age (SD) was 32.4 (6.35) years. Scale-based Kuder-Richardson alpha, S-CVI, ICC, and confidence interval were 0.79, 0.97, 0.68, and 0.38-0.89, respectively. The validity and reliability of the 16-item CSM questionnaire were confirmed. Therefore, the application of this scale is recommended.

Psychometric validation of four-item exercise identity and healthy-eater identity scales and applications in weight loss maintenance

BackgroundIdentifying as someone who engages in health promoting behaviors like healthy eating and exercising may be associated with sustained engagement in those behaviors, but reliable and valid instruments are needed to improve the rigor of this research. Two studies were conducted to (1) examine the psychometric properties of a four-item exerciser identity measure (4-EI) and an adapted healthy-eater identity measure (4-HEI) and (2) examine differences in identity strengths across categories of weight loss success.MethodsData from 1,709 community dwelling adults in the International Weight Control Registry (IWCR) were used. A random half of the sample was used to assess the proposed unidimensional factor structure of the 4-EI and 4-HEI and examine convergent and discriminant validity using Spearman rank-order correlations. One-way ANOVA was used in the other random half of the sample to compare 4-EI and 4-HEI scores (-3 to + 3) across three self-defined weight loss categories (‘Successful’, ‘Regain’, and ‘Unsuccessful’) and those maintaining ≥ 5% weight loss for > 1 year vs. not.ResultsResults support the unidimensional factor structure with all four items (eigenvalue scores > 2.89) as well as convergent and discriminant validity for both measures. Exercise identity was strongly correlated with self-reported physical activity (r (735) = 0.52, p <.001) and measures of autonomous motivation. Healthy eating identity was moderately correlated with cognitive restraint in eating (r (744) = 0.42, p <.001) and other measures predictive of eating behavior. 4-EI and 4-HEI are stronger in Successful (4-EI: M = 0.90, SD = 1.77; 4-HEI: M = 1.56 SD = 1.37) vs. Regain (4-EI: M=-0.18, SD = 1.68; 4-HEI: M =.57, SD = 1.48) and Unsuccessful (4-EI:M=-0.28, SD = 1.62; 4-HEI: M = 0.51, SD = 1.33) and those maintaining ≥ 5% weight loss (4-EI:M = 0.47, SD = 1.78; 4-HEI: M = 1.13, SD = 1.49) vs. not (4-EI:M=-0.27, SD = 1.66; 4-HEI: M = 0.53, SD = 1.47), p’s < 0.001.ConclusionsThe 4-EI and 4-HEI have acceptable psychometric properties and can advance understanding of the role of identity in exercise and dietary behaviors and weight loss maintenance.Trial registrationThe parent observational study, International Weight Control Registry (IWCR), for these sub-studies is registered in ClinicalTrials.gov (NCT04907396).

Measuring patient activation: the utility of the Patient Activation Measure administered in an interview setting

BackgroundPatient activation is an emerging field in healthcare research concerning knowledge, skills, and confidence of patients in managing their health. This is particularly important for patients with chronic diseases, who often require more complex care management and self-care skills. However, due to temporary or longer-lasting visual impairments, certain patient groups cannot answer a questionnaire independently. The main objective is to investigate the psychometric properties of the German Patient Activation Measure® (PAM) survey in an everyday clinical setting where it has to be read aloud.MethodsOutpatients with macular edema participated in this questionnaire-based cross-sectional study. The study assessed patient activation by the PAM® survey, self-rated health, self-efficacy, quality of life, and general mood. Interviewers read questionnaires aloud to patients. Psychometric properties of the PAM® survey were investigated by item response theory (IRT), Cronbach’s α and trait–trait correlations.ResultsThe analysis included N = 554 patients. Median age was 69 (IQR 62.0–76.0) years and mean overall activation score 74.1 (SD 13.7). All items showed ceiling effects. Empirical reliability from the IRT model and Cronbach’s α were 0.75. The PAM® survey showed a Spearman correlation of 0.54 with self-efficacy, 0.51 with quality of life and 0.34 with general mood.ConclusionThe read-aloud PAM® survey has been shown to provide to adequate measurement precision and convergent validity to be used as a screening tool in an everyday clinical setting. Objective assessment in an interview setting with the PAM® survey is possible. PAM® items are good in distinguishing lower to middle activated patients, but not patients with high activation. Further, issues with structural validity need more investigation.

The common factor of executive functions measures nothing but speed of information uptake.

There is an ongoing debate about the unity and diversity of executive functions and their relationship with other cognitive abilities such as processing speed, working memory capacity, and intelligence. Specifically, the initially proposed unity and diversity of executive functions is challenged by discussions about (1) the factorial structure of executive functions and (2) unfavorable psychometric properties of measures of executive functions. The present study addressed two methodological limitations of previous work that may explain conflicting results: The inconsistent use of (a) accuracy-based vs. reaction time-based indicators and (b) average performance vs. difference scores. In a sample of 148 participants who completed a battery of executive function tasks, we tried to replicate the three-factor model of the three commonly distinguished executive functions shifting, updating, and inhibition by adopting data-analytical choices of previous work. After addressing the identified methodological limitations using drift-diffusion modeling, we only found one common factor of executive functions that was fully accounted for by individual differences in the speed of information uptake. No variance specific to executive functions remained. Our results suggest that individual differences common to all executive function tasks measure nothing more than individual differences in the speed of information uptake. We therefore suggest refraining from using typical executive function tasks to study substantial research questions, as these tasks are not valid for measuring individual differences in executive functions.

Psychometric properties of measures for electronic cigarette dependence among former-smoking electronic cigarette users

BackgroundMeasures designed to assess electronic cigarette (ECIG) dependence are largely adapted from those developed for cigarette smoking, and have been evaluated mainly among dual ECIG-cigarette users. The present study evaluated the psychometric properties of four dependence measures among former-smoking ECIG users. MethodsRespondents (N = 187) were daily ECIG users who had formerly smoked cigarettes regularly. As part of an online survey, they completed four dependence measures: Penn State Electronic Cigarette Dependence Index (PSECDI); E-Cigarette Dependence Scale (EDS-4); Glover Nilsson Behavioral Questionnaire (GNBQ); and Diagnostic and Statistical Manual 5th Edition (DSM-5). ResultsConfirmatory factor analysis revealed a single factor structure for all four measures, and fit indices were adequate for all models. Most inter-item correlations (mean r’s = 0.21 to 0.45) and all item-total correlations (mean r’s = 0.53 to 0.80) were significant for all four measures. Internal consistency was highest for the GNBQ (α = 0.86) followed by the EDS-4 (α = 0.81), PSECDI (α = 0.76), and DSM-5 (α = 0.75). Age of ECIG initiation was correlated negatively with scores on the EDS-4 and DSM-5, while number of ECIG quit attempts was correlated positively with scores on all measures except the GNBQ. Convergent validity was highest for comparisons between the EDS-4 and PSECDI (r = 0.75) though all comparisons were significant (p’s < 0.001). ConclusionsAll four measures demonstrated acceptable reliability and validity in this sample of former-smoking ECIG users.

DSM-5 suicidal behavior disorder: a systematic review of research on clinical utility, diagnostic boundaries, measures, pathophysiology and interventions.

It has been a decade since Suicidal Behavior Disorder (SBD) was introduced in Section III of the DSM-5 under "Conditions for Further Study". SBD is chiefly characterized by a self-initiated sequence of behaviors believed at the time of initiation to cause one's own death and occurring in the last 24 months. To systematically review empirical studies on SBD to identify primary research themes and promising future research directions. A search of empirical articles on SBD published between May 2013 and March 2023 was conducted according to the Preferred Reporting Items for Systematic Reviews and Meta-Analyses guidelines. Screening of 73 records by two independent raters yielded 14 eligible articles. The primary research themes identified from these articles included clinical utility of SBD to predict future suicide risk, association of SBD with closely related disorders, psychometric properties of SBD measures, pathophysiology of SBD, and the effectiveness of interventions for people with SBD. Understanding of SBD has slowly progressed since its introduction a decade ago and has mainly been applied in research to define study groups displaying suicidal behavior. The clinical utility of SBD for predicting future suicide risk is low and more research is needed to understand measurement of the diagnosis and its distinctiveness from related disorders and other self-harming behaviors.

Measuring Afrocentrism: A Review of Existing Instruments

Abstract Measurement of Afrocentrism and investigation of Afrocentricity’s significance in the lives of Black Americans has gained momentum, given the current evidence suggesting that cultural factors matter in the lives of diverse populations. In particular, factors associated with African philosophical constructs may have significant relationships with improved mental health and overall well-being among African and African diaspora populations. However, the prior conceptual literature suggests that Afrocentrism is a heterogenous concept with a multitude of domains associated with its measurement. The present study was envisioned given the relative absence of studies evaluating the availability and psychometric properties of Afrocentric measures within social work. Utilizing systematic analysis methodology and PRISMA guidelines, a search for Afrocentric measures was undertaken using four key databases. Spanning the literature between 1980 and 2021, this review identified a total of seven instruments that fully met the study’s inclusion-specific criteria. In accordance with the call for continued research and practice emphasizing resilience and protective factors within the lives of Black populations, the present study provides accessible knowledge to researchers and practitioners on the currently available instruments to evaluate Afrocentrism in the lives of populations of African descent.

Clinical tools for evaluating the severity of overactive bladder: A systematic review of psychometric properties

Objectives To systematically evaluate the evidence describing the psychometric properties of clinical measures for assessing overactive bladder symptoms (urinary urgency with or without urge urinary incontinence, urinary frequency and nocturia). To evaluate the quality of this evidence-base using the COnsensus-based Standards for selecting health status Measurement INstruments (COSMIN) checklist and the Grading of Recommendations, Assessment, Development, and Evaluation (GRADE) tools. Data sources Five electronic databases (CINAHL, EMBASE, MEDLINE, Scopus and Web of Science) were searched from dataset inception to August 2023. Review methods Study screening, data extraction and quality appraisal were performed by two independent authors. Inclusion criteria were studies testing one or more psychometric properties of clinical tools for the assessment of overactive bladder symptoms among adults aged 18 years and older for both sexes. The methodological quality and quality of the evidence were evaluated using the COSMIN checklist and GRADE tools, respectively. Results The search identified 40 studies totalling 10,634 participants evaluating the psychometric properties of 15 clinical tools. The COSMIN methodological quality was rated good for most measures, and the GRADE quality of evidence ranged from low (13%) to high (33%). The Overactive Bladder Symptom Score, Overactive Bladder Questionnaire and Neurogenic Bladder Symptom Score were of good methodological and high-GRADE evidence qualities. Conclusion Overactive Bladder Symptom Score, the Overactive Bladder Questionnaire and the Neurogenic Bladder Symptoms Score are promising psychometrically sound measures. The Overactive Bladder Symptom Score has been applied to the most culturally diverse populations supported by studies of good methodological and high-GRADE evidence quality.

Examining the Psychometric Properties of Post-graduate Hospital Educational Environment Measure for Saudi Pediatric Trainees: Principal Component Analysis

Background: The quality and congeniality of the hospital educational environment (HEE) is a major determinant for the success of the ‎training of future health professionals. Satisfactory and effective engagement of fellow physicians in the clinical learning program ultimately affects their clinical performance. Objectives: To evaluate and assess the HEE of residents and fellow trainees at a university hospital in Jeddah using a psychometric tool, Post-graduate Hospital Educational Environment Measure (PHEEM). Methods: The PHEEM questionnaire developed by Roff et al. (2005) was used to survey 71 pediatric post-graduate trainees in the second half of 2021. The HEE perception was correlated with the trainee’s demographic and academic data. Principal component analysis was performed to examine the validity of the PHEEM 3-dimensional construct. Results: Most of the participants were from the first (23.9%) and second post-graduate year (33.8%) and had majorly general pediatrics as a specialty (83.1%). The mean PHEEM score was 99.35 ± 22.46 out of 160 with a distribution pattern of poor (2.8%), suboptimal (9.9%), more positive with the need for improvement (73.2%), and optimal (14.1%). The PHEEM score was significantly lower among trainees of &lt; 27 years (94.33 ± 23.48; P = 0.037) compared to the ones aged &gt; 27 years (105.47 ± 19.83). Medical residents and trainees from the first post-graduate year scored remarkably low (87.86 ± 21.21; P = 0.008) compared to the other senior fellow peers. The correlation observed in overall PHEEM scores showed a similar trend in 3 individual components. For the principal component analysis (PCA), 10 components met the initial criteria of eigenvalue &gt; 1 and loading factor &gt; 0.5, encompassing 75.9% of the scale variance. The thematic analysis highlighted several areas for improvement, such as trainee rights and psychological support. Conclusions: The HEE of the pediatric department was broadly ‎suitable for post-graduate training programs. There are still several areas for improvement, including organizational and logistical aspects that include adequate learning time. ‎In addition, the psychological safety of trainees should also be considered.

Examining the psychometric properties of the headspace Youth (mental health) Service Satisfaction Scale in a mental health service in Ireland.

Evaluating service quality and satisfaction is central to the provision of accessible and developmentally appropriate youth mental health services. However, there are limited suitable measures and a lack of published evidence on the psychometric properties of measures to assess young people's satisfaction with youth mental health services. The headspace Youth (Mental Health) Service Satisfaction Scale (YSSS) was designed and implemented to assess young people's satisfaction with headspace mental health services in Australia. This study examined the reliability and factor structure of the YSSS in a youth mental health service in Ireland. The sample comprised 1449 young people (66.2% female) aged 12-25 years (M = 16.48, SD = 2.97). Participants completed the YSSS after their final brief intervention session through Jigsaw-The National Centre for Youth Mental Health. Confirmatory factor analysis (CFA) was performed on one- and four-factor models to test findings from previous studies. Reliability was also examined. CFA supported a single-factor structure of the YSSS, and all items were suitable for inclusion. The internal consistency of the measure was deemed acceptable (α = 0.89). Findings suggest that the YSSS is a reliable measure for monitoring satisfaction with youth mental health services in an Irish context. The measure demonstrated a unidimensional construct of satisfaction. These findings support the broader application of the YSSS and add to existing knowledge on measuring satisfaction within youth mental health services.

The validity and reliability of the Persian version of the Athlete Sleep Screening Questionnaire.

Sleep as a biological phenomenon is effective in the performance and recovery of athletes. Questionnaires can be used as a cost-effective initial assessment tool for sleep. The Athlete Sleep Screening Questionnaire (ASSQ) demonstrated a clinically valid instrument for screening relevant sleep issues in athletic populations. Due to the lack of validated tools for adequate screening for sleep difficulties in the Iranian athlete population, the present study was conducted to evaluate the validity and reliability of the Persian version of the ASSQ. The translation process was performed using instructions by Beaton et al. Content validity was assessed by a panel of experts. Exploratory and confirmatory factor analysis was performed for two 5-item sleep difficulty scores (SDS) and a 4-item chronotype score. Internal consistency based on Cronbach's alpha and McDonald's omega and stability reliability were used to evaluate reliability. The ASSQ achieved conceptual and semantic equivalence with the original scale. The item-level content validity index (I-CVI) of each item ranged from 0.87 to 1, and the averaging scale-level CVI/average was 0.95. In factor analysis, one factor for SDS and one factor for chronotype score were identified and confirmed. The internal consistency of the SDS scale (α =0.77, Ω =0.83) and chronotype (α =0.74, Ω =0.77) was acceptable. Stability reliability was confirmed for SDS scale (intra-class correlation [ICC] =0.87) and for chronotype (ICC = 0.83). Persian ASSQ has acceptable psychometric measurement properties as a screening tool to assess sleep in Iranian athletes.

Psychometric properties of self-report measures of eating disorder cognitions: a systematic review

BackgroundAlthough eating disorder (ED) models display some differences in theory and treatment approach, cognitive-behavioural, schema-focused, and disorder-specific models all highlight the fundamental nature of cognitions as key factors in ED development and maintenance processes. As such, it is vital that ED cognitions continue to be assessed and monitored as therapeutic targets and treatment outcomes as well as being examined as constructs in empirical research. This review aimed to systematically identify and evaluate the psychometric properties of existing self-report measures of ED cognitions.MethodsA systematic review protocol was registered using the international prospective register of systematic reviews (PROSPERO; CRD42023440840). Included studies described the development, validation and/or the psychometric evaluation of a measure (or subscale) that was specifically developed to solely assess ED cognitions (that is thoughts, expectations, assumptions, or beliefs), in English-speaking, adult populations. The search was conducted using three electronic databases: PsycINFO, MedLine, and Embase. Two independent reviewers conducted screening, selection and evaluation of the psychometric properties of relevant measures using a standardised, well-established quality appraisal tool.ResultsOf the initial search of 7581 potential studies, 59 met inclusion criteria and described the psychometric evaluation of 31 measures (or subscales) of ED cognitions. The findings from the current review indicate that of the included measures, none currently meet all nine criteria of adequate psychometric properties. The Eating Beliefs Questionnaire (EBQ; and EBQ-18), and the Eating Disorder Inventory Body Dissatisfaction subscale (EDI [BD]) currently possess the most evidence supporting their validity, reliability, and clinical utility.ConclusionsThe findings of the current systematic review provide guidance for future researchers to focus efforts on improving evidence for the validity, reliability and utility of self-report measures of ED cognitions. Overall, the present study has provided a detailed and systematic evaluation to support researchers and clinicians in future selection of measures of ED cognitions dependent on the specific aims of their research and treatment.

The psychometric properties and treatment outcomes associated with two measures of the adult therapeutic alliance using naturalistic data

AbstractPurposeThis is the first of two articles that examine the psychometric properties and treatment outcomes associated with measures of the therapeutic alliance collected in naturalistic settings rather than clinical trials. These articles break new ground in understanding the relationship between measures of alliance and treatment outcome by performing detailed item analyses in order to assess the psychometric properties of each individual item, its propensity to change from session to session and its utility in predicting change in the outcome measure.MethodsData were taken from the ACORN database for adults attending for psychotherapy treatment in naturalistic settings (N = 147,399). The sample, the largest to date, included only those completing both an alliance measure and an outcome measure at every session. Two sets of three different alliance items are used across three different treatment populations: general outpatient, substance use, and severe and persistent mental health difficulties. To investigate this possibility, the psychometric properties of each item were evaluated, including factor analysis, likelihood of change over time in treatment and correlations between changes in alliance and magnitude of client‐reported improvement in therapy. The predictive validity of each individual item is compared with the predictive validity of their respective three‐item measures. The problem of alliance scores being heavily skewed in a positive direction and the resulting lack of variability from session to session is addressed by categorising change in alliance as same, better or worse, regardless of the magnitude of change.ResultsFindings tended to differ from those in clinical trials, with the last alliance score being most predictive of outcome. In this data set, the alliance accounted for, at most, 2% of the variance in outcomes. Measures of the therapeutic alliance demonstrate ceiling effects, and the alliance–outcome correlation is far from linear. Change in alliance score, rather than a single assessment, is more predictive of outcome, regardless of the magnitude of change in the alliance measure, with effect sizes of up to 50% more for those who rated the alliance as worse than for those rating it as no change or better.ConclusionTherapists using therapeutic alliance questionnaires will benefit from being aware of how the psychometric properties of alliance measures impact outcomes. Even the smallest drop in alliance is predictive of significant clinically meaningful differences. Implications for practice, training and research are considered.