Psychometric Properties Research Articles

A Comparison of Test-Retest Reliability and Practice Effects of Short Portable Mental State Questionnaire and Montreal Cognitive Assessment in Patients with Stroke.

To compare the test-retest reliabilities and minimal detectable change (MDC) of the Short Portable Mental State Questionnaire (SPMSQ) and the Montreal Cognitive Assessment (MoCA) in patients with stroke. 63 patients were recruited from 1 medical center. The SPMSQ and MoCA were administered twice, 2 weeks apart. Both measures showed high intraclass correlation coefficients (SPMSQ: 0.87; MoCA: 0.89) and acceptable MDC%s (SPMSQ: 14.8%; MoCA: 19.6%). A small correlation (r = 0.30) was found between the absolute difference and average in each pair of assessments in the SPMSQ, which was close to the criterion of heteroscedasticity. A small practice effect was observed in the MoCA (Cohen's d = 0.30). The SPMSQ demonstrated smaller random measurement error and an absence of practice effect. When comparing the psychometric properties of the SPMSQ and MoCA as outcome measures for assessing cognitive function in patients with stroke, the SPMSQ appears to be a more suitable choice than the MoCA.

Development and Validation of the Identity Negotiation Experiences and Strategies Scale

ABSTRACT A rich theoretical and empirical literature captures experiences of identity conflict and tension at the nexus of identity domains that feel incompatible. The Identity Negotiation Experiences and Strategies (INES) scale was developed to provide a quantitative tool for capturing experiences of identity strain or conflict, and strategies for responding to or managing strain. Focus groups with college students from the United States, the Netherlands, and Finland were used to develop a pool of items capturing students’ identity negotiation experiences. Subsequently, two college student samples from the United States and the Netherlands were used to refine the scale and assess psychometric properties. Four subscales – Strain, Compartmentalization, Vigilance, and Identity Negotiation Resources – demonstrated strong and significant correlations with other theoretically relevant identity processes, as well as with depression symptoms. Metric measurement invariance was demonstrated across the U.S. and Dutch samples. We explore links with existing theory and research and potential future uses for the INES.

A systematic review of evaluative instruments for the purpose of monitoring forensic patient recovery and outcomes

ABSTRACT Ideally, evidence-based patient outcomes would be collected on a 6-monthly basis, allowing accurate measurement of treatment progress. This would encourage research and subsequent development of forensic mental health services. Lack of standardised routine outcome collection within Scotland may be acting as a barrier to this. The Royal College of Psychiatrists recommends that evidence-based clinical and patient-reported data should be collected; however, no specific measures are recommended. COnsensus-based Standards for health Measurement INstruments (COSMIN) guidelines for systematic reviews of outcome measures were followed and their Risk of Bias tool used to evaluate the quality of studies. Instrument content validity, for the purposes of measuring forensic patient recovery, was analysed separately through review of articles relating to instrument development and user feedback. From four evaluative instruments selected by predefined criteria, only Structured Assessment of Protective Factors for violence risk (SAPROF) and Instrument for Forensic Treatment Evaluation (IFTE) possessed the core psychometric properties of a useful outcome measure. These two instruments can therefore be recommended for the purpose of monitoring forensic patient recovery, with SAPROF being the more feasible option. HCR-20 and HoNOS-secure were found to lack content validity for this purpose. Additional psychometric studies for SAPROF are recommended.

Development of the Menopause Perception Scale.

How women perceive menopause depends on how well they go through that period of time. However, there is no measure that can be used to assess how women perceive menopause. Therefore, we developed a valid and reliable scale (Menopause Perception Scale [MPS]) to assess how women perceive menopause. This methodological research was conducted in three stages. First, we developed items and assessed their content validity. Second, we collected data from 470 women. Third, we assessed the scale for validity and reliability. Exploratory factor analysis and confirmatory factor analysis were used for construct validity. Cronbach's α was calculated for reliability. Pearson's correlation coefficient was used for criterion validity. Mean comparison tests were performed for known-groups validity. The MPS had a content validity index of 0.90. It had a Kaiser-Meier-Olkin score of 0.768, for which Bartlett's test of sphericity was significant (1,778.047; P < 0.001). The values were acceptable. The exploratory factor analysis yielded an 18-item structure with factor loads greater than 0.40. It also revealed a four-factor model (acceptance, perceived sexuality, normalization, and perceived support) confirmed by the confirmatory factor analysis. The fit indexes were acceptable. The model explained 56.64% of the total variance. The internal consistency was acceptable (Cronbach's α = 0.824). There were positive correlations between the scale and its subscales. Furthermore, the MPS was significantly correlated with the Menopause Attitude Assessment Scale (r = 0.334, P < 0.001) and the Menopause Rating Scale (r = -0.286, P < 0.001). The MPS is a valid, reliable, user-friendly, and practical self-report measure with satisfactory psychometric properties. Researchers should conduct cross-cultural studies to adapt it to other cultures.

Validation of the 12-item Gamification User Types Hexad Scale in 1,610 Hong Kong Young Gamers

AbstractThe present study aimed to examine the psychometric properties of the Gamification User Types Hexad Scale (Hexad) and validate the 12-item short version (Hexad-12) in the Chinese context. An online survey recruited 1,610 young gamers aged between 11 and 29 (mean age = 23.1, SD = 4.18) in Hong Kong between May and June 2023, who completed the Hexad-24 and other validated measures. Factorial validity and measurement invariance of Hexad were evaluated by confirmatory factor analysis. Convergent validity of Hexad factors was examined with demographic and gaming characteristics, social support, internet gaming disorder (IGD) symptoms, depressive symptoms, and hikikomori. The 6-factor model provided mediocre fits (comparative fit index &lt; 0.90 and standardized root mean square residuals &gt; 0.07) to the original 24-item Hexad but adequate fits (comparative fit index = 0.97 and standardized root mean square residuals &lt; 0.04) to Hexad-12 in split samples with substantial factor loadings and acceptable reliability. The Hexad-12 factors showed scalar measurement invariance across gender, age groups, and game genre. Disruptor was positively and moderately to strongly correlated with IGD and depressive symptoms, hikikomori, and suicidal ideation. Philanthropist and socializer were positively and moderately correlated with social support and meaning in life; free-spirits and achievers were negatively and weakly correlated with IGD and depressive symptoms, hikikomori, and suicidal ideation. The present findings demonstrated adequate psychometric properties for the Hexad-12, supporting its use for brief assessment of Chinese gamers' user types.

Longitudinal measurement invariance and psychometric properties of the Patient Health Questionnaire-Four in China

BackgroundDepression and anxiety symptoms among medical students are often a concern. The Patient Health Questionnaire-Four (PHQ-4), an important tool for depression and anxiety screening, is commonly used and easy to administer. This study aimed to assess and update the longitudinal measurement invariance and psychometric properties of the simplified Chinese version.MethodsA three-wave longitudinal survey was conducted among healthcare students using the PHQ-4. Structural validity was based on one-factor, two-factor, and second-order factor models, construct validity was based on the Self-Rated Health Questionnaire (SRHQ), Sleep Quality Questionnaire (SQQ), and Rosenberg Self-Esteem Scale (RSES), and longitudinal measurement invariance (LMI), internal consistency, and test–retest reliability were based on structural consistency across three time points.ResultsThe results of the confirmatory factor analysis indicated that two-factor model was the best fit, and LMI was supported at three time points. Inter-factor, factor-total, and construct validity correlations of the PHQ-4 were acceptable. Additionally, Cronbach’s alpha, McDonald’s omega, and the intraclass correlation coefficient demonstrated acceptable/moderate to excellent reliability of the PHQ-4.ConclusionsThis study adds new longitudinal evidence that the Chinese version of the PHQ-4 has promising LMI and psychometric properties. Such data lends confidence to the routine and the expanded use of the PHQ-4 for routine screening of depression and anxiety in Chinese healthcare students.

Cross-cultural adaptation and psychometric evaluation of the Turkish version of the Smombie Scale for Adolescents.

Smombie has become an important problem especially in terms of adolescent health. The aim of this study was to translate the Smombie Scale for Adolescents (SSA) into Turkish and to examine its psychometric properties. This study has a methodological design. The study was conducted between March and April 2024. The sample of the study consisted of 430 adolescents. The data were collected by using Personal Information Form and SSA. Content Validity Index, Confirmatory Factor Analysis (CFA), test-retest reliability, Cronbach's α coefficient, item-total score correlation, 27% upper-lower group item analysis and Hotelling T2 test were used in data analysis. The four-factor structure of the scale showed a good fit in CFA (chi-square minimum discrepancy [CMIN] = 187.463, degrees of freedo (DF) = 83, CMIN/DF = 2.259, root mean square error of approximation = 0.054, root mean square residual = 0.033, goodness of fit index = 0.947, adjusted goodness of fit index = 0.923, normed fit index = 0.930, tucker-lewis index = 0.949 and comparative fit index = 0.959). Cronbach's α coefficient of the scale was found to be 0.86. The item-total score correlation of the scale was found between 0.212 and 0.721. The test-retest intraclass correlation coefficient of the scale was found to be 0.876. This study shows that the scale is a reliable tool for assessing adolescents' smombie tendencies. It is thought that the scale will contribute to the protection and development of adolescent health.

Psychometric properties of the Swedish version of the Parenting Concerns Questionnaire in parents with cancer.

Parenting concerns can be a major source of distress for patients with cancer who are parents of dependent children; however, these are often not addressed in health care. The Parenting Concerns Questionnaire (PCQ) is an instrument designed to assess parents' worries about the impact of cancer on their children and their ability to parent during this time. The Swedish version of thePCQ has, however, not been evaluated. This study therefore aimed to examine the psychometric properties of the PCQ in a sample of Swedish parents with cancer. A sample of 336 patients with cancer having dependent children (≤18 years) were included in a cross-sectional web-based survey. Participants completed questionnaires assessing parenting concerns, depression, anxiety, and stress symptoms (DASS); self-efficacy, family functioning (FAD-GF); and sociodemographic and clinical characteristics. Descriptive analyses, as well as reliability and validity analyses, were conducted followed by a confirmatory factor analysis of the factor structure proposed by the authors of the original version of the PCQ. The majority were mothers (94.9%) with breast cancer (66.4%) aged 40-50 years (59.5%). The results showed evidence for convergent, criterion, and known group's validity, but the original three-factor structure of the PCQ was not fully supported by confirmatory factor analysis. Evaluating parenting concerns may be an important step towards identifying patients who could benefit from targeted psychosocial interventions. However, the PCQ may require some further refinement to fully capture the breadth of parenting concerns in parents with cancer in different settings.

Sleep-loss related to itch in atopic dermatitis: assessing content validity and psychometric properties of a patient-reported sleep-loss rating scale

BackgroundSleep loss is a key factor contributing to disease burden in people with atopic dermatitis (AD). Mitigating itch to improve sleep is an important outcome of AD treatment. This study explored the content validity and measurement properties of the Sleep-Loss Scale, a single-item rating scale for assessing itch interference with sleep in clinical trials of AD treatments.MethodsConcept elicitation and cognitive debriefing interviews were conducted with 21 adults and adolescents (12–17 years of age) with moderate-to-severe AD to develop a conceptual model of patient experience in AD and explore the content validity of the scale. Data collected from adults with moderate-to-severe AD enrolled in a phase 2b study (NCT03443024) were used to assess Sleep-Loss Scale’s psychometric performance, including reliability, construct validity, and ability to detect change. Meaningful within-patient change (MWPC) thresholds were also determined using anchor-based methods.ResultsQualitative findings from concept elicitation highlighted the importance of sleep-loss related to itch in AD. Debriefing analysis of the Sleep-Loss Scale indicated that the scale was relevant, appropriate, and interpreted as intended. Trial data supported good reliability, construct validity and ability to detect improvement. MWPC was defined as a 1-point improvement using trial data, a finding supported by qualitative data.ConclusionsThe Sleep-Loss Scale provides a valid and reliable patient-reported measure of the impact of itch on sleep in patients with AD, and can detect change, indicating it is fit-for-purpose to evaluate the efficacy of AD treatments in moderate-to-severe patients.

Development and Psychometric Evaluation of the Social Participation Questionnaire: A Methodological and Cross-Sectional Study.

Social participation is vital for the health maintenance of general populations as well as the functional recovery and social ties of clinical patients. To develop a Social Participation Questionnaire (SPQ) to evaluate participation in social activities in an individual's life and to test the reliability and validity of the SPQ. Cross-sectional study. Community and clinic in China. A total of 1419 healthy adults and 486 breast cancer patients. The initial items were developed from a theoretical framework, a literature review, and Delphi expert consultation. Item analysis, exploratory (EFA) and confirmatory factor analysis (CFA), criterion validity, construct reliability, and internal consistency reliability were performed to examine the psychometric properties of the SPQ. The final SPQ was comprised of 11 different types of social activities, falling under the 3 dimensions of activities of daily life, sports and entertainment activities, and social service activities. EFA explained 50.674% of the total item variance contributing to the tool. CFA showed that the SPQ fit well. The total SPQ score was significantly associated with social network, quality of life, and cognitive function (r = |.180∼.466|, P < .001). The internal consistency coefficient was acceptable (range of Cronbach's alpha, .695 to .720). The SPQ has robust properties, wide application, and provides a culturally relevant tool to evaluate the social participation of individuals, thus facilitating rigorous clinical and population-based research.

Validation of the Big Five Personality Scale for Ethiopian university students: exploring the psychometric properties of the Amharic version

Validation of the Big Five Personality Scale for Ethiopian university students: exploring the psychometric properties of the Amharic version

Psychometric Properties of Various Factorial Models of the ORTO-15 Tested With Brazilian Respondents.

The ORTO-15 is a commonly used screening instrument for symptoms of Orthorexia Nervosa (ON), an obsessive overconcern with healthy eating. However, its limitations have been evidenced in several published factorial models. We analyzed the psychometric properties of seven different ORTO-15 factorial models using data from Brazilian adult participants (n = 1455; 71.4% women; M age = 29.5, SD = 8.9 years) from the country's five macro-regions who answered online questions for sample characterization and completed the Portuguese version of the ORTO-15 containing 15 items. We tested the fit of each model separately, analyzing data for men and women with separate confirmatory factor analysis, and using the Weighted Least Squares Mean and Variance Adjusted estimation method and goodness-of-fit indices. We also calculated the average variance extracted and the alpha ordinal and omega coefficients to analyze the convergent validity and reliability of the factors. None of the models tested presented adequate properties of validity and reliability. Although we found some acceptable reliability coefficients, they do not guarantee the validity of the data. Future investigators should be cautious when choosing the ORTO-15 for ON screening.

Beyond the false belief task: How children develop their knowledge about the mind

AbstractPrevious research on children's knowledge about the mind has primarily focused on their comprehension of false beliefs, leaving the conceptualization of thoughts and thinking less explored. To address this gap, we developed a new assessment tool, the interview about the mind (IaM), to assess children's understanding of the mind. Two studies involving Polish preschool and early school‐aged children were conducted to assess the validity and reliability of the tool: a cross‐sectional study with 212 preschoolers aged three to 6 years (106 boys, M = 59 months) followed by a longitudinal study with approximately 200 children (110 boys) assessed at ages 5.5, 6.5, and 7.5 years. We found that the IaM possesses robust psychometric properties and a one‐factor structure. Younger children recognize that thoughts are imperceptible to the senses and identified the mind's location as the head. Older children exhibited difficulties with analogical or abstract definitions of thoughts. As expected, a linear developmental trajectory was evident from ages 5.5–7.5, with children's language abilities showing a positive correlation with IaM scores. Future research should explore the relationship between knowledge about the mind and theory of mind (ToM), as well as cross‐cultural differences in children's mind conceptualization.

Psychometric properties of the Perth emotional labour scale: Preliminary support for a new measure with theoretical implications.

Emotional labour is the process by which people regulate emotions congruently with occupational requirements. Research consistently links emotional labour to greater levels of burnout. However, we argue this literature is potentially confounded by measurement error. We sought to validate an English adaptation of a recent emotional labour measure that addresses measurement error concerns in an under-researched sample at risk of burnout-psychologists providing psychotherapy. We termed this measure the Perth Emotional Labour Scale (PELS) which is based upon Andela and colleagues' (2015) original measure. Additionally, we explored what factors of emotional labour contributed most to burnout in this group. We recruited 418 psychologists (81.58% female, 17.46% male, 0.96% non-binary) across Australia (N=362, 86.60%) and New Zealand (N=56, 13.40%). Factor analyses and correlational analyses examined the PELS' reliability and validity. Hierarchical multiple regression analysis explored whether each component of emotional labour contributed unique variance to emotional exhaustion (EE). Preliminary support for the PELS' psychometric properties was found and emotional dissonance was found to be the only emotional labour factor that uniquely contributed to EE. We demonstrate preliminary psychometric support for the PELS but recommend further development and argue our findings have unique implications for research and practice.

Psychometric properties of the arabic version of occupational value with pre-defined ítems

Background Perceived occupational value is closely linked with well-being and there is need worldwide for assessment tools that target this phenomenon. The Occupational Value with pre-defined items (OVal-pd), measuring three dimensions of occupational value; concrete, socio-symbolic and self-rewarding, was designed for that purpose. Aim To pilot an Arabic version of OVal-pd and evaluate its psychometric properties in terms of content validity, factor structure, homogeneity, construct validity, test-retest stability, floor and ceiling effects, and measurement error. Methods Snowball sampling was used to recruit Arabic-speaking persons living in Sweden (n = 55). They completed the OVal-pd and questionnaires addressing background factors, content validity and feasibility. Confirmatory factor analysis, Spearman’s rank correlation, Cronbach’s α, intraclass correlation coefficients, and minimum detectable change were calculated. Results A 22-item version of the Arabic OVal-pd was found to have acceptable content validity and feasibility and the proposed three occupational value dimensions were confirmed. Good properties in terms of construct validity, internal consistency and test-retest stability were also established. No floor or ceiling effects were observed. Conclusion The Arabic OVal-pd showed good validity and reliability on various psychometric aspects. Significance In today’s multicultural societies, the Arabic OVal-pd can be an important tool for occupational therapists working with Arabic-speaking clients.

Further Psychometric Evaluation of the Eight-Item Hospice Philosophy Scale: Results From a National Sample of Interdisciplinary Hospice Clinicians.

This study examined the psychometric properties of the eight-item Hospice Philosophy Scale (HPS-8) through confirmatory factor analysis; differential item functioning by age, gender, race, and professional discipline; and internal consistency reliability. We administered the HPS-8 to a national convenience sample of 471 interdisciplinary hospice clinicians. Confirmatory factor analysis results supported a one-factor model with an error correlation between two similarly worded items, χ2(19) = 48.38, p < .001 (RMSEA = .06, SRMR = .03, CFI = .98, TLI = .97). "Multiple indicators, multiple causes" model results indicated differential item functioning by age, race, and/or professional discipline on five items. However, subsequent uncorrected and differential item functioning-corrected models detected no statistically significant HPS-8 mean differences by grouping variables. Composite reliability results (CR = .82) demonstrated acceptable internal consistency reliability. Our results support the HPS-8 as a valid and reliable measure of attitudes toward the hospice philosophy of care in hospice clinicians.

Psychometric Testing of the Korean version of the Self-Care of Coronary Heart Disease Inventory Version 3

PurposeThis methodological study evaluated the psychometric properties of the Self-Care of Coronary Heart Disease Inventory version 3 (SC-CHDI v3) in a Korean context. MethodsThe SC-CHDI v3 was translated into Korean following a rigorous translation process. Participants were 452 patients who had experienced coronary heart disease (CHD), all recruited from a tertiary hospital in Korea. Exploratory and confirmatory factor analyses were performed to test construct validity. Concurrent validity was examined by correlating scores from the Korean version of the SC-CHDI v3 with those from the Cardiac Self-Efficacy Scale. Internal consistency was analyzed using Cronbach’s alpha and McDonald’s omega. ResultsThe Korean version of the SC-CHDI v3 consists of 21 items, excluding two from the original instrument. The self-care maintenance subscale identified a two-factor structure: “treatment adherence” and “health-promoting behaviors.” The goodness-of-fit indices were satisfied: χ2 = 18.19, p = .110, comparative fit index (CFI) = .97, Tucker-Lewis Index (TLI) = .95, and standardized root mean square residual (SRMR) = .04. The self-care monitoring subscale consisted of a one-dimensional structure (“monitoring behaviors”) and the goodness-of-fit indices were satisfied: χ2 = 19.19, p = .059, CFI = .99, TLI = .99, and SRMR = .04. The self-care management subscales had a two-factor structure of “consulting behaviors” and “problem-solving behaviors.” The goodness-of-fit indices were satisfied: χ2 = 16.44, p = .037, CFI = .99, TLI = .98, and SRMR = .03. Scores from the Cardiac Self-Efficacy Scale showed a positive correlation with the Korean version of SC-CHDI v3 subscales. Reliability estimates were ≥ .80 for all subscales except for the self-care maintenance subscale. ConclusionsThe Korean version of the SC-CHDI v3 consists of 21 items in 3 subscales and is a valid and reliable instrument. Therefore, healthcare providers can effectively utilize it to assess the self-care levels of patients with CHD.

Protocol for a systematic review evaluating psychometric properties and gender-related measurement (non)invariance of self-report assessment tools for autism in adults

BackgroundGiven the recent evidence on gender differences in the presentation of autism, there is an increasing concern that current tools for autism do not adequately capture traits more often found in women. If tools for autism measure autistic traits differently based on gender alone, their validity may be compromised as they may not be measuring the same construct across genders. Measurement invariance investigations of autism measures can help assess the validity of autism constructs for different genders. The aim of this systematic review is to identify and critically appraise the psychometric properties of all self-report tools for autism in adults that meet two criteria: (a) they have been published since or included in the NICE (2014) recommendations, and (b) they have undergone gender-related measurement invariance investigations as part of their validation process.MethodsA search of electronic databases will be conducted from 2014 until the present using MEDLINE, Embase, and PsycINFO using predefined search terms to identify eligible studies. The search for grey literature will include sources such as OpenGrey, APA PsycEXTRA, and Scopus. Two reviewers will independently screen titles, abstracts, and full texts for eligibility. The references of included studies will be searched for additional records. The methodological quality of the studies will be evaluated using the COSMIN Risk of Bias checklist, while psychometric quality of findings will be assessed based on criteria for good measurement properties and ConPsy checklist. The quality of the total body of evidence will be appraised using the approach outlined in the modified GRADE guidelines.DiscussionThis systematic review will be among the first to assess the psychometric properties and gender-related measurement invariance of self-reported measures for autism in adults that were published since (or included in) NICE (2014) guidelines. The review will provide recommendations for the most suitable tool to assess for autism without gender bias. If no such measure is found, it will identify existing tools with promising psychometric properties that require further testing, or suggest developing a new measure.Systematic review registrationThe protocol has been registered at the International Prospective Register of Systematic Reviews (PROSPERO). The registration number is CRD42023429350.

Psychometric properties of the Persian version of the Edmonton Frail Scale

ABSTRACT Due to the need for a validated and relevant scale for assessing frailty, we aimed to translate and adapt a specific tool, ‘Edmonton Frail Scale’ (EFS), into the Persian language and evaluate its psychometric properties. In this methodological and cross-sectional study, we recruited 347 older adults in Naqadeh, Iran. Next, by using the Exploratory Factor Analysis (EFA) and Confirmatory Factor Analysis (CFA), we examined the construct validity of the p-EFS. The internal consistency/reliability was estimated by computing Cronbach’s coefficient alpha. The Exploratory factor analysis revealed a three-factor model that included 11 items and accounted for 49.00% of the variance. Additionally, the construct validity of this three-factor model was supported by the results of the confirmatory factor analysis. The remerged factors were 1) functional, physiological, and cognition status, 2) medication, nutrition status, and social support, and 3) general health status. The Iranian version of EFS is a valid and reliable scale that we suggest for specialists, physicians, and health workers to measure frailty.

Somatosensory Amplification Scale—Chinese version: psychometric properties and its mediating role in the relationship between alexithymia and somatization

Somatosensory Amplification Scale—Chinese version: psychometric properties and its mediating role in the relationship between alexithymia and somatization