Structural Validity Research Articles

Modelling vocational interests: application of the Personal Globe Inventory in Portugal

AbstractA translated version of the Personal Globe Inventory (PGI, Tracey, 2002) was administered to a Portuguese sample of college students (n = 312) and the data were examined with respect to its internal structure. Results of component analyses suggested, as expected, four substantive factors underlying PGI: General Interest, People/Things, Data/Ideas and Prestige. The randomized test of hypothesized order relations showed that spherical, eight and six (i.e., RIASEC) type models fit the Portuguese data equally well as data from the United States. No structure differences were found across gender. The results support the structural validity of the PGI to Portuguese respondents.

Validation of the athletic mental energy scale for Chinese school-age adolescents

Mental energy is an important factor in many domains, including athletic performance. The athletic mental energy scale (AMES) is one of the established tools available to measure athletes’ perceived mental energy state. To date, there is no validated questionnaire to assess athletic mental energy for Chinese adolescents. Therefore, purpose of this study was to validate a Chinese version of AMES (C-AMES) among the Chinese adolescents in Lanzhou, Gansu Province, China. We sampled 729 adolescents aged 14 to 18 in five middle schools in Lanzhou City, Gansu Province, China to complete the revised C-AMES. Data were analyzed for factor structure validity by performing CFA. The results showed that the fit index was acceptable (RMSEA = 0.050, CFI = 0.962, TLI = 0.951), and a six-factor model containing 18 C-AMES items had good measurement properties for athletic mental energy. We suggest future study may use C-AMES to examine the relationship between athletes’ mental energy and athletic performance and sporting behavior.

Reliability and Validity of the Chinese Mandarin Version of the Dysphagia Handicap Index.

This study aimed to develop the Dysphagia Handicap Index-Chinese Mandarin (DHI-CM) and to assess its reliability and validity. This prospective study was conducted in China with individuals who speak Mandarin. The DHI-CM was developed according to a five-stage process. 264 patients with oropharyngeal dysphagia (OD) and 187 healthy individuals completed the study. Reliability was assessed using Cronbach's α and test-retest reliability. Differences between healthy participants and patients with OD were analyzed for instrument validity. Convergent and concurrent validity were assessed using the Swallowing Quality of Life Questionnaire (SWAL-QoL) and Functional Oral Intake Scale (FOIS), respectively. The Content Validity Index (CVI) was used to assess content validity. Exploratory and Confirmatory Factor Analyses (EFA and CFA, respectively) were used to assess structural validity. The Cronbach's alpha was > 0.9 for the total score and every individual subscale. The Pearson and intraclass correlation coefficients were both > 0.8. The patients with OD showed significantly higher scores in the DHI-CM and its subscales than the healthy individuals. Significant correlations were found between most subscales of the DHI-CM and both the SWAL-QoL and FOIS. The CVI of the DHI-CM was 0.892 and ranged between 0.878 and 1.000 for the subscales. The EFA identified three components that explained 24.33%, 23.99%, and 22.73% of the variance, respectively. The scale showed good structural validity through CFA. Conclusions. The DHI-CM demonstrated good reliability and validity among Mandarin-speaking Chinese adults.

Unveiling brand loyalty in emerging markets: Analyzing smartphone user preferences: Robustness of structural equation modeling (SEM) and simultaneous equation modeling (SEMs)

This study aims to examine the determinants of brand loyalty in emerging markets, focusing on smartphone consumers in Bangladesh. The study focuses on identifying the key elements that contribute to brand loyalty and the extent of their impact on customers' commitment to their preferred smartphone manufacturers. A theoretical framework will be employed to establish the relationship between the independent and dependent variables. Data for the study was collected from 390 participants through a Google form explicitly designed for this purpose. In this study Simultaneous Regression Analysis has been used to synchronize the findings of the Structural Equation Models (SEM) and also is used to emphasize the robustness of the study. The data analysis used PSS to calculate the mean and standard deviation. Structural Equation Modeling (SEM), reliability, and convergent validity were accomplished using Amos. The findings indicate that consumer attitudes, service quality, public self-consciousness, and behavioural brand experience all significantly influence brand loyalty. Furthermore, brand trust plays a crucial and favourable mediating role between consumer perceptions, brand loyalty, and service excellence. The model suggested in this study has a big effect, and Bangladesh policymakers should consider this model when planning new factors affecting brand loyalty. The results of this research can be valuable for Bangladeshi smartphone companies as they gain insights into the factors affecting brand loyalty among consumers. The study discusses the limitations of its generalizability and provides practical implications for businesses and their market offerings.

Cross-Cultural Validation of Teachers Social Self-Efficacy Scale: Insights from Cyprus, Greece, and Portugal

The main aim of this study is to explore early childhood teachers’ social self-efficacy in Cyprus, Greece, and Portugal. In addition, this study examines the validity of the factorial structure of the Teachers’ Social Self-Efficacy Scale (TSSES). A sample of 349 early childhood teachers across the three countries participated in this study. An exploratory analysis and then a confirmatory factor analysis were employed to reveal the structure of the TSSES. Configural and metric invariance were established for the one-factor structure of the TSSES. The results showed that teachers in Portugal and Cyprus experience high levels of social self-efficacy, whereas Greek teachers experience moderate to high levels of social self-efficacy. The TSSES seems to be a reliable instrument for assessing social self-efficacy beliefs. Possible implications for practice are also discussed.

Systematic review following COSMIN guidelines: Short forms of Zarit Burden Interview

This comprehensive review assessed the psychometric properties of abbreviated versions of the Caregiver Burden Instrument (ZBI-22). Initially, 40 articles that met the inclusion criteria were identified through a systematic search of four databases. Additionally, 26 articles were included through manual searches, totaling 66 articles in the analysis. Different versions of instruments measuring caregiver burden were examined, considering item variability and differences in factor structures. Although most measures exhibited satisfactory content validity, as well as construct validity supported by high internal consistencies, it is important to note that measurement invariance, criterion validity and test-retest reliability were not established for all measures analyzed. Furthermore, structural validity was not satisfactory for all versions. Research and clinical practice could benefit from a standardized approach that allows for a more accurate and consistent assessment of caregiver strain.

Multidimensionality of children’s foundational skills: an IRT-based validation of the NEPSY factorial structure

ABSTRACT Objective Measurement tools for children’s foundational skills provide important insights towards the developmental mechanisms of these domains. This study examines the structure of sensorimotor, visuospatial processing (VP), executive function (EF) skills and their interrelationship. The NEPSY is a widely-used neuropsychological instrument, but while validated at the domain-level through classical test theory approaches, no studies have conducted in-depth item-level analyses on its structural and psychometric properties. Method This study examined whether the designed structure of NEPSY is empirically supported by fitting unidimensional and multidimensional Item Response Theory models to item response data of early elementary students in the United States. A confirmatory factor analysis was also conducted to examine the factorial structure of the data. Results Results provide empirical support to the factorial structure of NEPSY, both at the domain level and within the VP sub-domain. The results show that VP and EF are separate constructs and subtests within the VP domain can further be modelled as interrelated but distinct factors – non-motor and motor-based processing. Conclusion Our specific results support the theoretical stance that VP consists of multiple component skills that are distinct because they require different neurological processes. This multidimensional NEPSY model shares some structural commonalities with the Cattell–Horn–Carroll model.

Validation of the factor structure of the motivated strategies for learning questionnaire

Validation of the factor structure of the motivated strategies for learning questionnaire

A Visual Environment for Data Driven Protein Modeling and Validation.

In structural biology, validation and verification of new atomic models are crucial and necessary steps which limit the production of reliable molecular models for publications and databases. An atomic model is the result of meticulous modeling and matching and is evaluated using a variety of metrics that provide clues to improve and refine the model so it fits our understanding of molecules and physical constraints. In cryo electron microscopy (cryo-EM) the validation is also part of an iterative modeling process in which there is a need to judge the quality of the model during the creation phase. A shortcoming is that the process and results of the validation are rarely communicated using visual metaphors. This work presents a visual framework for molecular validation. The framework was developed in close collaboration with domain experts in a participatory design process. Its core is a novel visual representation based on 2D heatmaps that shows all available validation metrics in a linear fashion, presenting a global overview of the atomic model and provide domain experts with interactive analysis tools. Additional information stemming from the underlying data, such as a variety of local quality measures, is used to guide the user's attention toward regions of higher relevance. Linked with the heatmap is a three-dimensional molecular visualization providing the spatial context of the structures and chosen metrics. Additional views of statistical properties of the structure are included in the visual framework. We demonstrate the utility of the framework and its visual guidance with examples from cryo-EM.

Psychometric Properties of the PEDI–PRO: An Accessible Self-Reported Measure of Functional Abilities for Transition-Age Youth With IDD

Abstract Date Presented 03/22/24 The Pediatric Evaluation of Disability Inventory–Patient Reported Outcome (PEDI–PRO) is a self-assessment of functional abilities for youth with developmental disabilities ages 14–22. A national sample of 307 established its structural, known-groups, and convergent validity. Results inform automatic scoring algorithms. Primary Author and Speaker: Andrew Persch Additional Authors and Speakers: Pengsheng Ni, Beth Pfieffer, Ariel Schwartz Contributing Authors: Fiorella Guerrero, Jessica M. Kramer

Development and validation of FinTox: A new screening tool to assess cancer-related financial toxicity.

This study aimed to develop and validate FinTox, a concise tool for screening and managing financial toxicity in oncology settings. Development involved qualitative interviews with healthcare providers and patients, and feedback from a 7-member expert panel resulting in a 5-item measure that evaluates financial strain, psychological responses, and care modifications. Psychometric evaluations examined factor structure, internal consistency, test-retest reliability, and concurrent and convergent validity. Associations between FinTox scores and sociodemographic/medical factors were also analyzed using univariate and multivariable regression models. Twelve healthcare providers and 20 patients were interviewed, and 268 patients (69.8% female, 47.4% non-Hispanic White) completed surveys including FinTox, the Comprehensive Score for Financial Toxicity (COST), health-related quality of life (HRQOL) measures, and sociodemographic questions. FinTox demonstrated excellent internal consistency (Cronbach's alpha = 0.90) and test-retest reliability (ICC = 0.95). Significant correlations with the COST (r = -0.62, p < 0.001) and HRQOL measures corroborated content and convergent validity. Diagnostic accuracy was evidenced by a sensitivity of 72.3%, specificity of 85.2%, positive predictive value of 83.2%, and negative predictive value of 70.3%. Higher FinTox scores were also associated with receiving care at a safety-net hospital, Black race, household income <600% of the federal poverty level, and Stage 4 cancer. FinTox's robust psychometric properties and diagnostic accuracy position it as a reliable tool for detecting financial toxicity. Future research should evaluate its responsiveness to changes over time and integration into clinical workflows.

Associations Between Labor Control Through Digital Platforms and Workers' Mental Wellbeing: A Survey of Location-based Platform Workers in Taiwan

BackgroundPlatform work offers flexibility and autonomy to workers, but there are concerns about the impacts of excessive labor control exercised by digital platforms using algorithmic management. This study assessed the level of labor control exerted by digital platforms and explored its associations with psychosocial work conditions and workers' mental well-being. MethodsA total of 487 location-based platform workers in Taiwan, encompassing ride-hailing, delivery, and house chore services, participated in this questionnaire survey. A 5-item scale was created to assess platform-mediated labor control. Psychosocial work conditions, including demands, job control, work rewards, and mental well-being, including burnout and self-rated mental health status, were assessed using validated instruments. Cronbach's α and principal component analysis were employed to assess the validity of the labor control scale. Logistic regression analysis and path analysis were conducted to investigate the relationship between labor control and workers' mental health. ResultsExploratory factor analyses confirmed the structural validity and the internal consistency of the scale. Logistic regression models revealed that higher levels of labor control were associated with an increased risk of burnout and poorer mental health. Path analyses further indicated that higher labor control through digital platforms raised mental health risks by increasing job demands. ConclusionAlgorithmic management is associated with increased stress among platform workers as they try to meet the platform's performance metrics.

Shared decision-making in healthcare: development and assessment of the translated Finnish version of the SDM-Q-9.

The aim of this study was to assess the cultural validity and reliability of a Finnish version of the nine-item Shared Decision-Making Questionnaire (SDM-Q-9) in a sample of patients with different sociodemographic characteristics. The original SDM-Q-9 was translated into Finnish with the agreement of the developers of the original scale. The standardised translation procedure was followed by a pilot test of the questionnaire. The data were collected from an online questionnaire. Reliability was estimated by Cronbach's alpha. Structural validity of the questionnaire was assessed by confirmatory factor analysis. The pilot study assessing the cultural validity of the scale was a success, as it did not find any expressions needing to be revised. The Finnish version of the SDM-Q-9 - the SDM-Q-9-FIN - was tested in the study where a total of 736 patients responded to the questionnaire. The questionnaire yielded high reliability with a Cronbach's alpha of 0.92. Confirmatory factor analysis confirmed the unidimensional factor structure with Item 1 excluded. The SDM-Q-9-FIN was shown to be a reliable instrument for evaluating shared decision-making among Finnish patients. Further testing and research are recommended among a greater diversity of patient groups.

Structural validity of the impact of vision impairment questionnaire among patients with visual impairment in Thailand

BackgroundThe Impact of Vision Impairment (IVI) questionnaire is used to assess vision-related quality of life (VRQOL) among patients with visual impairment. This study aims to evaluate the factor structure of the IVI in the context of Thai culture to assess psychometric properties. MethodsThis cross-sectional study was conducted between February and July 2022. Purposive sampling was used to include 502 patients with visual impairment who received treatment at a tertiary eye center, King Chulalongkorn Memorial Hospital, Bangkok, Thailand. The data were collected using the interviewer-administered questionnaire. The participants were randomly divided into two groups: one employed for exploratory factor analysis (EFA; n = 251) and the other for confirmatory factor analysis (CFA; n = 251). ResultsEFA yielded 28 items that supported a four-factor structure: behaviors related to mobility and independence (8 items), reading (3 items), self-dependence (7 items), and emotional impact of vision loss (10 items), with a total variance of 64.9 %. The model fit was good: χ2/df = 1.66, CFI = 0.949, TLI = 0.940, RMSEA = 0.052, and SRMR = 0.041. The AIC and BIC for the bifactor four-factor model (17,484.86 and 17,879.41, respectively) were lower than those for the bifactor three-factor model (17,566.44 and 17,961.29, respectively), indicating that the former showed the best fit. ConclusionsGiven its good reliability and validity, the IVI scale has been extensively used to explore the impact of visual impairment on the VRQOL of patients in the clinical setting, thus greatly benefitting researchers, healthcare providers, and ophthalmologists.

Multifunctional Metasurface Polarizers Synthesis Using Effective Data Generation with Adaptive Attention and Space‐To‐Depth Enhanced Network

AbstractConventional approaches for designing metasurfaces with the desired scattering response are often a time‐consuming and onerous process that heavily relies on the design experience and empirical methods. In this paper, a time and resource‐efficient design method is proposed for the synthesis of multiple metasurface polarizers with an efficient automated data generation process by utilizing the structure validation surrogate model (SVSM). Moreover, a novel attention and space‐to‐depth enhanced adaptive tandem network (ASE‐ATN) is proposed which integrates symmetry‐aware space‐to‐depth (SA‐SPD) along with the attention mechanism for efficient feature extraction. Several design examples of metasurfaces with linear polarization to orthogonal linear polarization (LP‐OLP) and/or linear polarization to circular polarization (LP‐CP) conversion capabilities are provided to verify the performance of the proposed method. The feasibility of the proposed method is demonstrated through the fabrication and measurement of a dual‐band dual‐polarization converter.

Measuring the quality of self-care of elderly patients with dementia in a developing country.

In developing countries like Uganda, people with dementia are cared for by non-medically trained family members with minimal support from the formal healthcare system. The quality of care in this setting is largely unknown but significantly affects the well-being of those with dementia. A tool designed to measure the quality of informal care for old frail adults with or without dementia was translated into Luganda. A committee of experts reviewed and finalized the translation, which was pilot-tested and then used to measure the quality of dementia self-care. We consecutively enrolled 105 caregivers of elderly people with dementia; the median age was 35 years (Interquartile Range 26-47 years), and 67% were females, taking care of a grandparent (44%) or a parent (34%). We used confirmatory factor analysis to assess for structural validity and computed correlation coefficients and Cronbach's alpha to assess for discriminant validity and internal reliability, respectively. The three-factor model applied to the 20 items, adequately fit the data (Comparative Fit Index = 0.88, Tucker-Lewis Index = 0.87, Root Mean Square Error of Approximation = 0.08; 90% Confidence Interval (0.06-0.09), Standardized Root Mean Square Residual = 0.089). There was good discriminant validity, and correlation coefficients between dimensions/scales and the Dementia Knowledge Assessment Scale scores were low. There was good internal reliability with all items Cronbach's alpha ranging from 0.69 to 0.89. Our findings demonstrated that this culturally adapted, shorter measurement tool is valid and reliable. The tool can be used by researchers, health workers, and agencies to assess the quality of self-care for elderly people with dementia in Uganda.

The SSIS SEL Brief Scales – Student Form: Examining the Structural Validity of a Portuguese Version

Abstract Background Despite the increased use of social and emotional learning (SEL) programs, empirical research is hindered by lengthy assessment options, difficult to fit into educational contexts. To cover these needs, the Social Skills Improvement System SEL Brief Scales – Student Form (SSIS SELb-S) was developed. Although it has been translated into several languages, a Portuguese version with sound psychometric properties is still missing. Objective This study aimed to develop the Portuguese version (SSIS SELb-Spt) and to examine its psychometric properties. METHODS: After translating the original SSIS SELb-S to Portuguese, the instrument was administered to 200 5th graders, along with self- and hetero-report measures of school well-being and involvement, peer acceptance, and academic achievement. We examined the SSIS SELb-Spt factorial validity and reliability, tested its correlations with external correlates, and examined the instruments’ predictive validity. Results Results supported a three-factor structure of the scale, which included the dimensions of intrapersonal and interpersonal skills, and responsible decision-making. Correlations with external correlates were in the expected direction. Moreover, the scale predicted school involvement and later academic achievement. Conclusion This study seems to corroborate and extend previous knowledge about the validity of SSIS SELb-S, offering validity and reliability evidence on the scale’s three-factor structure.

A new measure of regulatory focus: Preventing measurement error by promoting best validation practices.

The goals of this project were to improve our understanding of chronic regulatory focus constructs and to provide researchers with a measure that adequately assesses the constructs, can distinguish individual differences effectively across the range of the constructs, and is appropriate for use in diverse populations. Employing best practices in construct validation, we developed the International Personality Item Pool Regulatory Focus Scale (IPIP-RFS). Utilizing 14 samples (N = 4867), we established substantive (via expert ratings and regulatory focus literature), structural (via factor analysis, item response theory, and measurement invariance), and external (via convergent, discriminant, and predictive associations) validity. The IPIP-RFS adequately assesses the constructs of chronic promotion focus and prevention focus, can accurately assess individuals along the continua of the constructs, and is suitable for use among populations that vary in gender, race, and age. Individual differences in promotion focus reflect self-regulation and goal pursuit related to cognitive and behavioral exploration and flexibility (i.e., plasticity), whereas individual differences in prevention focus reflect self-regulation and goal pursuit related to motivational and interpersonal steadiness (i.e., stability). Promotion and prevention focus are important elements of personality with broad implications for functioning and outcomes in health and other important domains.

Perception of School Social Bonding (PSSB) Instrument: Structural and Concurrent Validity

AbstractSchool bonding refers to the connections that students have with their schools and with various aspects of their academic environments, with an emphasis on close affective relationships and investment in doing well at school. The Perception of School Social Bonding (PSSB) instrument is a 10-item, self-report instrument with 3 subscales measuring different aspects of student school bonding: attachment; involvement; and belief. The instrument is grounded in Hirschi’s theory of social control and was evaluated for structural and concurrent validity in a sample of 3,507 students from mixed ethnicity, gender, and age groups. The 3-factor structure of the scale was supported; differences across gender and ethnic groups were identified; and some subscale scores related inversely to chronic school absenteeism. The brevity and sensitivity of the PSSB may make it particularly useful as a universal screening measure in multi-tiered systems of support models.

Development and Validation of the Ease of Imagery Questionnaire.

The present series of studies aimed to develop and provide initial validation of the Ease of Imagery Questionnaire (EIQ)-a measure assessing ease of imaging different positive and negative imagery content reflective of valence and engaging or disengaging in adverse situations. Five studies were conducted to collectively examine the questionnaire's factor structure and concurrent validity. Study 1 (N = 336) and Study 2 (N = 207) informed the development of 16 items of the EIQ, with a four-factor structure supported in Studies 3 (N = 219), 4 (N = 135), and 5 (N = 184) using confirmatory factor analysis. Study 3 also supported concurrent validity with significant bivariate correlations (p < .05) with the similar Sport Imagery Ability Questionnaire subscales, while studies 4 and 5 demonstrated criterion validity in the EIQ's prediction of challenge and threat appraisal tendencies, perceived stress, stress mindset, and anxiety and depressive symptoms. Overall, the EIQ demonstrates a replicable four-factor structure and appears to assess ability to image content associated with positive and negative emotions as well as demanding stress-evoking situations.