Concurrent Predictive Validity Research Articles

Measuring General Health Literacy in Chinese adults: validation of the HLS19-Q12 instrument.

Health literacy measurement lays a solid foundation to identify associations with health outcomes and monitor population health literacy levels over time. In mainland China, most existing health literacy instruments are either knowledge-based or practice-based, making health literacy results incomparable between China and other countries. This study aimed to examine the reliability and validity of the 12-item Health Literacy Population Survey (HLS19-Q12) in a general population of Chinese adults. A cross-sectional study was conducted to recruit primary carers of students from 11 schools in Zhengzhou, Henan Province, using convenience cluster sampling. Participants completed an online self-administered survey that collected information on key sociodemographics, health literacy (HLS19-Q12 and a comparison tool: Health Literacy Questionnaire (HLQ)), and health-related outcomes. Using the COnsensus-based Standards for the selection of health status Measurement Instruments (COSMIN) checklist as a guideline, we tested internal consistency, test-retest reliability, content validity, structural validity, concurrent predictive validity, and convergent validity of the HLS19-Q12. Overall, 14,184 participants completed the full survey. The HLS19-Q12 showed excellent internal consistency (Cronbach's α = 0.93), moderate test-retest reliability (intra-class correlation coefficient = 0.54), satisfactory content validity (based on the 12-matrix health literacy model), and strong structural validity (comparative fit index = 0.94, Tucker and Lewis's index of fit = 0.93, root mean square error of approximation = 0.095). Concurrent predictive validity results showed health literacy was associated with both health determinants and health-related outcomes. The HLS19-Q12 had weak to strong correlations (coefficients = 0.24 to 0.42) with the nine scales of the HLQ. Respondents had an average score of 81.6 (± 23.0) when using the HLS19-Q12, with 35.0% and 7.5% having problematic and inadequate levels of health literacy, respectively. The HLS19-Q12 is a reliable and valid instrument to measure health literacy in our sample. Further validation is needed with a more nationally representative sample of Chinese adults. The HLS19-Q12 could be used as a comprehensive, skills-based, and easy-to-administer health literacy assessment tool integrated into population surveys and intervention evaluations.

Feasibility of a 2-minute eye-tracking protocol to support the early identification of autism

We tested the potential for Gazefinder eye-tracking to support early autism identification, including feasible use with infants, and preliminary concurrent validity of trial-level gaze data against clinical assessment scores. We embedded the ~ 2-min ‘Scene 1S4’ protocol within a comprehensive clinical assessment for 54 consecutively-referred, clinically-indicated infants (prematurity-corrected age 9–14 months). Alongside % tracking rate as a broad indicator of feasible assessment/data capture, we report infant gaze data to pre-specified regions of interest (ROI) across four trial types and associations with scores on established clinical/behavioural tools. Most infants tolerated Gazefinder eye-tracking well, returning high overall % tracking rate. As a group, infants directed more gaze towards social vs. non-social (or more vs. less socially-salient) ROIs within trials. Behavioural autism features were correlated with increased gaze towards non-social/geometry (vs. social/people) scenes. No associations were found for gaze directed to ROIs within other stimulus types. Notably, there were no associations between developmental/cognitive ability or adaptive behaviour with gaze towards any ROI. Gazefinder assessment seems highly feasible with clinically-indicated infants, and the people vs. geometry stimuli show concurrent predictive validity for behavioural autism features. Aggregating data across the ~ 2-min autism identification protocol might plausibly offer greater utility than stimulus-level analysis alone.

Evaluating traumatic event scoring schemas for their predictive value to concurrent diagnostic profiles: Texas Childhood Trauma Research Network

BackgroundTo prospectively chart pathways of risk and resiliency following childhood trauma studies need to address three limitations of prior work: 1) recruit beyond social service/ treatment settings; 2) include broad spectrum of trauma types and 3) cast a broad longitudinal measurement framework of both clinical diagnoses and traumatic exposures. The Texas-Childhood Trauma Research Network (TX-CTRN) is a multi-site collaboration that addresses these limitations. In this baseline-only report, we examined domains of trauma and evaluated the concurrent predictive validity of various traumatic event scoring schemas for clinical diagnoses. MethodsBroad-base recruitment of 8–20 year-olds (N = 1289) included trauma centers, emergency departments, pediatric and primary care clinics, and other community settings. Assessments were comprehensive and based on clinical interviews by trained research interviewers. ResultsFactor analyses supported a five-factor solution of trauma domains including unintentional/acute, intentional/interpersonal, bullying, in-home versus community witnessed interpersonal harms. Trauma burden scoring schemas were examined for their predictive superiority. Domain-specific counts of traumas that met DSM-5 post-traumatic-stress disorder (PTSD) Criterion-A was the best overall schema in distinguishing among youth with no diagnosis, comorbidities, those with depression, suicidality, substance misuse, and PTSD. LimitationsThere were no assessments of neglect. ConclusionsFindings largely aligned with earlier studies on the relative importance of intentional interpersonal traumas and showed bullying may be an important source of traumatic stress that independently adds to prediction of several diagnoses and should be considered in clinical practice.

The development of a novel, multilingual IBD knowledge questionnaire for Asian patients with inflammatory bowel disease

BackgroundInflammatory bowel disease is an uncommon disease in developing nations whereby patient’s knowledge on the disease may be limited. The CCKNOW questionnaire, a widely known questionnaire to assess patient’s knowledge on the disease, may be too complex to comprehend for patients in developing countries. The aim of this study is to develop a new tool known as AIBDKQ questionnaire to evaluate the local inflammatory bowel disease patient’s knowledge.MethodsThis was a prospective study carried out in four phases. In phase 1, three gastroenterologists with expertise in IBD generated a total of 21 questions related to the general knowledge of the disease in the English language. Phase 2 involved content and face validity whereby the questions were further validated by other gastroenterologists. In phase 3, the validated questions were translated into three languages namely Malay, Mandarin and Tamil which are commonly used in Malaysia. In phase 4 (statistical validity), administration of the questionnaires to patients and hospital staff were conducted to assess the construct validity, discriminative ability, predictive validity and reliability of the questionnaires.ResultsA total of 21 questions were generated initially. Further evaluation indicated that 20 items had adequate kappa and content validity index for relevance (CVI: 0.714 to 1, Kapp: 0.645 to 1) and clarity (CVI: 0.714 to 1, Kapp: 0.645 to 1). The questionnaires in four languages were administered to 213 patients to assess the construct validity. Six items were removed (three for low communality, one for small loading factors, two for cross loading), resulting in 16 final questions. Assessment with 34 hospital staff involving nurses, doctors and clerks showed significant differences in knowledge between the groups (F = 14.007, p < 0.001) and were able to discriminate doctors from nurses and clerks. Another group of 18 hospital staff administered with AIBDKQ and CCKNOW questionnaires showed a Pearson’s correlation coefficient of 0.8 indicating strong correlation and concurrent predictive validity between the two questionnaires. Final assessment with 38 patients for reliability assessment revealed high intraclass correlation of the questionnaire among the four languages.ConclusionsThe AIBDKQ has an excellent discriminant ability and internal consistency with a strong correlation when compared to the standard CCKNOW questionnaire.

Measuring Comprehensive, General Health Literacy in the General Adult Population: The Development and Validation of the HLS19-Q12 Instrument in Seventeen Countries.

For improving health literacy (HL) by national and international public health policy, measuring population HL by a comprehensive instrument is needed. A short instrument, the HLS19-Q12 based on the HLS-EU-Q47, was developed, translated, applied, and validated in 17 countries in the WHO European Region. For factorial validity/dimensionality, Cronbach alphas, confirmatory factor analysis (CFA), Rasch model (RM), and Partial Credit Model (PCM) were used. For discriminant validity, correlation analysis, and for concurrent predictive validity, linear regression analysis were carried out. The Cronbach alpha coefficients are above 0.7. The fit indices for the single-factor CFAs indicate a good model fit. Some items show differential item functioning in certain country data sets. The regression analyses demonstrate an association of the HLS19-Q12 score with social determinants and selected consequences of HL. The HLS19-Q12 score correlates sufficiently highly (r ≥ 0.897) with the equivalent score for the HLS19-Q47 long form. The HLS19-Q12, based on a comprehensive understanding of HL, shows acceptable psychometric and validity characteristics for different languages, country contexts, and methods of data collection, and is suitable for measuring HL in general, national, adult populations. There are also indications for further improvement of the instrument.

HLS19-NAV-Validation of a New Instrument Measuring Navigational Health Literacy in Eight European Countries.

To manoeuvre a complex and fragmented health care system, people need sufficient navigational health literacy (NAV-HL). The objective of this study was to validate the HLS19-NAV measurement scale applied in the European Health Literacy Population Survey 2019-2021 (HLS19). From December 2019 to January 2021, data on NAV-HL was collected in eight European countries. The HLS19-NAV was translated into seven languages and successfully applied in and validated for eight countries, where language and survey method differed. The psychometric properties of the scale were assessed using confirmatory factor analysis (CFA) and Rasch modelling. The tested CFA models sufficiently well described the observed correlation structures. In most countries, the NAV-HL data displayed acceptable fit to the unidimensional Rasch partial credit model (PCM). For some countries, some items showed poor data-model fit when tested against the PCM, and some items displayed differential item functioning for selected person factors. The HLS19-NAV demonstrated high internal consistency. To ensure content validity, the HLS19-NAV was developed based on a conceptual framework. As an estimate of discriminant validity, the Pearson correlations between the NAV-HL and general health literacy (GEN-HL) scales were computed. Concurrent predictive validity was estimated by testing whether the HLS19-NAV, like general HL measures, follows a social gradient and whether it forms a predictor of general health status as a health-related outcome of general HL. In some countries, adjustments at the item level may be beneficial.

The Concurrent Predictive Validity of the Intercultural Business Communication Competence Scale

The Concurrent Predictive Validity of the Intercultural Business Communication Competence Scale

The Development and Validation of a Measure to Assess COVID-19 Stress among College Students for Sustainable Education

The impact of the COVID-19 pandemic on students’ personal, academic, and social life has been quite stressful. The threat to life from the virus, social isolation, and the need to shift from face-to-face learning to online mode has been challenging. Thus, the purpose of the present study was to develop and validate a self-administered tool to assess the source of COVID-19 pandemic stress among college students. The data was collected online using google forms in two phases. The data collected from 173 participants from phase one was analyzed using exploratory factor analysis (EFA). The second phase data of 216 participants were analyzed to validate the factor structure using confirmatory factor analysis (CFA). The standardized factor loadings, Composite Reliability (CR), and AVE of factors were assessed to determine the convergent validity of the scale. Similarly, discriminant validity and concurrent predictive validity were assessed through the HTMT ratio of correlations and ROC curves, respectively. A succession of Exploratory Factor Analysis yielded a five-factor solution, explaining 73.83 percent variance with 13 indices. CFA via maximum likelihood with bootstrapping indicated a good fit for the five-factor model (SRMR = 0.037, RMSEA = 0.049, CFI = 0.981). The standardized factor loadings, Composite Reliability (CR), and AVE of factors together suggest acceptable convergent validity. Further, the ROC curve results to assess stress indicated an acceptable AUC, with a magnitude of 0.79, p &lt; 0.01, indicating concurrent predictive validity for the five-factor Student COVID-19 Stress Scale (SCSS). HTMT ratio of correlations &lt;0.85 indicated discriminant validity for the factor structure. The CR &gt; 0.70 for the dimensions indicated acceptable reliability. Thus, the SCSS can be an effective instrument to assess the source of pandemic stress among students so that tailor-made timely interventions can be provided to prevent long-term adverse effects.

Facilitating research on eating disorders stigma: validation of the internalised stigma of mental illness scale for use in people with eating disorders

ABSTRACTStigma internalisation in people with eating disorders is an area of increasing scientific interest. To date, however, no measure of stigma internalisation has been validated for use in people with eating disorders, which may help explain the paucity of research investigating stigma in this population. We conducted a confirmatory factor analysis of the 29-item Internalised Stigma of Mental Illness Scale (ISMI) in a sample of 331 individuals with various eating disorders, and further examined its concurrent predictive validity and convergent validity. The original factor structure of the ISMI indicated poor fit. Five modifications were made; one item was excluded, three items had their factor loadings moved to a different subscale, and the co-variance between two items was modelled. The modified ISMI indicated good fit and exhibited evidence of concurrent predictive validity and convergent validity. The ISMI is valid for use in people with eating disorders with minimal changes to subscale scoring. ...

Intention to Experiment With E-Cigarettes in a Cross-Sectional Survey of Undergraduate University Students in Hungary

ABSTRACTBackground: Electronic cigarettes are often used to promote cessation. Only a few studies have explored the motivations for e-cigarette experimentation among young adults. Objectives: The goals of this study were to assess the intention to try e-cigarettes among Hungarian university students and to develop a motivational scale to measure vulnerability to e-cigarette experimentation. Methods: 826 Hungarian university students completed an internet-based survey in 2013 to measure motives for trying e-cigarettes. We conducted exploratory factor analyses and identified factors that promote and deter experimentation. Logistic regression analysis was performed to test the concurrent predictive validity of the identified motivational factors and we used these factors to predict e-cigarette experimentation, controlling for other known correlates of e-cigarette use. Results: 24.9% of the participants have ever tried an e-cigarette and 17.2% of current nonsmokers experimented with the product. Almost 11% of respondents intended to try an e-cigarette in the future, yet only 0.6% were current e-cigarette users. Six factors were identified in the motivational scale for experimentation, four that promote usage (health benefits/smoking cessation; curiosity/taste variety; perceived social norms; convenience when smoking is prohibited) and two that deter usage (chemical hazard; danger of dependence). In a logistic regression analysis, the curiosity/taste factor was the only motivational factor significantly associated with the intention to try e-cigarettes in the future. Conclusions: This is the first study to test a motivational scale about what motivates e-cigarettes usage among university students. Additional research is needed to better understand these factors and their influence on e-cigarette uptake.

Clarifying the Relational Ties of Organizational Belonging

In order to clarify the roles of relational ties within the perceived organizational membership theoretical framework, we test the discriminant validity and concurrent predictive validity of perceived insider status, psychological ownership, and organizational identification. Hypotheses were tested using confirmatory factor analysis and hierarchical multiple regression for a sample of 347 workers across two industry segments. Results indicate that the constructs of interest each explain unique variance. Perceived insider status and psychological ownership were significant predictors of job satisfaction and turnover intentions, whereas organizational identification was only found to predict job satisfaction. Post hoc analyses indicate that relationship between organizational identification and turnover intentions is fully mediated by perceived insiders status and psychological ownership.

Pain-Related Beliefs Among Chinese Patients with Chronic Pain: The Construct and Concurrent Predictive Validity of the Chinese Version of the Survey of Pain Attitudes-14 (ChSOPA-14)

Context Pain beliefs as indexed by the Survey of Pain Attitudes (SOPA) have been consistently shown to predict pain adjustment outcomes in Western populations. However, its utility in non-Western populations is unclear. Objectives We evaluated the construct and predictive validity of the Chinese version of the 14-item SOPA (ChSOPA-14) in a sample of Chinese patients with chronic pain. Methods A total of 208 Chinese patients with chronic musculoskeletal pain completed the ChSOPA-14, the Chronic Pain Grade questionnaire, the Pain Catastrophizing Scale, the Center for Epidemiological Studies-Depression Scale, and measures of sociodemographic characteristics. Results Except Medical Cure, all ChSOPA-14 scales were significantly correlated with validity criterion measures (all P < 0.05) in expected directions. The present Chinese sample scored the highest on the Medical Cure scale (mean = 2.98, standard deviation [SD] = 1.05) but the lowest on the Disability scale (mean = 1.75, SD = 1.67). Results of hierarchical multiple regression analyses showed that the ChSOPA-14 scales predicted concurrent depression ( F(7,177) = 14.51, P < 0.001) and pain disability ( F(7,180) = 8.77, P < 0.001). Pain Control (std β [standardized beta coefficient] = −0.13; 95% confidence interval [CI]: −3.41, −0.13; P < 0.05) and Emotion (std β = 29; 95% CI: 1.76, 5.02; P < 0.001) emerged as significant independent predictors of concurrent depression whereas Disability (std β = 0.19; 95% CI: 1.33, 7.88; P < 0.01), Emotion (std β = 16; 95% CI: 0.08, 7.59; P < 0.05), and Solicitude (std β = −0.14; 95% CI: −7.05, −0.04; P < 0.05) significantly associated with concurrent disability. Conclusion The findings offer preliminary evidence for the construct and concurrent predictive validity of the ChSOPA-14. This makes available a suitable instrument for chronic pain in the Chinese population and will facilitate future cross-cultural research on pain beliefs.

I often do it vs. I like doing it: Comparing a frequency- and valency-approach to extraversion

The phrasing of many personality questionnaire items is often seemingly done without systematic considerations regarding item and response format which may deteriorate data quality. Psychometric properties of two widely used item formats, a Behavior Frequency Approach (BFA: “How often is the behavior enacted?”) vs. a Behavior Valency Approach (BVA: “How much is the behavior enjoyed?”), are compared with two extraversion scales tailored to the approaches. We investigated in three studies (Study 1: N = 215; Study 2: N = 60; Study 3: nfrequency = 150, nvalency = 141) convergent/discriminant validity with NEO-PI-R, NEO-FFI, and BFI-S Extraversion and concurrent predictive validity with self-reported criteria. The BFA consistently demonstrated an advantage vis-à-vis the BVA. Implications are discussed.

Screening for major depression in persons with HIV infection: the concurrent predictive validity of the Profile of Mood States Depression-Dejection Scale

Major Depressive Disorder (MDD) is among the most prevalent but underdiagnosed psychiatric disorders in persons with HIV infection. Given the known adverse impact of comorbid MDD on HIV disease progression and health-related quality of life, it is important both for research and for efficient, effective clinical care, to validate existing screening measures that may discriminate between MDD and the somatic symptoms of HIV (such as fatigue). In the current study, we evaluated the concurrent predictive validity of the Profile of Mood States (POMS) Depression-Dejection scale in detecting current MDD in 310 persons with HIV infection. The Structured Clinical Interview for DSM-IV (SCID) diagnosis of MDD and the Cognitive-Affective scale from the Beck Depression Inventory (BDI-CA) served as comparative diagnostic and severity measures of depression, respectively. Results demonstrated that the POMS Depression-Dejection scale accurately classified persons with and without MDD SCID diagnoses, with an overall hit rate of 80%, sensitivity of 55%, specificity of 84%, and negative predictive power of 91% using a recommended cutpoint of 1.5 standard deviations above the normative mean. Moreover, the POMS performed comparably to the BDI-CA in classifying MDD. Findings support the predictive validity of the POMS Depression-Dejection scale as a screening instrument for MDD in persons with HIV disease.

Development and Validation of a Measure of Display Rule Knowledge: The Display Rule Assessment Inventory.

As one component of emotion regulation, display rules, which reflect the regulation of expressive behavior, have been the topic of many studies. Despite their theoretical and empirical importance, however, to date there is no measure of display rules that assesses a full range of behavioral responses that are theoretically possible when emotion is elicited. This article reports the development of a new measure of display rules that surveys 5 expressive modes: expression, deamplification, amplification, qualification, and masking. Two studies provide evidence for its internal and temporal reliability and for its content, convergent, discriminant, external, and concurrent predictive validity. Additionally, Study 1, involving American, Russian, and Japanese participants, demonstrated predictable cultural differences on each of the expressive modes.

The Child Abuse Potential Inventory: Cross-Validation in Croatia

The aim of this study was to cross-validate the Child Abuse Potential Inventory by Milner in Croatia. The inventory was translated and administered to 59 parents reported to centres of social work for child abuse or neglect and to a sample of 383 in the general population of parents. Data on sociodemographic variables and socioenvironmental stressors on the family were also collected. A significant difference in scores on the inventory's Abuse Scale between groups of parents was found. Discriminant analysis indicated an over-all correct classification rate for the Abuse Scale of 87.59%. The coefficient of internal consistency for the Abuse Scale for all respondents was 0.91. Results were interpreted as supportive of concurrent predictive validity in the Croatian sociocultural context.

A Preliminary Validation of a Nutritional Risk Measure for the Elderly

We used data from a two-stage random sample of 401 noninstitutionalized elderly individuals residing in 18 census tracts in south-central metropolitan St. Louis to establish the reliability and validity of a 16-item nutritional risk measure. Reliability analysis yielded a Cronbach's alpha of 0.603. Concurrent predictive validity was demonstrated by the prediction of physician, emergency room, and hospital use. Individuals with high scores displayed a consistent pattern of higher rates of known nutrition-related problems and their sequelae than did those with low scores, providing evidence of known groups validity. Statistical correlations with components of an established theoretical model of the elderly's health and illness behavior demonstrate preliminary support for construct validity. The advantages of our nutritional risk measure include its ease of administration and telephone portability.