Measures Of Psychological Constructs Research Articles

Measurement of psychological constructs in military populations and settings

Measurement of psychological constructs in military populations and settings

Using IRTree Models to Promote Selection Validity in the Presence of Extreme Response Styles.

The measurement of psychological constructs is frequently based on self-report tests, which often have Likert-type items rated from "Strongly Disagree" to "Strongly Agree". Recently, a family of item response theory (IRT) models called IRTree models have emerged that can parse out content traits (e.g., personality traits) from noise traits (e.g., response styles). In this study, we compare the selection validity and adverse impact consequences of noise traits on selection when scores are estimated using a generalized partial credit model (GPCM) or an IRTree model. First, we present a simulation which demonstrates that when noise traits do exist, the selection decisions made based on the IRTree model estimated scores have higher accuracy rates and have less instances of adverse impact based on extreme response style group membership when compared to the GPCM. Both models performed similarly when there was no influence of noise traits on the responses. Second, we present an application using data collected from the Open-Source Psychometrics Project Fisher Temperament Inventory dataset. We found that the IRTree model had a better fit, but a high agreement rate between the model decisions resulted in virtually identical impact ratios between the models. We offer considerations for applications of the IRTree model and future directions for research.

Psychometric properties of the Flourishing Scale for South African first-year students

This study focused on a positive construct of well-being, namely flourishing. In a multicultural and diverse country such as South Africa, it is a legal requirement to provide evidence that measures of psychological constructs, like flourishing, are fair, unbiased, and equivalent for diverse groups in the country. The aim was to test the psychometric properties of the Flourishing Scale, a purpose-made scale that measures positive functioning across various areas of life. This study tested the factorial validity, item bias, measurement invariance and reliability of the Flourishing Scale in a sample of 1088 South African first-year university students. A unidimensional structure was confirmed. Although three items showed statistically significant uniform and total bias for language and campus groups, the magnitude and practical impact were negligible. No evidence of bias across gender groups was found. Configural, metric and partial scalar invariance were established for language and campus groups. Full measurement invariance was established across gender groups. Cronbach’s alpha coefficient was 0.91, indicating high reliability. The study provided promising results for using the Flourishing Scale among South African university students to measure flourishing as an aspect of well-being.Contribution: This study contributes to the field of student well-being in South Africa. No studies could be found that test for item bias or measurement invariance of the Flourishing Scale, specifically for South African first-year students. This study is the first to test these psychometric properties of a Flourishing Scale in a multicultural setting for students from different languages.

The Questionable Practice of Partialing to Refine Scores on and Inferences About Measures of Psychological Constructs.

Partialing is a statistical approach researchers use with the goal of removing extraneous variance from a variable before examining its association with other variables. Controlling for confounds through analysis of covariance or multiple regression analysis and residualizing variables for use in subsequent analyses are common approaches to partialing in clinical research. Despite its intuitive appeal, partialing is fraught with undesirable consequences when predictors are correlated. After describing effects of partialing on variables, we review analytic approaches commonly used in clinical research to make inferences about the nature and effects of partialed variables. We then use two simulations to show how partialing can distort variables and their relations with other variables. Having concluded that, with rare exception, partialing is ill-advised, we offer recommendations for reducing or eliminating problematic uses of partialing. We conclude that the best alternative to partialing is to define and measure constructs so that it is not needed.

The psychometric properties and gender invariance of the Italian version of the Perceived Vulnerability to Disease Questionnaire (I-PVDQ) during the COVID-19 pandemic

BackgroundThe Perceived Vulnerability to Disease Questionnaire (PVDQ) measures beliefs associated with personal susceptibility to infectious diseases and behaviors or perceptions in the presence of potential risk of pathogen transmission. Given the onset of the Severe Acute Respiratory Syndrome Coronavirus 2 global pandemic, otherwise known as the COVID-19 pandemic, the construct being measured may function differently based on affective, behavioral, and cognitive changes along with the need to change norms and lifestyles in a global context. The present study aims to test the psychometric properties and the gender invariance of the Italian adaptation of the PVDQ to confirm that the scale can be used with Italian-speaking people, and that it functions effectively during a pandemic.MethodsA total of 509 participants filled out an online questionnaire including the Italian version of the I-PVDQ (I-PVDQ) and several measures of psychological constructs. Reliability and factor analyses (single and multigroup) were conducted. Bayesian correlation tests and Bayesian independent sample t-tests were used to assess the validity of I-PVDQ.ResultsExploratory factor analysis supported the two-factor structure of the I-PVDQ, and factor loadings loaded appropriately onto perceived infectability (PI) and germ aversion (GA). In terms of invariance, the scale showed configural, metric, scalar, and strict invariance across genders. Decisive evidence in favor of correlation with the measure of COVID-19 related fears for both PI and GA was found. There was strong evidence for observed correlations with COVID-19 related constructs such as intolerance to uncertainty, psychological inflexibility, resilience, stress, and anxiety. Women showed higher GA than men, while there were no gender differences in PI.ConclusionsTaken together, these results suggest that the I-PVDQ confirms the psychometric properties of the original version and that can be used to detect PVD when it is affected by environmental circumstances since its functioning is preserved during a pandemic.

Improving Scale Equivalence by Increasing Access to Scale-Specific Information

Measures of the same phenomenon should produce the same results; this principle is fundamental because it allows for replication—the basis of science. Unfortunately, measures of a psychological construct in one language can often measure something a bit different in another language (i.e., low “scale equivalence”). Historically, the problem was thought to stem from insufficient knowledge of best-practice translation procedures. Yet solutions based on this diagnosis and their widespread adoption have not resolved the issue. In this article, we suggest that an additional problem might be insufficient information about the measure being translated. If so, low scale equivalence is a problem that translators and cross-cultural psychologists cannot solve on their own. We explore the possibility that measure-specific translation guides be created by original scale builders for the most widely used measures of important psychological constructs. We describe why such guides are needed, when they are needed, what they might look like, their feasibility, and next steps, providing a complete example guide and test case in a supplement concerning the Primals Inventory. In this article, we seek to spark discussion on translation practices happening behind the scenes and how greater transparency can improve scale equivalence, in the spirit of open science.

Explaining hydrogen energy technology acceptance: A critical review

The use of hydrogen energy and the associated technologies is expected to increase in the coming years. The success of hydrogen energy technology (HET) is, however, dependent on public acceptance of the technology. Developing this new industry in a socially responsible way will require an understanding of the psychology factors that may facilitate or impede its public acceptance. This paper reviews 27 quantitative studies that have explored the relationship between psychological factors and HET acceptance. The findings from the review suggest that the perceived effects of the technology (i.e., the perceived benefits, costs and risks), and the associated emotions, are strong drivers of HET acceptance. This paper does, though, highlight some limitations with past research that make it difficult to make strong conclusions about the factors that influence HET acceptance. The review also reveals that few studies have investigated acceptance of different types of HET beyond a couple of applications. The paper ends with a discussion about directions for future research and highlights some practical implications for messaging and policy. • Perceived effects, and associated emotions, are strong predictors of acceptance. • Unclear what context-specific beliefs underpin attitudes towards hydrogen. • Most studies focused on acceptance of hydrogen fuel stations and hydrogen cars. • A dearth of research investigating acceptance of the whole hydrogen value chain. • Identified inconsistencies in the measurement of psychological constructs.

Using LIWC to Analyze Participants' Psychological Processing in Accounting JDM Research

SUMMARY This paper provides methodological guidance for judgment and decision-making (JDM) researchers in accounting who are interested in using the Linguistic Inquiry and Word Count (LIWC) text analysis program to analyze research participants' written responses to open-ended questions. We discuss how LIWC's measures of psychological constructs were developed and validated in psycholinguistic research. We then use data from an audit JDM study to illustrate the use of LIWC to guide researchers in identifying suitable measures, performing quality control procedures, and reporting the analysis. We also discuss research design considerations that will strengthen the inferences drawn from LIWC analysis. The paper concludes with examples where LIWC analysis has the potential to reveal participants' deep, complex, effortful psychological processing and affective states from their written responses.

Psychometric assessment of the Swedish version of the injustice experience questionnaire among patients with chronic pain.

The use of the Injustice Experience Questionnaire (IEQ) in psychological assessment of individuals with chronic pain is supported by research. The psychometric properties of the Swedish version, the IEQ-S, has not yet been evaluated. Hence, the aim was to investigate structural validity, and concurrent criterion validity of the IEQ-S against the Work Ability Index (WAI), the Pain Catastrophizing Scale (PCS-SW), the Patient Health Questionnaire 9-item depression module (PHQ-9), and the Generalized anxiety disorder 7-item scale (GAD-7). Internal consistency and test-retest reliability were also studied. Sixty-five participants, referred to a University hospital, with a pain duration over three months were consecutively sampled. They completed the IEQ-S at admission and again within six weeks. A confirmatory factor analysis was performed for the study of structural validity. Concurrent criterion validity was evaluated using Spearman's correlation coefficient. Internal consistency reliability for the full IEQ-S was calculated using the Cronbach's alpha. Test-retest reliability was calculated using an Intraclass Correlation Coefficient (ICC). The median total score (0-48, where high scores indicate high levels of injustice) at admission (test 1) was 27.0 (n=64), 25th percentile=15.3, 75th percentile=37.8, range=3-48 points. A one-factor model was supported with item-loadings between 0.67-0.92. Spearman's correlation coefficient between the IEQ-S and the WAI (n=56) was rS =-0.46; the PCS-SW (n=63) was rS =0.68, the PHQ-9 (n=64) was rS =0.50 and the GAD-7 (n=64) was rS =0.57, p<0.01. Cronbach's alpha was 0.94 (n=64). The ICC was 0.80 (n=55), with a 95% confidence interval, ranging between 0.69-0.88. Our study supported structural validity and concurrent criterion validity of the IEQ-S against other measures of psychological constructs and work ability. It also supported the internal consistency reliability of the IEQ-S and the test-retest reliability with a retest interval up to six weeks, was good. These findings support the use of the IEQ-S as an adjunct tool to assess appraisals of injustice in patients with chronic pain who are referred to tertiary care in Sweden. The added value might be identification of those who are at risk for slow or no improvement in their pain condition over time, and sick-leave, but this has to be confirmed in future studies. EPN Uppsala D-No 2016-376.

Validation of the Mental Toughness Measure of Athletes and Non-athletes with the Structural Equation Model

The use of structural equation models (SEM) in scientific research perform a promising methodological and empirical direction to validate the measurement of psychological constructs. The aim of this paper is to validate the measurement of mental toughness of athletes and non-athletes with SEM. The sample consisted of 853 Tunisian participants (444 males and 409 females; 409 athletes and 444 non-athletes), aged 14 to 27 years (M=20.38 SD=4.12). The sample completed the Arabic translated questionnaire of Clough, Earle [1] which measures six components of their mental toughness. The SEM approved a good model fit (χ²=1146.33; df =1065; CFI=.93; SRMR=.063; RMSEA=.009) which allows for a valid Arabic-speaking measure of the six components of mental toughness.

Direct versus Indirect Well-Being Measures: Using Partially Structured Stimuli to Evaluate Well-Being

Given the important limitations of direct (explicit) measures, the study of indirect (implicit) measures of psychological constructs has received increased attention of social researchers. However, in the field of well-being the measures that have traditionally been used have tried to capture people’s well-being in an explicit and direct way, with some exceptions that are based mainly on adaptations of the Implicit Association Test (IAT). Given the critics that the IAT has received, the first aim of the present research was to develop a new life satisfaction measure using partially structured stimuli (PSWBS). The second goal was to examine the relation between direct and indirect well-being measures. In the first study, PSWBS showed good internal consistency, test–retest reliability and construct validity. Factorial analyses indicated that this measure acted as an indirect measure. In addition, direct and indirect well-being showed a significant but weak relation. To explain this result, in a second study we analyzed the moderating role of social comparison orientation on the relation between direct and indirect well-being measures. As expected, more social comparison tendency implied a stronger relation. In a third study we analyzed the criterion validity of both kind of measures. The PSWBS, the Personal Wellbeing Index-Adults and the Satisfaction With Life Scale significantly correlated with a criterion validity coefficient in terms of a semi-structured interview made by an external experimenter. Finally, in a fourth experiment we analyzed the influence of social desirability on direct and indirect measures of well-being. In contexts of high desirability, partially structured stimuli seemed to be more resistant to response factors (e.g., control of impressions) than traditional direct measures.

Measurement of Psychological Constructs in Military Populations and Settings

"Measurement of Psychological Constructs in Military Populations and Settings." Military Psychology, 32(4), pp. 377–378

Measuring Dispositional Optimism in Large-Scale Studies

Abstract. In different fields of the behavioral sciences, a growing demand for brief measures of psychological constructs can be observed. The current research presents new evidence on the reliability and validity of a recently developed ultra-short measure of the optimism construct sensu Scheier and Carver (1985) , the German version of the Scale Optimism-Pessimism-2 (SOP2) as well as first evidence on Spanish and Italian adaptations. Reliability estimates indicate good reliability. Correlations with criteria from the nomological net of the construct are as expected. Equivalence of SOP2 factors across language versions is supported. Due to its highly efficient, yet accurate and valid measurement of the construct, the SOP2 is strongly recommended for assessment settings with severe monetary/time constraints, for example, large-scale surveys. Due to the factor equivalence, the SOP2 is also a valuable measure for cross-cultural studies.

PHS77 - Development and Validation of Psychological Intervention Guideline for Patients Diagnosed with Non-Communicable Chronic Diseases

Managing Non-communicable Chronic Diseases (NCDs) involves important challenges for health systems especially in developing countries, due to the demand of comprehensive healthcare programmes, aimed to reduce the gradual deterioration, the symptom severity and the economic impact at the family and the state level. The objective of the study was to develop an evidence-based guideline for psychological intervention to support the work of clinical and health psychologists, as part of a comprehensive care of patients diagnosed with NCDs. A systematic review was performed, and recommendations based on empirical evidence about psychological interventions to approach the psychological and social factors of the disease of patients diagnosed with NCDs were proposed. The inclusion of such recommendations in the guideline was achieved through meetings of informal consensus with group members. The experts and patients suggestions were also considered in the process. The evidence-based recommendations were scored according to the Scottish Intercollegiate Guidelines Network (SIGN) standards. Scientific evidence provided the following main topics related to psychological intervention on NCDs: (1) health education; (2) managing of anxiety/depression; (3) health-related quality of life; (4) adherence and compliance; and (5) self-efficacy and self-control. In addition, recommendations about psychometric instruments or tests for evaluation and measurement of psychological constructs were considered. This guideline is ready to start a validation processes and its implementation in a clinical setting. The clinical and medical psychology practice guideline is the first step to stablish an evidence-based compendium of recommendations to optimize the health outcomes in patients diagnosed with NCDs and our intention is to include this guideline as part of comprehensive health care programmes highlighting the psychological and psychosocial interventions as the main line of action for patients’ health improvement.

Answering the call for construct orientation: Developing a situational judgment test of achievement motivation

Situational judgment tests (SJTs) have been shown to display incremental validity over and above intelligence and personality traits when it comes to predict job performance. Thus, they appear as a promising method of assessing occupational aptitude. However, the best design of SJTs is far from being agreed upon. Additionally, it has been repeatedly criticized that the development of SJTs often does not aim at the measurement of psychological constructs. These aspects preclude conclusions about the generalizability of SJTs as well as investigating their explanatory power. This contribution summarizes the different approaches how SJTs have been constructed and relevant practical implications. Advisable stages of development are exemplified by describing the construction of a SJT of achievement motivation (SJT-AM) of unemployed clients. The SJT-AM accounts for the variety of construction principles and also allows for testing different scoring methods. Preliminary results will be reported and discussed.

Depression and life satisfaction among European and Confucian adolescents.

The purpose of this study was to compare adolescents from Europe and Confucian Asia on measures of psychological constructs that reflect either maladjustment or positive outlook on life. Empirical findings are reported based on N = 7,167 secondary school students (15 years old) from Confucian Asia (Hong Kong, Singapore, South Korea, and Taiwan) and from Europe (Denmark, Finland, Netherlands, Serbia, and Latvia with 2 nationalities-Latvian and Russian). Participants' responses were used to assess several aspects of personality and psychopathology, in addition to well-being, social attitudes, and parental styles. Exploratory factor analysis of these measures produced 4 factors: Depression, Life Satisfaction, Toughness and Modesty. Adolescents from Confucian countries show higher levels of Depression and lower levels of Life Satisfaction in comparison to their European counterparts. The most potent influences on Depression and Life Satisfaction were found to be Toughness and Parental Warmth variables, both of which are, in turn, linked to differences between regions/cultures.

Using the GLIMMIX Procedure in SAS 9.3 to Fit a Standard Dichotomous Rasch and Hierarchical 1-PL IRT Model

Although Rasch models have been shown to be a sound methodological approach to develop and validate measures of psychological constructs for more than 50 years, they remain underutilized in psychology and other social sciences. Until recently, one reason for this underutilization was the lack of syntactically simple procedures to fit Rasch and item response theory (IRT) models in general statistical software packages. In this article, the authors demonstrate how to fit the standard dichotomous Rasch model and a dichotomous one-parameter logistic IRT model with nested random effects via the easy-to-use GLIMMIX procedure in SAS 9.3. For comparison purposes, the standard dichotomous Rasch model was also fit using the Rasch specialized software, WINSTEPS 3.68.2. The SAS code used to simulate the data on which the Rasch model was fit is provided to allow replication of estimates. Findings suggest that the GLIMMIX procedure may be a viable option for fitting the standard dichotomous Rasch and dichotomous IRT models.

One is Enough

The Dynamic Analog Scale (DAS)—a generic and flexible technique for creating single-item measures of psychological constructs—comprises detailed definitions and a continuous analog scale on which self and others are rated simultaneously. Using five experimental conditions, the authors investigated the psychometric properties of the DAS as well as the impact of different social contexts and modified Big Five trait definitions on participant ratings and their relationships to measures of volunteerism, religiosity, affect, and alcohol consumption. Results revealed few differences across conditions, and reliability coefficients and predictive validity estimates were similar to those typically obtained using standard, multiple-item questionnaires. The DAS is therefore supported as a consistent and efficacious method for measuring personality traits with single items.

Confirmatory Analysis of the Bradburn Affect Balance Scale and its Relationship with Morale in Older Canadian Adults

The measurement of psychological constructs depends upon clear definitions and demonstrated relationships among items, scales, and relevant theories. In this study, we examined these relationships for the measurement of affect as reflected in the popular Bradburn Affect Balance Scale (ABS). Results of confirmatory analyses of data from 187 older Canadian adults (Mean age, 69.7 years) showed that a two-dimensional structure fitted the item data much better than the unidimensional, bipolar model suggested by the original scoring key. The two dimensions showed parallel patterns of correlations with two measures of morale and with a measure of social desirability, but these patterns differed from that of the conventional unidimensional ABS score. Results suggested that the ABS should be used with caution and with scoring for two distinguishable dimensions.

Construct Validity: Advances in Theory and Methodology

Measures of psychological constructs are validated by testing whether they relate to measures of other constructs as specified by theory. Each test of relations between measures reflects on the validity of both the measures and the theory driving the test. Construct validation concerns the simultaneous process of measure and theory validation. In this article, we review the recent history of validation efforts in clinical psychological science that has led to this perspective, and we review the following recent advances in validation theory and methodology of importance for clinical researchers. These are: the emergence of nonjustificationist philosophy of science; an increasing appreciation for theory and the need for informative tests of construct validity; valid construct representation in experimental psychopathology; the need to avoid representing multidimensional constructs with a single score; and the emergence of effective new statistical tools for the evaluation of convergent and discriminant validity.