Cross-national Validity Research Articles

Measurement invariance across countries of the Test of Memory Strategies (TMS): A contribution to the cross-national validity study

Previous literature showed a complex interpretation of recall tasks due to the complex relationship between Executive Functions (EF) and Long Term Memory (M). The Test of Memory Strategies (TMS) could be useful for assessing this issue, because it evaluates EF and M simultaneously. This study aims to explore the validity of the TMS structure, comparing the models proposed by Vaccaro et al. (2022) and evaluating the measurement invariance according to three countries (Italy, Spain, and Portugal) through Confirmatory Factor Analysis (CFA). Four hundred thirty-one healthy subjects (Age mean = 54.84, sd = 20.43; Education mean = 8.85, sd =4.05; M = 177, F = 259) were recruited in three countries (Italy, Spain, and Portugal).Measurement invariance across three country groups was evaluated through Structural Equation modeling. Also, convergent and divergent validity were examined through the correlation between TMS and classical neuropsychological tests. CFA outcomes suggested that the best model was the three-dimensional model, in which list 1 and list2 reflect EF, list 3 reflects a mixed factor of EF and M (EFM) and list4 and list5 reflect M. This result is in line with the theory that TMS decreases EF components progressively. TMS was metric invariant to the country, but scalar invariance was not tenable. Finally, the factor scores of TMS showed convergent validity with the classical neuropsychological tests.The overall results support cross-validation of TMS in the three countries considered.

How safe are we? Introducing the multidimensional model of perceived personal safety

Investigations of individual differences in how safe people feel in their social lives have typically used single-item measures or indirect measures. To examine the multifaceted nature of perceived personal safety more comprehensively, we introduce a novel measurement model of perceived personal safety, validated over the course of 8 studies (5 main and 3 supplementary studies; total N = 4390). Three distinct factors capturing variance in perceived personal safety emerged, Feeling of Safety (i.e., experiencing security in day-to-day life), Fear of Crime (i.e., being afraid of victimization), and Safety Confidence (i.e., trusting one's own ability to remain safe). Studies 1–3 introduce a newly developed multidimensional model, providing evidence for its face and construct validity. Studies 4 A-4B suggest that the feeling of safety facet specifically relate to better mental health outcomes, even across the span of one year. Study 5 explored the cross-national validity of this model across four different European countries. Contrary to past conceptualizations, perceived personal safety appears to be multidimensional, with different facets affecting our lives in distinct ways.

Populism, Economic Distress, Cultural Backlash, and Identity Threat: Integrating Patterns and Testing Cross-National Validity.

Populism is on the rise across liberal democracies. The sociopsychological underpinnings of this increasing endorsement of populist ideology should be uncovered. In an online cross-sectional survey study among adult samples from five countries (Chile, France, Italy, Romania, and the United Kingdom; N = 9,105), we aimed to replicate an economic distress pattern in which relative deprivation and identity threat are associated with populism. We further tested a cultural backlash pattern-including perceived anomie, collective narcissism, and identity threat as predictors of populism. Multigroup structural equation models supported both economic distress and cultural backlash paths as predictors of populist thin ideology endorsement. In both paths, identity threat to belonging played a significant role as partial mediator. Furthermore, an integrative model showed that the two patterns were not mutually exclusive. These findings emphasize the implication of identity threat to belonging as an explanatory mediator and demonstrate the cross-national generalizability of these patterns.

Measuring individual differences in active smelling to evaluate products – The ENFAS-Instrument

Consumers evaluate products with all their senses but exhibit considerable variability in the extent to which they actively use and rely on a specific sense. We know little about the variability in consumers’ propensity to actively engage their sense of smell in the context of product evaluation in purchase decision making. This research provides insights into this issue by conceptualizing the need for smell construct, detailing the development of the ENFAS scale, and providing state-of-the-art psychometric evidence of its validity. Ten studies contributed to a two-dimensional 11-item instrument, supporting the scale’s external and cross-national validity, and establishing the position of need for smell in its nomological net. The results yield insight into how smell perception affects consumer choices and may help optimize product presentations for the retail context.

Opportunities and barriers of creating healthy living environments – a Delphi Study

Abstract Comprehensive intersectoral and participatory strategies are required for successful implementation and functioning of local health promotion governance across Europe. 12 experts from 7 European countries took part in the two-stage online Delphi survey. 22 theses on key topics of municipal health promotion, prepared in a participatory process through interviews and a workshop with experts, were rated on a 10-point Likert scale (strongly disagree - strongly agree), and the confidence in answering and comments was queried. This procedure was repeated in the 2nd round. The response behaviour of the participants from the 1st round was made transparent to enable changes in opinion. In the quantitative analysis, the distribution of thesis rating was determined. The extent of consensus building was determined by comparing standard deviations. The comments were evaluated and summarized by content analysis. The outcome of the Delphi survey represents consensus-generated recommendations for the creation of healthy living environments in the municipal context. Consensus was reached on most of the theses. The experts agree on the need for an open structure of networks (mean 9.2; SD 0.6), a common vision in these networks (mean 8.3; SD 0.8), the resources required for organizing participatory processes (mean 9.5; SD 0.9) and the responsibility of all political areas for implementing an overall municipal strategy (mean 9.1; SD 0.8). The qualitative analysis provides indications that certain theses are assessed differently due to country-specific experiences and conditions. The results of the Delphi study provide a clear direction for generating recommendations. Depending on context and country, some contents are evaluated differently, which should be taken into account for the recommendations. In total, the study identified recommendations with cross-national validity that are beneficial for the creation of health promoting structures at local level.

Problems of cross-cultural criminology no more! Testing two central tenets of Self-Control Theory across 28 nations

PurposeThe current investigation tested two tenets from self-control theory regarding its cross-national validity and applicability, namely the extent to which (1) parenting behaviors (closeness and monitoring) were associated with low self-control, and (2) the extent to which opportunities (two competing operationalizations: routine activities or peer deviance) and low self-control independently (and synergistically) predicted deviant behaviors. MethodsData were collected as part of the Second International Self-Report Delinquency Study (ISRD-2) from 28 cultures, from seventh, eighth, and ninth grade adolescents (N = 66,859), and analyzed using hierarchical linear modeling. Country level variables included years in school, size of the prison population, unemployment rate, and life expectancy. Results(1) Low self-control significantly varied at both the individual- and country-levels; both closeness and monitoring negatively predicted low self-control. At the country level, more years in school and a greater prison population were positively associated with low self-control, while life expectancy was negatively associated. (2) Deviance significantly varied at the individual and country levels. Low self-control and opportunities (peer deviance and routine activities) uniquely explained variance in deviance. ConclusionsFindings provide support for the cross-cultural application of self-control theory.

The structure of foreign policy attitudes among middle power publics: a transpacific replication

ABSTRACT Empirical models illustrating how mass publics organise their views on foreign policy issues abound. Models that posit militant internationalism and cooperative internationalism as the two factors structuring mass foreign policy attitudes and that typically rely on American survey data have given way to models positing a larger number of underlying factors supported by cross-national survey data. Still, there are few studies assessing the cross-national validity of multi-factor models. Further, middle power states that must navigate between international leadership and followership remain understudied. This article draws on new survey data from Canada and Australia—two archetypal middle power states—to replicate a recent and influential model of foreign policy attitudes comprised of four factors: cooperative internationalism, militant internationalism, isolationism, and support for global justice. Using an exploratory structural equation modelling (ESEM) framework, it finds that the four-factor structure of foreign policy attitudes observed in the United States, United Kingdom, France and Germany obtains among the Canadian and Australian publics, yet there are country-specific nuances that suggest differences in the ways Canadians and Australians perceive foreign policy options.

An integrative review of SHRM research in South Korea: current status and future directions

PurposeThe purpose of this study is to determine the current status of strategic human resource management (SHRM) research in the context of Korea as well as to provide specific recommendations for future research.Design/methodology/approachAn integrative literature review was performed to aggregate a body of studies in the Korean context. In total, 39 articles were carefully selected for inclusion in the present review.FindingsThe review demonstrated that prior studies conducted in Korea have examined whether the established relationship between strategic human resource (HR) practices and organizational outcomes has cross-national validity in Korean contexts, the extent to which the established relationship is moderated by contextual factors, as well as whether a combination of strategic HR practices and the congruence of HR practices with other organizational factors affect organizational outcomes. In addition, the review revealed four unique methodological characteristics of Korea-based studies, namely, the extensive use of self-reported questionnaires, personnel in managerial positions serving as the main sources of primary data, secondary data collected by Korean government research bodies being actively dealt with and an awareness of the necessity of a longitudinal design for causal research.Originality/valueThe present review makes an important contribution to the study of SHRM in general and the strategic human resources management model in Korea in particular. It is clear that more research is required, although it is encouraging to note the quality of prior research concerning Korean contexts and the specific mechanisms by which strategic HR practices influence organizational outcomes. Finally, there is a clear need for future research that explicitly considers employees' perceptions of strategic HR practices and specific contextual factors in Korea, and further, that utilizes more rigorous and diverse research methods to investigate the effectiveness of strategic HR practices in Korea.

Fear of Online Consumer Identity Theft: Cross-Country Application and Short Scale Development

The growing internationalization of electronic commerce demands the establishment of the cross-national validity of theoretical concepts. An important concept in e-commerce is consumers’ fear of online identity theft (FOIT), which impedes consumers’ willingness to engage in online transactions and can negatively affect e-commerce revenues. The present study validates the consumer FOIT scale developed in Germany by Hille et al. (2015) in a cross-cultural setting and proposes an abbreviated version of the scale, which is approximately 35% shorter than the original. Established validation procedures with samples of online consumers from Germany, the United States, and Japan demonstrate the reliability, validity, and cross-national applicability of the short FOIT scale. In particular, this study extends Hille et al. (2015) research by examining and revealing the impact of FOIT on consumers’ prevention-focused responses. This research offers implications for both research and e-commerce managers.

An Empirical Comparison of Seven Populist Attitudes Scales

With the recent upsurge of populism in developed and transition democracies, researchers have started measuring it as an attitude. Several scales have been proposed for this purpose. However, there is little direct comparison between the available alternatives. Scholars who wish to measure populist attitudes have little information available to help select the best scale for their purposes. In this article, we directly compare seven populist attitudes scales from multiple perspectives: conceptual development, questionnaire design, dimensionality, information, cross-national validity, and external validity. We use original survey data collected online from nine countries in Europe and the Americas, with around 250 participants per country, in which all seven batteries of questions were present. Results show that most scales have important methodological and validity limitations in at least one of the dimensions tested, and should not be used for cross-national comparative research. We recommend populist attitudes items that work better at capturing populism, and more generally provide guidelines for researchers who want to compare different scales that supposedly measure the same construct.

Construct Equivalence of Left-Right Scale Placement in a Cross-National Perspective

Equivalence in survey design and implementation is a core issue in cross-national research. Construct equivalence deals with the validity of concepts measured by survey questions and is a prerequisite for meaningful cross-national analyses. Since respondents are socialized in different cultures and political systems, their interpretation of concepts in the same way cannot be taken for granted. This study is about the construct equivalence of the left-right scale from a cross-national perspective. The left-right scale is a standard survey question used to measure ideological orientation in a minimalist way. However, ideological orientation may be measured in different dimensions from cross-national perspective, and thus, the conceptual understanding of the left-right scale as an indicator of the left-right dimension may differ across countries, which may challenge the comparability and the cross-national validity of the left-right scale. To test the understanding of left and right, we asked about individual associations by using probe questions in a cross-national survey. We checked for nonresponse and shared and country-specific explanations of left and right. Our results show that respondents from different countries or with different political orientations do not have the same ideas about left and right. For leftist respondents, shared explanations of left are more relevant, whereas for rightists, country-specific interpretations of right are more influential. These results challenge the cross-national usability of the left-right scale, and so conclusions based on this scale may not be comparable.

News audience fragmentation in the Japanese Twittersphere

ABSTRACTAlthough computational approaches to ideology-based audience fragmentation are promising, they are not without limitations. First, most existing studies have focused on the US, and the cross-national validity of their results has rarely been tested. Second, previous studies that rely solely on behavioral data from social media tend to make strong analytical assumptions such as that Twitter users prefer to follow media and politicians whose ideological positions are similar to their own, and that the ideologies of political elites can be extrapolated to infer the ideologies of ordinary users. We aim to address these limitations. First, we focus on Japan to test the generalizability of US findings in an Asian context. Second, we do not rely solely on behavioral measurement but combine survey and social media data to infer the ideologies of Twitter users. Results indicate that our classifier built based on these self-reported ideologies produces more valid estimates than naïve extrapolation from views of the elites. Based on these improved estimates of Twitter users’ ideologies, we demonstrate that the ideological distributions of those who follow major Japanese media accounts on Twitter largely overlap, suggesting an absence of ideology-based audience fragmentation.

Cross-national validity of the Beck Hopelessness Scale for children and adolescents: findings from the YouthSave-Impact Study Kenya

A sense of hopelessness is common but under-identified among poor children in sub-Saharan Africa (SSA). Given the concomitant inadequate screening, assessment, and a lack of culturally and developmentally appropriate measures in much of SSA, identifying reliable and valid measures of hopelessness is needed. One promising candidate, the Beck Hopelessness Scale (BHS), has undergone limited evaluation in the region and none with non-adult populations. The present study assesses the psychometric properties of the BHS using data from a diverse sample of 3965 school-going youth (M = 12.2, SD = 1.1) in Kenya. Given inconclusive results from model comparisons of previously established factor structures, we used parallel analysis, exploratory factor analysis, and confirmatory factor analysis to ascertain the factor structure of the BHS in this sample. We also evaluated measurement invariance of the scale across two key developmental ages (9–12 and 13–18), given distinct cognitive and emotional differences. Models supported a one-factor 20-item structure with partial invariance across child and adolescent samples. Concurrent criterion validity correlations were in the small to medium range. Findings provide evidence of the utility of the BHS as a psychometrically sound measure that possesses cultural relevance to Kenyan youth.

The DRINC (Drinking Reasons Inter-National Collaboration) project: Rationale and protocol for a cross-national study of drinking motives in undergraduates

Couture, M., Stewart, S., Cooper, M., Kuntsche, E., O’Connor, R., Mackinnon, S., & DRINC Team, t. (2017). The DRINC (Drinking Reasons Inter-National Collaboration) project: Rationale and protocol for a cross-national study of drinking motives in undergraduates. The International Journal Of Alcohol And Drug Research, 6(1), 7-18. doi:http://dx.doi.org/10.7895/ijadr.v6i1.239Drinking motives are a proximal predictor of alcohol use and misuse through which the effects of more distal influences (e.g., personality) on alcohol-related outcomes are mediated. Although Cooper’s (1994) four-factor drinking-motives model has been well validated in North America, few studies have validated this model in other countries. The aim of the present paper is to describe the rationale, protocol, and methods of a project designed to evaluate the cross-national validity and generalizability of Cooper’s (1994) measure, as modified by Kuntsche and Kuntsche’s Drinking Motives Questionnaire Revised Short Form (DMQ–R SF, 2009), and of the theoretical model (Cooper, Frone, Russell, & Mudar, 1995) linking drinking motives to specific personality risks and alcohol consequences. The project uses data from undergraduates representing 10 nations (Brazil, United Kingdom and Republic of Ireland, Canada, Hungary, Mexico, the Netherlands, Portugal, Spain, Switzerland, and the United States; total N = 8,478). Findings from this collaboration can be used to guide international researchers in determining the suitability of the DMQ–R SF as a measure of drinking motives in countries outside of North America and may have implications for the development of preventive and therapeutic interventions for alcohol misuse among young adults globally.

Sustainable food consumption in the nexus between national context and private lifestyle: A multi-level study

This paper investigates how country of residence and food-related lifestyle (FRL) interact in shaping (un)sustainable food consumption patterns. An online survey was carried out in ten European countries (n≈335 in each country), covering the five regions North, South, East, West and Central Europe. Multi-group CFA (AMOS22) was used to test the cross-national validity of the FRL instrument. After deleting a few items, it was found that the factorial structure of all five FRL domains is invariant with respect to factor configuration and factor loadings but not with respect to item intercepts. The segmentation analysis was performed by means of Latent Gold 5.1 and multi-level latent class analysis based on data from all ten countries and using the 23 FRL dimensions as input. A five-segment, three-country class solution was judged to produce the best compromise between fit and parsimony, confirming that cross-country FRL segments can be meaningfully identified, but that the segment structure differs across Europe’s regions. The joint effect of country class and FRL on sustainable food-related consumer behaviour was analysed by means of GLM (SPSS22). Both country class and FRL significantly account for variation in meat and organic food consumption and FRL in addition for variation in sustainable food product innovativeness. Further, there is significant interaction between country and FRL for all outcome variables. Hence, the impact of FRL on sustainability choices partly depends on country of residence.

“They Say One Thing and Mean Another” How Differences in In-Group Understandings of Key Goals Shape Political Knowledge

Abstract Journalists and politicians play different roles in the functional structure of the Habermasian public sphere; as such, they might be expected to have different understandings of what knowledge production and transmission might mean. This difference of understanding is more than a conflict over definitions; it is an epistemic divergence à la Fuller (2002:220), where already defined groups hold divergent understandings of what constitutes understanding. While a substantial body of work has been based on the idea of epistemic communities in the context of science and expert organizations in general, little empirical research exists to demonstrate the validity and adaptability of the concept of epistemic communities in comparative political communication research. Here, we show the cross-national validity of the concept of epistemic communities in the context of professional groups of politicians and political journalists in Austria, Finland, France, Denmark, Germany, Slovenia, Spain, Sweden and Switzerland.

Adult-perpetrated animal abuse: development of a proclivity scale

There is a clear discrepancy in the reporting of animal cruelty complaints, prosecutions, and convictions suggesting that any prevalence figures of abuse are significant under-representations. Therefore, it can be inferred that there is a large number of animal abusers who are unapprehended. Currently there is no validated tool that assesses the proclivity or propensity to engage in animal abuse amongst members of the general public. Such a tool would enable researchers to study individuals who may think like animal abusers or may be unapprehended offenders themselves. This paper presents the newly developed Animal Abuse Proclivity Scale (AAPS) and some preliminary findings. The results from our two studies show that: (1) the psychometric properties of the AAPS indicate that the scale is a highly reliable measure; (2) the AAPS relates to measures assessing offence-supportive attitudes and reflects the gender differences seen in the literature; and (3) the AAPS demonstrates cross-national validity. These findings support that the AAPS, similar to other offending proclivity measures, is a tool that can be used to examine the factors most related to animal abuse propensity. We discuss how the AAPS can contribute to future developments in theory and practice in the field.

Service employees' willingness to report complaints scale: Cross-country application and replication

Although effective customer complaint management can be a key success factor for international service firms, relatively little is known about employees' proclivity to report complaints. The present study examines the meaningfulness and cross-national validity of the Israel-developed willingness to report complaints (WRC) scale. Recognized validation procedures, with samples of service employees from Germany and the U.S., demonstrate the reliability, validity and cross-national invariance of the WRC scale. This article offers implications for both research and service managers.

Assessment of the cross-national validity of an End-anchored 9-point hedonic product liking scale

An end-anchored 9-point hedonic product liking (PL) scale is an easy-to-apply instrument to examine consumers’ PL. Because 9-point hedonic PL scales are also popular in cross-national research, strong demands are put on its cross-national equivalence, that is, the absence of cross-national scoring bias. The present study provides a procedure to identify the presence of cross-national scoring bias in the use of the end-anchored 9-point hedonic PL scale or any other rating scale to measure PL. The procedure is illustrated on experimental (illustrative) data from students in four European nations (i.e., Belgium, Germany, the Netherlands, and Spain). It explores cross-national equivalence in terms of (1) mean PL scores, (2) variation in PL scores, and (3) the impact of cross-cultural scoring bias in statistical inference making. Data analyses revealed that cross-national scoring bias only affected the variability in participants’ PL scores, but not the level of their PL scores. However, cross-national scoring bias in variation in PL scores did exert a substantial influence on a statistical inference making of mean PL scores. In sum, this study (1) provides preliminary evidence that cross-national scoring bias may seriously hamper the validity of cross-national comparisons of PL scores; and (2) offers a new methodology allowing food researchers to assess the extent to which the amount of cross-national scoring bias in their PL data will result in invalid cross-national comparisons.

Comparison of the Level and Prevalence of ADHD Symptoms in Macao (China) and U.S. University Students

Compared to other areas of the world and other Chinese societies such as Hong Kong and Taiwan, little is known about psychiatric conditions in Macao, a Special Administrative Region of China. There is growing evidence of the cross-national and cross-cultural validity of attention deficit hyperactivity disorder (ADHD), but there are no studies of ADHD symptoms in Macao. This study compared Diagnostic and Statistical Manual of Mental Disorders (4th ed., text rev.) ADHD symptoms of Macao postsecondary students (N = 459) to U.S. peers (N = 261). Based on symptom counts, Macao students reported higher rates of ADHD. With regard to recent problems, 7.01% of Macao students and 2.69% of U.S. students reported enough symptoms to meet the cutoff for 1 of the 3 subtypes. Requiring that enough symptoms be recalled to meet childhood criteria, recent rates dropped to 3.74% (Macao) and 1.15% (United States), which are within expectations based on worldwide estimates. Comparisons using other methods of calculating rates are also provided. This research adds to the limited knowledge of ADHD symptoms in postsecondary students across countries, and provides the first account of such symptoms in Macao. Assessment of ADHD symptoms in Macao is complicated by the high level of overall distress reported by students.