Meta-analytic Examination Research Articles

Understanding organizational commitment: A meta-analytic examination of the roles of the five-factor model of personality and culture.

We examined the relationships between the Five-Factor Model (FFM) of personality traits and three forms of organizational commitment (affective, normative, and continuance commitment) and their variability across individualistic and collectivistic cultures. Meta-analytic results based on 55 independent samples from 50 studies (N = 18,262) revealed that (a) all FFM traits had positive relationships with affective commitment; (b) all FFM traits had positive relationships with normative commitment; and (c) Emotional Stability, Extraversion, and Openness to Experience had negative relationships with continuance commitment. In particular, Agreeableness was found to be the trait most strongly related to both affective and normative commitment. The results also showed that Agreeableness had stronger relationships with affective and normative commitment in collectivistic cultures than in individualistic cultures. We provide theoretical and practical implications of these findings for personality, job attitudes, and employee selection and retention.

Convergent and Divergent Validity of the Student Engagement in School Success Skills Survey

This study examines the convergent validity and divergent validity of the Student Engagement in School Success Skills (SESSS) survey. The SESSS is easy to administer (it takes fewer than 15 minutes to complete) and is used in schools to provide educators with useful information about students' use of skills and strategies related to school success. A total of 4,342 fifth graders completed the SESSS; the Motivated Strategies for Learning Questionnaire (MSLQ) Cognitive Strategy Use, Self-Regulation, Self-Efficacy and Test Anxiety subscales; and the Self-Efficacy for Self-Regulated Learning (SESRL). The three subscales of the SESSS (Self-Direction of Learning, Support of Classmates' Learning and Self-Regulation of Arousal) correlated highly with the MSLQ Cognitive Strategy Use and Self-Regulation subscales, moderately correlated with the Self-Efficacy subscale and the SESRL, and did not correlate with the MSLQ Test Anxiety subscale. Future research is needed to use the SESSS subscales as discriminable dimensions.Keywords: school success, convergent validity, divergent validity, Student Engagement in School Success Skills survey, educatorsFor more than a decade, researchers have placed increased emphasis on evidence-based practice and a programmatic approach to school counseling (Carey, 2004; Green & Keys, 2001; Gysbers, 2004; Lapan, 2005; Myrick, 2003; Paisley & Hayes, 2003; Whiston, 2002, 2011). This emphasis from the school counseling profession reflects national initiatives. In 2001, the Institute of Education Sciences, the research arm of the U.S. Department of Education, was established to determine, through rigorous and relevant research, what interventions are effective and ineffective for improving student achievement and education outcomes. The What Works Clearinghouse (WWC), an initiative of the Institute of Education Sciences, was created in 2002 to identify studies that provide credible and reliable evidence of the effectiveness of education interventions. The purpose of WWC is to inform researchers, educators and policymakers of interventions designed to improve student outcomes.The American School Counselor Association's (ASCA, 2005) response to emerging national policy and initiatives included a call for school counselor-led interventions that contribute to increased student achievement as part of a comprehensive school counseling program. The need for more research to identify evidence-based interventions tying school counselors to improved student academic performance also surfaced in a school counseling Delphi study, which identified the most pressing research questions in the profession (Dimmitt, Carey, McGannon, & Henningson, 2005). The top priority cited by this Delphi study was the need to determine which school counseling interventions resulted in the greatest student achievement gains. In addition, five major reviews of school counseling research all discussed the need for more research to strengthen the link between school counselor interventions and student achievement (Brown & Trusty, 2005; Dimmitt, Carey, & Hatch, 2007; Whiston & Quinby, 2009; Whiston & Sexton, 1998; Whiston, Tai, Rahardja, & Eder, 2011). However, researchers continue to report limitations in the school counseling outcome research. Among the limitations are conclusions drawn from studies based on nonstandardized outcome assessments. For instance, in a review of school counseling studies, Brown and Trusty (2005) concluded that school counseling research has been limited by the lack of valid and reliable instruments that measure the skills, strategies and personal attributes associated with academic and social/relationship success. More recently, Whiston et al. (2011) completed a meta-analytic examination of school counseling interventions and also determined the dominance of nonstandardized outcome assessments in school counseling research as a significant limitation. These limitations continue to be a hindrance for the school counseling profession, given the goal of establishing evidence-based practices that link school counselor interventions to improved student outcomes. …

Effects of correcting misinformation: A metaanalytic examination

Effects of correcting misinformation: A metaanalytic examination

A meta-analytic examination of the effects of the agentic and affiliative aspects of extraversion on leadership outcomes

Building on previous research that has shown that extraversion is the strongest Big Five personality predictor of effective leadership, the present study employed meta-analytic procedures to examine the independent effects of the two main aspects of extraversion—agency and affiliation—on leadership outcomes (transformational leadership and leadership effectiveness). Results showed that it is specifically the agentic aspect of extraversion that has a positive impact on leadership, whereas the affiliative aspect is unrelated to transformational leadership and negatively related to leadership effectiveness. Additionally, we demonstrate that assessing extraversion in terms of these two aspects leads to substantial improvements in predictive validity relative to broad measures of extraversion. Limitations associated with common method bias and modest effect sizes notwithstanding, our findings inform theory on specifically why it is that extraverts are perceived as better leaders than introverts. We also discuss practical implications for how to select and develop leaders in organisational settings and outline the types of organisations in which agency measures are likely to be most useful for selection purposes.

The good, the bad and the effective: a meta-analytic examination of selling orientation and customer orientation on sales performance

The concept of customer orientation (CO) is a focal construct in marketing and sales literature. Saxe and Weitz introduced CO to contrast the traditional high-pressure approach to sales (selling orientation). This study synthesizes empirical evidence from 1982 to 2013 to provide insight into the antecedents and consequences of both CO and selling orientation (SO). A conceptual meta-analytic model based on research into interpersonal motive models is proposed and tested using effect sizes from 126,790 salesperson survey responses to advance theory development on our understanding of how SO and CO behaviours affect organizations. Findings show that adaptive selling mediates the impact of both SO and CO which has important practical implications for hiring and training salespeople. Furthermore, this study shows that goal orientations are antecedents of SO and CO and that the impact of SO on job performance varies by customer type.

Thirty years of research on the Level of Service Scales: A meta-analytic examination of predictive accuracy and sources of variability.

We conducted a comprehensive meta-analysis of the Level of Service (LS) scales, their predictive accuracy and group-based differences in risk/need, across 128 studies comprising 151 independent samples and a total of 137,931 offenders. Important potential moderators were examined including ethnicity, gender, LS scale variant, geographic region, and type of recidivism used to measure outcome. Results supported the predictive accuracy of the LS scales and their criminogenic need domains for general and violent recidivism overall, and among broad subgroups of interest, including females and ethnic minorities. Although results indicated that gender and ethnicity were not substantive sources of effect size variability, significant differences in effect size magnitude were found when analyses were conducted by geographic region. Canadian samples consistently demonstrated the largest effect sizes, followed by studies conducted outside North America, and then studies conducted in the United States. This pattern was observed irrespective of gender, ethnicity, LS domain, LS variant, or type of recidivism outcome, suggesting geographic region may be an important source of effect size variation. We discuss possible factors underlying this pattern of results and identify areas for future research.

Situational Strength as a Moderator of the Relationship Between Job Satisfaction and Job Performance: A Meta-Analytic Examination

The purpose of the current meta-analysis was to test the hypothesis that situational strength attenuates the positive relationship between job satisfaction and job performance. Using meta-analytic data (k = 101, N = 19,494) and regression analysis, we examined situational strength’s association with the satisfaction–performance relationship. As hypothesized, the constraints dimension of situational strength was negatively associated with the magnitude of the job satisfaction–job performance relationship. Unexpectedly, the consequences dimension of situational strength failed to produce a similar effect. The current study provides insight into when job satisfaction and job performance are most likely and least likely to be related to each other. Thus, it has important theoretical implications for job attitude researchers and it has applied implications for practitioners wishing to increase job performance by improving employee satisfaction. The current study is the first large-scale examination of situational strength as a moderator of the relationship between job satisfaction and job performance.

Great expectations: A meta-analytic examination of optimism and hope

Optimism and hope—two psychological constructs reflecting positive expectations about one’s future—have garnered considerable research attention and each has been the subject of several narrative reviews. In the current meta-analysis, we examined the optimism–hope relationship and we examined several potential correlates and consequences of optimism and hope. Our results suggest that optimism and hope are distinguishable from each other. Furthermore, both are related to several indices of psychological and physical well-being and both are empirically distinguishable from other personality traits, such as the Five Factor Model characteristics and trait affectivity. We conclude by discussing directions for future research on optimism and hope.

The Underlying Motivational Mechanisms for Employee Creativity: A Meta-Analytic Examination

Drawing on the componential theory of creativity and social cognitive theory, this study examined intrinsic motivation and self-efficacy as distinct motivational mechanisms underlying creativity. R...

Substance use disorders and racial/ethnic minorities matter: A meta-analytic examination of the relation between alliance and outcome.

The purpose of this meta analysis was to examine the moderating impact of substance use disorder as inclusion/exclusion criterion as well as the percentage of racial/ethnic minorities on the strength of the alliance-outcome relationship in psychotherapy. It was hypothesized that the presence of a Diagnostic and Statistical Manual of Mental Disorders (DSM) Axis I substance use disorder as a criterion and the presence of racial/ethnic minorities as a sociocultural indicator are moderately correlated client factors reducing the relationship between alliance and outcome. A random effects restricted maximum-likelihood estimator was used for omnibus and moderator models (k = 94). The presence of (a) substance use disorder and (b) racial/ethnic minorities (overall and specific to African Americans) partially moderated the alliance-outcome correlation. The percentage of substance use disorders and racial/ethnic minority status was unexpectedly highly correlated in the present treatment research samples. Sociocultural contextual variables should be considered along with a DSM Axis I diagnosis of substance use disorders in analyzing and interpreting therapy process variables such as the alliance.

Psychosocial Treatment Efficacy for Disruptive Behavior Problems in Very Young Children: A Meta-Analytic Examination

Service use trends showing increased off-label prescribing in very young children and reduced psychotherapy use raise concerns about quality of care for early disruptive behavior problems. Meta-analysis can empirically clarify best practices and guide clinical decision making by providing a quantitative synthesis of a body of literature, identifying the magnitude of overall effects across studies, and determining systematic factors associated with effect variations. We used random-effects meta-analytic procedures to empirically evaluate the overall effect of psychosocial treatments on early disruptive behavior problems, as well as potential moderators of treatment response. Thirty-six controlled trials, evaluating 3,042 children, met selection criteria (mean sample age, 4.7 years; 72.0% male; 33.1% minority youth). Psychosocial treatments collectively demonstrated a large and sustained effect on early disruptive behavior problems (Hedges' g = 0.82), with the largest effects associated with behavioral treatments (Hedges' g = 0.88), samples with higher proportions of older and male youth, and comparisons against treatment as usual (Hedges' g = 1.17). Across trials, effects were largest for general externalizing problems (Hedges' g = 0.90) and problems of oppositionality and noncompliance (Hedges' g = 0.76), and were weakest, relatively speaking, for problems of impulsivity and hyperactivity (Hedges' g = 0.61). In the absence of controlled trials evaluating psychotropic interventions, findings provide robust quantitative support that psychosocial treatments should constitute first-line treatment for early disruptive behavior problems. Against a backdrop of concerning trends in the availability and use of supported interventions, findings underscore the urgency of improving dissemination efforts for supported psychosocial treatment options, and removing systematic barriers to psychosocial care for affected youth.

The Relationship Between Typical and Maximum Performance: A Meta-Analytic Examination

This study's purpose was to meta-analytically estimate the magnitude of the relationship between typical and maximum job performance to determine if this distinction deserves greater attention. We also tested several moderators including three associated with the temporal boundaries of this relationship and examined theoretical antecedents of typical and maximum performance (ability, motivation, and personality). This meta-analysis revealed a moderate typical–maximum performance association (ρ = .42), suggesting that a meaningful distinction does exist. Although the examined temporal moderators did not meaningfully affect the typical–maximum performance relationship, task complexity, type of performance measure, and study setting were significant moderators. Antecedent analyses confirmed that both ability and Openness to Experience are more strongly related to maximum than typical performance. The implications of these findings are discussed.

Defying conventional wisdom: A meta-analytical examination of the differences between demographic and job-related diversity relationships with performance

Conventional wisdom in the diversity literature holds that job-related dimensions of diversity are the domain of positive performance, whereas demographic dimensions of diversity are the domain of negative performance effects. In a meta-analysis (N=146 studies, 612 effect sizes), we show that this conclusion may be based on rater biases; it does not apply to studies involving more objective assessments of performance, assessments that cannot be influenced by knowledge of a team’s composition. We also show that the influence of job-related diversity is moderated by task complexity and that job-related diversity is more positively related to innovative performance than to in-role performance. We discuss how these results invite a reconsideration of the role of the job-related/demographic diversity distinction and provide suggestions on how to further advance our understanding of diversity’s effects.

Fairness at the collective level: A meta-analytic examination of the consequences and boundary conditions of organizational justice climate.

This article uses meta-analytic methods (k = 38) to examine the relationship between organizational justice climate and unit-level effectiveness. Overall, our results suggest that the relationship between justice and effectiveness is significant (ρ = .40) when both constructs are construed at the collective level. Our results also indicate that distributive justice climate was most strongly linked with unit-level performance (e.g., productivity, customer satisfaction), whereas interactional justice was most strongly related to unit-level processes (e.g., organizational citizenship behavior, cohesion). We also show that a number of factors moderate this relationship, including justice climate strength, the level of referent in the justice measure, the hierarchical level of the unit, and how criteria are classified. We elaborate on these findings and attempt to provide a clearer direction for future research in this area.

A Meta-Analytic Examination of Models Linking Justice, Trust, and Job Performance

A quantitative review of the relationship between justice, trust, and job performance behaviors (i.e. OCB and task performance) is organized around four theoretical models that have received varyin...

Meta-Analysis of Group Learning Activities: Empirically Based Teaching Recommendations

Teaching researchers commonly employ group-based collaborative learning approaches in Teaching of Psychology teaching activities. However, the authors know relatively little about the effectiveness of group-based activities in relation to known psychological processes associated with group dynamics. Therefore, the authors conducted a meta-analytic examination of whether learning outcomes are moderated by aspects of group process and collaborative learning. Results indicated that (a) group duration of a brief period (one to three classes) was more effective than group duration lasting more than one-half semester, (b) high levels of participant interdependence were associated with greater learning outcomes, and (c) group activities incorporating a formal group project presentation evidenced significantly less robust learning outcomes than activities that did not include a formal group presentation. Based on the findings, the authors provide teaching suggestions that reflect how group processes may impact learning effectiveness.

A convergent functional architecture of the insula emerges across imaging modalities

Empirical evidence increasingly supports the hypothesis that patterns of intrinsic functional connectivity (iFC) are sculpted by a history of evoked coactivation within distinct neuronal networks. This, together with evidence of strong correspondence among the networks defined by iFC and those delineated using a variety of other neuroimaging techniques, suggests a fundamental brain architecture detectable across multiple functional and structural imaging modalities. Here, we leverage this insight to examine the functional organization of the human insula. We parcellated the insula on the basis of three distinct neuroimaging modalities - task-evoked coactivation, intrinsic (i.e., task-independent) functional connectivity, and gray matter structural covariance. Clustering of these three different covariance-based measures revealed a convergent elemental organization of the insula that likely reflects a fundamental brain architecture governing both brain structure and function at multiple spatial scales. While not constrained to be hierarchical, our parcellation revealed a pseudo-hierarchical, multiscale organization that was consistent with previous clustering and meta-analytic studies of the insula. Finally, meta-analytic examination of the cognitive and behavioral domains associated with each of the insular clusters obtained elucidated the broad functional dissociations likely underlying the topography observed. To facilitate future investigations of insula function across healthy and pathological states, the insular parcels have been made freely available for download via http://fcon_1000.projects.nitrc.org, along with the analytic scripts used to perform the parcellations.

How Well Do Children Who Are Internationally Adopted Acquire Language? A Meta-Analysis

In this article, the authors present the results of a systematic and meta-analytic examination of the language outcomes of children who are internationally adopted. The study examined the questions of whether the early life experiences of children who are internationally adopted and the language switch that occurs after adoption hinder the acquisition of language skills. The authors selected available studies on the language acquisition of internationally adopted children using search strategies from both a comprehensive set of databases and manual searching of selected studies. Study eligibility criteria included (a) participants clearly identified as being internationally adopted, (b) measurable language outcomes were reported, (c) a control group or normative measure was used in the design of the study, and (d) effect size was reported, or data were provided to calculate effect size. The meta-analysis found that as a group, the children expressed great variability in their language skills. Overall, they were more likely to have poorer language outcomes than comparison children, but several moderating variables were found. The results of the meta-analysis have direct clinical application regarding the assessment and treatment of language skills of internationally adopted children. The study also has implications for future studies of the language development of internationally adopted children.

The Predictive Validity of Assessment Centers in German-Speaking Regions

As previous meta-analyses have focused almost solely on English-speaking regions, this study presents the first systematic meta-analytical examination of the predictive validity of assessment centers (ACs) conducted in German-speaking regions. It summarizes 24 validity coefficients taken from 19 studies (N = 3,556), yielding a mean corrected validity of ρ = .396 (80% credibility interval .235 ≤ ρ ≤ .558). ACs with different purposes and different kinds of criterion measures were analyzed separately. Furthermore, target group (internal vs. external candidates), average age of the assessees, inclusion of intelligence measures, number of instruments used, AC duration, as well as time elapsed between AC and criterion assessment were found to moderate the validity.

A meta-analytic examination of hardiness.

Hardiness, which is a multidimensional personality trait that is hypothesized to protect people from the effects of stress, has attracted considerable research attention during the last 30 years. The current study provides a meta-analytic review of hardiness. Specifically, we examined the relationships between the hardiness facets, the relationship between hardiness and other personality variables, as well as the relationships between hardiness and several hypothesized criteria, including stressors, strains, social support, coping, and performance. Our analyses generally suggest that hardiness is: (a) positively related to other personality traits that are expected to protect people from stress, (b) negatively related to personality traits that are expected to exacerbate the effects of stress, (c) negatively related to stressors, strains, and regressive coping, and (d) positively related to social support, active coping, and performance. Regression analyses suggest that hardiness is significantly related to important criteria after the effects of other personality traits (e.g., the Five Factor Model traits) are controlled.