Meta-analysis Synthesis Research Articles

Factors Influencing Sponsorship Effectiveness: A Meta-Analytic Review and Research Synthesis

Sponsorship is a significant element of today’s marketing communication. Nevertheless, managers and researchers lack of systematic and integrative understanding of key factors that influence sponsorship outcomes and the contexts in which the relationships between sponsorship effectiveness antecedents and outcomes are stronger or weaker. The authors attempt to address this gap by providing a systematic meta-analytic review of sponsorship effectiveness that incorporates (1) cognitive, affective, and conative consumer-focused sponsorship outcomes; (2) sponsor-related, dyadic, and sponsee-related antecedents to consumer-focused sponsorship outcomes; and (3) sponsorship-related and methodological moderators of the relationships between the three antecedent categories and three outcome categories. Our findings help assess the validity and robustness of the predictive capability of the antecedents, and they also offer a more generalizable and empirically established set of factors that are vital to the achievement of key sponsorship outcomes. Several of our results afford noteworthy implications for improving the effectiveness of sponsorship research and practice.

Inside-out and outside-in orientations: A meta-analysis of orientation's effects on innovation and firm performance

The inside-out and outside-in orientations place differing levels of emphasis on internal versus external resources and capabilities as sources of competitive advantage. While the inside-out orientation primarily considers organizational resources, followed by competitors and customers (implicitly), the outside-in orientation appears to reverse the order by first examining customers and competitors and then the degree to which the firm responds to them, implicitly addressing organizational resources. Existing empirical evidence does not clarify the comparative effects of inside-out and out-side in orientations on innovation performance. This paper draws on 232 independent studies (N=38,051) analyzed systematically through a quantitative meta-analytic synthesis in order to develop a detailed contextualized elaboration of the relationships between the inside-out and outside-in orientations and innovation performance. Going beyond the direct effects, we also extend the literature by investigating the moderating effects of industry type (high-tech vs. low-tech), economic development (developed vs. developing countries), and cultural context (collectivist vs. individualist cultures). Our findings shed light on the relative value of inside-out and outside-in orientation for innovation performance, the direct and indirect effects of the two orientations on firm performance, and the conditions under which the effectiveness of each is enhanced.

The person-based nature of prejudice: Individual difference predictors of intergroup negativity

Person-based factors influence a range of meaningful life outcomes, including intergroup processes, and have long been implicated in explaining prejudice. In addition to demonstrating significant heritability, person-based factors are evident in expressions of generalised prejudice, a robust finding that some people (relative to others) consistently score higher in prejudice towards multiple outgroups. Our contemporary review includes personality factors, ideological orientations (e.g., authoritarianism), religiosity, anxiety, threat, disgust sensitivity, and cognitive abilities and styles. Meta-analytic syntheses demonstrate that such constructs consistently predict prejudice, often at the upper bounds of effect sizes observed in psychological research. We conclude that prejudice theories need to better integrate person- and situation-based factors, including their interaction, to capture the complexity of prejudice and inform intervention development.

Does baseline heart rate variability reflect stable positive emotionality?

Several recent studies have found significant correlations, medium in effect size, between baseline heart rate variability (HRV) and measures of positive functioning, such as extraversion, agreeableness, and trait positive affectivity. Other research, however, has suggested an optimal level of HRV and found non-linear effects. In the present study, a diverse sample of 239 young adults completed a wide range of measures that reflect positive psychological functioning, including personality traits, an array of positive emotions (measured with the Dispositional Positive Emotions Scale), and depression, anxiety, and stress symptoms (measured with the DASS and CESD). HRV was measured with a 6-min baseline period and quantified using many common HRV metrics (e.g., respiratory sinus arrhythmia, root mean square of successive differences, and others), and potentially confounding behavioral and lifestyle variables (e.g., BMI, caffeine and nicotine use, sleep quality) were assessed. Neither linear nor non-linear effects were found, and the effect sizes were small and near zero. The findings suggest that the cross-sectional relationship between HRV and positive experience deserves more attention and meta-analytic synthesis.

Employment and educational outcomes in early intervention programmes for early psychosis: a systematic review.

Young adults with early psychosis want to pursue normal roles - education and employment. This paper summarises the empirical literature on the effectiveness of early intervention programmes for employment and education outcomes. We conducted a systematic review of employment/education outcomes for early intervention programmes, distinguishing three programme types: (1) those providing supported employment, (2) those providing unspecified vocational services and (3) those without vocational services. We summarised findings for 28 studies. Eleven studies evaluated early intervention programmes providing supported employment. In eight studies that reported employment outcomes separately from education outcomes, the employment rate during follow-up for supported employment patients was 49%, compared with 29% for patients receiving usual services. The two groups did not differ on enrolment in education. In four controlled studies, meta-analysis showed that the employment rate for supported employment participants was significantly higher than for control participants, odds ratio=3.66 [1.93-6.93], p<0.0001. Five studies (four descriptive and one quasi-experimental) of early intervention programmes evaluating unspecified vocational services were inconclusive. Twelve studies of early intervention programmes without vocational services were methodologically heterogeneous, using diverse methods for evaluating vocational/educational outcomes and precluding a satisfactory meta-analytic synthesis. Among studies with comparison groups, 7 of 11 (64%) reported significant vocational/education outcomes favouring early intervention over usual services. In early intervention programmes, supported employment moderately increases employment rates but not rates of enrolment in education. These improvements are in addition to the modest effects early programmes alone have on vocational/educational outcomes compared with usual services.

Methyl bromide alternatives for strawberry and tomato pre-plant uses: A meta-analysis

This paper reports the results of a meta-analytic synthesis of information from a large number of horticultural experiments that evaluated the technical feasibility of methyl bromide alternatives as soil fumigants in strawberry (Fragaria ananassa) cultivation in California, Florida, and Spain, and in tomato (Solanum lycopersicum) cultivation in Florida. A technically feasible alternative is defined as a treatment that provides pest control and crop yields similar to methyl bromide standard fumigation. We selected papers using five criteria, which jointly ensured inclusion of field experiments that contained usable information on at least three treatments—(1) an untreated control, (2) a methyl bromide treatment, and (3) a treatment that is an alternative to methyl bromide treatment. Because of the differences in regional cropping environments, we performed separate meta-analyses for four crop/region combinations. To explore the potential effects of missing information on past fumigation history and pest pressure on the results, we performed two sensitivity analyses, in which the set of usable field experiments included only those experiments in which the improvement of the methyl bromide treatment yield over the control yield was either 15% or 50%. Finally, the definition of several potential alternative chemical treatments took into account differences in formulations and application rates. The results we obtained do not support the technical superiority of methyl bromide over its alternatives. We found several potential alternatives for which we could not reject the hypothesis of technical feasibility, based on the experimental data for strawberries in California and Spain. In particular, the results on strawberry field experiments in California indicate that the estimated effect size of the treatment using 1,3-dichloropropene/chloropicrin 65:35 formulation (applied at the standard rate) was close to the estimated effect size for methyl bromide. The results from strawberry and tomato field experiments in Florida were inconclusive. However, this does not establish that methyl bromide is technically superior to its alternatives. Given the data-related limitations of the analysis, standard protocols are necessary for conducting and reporting the experiments to allow for more meaningful synthesis of the experimental data.

The Prevalence of Pathological Gambling Among College Students: A Meta-analytic Synthesis, 2005–2013

The problem of gambling addiction can be especially noteworthy among college and university students, many of whom have the resources, proximity, free time, and desire to become involved in the myriad options of gambling now available. Although limited attention has been paid specifically to college student gambling in the body of literature, there have been two published meta-analyses estimating the prevalence of probable pathological gambling among college students. This present study aims to be the third, presenting an up-to-date proportion of those students exhibiting gambling pathology, and is the first to include international studies from outside the United States and Canada. The purpose of this study was to use the most up-to-date meta-analytical procedures to synthesize the rates of probable pathological gambling for college and university students worldwide. A thorough literature review and coding procedure resulted in 19 independent data estimates retrieved from 18 studies conducted between 2005 and 2013. To synthesize the studies, a random effects model for meta-analysis was applied. The estimated proportion of probable pathological gamblers among the over 13,000 college students surveyed was computed at 10.23%, considerably higher than either of the two previously published meta-analyses, and more than double the rate reported in the first meta-analysis of this type published in 1999. Implications and recommendations for future practice in dealing with college students and gambling addiction are outlined and described for both administrators and mental health professionals.

일반가정의 아동을 대상으로 한 다문화교육 프로그램의 효과에 관한 메타분석

일반가정의 아동을 대상으로 한 다문화교육 프로그램의 효과에 관한 메타분석

What do we really know about the signalling role of plumage colour in blue tits? A case study of impediments to progress in evolutionary biology

Evolutionary biologists seek to explain the origin and maintenance of phenotypes, and a substantial portion of this research is accomplished by thorough study of individual species. For instance, many researchers study individual species to understand evolution of ornamental traits which appear to be products of sexual selection. I explored our understanding of sexual ornaments in a well-studied vertebrate species that may serve as a case study for research programs in evolutionary biology. I attempted to located all published papers examining plumage colour and variables related to sexual selection hypotheses in a common European songbird, the blue tit (Cyanistes caeruleus). Researchers have estimated over 1200 statistical relationships with plumage colour of blue tits in 52 studies. However, of the approximately 1000 main-effect relationships from the 48 studies that are candidates for inclusion in this meta-analysis, more than 400 were reported without details of strength and direction. Circumstantial evidence suggests that an unknown number of other estimated effects remain unpublished. Missing information is a substantial barrier to interpretation of these papers and to meta-analytic synthesis. Examination and analysis of funnel plots indicated that unpublished effects may be a biased sample of all effects, especially for comparisons of plumage colour to age and individual quality, and possibly also to measures of mate choice. Further, type I error was likely elevated by the large number of statistical comparisons evaluated, the frequent use of iterative model-building procedures, and a willingness to interpret a wide variety of results as support for a hypothesis. Type I errors were made more problematic because blue tit plumage researchers only rarely have attempted to replicate important findings in their own work or that of others. Replication is essential to drawing robust scientific conclusions, especially in probabilistic systems with moderate to weak effects or a likelihood of bias. Last, researchers studying blue tit plumage have often developed ad hoc explanations for deviations of results from their predictions. Revising hypotheses in light of data is appropriate, but these revised hypotheses were rarely tested with new data. The only highly robust conclusion supported by meta-analysis is that male blue tits have plumage that reflects more light in the ultraviolet and yellow wavelengths than the plumage of females. Various other effects, including condition-dependence of plumage colour expression and a tendency for females to adjust the sex ratio of their offspring in response to male colour, remain uncertain. These obstacles to progress in the blue tit plumage literature are likely common in evolutionary biology, and so I recommend changes to incentive structures which may improve progress towards scientific understanding in this discipline.

938

Introduction: The purpose of paediatric pharmacokinetic studies is to provide precise estimates of the true value of pharmacokinetic parameters to inform dosing. Hypothesis: We evaluated age-groups studied and the precision of parameter estimates in peer-reviewed pharmacokinetic studies. Methods: Systematic reviews of 10 drugs included publications describing >1 pharmacokinetic study in patients <18 years. A pharmacokinetic study was defined as peer-reviewed primary data used to estimate one or more of the pharmacokinetic parameters: volume of distribution (Vd), clearance (CL), or half-life (HL). We defined uncertainty as the width of the 95% confidence interval divided by the study mean, and acceptable uncertainty as uncertainty <20%. We sought age-specific data for each of 5 pre-defined age groups for each drug. Results: Review of 6207 abstracts identified 114 eligible manuscripts containing 171 pharmacokinetic studies and 425 pharmacokinetic parameter estimates (145 Vd, 150 CL, 130 HL) and 364 uncertainty intervals. The median(IQR) sample size was 14(8-30). Estimates were derived from single age groups in 72(42.11%) studies however 28(56%) of the 50 drug/age-group pairs had no group-specific data. Acceptable uncertainty was found in 21(16.67%) Vd, 29(25.22%) HL, and 37(30.08%) CL estimates. Groups of potentially similar single-age studies were heterogeneous. Conclusions: Review of 10 commonly administered drugs found missing age-specific data was common. Available data were imprecise and not amenable to meta-analytic synthesis. Potential sources of variability included small sample sizes. Peer-reviewed pharmacokinetic data for children is incomplete, when available is imprecise, is likely to be a major source of dosing error and threat to the provision of optimal pharmacotherapy to children.

Gardening Increases Vegetable Consumption in School-aged Children: A Meta-analytical Synthesis

Although a handful of published reports suggest that garden-based nutrition education programs are effective in increasing fruit and vegetable consumption, many of these studies have low statistical power because of small sample sizes and lack of long-term data. In this study, we used meta-analytical techniques to examine the efficacy of garden-based nutrition education programs for increasing children’s nutrition knowledge, preference for fruit and vegetables, and/or consumption of fruit and vegetables. We confined our analysis to peer-reviewed studies that examined programs that were delivered to children in the United States. We looked at the relative impacts of garden-based nutrition education programs, compared with experimental controls (i.e., no nutrition education) and nutrition education programs without a gardening component. We compared the results of our meta-analysis with those of a vote counting analysis to illustrate the importance of repeated studies and quantitative analysis. In our vote counting analysis, the majority of the outcomes were nonsignificant in the control and nutrition education groups, but positive and significant for the gardening group. Our quantitative analysis of the impacts of gardening education programs on children’s nutrition knowledge, preference for fruit and vegetables, and/or consumption of fruit and vegetables was limited by the small number of studies that reported the full suite of descriptive statistics needed to conduct a meta-analysis. Nonetheless, one striking and robust result emerged: gardening increased vegetable consumption in children, whereas the impacts of nutrition education programs were marginal or nonsignificant. We suggest two nonmutually exclusive hypotheses to explain our results: gardening increases access to vegetables and gardening decreases children’s reluctance to try new foods. Our results suggest that gardening should be an integral component of wellness programs and policies. A historical lack of funding has impeded both the broader adoption of school gardens and rigorous research on the social, behavioral, and academic impacts of gardening on children. Recently, however, there has been an increase in federal support for gardening and garden-based research projects—a trend that we hope will continue and grow.

The effects of anger management on children’s social and emotional outcomes: A meta-analysis

The occurrence of violent behaviors and bullying in schools continues to be a recognized problem among students and school personnel. The concern caused by these behaviors have led many schools to implement anger management and other impulse control based programs for at-risk students in an effort to prevent many of these incidences. This study was a comprehensive, meta-analytic synthesis of the literature to assess the effectiveness of these interventions, using a total of 60 studies from 1979–2010 for analysis. Results indicated an overall effect size (ES) of −0.27, showing a small to moderate intervention effect in reducing children’s negative emotional and behavioral outcomes including anger, aggression, and loss of self control. Many different types of anger management components were found to be effective in promoting positive outcomes. Implications for school psychologists are discussed.

Meta-analysis and research on host–parasite interactions: past and future

Host–parasite interactions are characterised by a lack of stable species-specific traits that limits generalisations one can make even about particular host or parasite species. For instance, the virulence, life history traits or transmission mode of a given parasite species can depend on which of its suitable hosts it infects. In the search for general rules or patterns, meta-analysis provides a possible solution to the challenges posed by the highly variable outcomes of host–parasite interactions. It allows an estimate of the overall association between any factor and its biological response that transcends the particulars of given host and parasite taxonomic combinations. In this review, we begin with a historical overview of the use of meta-analysis in research on the ecology and evolution of host–parasite interactions. We then identify several key conceptual advances that were made possible only through meta-analytical synthesis. For example, meta-analysis revealed the predominant association between rates of host and parasite gene flow and local adaptation, as well as an unexpected latitudinal gradient in parasite virulence, or parasite-induced host mortality. Finally, we propose some areas of research on host–parasite interactions that are based on a mature theoretical foundation and for which there now exist sufficient primary results to make them ripe for meta-analysis. The search for the processes causing variability in parasite species richness among host species, and the link between the expression of host resistance and the specificity of parasites, are two such research areas. The main objective of this review is to promote meta-analysis as a synthetic tool overriding the idiosyncrasies of specific host–parasite combinations and capable of uncovering the universal trends, if any, in the evolutionary ecology of parasitism.

Evaluation of methodology and quality characteristics of systematic reviews in orthodontics

Systematic reviews (SRs) are published with an increasing rate in many fields of biomedical literature, including orthodontics. Although SRs should consolidate the evidence-based characteristics of contemporary orthodontic practice, doubts on the validity of their conclusions have been frequently expressed. The aim of this study was to evaluate the methodology and quality characteristics of orthodontic SRs as well as to assess their quality of reporting during the last years. Electronic databases were searched for SRs (without any meta-analytical data synthesis) in the field of orthodontics, indexed up to the start of 2010. The Assessment of Multiple Systematic Reviews (AMSTAR) tool was used for quality assessment of the included articles. Data were analyzed with Student's t-test, one-way ANOVA, and linear regression. Risk ratios (RR) with 95% confidence intervals were calculated to represent changes during the years in reporting of key items associated with quality. A total of 110 SRs were included in this evaluation. About half of the SRs (46.4%) were published in orthodontic journals, while few (5.5%) were updates of previously published reviews. Using the AMSTAR tool, thirty (27.3%) of the SRs were found to be of low quality, 63 (57.3%) of medium quality, and 17 (15.5%) of high quality. No significant trend for quality improvement was observed during the last years. The overall quality of orthodontic SRs may be considered as medium. Although the number of orthodontic SRs has increased over the last decade, their quality characteristics can be characterized as moderate.

Noise effects on human performance: A meta-analytic synthesis.

Noise is a pervasive and influential source of stress. Whether through the acute effects of impulse noise or the chronic influence of prolonged exposure, the challenge of noise confronts many who must accomplish vital performance duties in its presence. Although noise has diffuse effects, which are shared in common with many other chronic forms of stress, it also exerts its own specific influences on various forms of cognitive and motor response. We present a quantitative evaluation of these influences so that their harmful effects can be mitigated, their beneficial effects exploited, and any residual effects incorporated and synthesized into selection, training, and design strategies to facilitate human performance capacities. Predictions of single and joint moderator effects were made on the basis of major theories of noise and performance, specifically those explanations based on arousal, masking, or cognitive-resource mechanisms. These predictions were tested through moderator analyses of effects as a function of task type, performance measure, noise type and schedule, and the intensity and duration of exposure. Observed outcome effects (797 effect sizes derived from 242 studies) varied as a function of each of these moderators. Collective findings identified continuous versus intermittent noise, noise type, and type of task as the major distinguishing characteristics that moderated response. Mixed evidence was obtained for the traditional arousal and masking explanations for noise effects. The overall pattern of findings was most consistent with the maximal adaptability theory, a mental-resource-based explanation of stress and performance variation.

Psychometric Properties of the Mobility Inventory for Agoraphobia: Convergent, Discriminant, and Criterion-Related Validity

Aims of this study were (a) to summarize the psychometric literature on the Mobility Inventory for Agoraphobia (MIA), (b) to examine the convergent and discriminant validity of the MIA's Avoidance Alone and Avoidance Accompanied rating scales relative to clinical severity ratings of anxiety disorders from the Anxiety Disorders Interview Schedule (ADIS), and (c) to establish a cutoff score indicative of interviewers’ diagnosis of agoraphobia for the Avoidance Alone scale. A meta-analytic synthesis of 10 published studies yielded positive evidence for internal consistency and convergent and discriminant validity of the scales. Participants in the present study were 129 people with a diagnosis of panic disorder. Internal consistency was excellent for this sample, α = .95 for AAC and .96 for AAL. When the MIA scales were correlated with interviewer ratings, evidence for convergent and discriminant validity for AAL was strong (convergent r with agoraphobia severity ratings = .63 vs. discriminant rs of .10–.29 for other anxiety disorders) and more modest but still positive for AAC (.54 vs. .01–.37). Receiver operating curve analysis indicated that the optimal operating point for AAL as an indicator of ADIS agoraphobia diagnosis was 1.61, which yielded sensitivity of .87 and specificity of .73.

What zinc supplementation does and does not achieve in diarrhea prevention: a systematic review and meta-analysis

BackgroundPrevention of diarrhea has presented indomitable challenges. A preventive strategy that has received significant interest is zinc supplementation. Existing literature including quantitative meta-analyses and systematic reviews tend to show that zinc supplementation is beneficial however evidence to the contrary is augmenting. We therefore conducted an updated and comprehensive meta-analytical synthesis of the existing literature on the effect of zinc supplementation in prevention of diarrhea.MethodsEMBASE®, MEDLINE ® and CINAHL® databases were searched for published reviews and meta-analyses on the use of zinc supplementation for the prevention childhood diarrhea. Additional RCTs published following the meta-analyses were also sought. Effect of zinc supplementation on the following five outcomes was studied: incidence of diarrhea, prevalence of diarrhea, incidence of persistent diarrhea, incidence of dysentery and incidence of mortality. The published RCTs were combined using random-effects meta-analyses, subgroup meta-analyses, meta-regression, cumulative meta-analyses and restricted meta-analyses to quantify and characterize the role of zinc supplementation with the afore stated outcomes.ResultsWe found that zinc supplementation has a modest beneficial association (9% reduction) with incidence of diarrhea, a stronger beneficial association (19% reduction) with prevalence of diarrhea and occurrence of multiple diarrheal episodes (28% reduction) but there was significant unexplained heterogeneity across the studies for these associations. Age, continent of study origin, zinc salt and risk of bias contributed significantly to between studies heterogeneity. Zinc supplementation did not show statistically significant benefit in reducing the incidence of persistent diarrhea, dysentery or mortality. In most instances, the 95% prediction intervals for summary relative risk estimates straddled unity.ConclusionsDemonstrable benefit of preventive zinc supplementation was observed against two of the five diarrhea-related outcomes but the prediction intervals straddled unity. Thus the evidence for a preventive benefit of zinc against diarrhea is inconclusive. Continued efforts are needed to better understand the sources of heterogeneity. The outcomes of zinc supplementation may be improved by identifying subgroups that need zinc supplementation.

"The road to forgiveness: A meta-analytic synthesis of its situational and dispositional correlates": Correction to Fehr et al. (2010).

Reports an error in road to forgiveness: A meta-analytic synthesis of its situational and dispositional by Ryan Fehr, Michele J. Gelfand and Monisha Nag (Psychological Bulletin, 2010[Sep], Vol 136[5], 894-914). In Table 2, weighted population correlations and associated standard errors and confidence intervals are incorrectly reported. In Table 3, weighted population correlations and associated confidence intervals are incorrectly reported, as well as the Q statistic for trait forgiveness. Corrected data are presented. The authors note that substantive interpretations of the results are not affected by the corrections. The median absolute value correction for the weighted population correlations in both tables is r = .01. (The following abstract of the original article appeared in record 2010-17510-010.) Forgiveness has received widespread attention among psychologists from social, personality, clinical, developmental, and organizational perspectives alike. Despite great progress, the forgiveness literature has witnessed few attempts at empirical integration. Toward this end, we meta-analyze results from 175 studies and 26,006 participants to examine the correlates of interpersonal forgiveness (i.e., forgiveness of a single offender by a single victim). A tripartite forgiveness typology is proposed, encompassing victims' (a) cognitions, (b) affect, and (c) constraints following offense, with each consisting of situational and dispositional components. We tested hypotheses with respect to 22 distinct constructs, as correlates of forgiveness, that have been measured across different fields within psychology. We also evaluated key sample and study characteristics, including gender, age, time, and methodology as main effects and moderators. Results highlight the multifaceted nature of forgiveness. Variables with particularly notable effects include intent (r = -.49), state empathy (r = .51), apology (r = .42), and state anger (r = -.41). Consistent with previous theory, situational constructs are shown to account for greater variance in forgiveness than victim dispositions, although within-category differences are considerable. Sample and study characteristics yielded negligible effects on forgiveness, despite previous theorizing to the contrary: The effect of gender was nonsignificant (r = .01), and the effect of age was negligible (r = .06). Preliminary evidence suggests that methodology may exhibit some moderating effects. Scenario methodologies led to enhanced effects for cognitions; recall methodologies led to enhanced effects for affect. (PsycINFO Database Record (c) 2011 APA, all rights reserved). Language: en

Supplemental Material for Noise Effects on Human Performance: A Meta-Analytic Synthesis

Supplemental Material for Noise Effects on Human Performance: A Meta-Analytic Synthesis

USING INTERNATIONAL STUDY SERIES AND META-ANALYTIC RESEARCH SYNTHESES TO SCOPE PEDAGOGICAL DEVELOPMENT AIMED AT IMPROVING STUDENT ATTITUDE AND ACHIEVEMENT IN SCHOOL MATHEMATICS AND SCIENCE

Taking lower-secondary schooling within the English educational system as an example, this paper illustrates the contribution of two bodies of international scholarship to the scoping of research-based pedagogical development aimed at improving student attitude and achievement in science and mathematics. After sketching the English context of systemic reform, the paper uses findings from the Trends in International Mathematics and Science Study (TIMSS) series to illuminate changes in performance, analysed within a framework of cross-system and between-subject comparison. Contrary to the optimistic picture from national assessment, the TIMSS findings suggest that systemic reform has produced fundamental gains only in student achievement in mathematics, and serious declines in student attitude towards both mathematics and science. Prompted by more favourable patterns elsewhere, the paper then triangulates the findings of recent meta-analytic research syntheses to identify promising lines of pedagogical development. Despite important differences in the conceptual frameworks and analytic methods of these syntheses, reasonably robust conclusions can be drawn about the effectiveness of four teaching components: domain-specific inquiry for student achievement in both subjects, student attitude in science, and learning processes in mathematics; cooperative group work for learning and attitude in science; contextual orientation for achievement in science; and active teaching for achievement in mathematics. Equally, discrepancies between findings or insufficiencies of evidence highlight a number of impacts particularly deserving deeper analysis or further investigation: cooperative group work on achievement outcomes, differing forms of learning assessment on both attitude and achievement outcomes, contextual orientation on outcomes in mathematics, and active teaching on outcomes in science.