Methodological Weaknesses Research Articles

Too hot to help or too cold to care? On the links between ambient temperature, volunteerism, and civic engagement.

We investigated the relationship between ambient temperature and prosocial behaviour in real-life settings. It was guided by two mechanisms of opposite predictions, namely (1) higher temperatures decrease prosociality by harming well-being, and (2) higher temperatures increase prosociality by promoting the embodied cognition of social warmth. In Study 1, U.S. state-level time-series data (2002-2015) supported the first mechanism, with higher temperatures predicting lower volunteer rates through lower well-being. Study 2 furthered the investigation by probing the relationship between neighbourhood temperature and civic engagement of 2268 U.S. citizens. The data partially supported the well-being mechanism and reported findings contradictory to the social embodiment mechanism. Higher temperatures predicted lower interpersonal trust and subsequently lower civic engagement. The unexpected finding hinted at a cognitive effect of heat and a compensatory mechanism in social thermoregulation. We discussed the findings regarding their methodological strengths and weaknesses, with cautions made on ecological fallacies and alternative models.

Lost in the mall again: a preregistered replication and extension of Loftus & Pickrell (1995)

ABSTRACT The seminal Lost in the Mall study [Loftus, E. F., & Pickrell, J. E. (1995). The formation of false memories. Psychiatric Annals, 25(12), 720–725. https://doi.org/10.3928/0048-5713-19951201-07] has been enormously influential in psychology and is still cited in legal cases. The current study directly replicated this paper, addressing methodological weaknesses including increasing the sample size fivefold and preregistering detailed analysis plans. Participants (N = 123) completed a survey and two interviews where they discussed real and fabricated childhood events, based on information provided by an older relative. We replicated the findings of the original study, coding 35% of participants as reporting a false memory for getting lost in a mall in childhood (compared to 25% in the original study). In an extension, we found that participants self-reported high rates of memories and beliefs for the fabricated event. Mock jurors were also highly likely to believe the fabricated event had occurred and that the participant was truly remembering the event, supporting the conclusions of the original study.

Constraints on peace research in war-torn situations: Cabo Delgado, Mozambique

Purpose It is assumed that fieldwork experiential learning on constraints of survey and ethnography research orientations in investigating armed conflict in Africa can contribute to the body of knowledge and help practitioners as well as other researchers working in difficult situations, such as war zones. More importantly, this paper aims to understand significant problems in Southern Africa, further methodological debates and produce new frontiers of knowledge in Southern African research studies. This paper will help other researchers who will be planning to conduct research in ongoing war-torn zones to be flexible with mixed research methodologies and data collection techniques that can ensure not only reliability and validity of the data but also, and more importantly, greater generalizability of this study. Design/methodology/approach This research in Cabo was initially guided by survey and ethnographic approaches. After facing constraints in their use in investigating the complexity of new wars, the author developed and shifted to interpretivism methodology as an alternative. It is essential that researchers be sensitive to the tensions between survey and ethnography methodologies and how they can be a mismatch to the research purpose. Findings The fieldwork experiences, using standardised survey and ethnography research orientations in Gabo, show that there is no generally appropriate blueprint of how to conduct research in violent conflicts. The valorised survey and ethnographic research strategies were not closely matched to facilitate understanding of the complexity of hybrid armed actors, indiscriminate and targeted violence which combined to militate against data generation. In the face of these problems, the author developed a new methodology, interpretivism, which embedded the descriptive, explanatory and predictive approaches. In tumultuous contexts, the standardised methodologies prioritize data generation more than critical thinking. Originality/value It is essential to study the nature of African armed conflicts by combining creativity and flexibility in the selection of research strategies. The constraints on peace research in war-torn situations in Cabo Delgado, Mozambique, have laid out the weaknesses of peacetime research methodologies, including survey research and ethnographic approaches. Now is the time to reassess fieldwork-based research particularly in violent settings.

Research in a Closed Political Context, COVID, and Across Languages: Methodological Lessons, Messages, and Ideas

This study offers a number of contemporary qualitative and mixed methods research lessons regarding cross-language research and research in closed social and political contexts such as post-Soviet countries, especially how such research may be adapted to disruptions like those posed by the COVID pandemic or other disasters. The lessons draw from a study of policy learning among government officials in Kazakhstan which illustrated several methodological strengths and weaknesses and generated a number of methodological recommendations. In particular, while the literature on best practices for research in closed contexts emphasizes deep interactions to develop trust, the COVID pandemic and other disruptions may force researchers to transition to online modalities and constrain options. We suggest strategies to overcome these limitations, including supplementing findings from interviews with content analysis or other multimethod approaches. Additionally, we argue that researchers in post-Soviet and post-colonial contexts must be particularly attuned to the challenges of cross-language research and the combination of local languages with the language of the colonial power. These lessons hold relevance for researchers working in a variety of contexts as they conduct research during times of disasters and geopolitical instability.

Risk formulation in forensic practice: a review of the evidence

PurposeThe purpose of this paper is to review the evidence base for the use of risk formulation in forensic practice settings.Design/methodology/approachSystematic literature review principles were adopted to identify literature exploring risk formulation in forensic practice settings in relation to offending behaviour.FindingsData were analysed using a narrative synthesis approach, and commonalities were observed across some of the studies in terms of definitions, outcomes, and implementation, of risk formulation; however, the findings of the review did not provide a definitive account of risk formulation practice in forensic settings. This is due to the narrow scope of the included studies, the small yet diverse samples, the heterogeneity in research aims and the methodological weaknesses apparent within the included studies.Research limitations/implicationsFurther research is needed to understand the application and outcomes of risk formulation in forensic practice settings.Practical implicationsPractitioners should be clear about how they are defining, implementing and assessing the outcomes of risk formulation, alongside being mindful of the evidence base when utilising forensic risk formulation in practice.Originality/valueTo the best of the authors’ knowledge, this is the first paper to focus solely on the evidence base for forensic risk formulation in practice.

Involving adolescents in the design, implementation, evaluation and dissemination of health research: an umbrella review protocol

IntroductionA lack of awareness on how to engage adolescents in research has been reported as one of the barriers to meaningful youth involvement in health research. Currently, available guidelines on...

Proposing a General Formula for Evaluating the Parametric Cost Using MLR Method

This research takes up address the practical side by taking case studies for construction projects that include the various Iraqi governorates, as it includes conducting a field survey to identify the impact of parametric costs on construction projects and compare them with what was reached during the analysis and the extent of their validity and accuracy, as well as adopting the approach of personal interviews to know the reality of the state of construction projects. The results showed, after comparing field data and its measurement in construction projects for the sectors (public and private), the correlation between the expected and actual cost change was (97.8%), and this means that the data can be adopted in the research study of the integration of parametric costs in a predictive model for future study. Changes in the parametric costs of construction projects substantially impact their time, cost, and quality and are a major barrier to their execution, necessitating research, analysis, and the development of the most effective solutions. The study aims to identify the parametric cost accurately through iterative tests and continuous improvements by presenting literature describing the history and characteristics of the parametric cost methodologies and identifying each methodology's limitations, strengths, and weaknesses to promote a better understanding of their best practices and use for managing project cost

Impact of the COVID-19 Pandemic on Children and Adolescents with New-Onset Type 1 Diabetes

Background. The COVID-19 pandemic has an impact on the incidence of type 1 diabetes and frequency of diabetic ketoacidosis. However, the exact relationships are unclear. It is also not known whether this is a short-term phenomenon or whether the effects have long-term relevance. Furthermore, it is not known whether these changes during the pandemic are due to direct effects of SARS-CoV-2 or to changes in the patient’s environment during the pandemic. Methods. We conducted an extensive literature search on PubMed. For the estimation of relative risks of new-onset type 1 diabetes, we applied a Poisson regression model and for the comparison of incidences and we included the logarithm of person-years. Furthermore, we performed a meta-analysis using the logarithm of the relative risk for new-onset type 1 diabetes as effect size. Results. Pooling the relative risk estimates in a random-effects meta-analysis revealed that the type 1 diabetes incidence rate increased by 20% (relative risk 1.200 (95% CI 1.125, 1.281)), and that the risk of new-onset type 1 diabetes after a SARS-CoV-2 infection increased by 62% (relative risk 1.622 (95% CI 1.347, 1.953)) compared with the prepandemic period. Conclusion. There is considerable evidence that there is an increase in type 1 diabetes in children during the COVID-19 pandemic. Many studies suggesting a direct effect of SARS-CoV-2 have methodological weaknesses. As no evidence of an increase in presymptomatic cases with isolated islet autoimmunity was found, this could also suggest an accelerated transition from presymptomatic patients to clinically overt type 1 diabetes. Furthermore, there was a marked exacerbation of the preexisting increase in the prevalence of diabetic ketoacidosis at diagnosis of type 1 diabetes during the pandemic. Both the increased incidence of paediatric type 1 diabetes and the higher prevalence of diabetic ketoacidosis at diagnosis led to a massive rise in the number of children with diabetic ketoacidosis during the pandemic.

A discussion of critical errors in a longitudinal study on the deterrent effect of drug‐induced homicide laws on opioid‐related mortality across 92 counties and the District of Columbia in the United States

AbstractDrug overdose claimed more than 100,000 lives in the United States in 2021. Drug‐induced homicide (DIH) laws create specific criminal liability for individuals who provide drugs that cause or contribute to the death of another person. DIH prosecutions in the United States have increased substantially over the past decade despite the absence of meaningful evidence of their individual‐ or community‐level impacts. Recently, Lee et al. analyzed the impact of DIH laws on county‐level opioid overdose mortality across 92 counties in 10 states and concluded that DIH laws are associated with significant reductions in rates of opioid overdose death. In this commentary, we present evidence demonstrating that the Lee et al. study is fundamentally flawed. Specifically, the legal data used by Lee et al. to define their treatment condition (the presence or absence of a state‐level DIH law) is incorrect in almost every aspect. We also describe significant methodological weaknesses, including flawed sampling strategies that resulted in a biased sample of county overdose rates as well as flawed modeling strategies that cannot effectively evaluate the hypothesis that DIH laws negatively impact opioid overdose mortality. More research on the individual‐ and community‐level impacts of DIH laws is needed. In the meantime, we advise policymakers to strengthen state 911 Good Samaritan laws, as DIH laws appear to erode the efficacy of this proven overdose‐prevention strategy.

Assessing the Subjective Effectiveness of Sensorimotor Insoles (SMIs) in Reducing Pain: A Descriptive Multicenter Pilot Study.

This pilot study aimed to investigate the use of sensorimotor insoles in pain reduction, different orthopedic indications, and the wearing duration effects on the development of pain. Three hundred and forty patients were asked about their pain perception using a visual analog scale (VAS) in a pre-post analysis. Three main intervention durations were defined: VAS_post: up to 3 months, 3 to 6 months, and more than 6 months. The results show significant differences for the within-subject factor "time of measurement", as well as for the between-subject factor indication (p < 0.001) and worn duration (p < 0.001). No interaction was found between indication and time of measurements (model A) or between worn duration and time of measurements (model B). The results of this pilot study must be cautiously and critically interpreted, but may support the hypothesis that sensorimotor insoles could be a helpful tool for subjective pain reduction. The missing control group and the lack of confounding variables such as methodological weaknesses, natural healing processes, and complementary therapies must be taken into account. Based on these experiences and findings, a RCT and systematic review will follow.

The Value Gap: A School Psychologist’s Perspective on Rausch et al.(2023)

Rausch et al. (2023) describe an empirical effort to test a number of hypotheses put forward by Lukianoff and Haidt (2018) regarding the values of contemporary (Gen Z) vs. previous generations of undergraduates. My review of their work focuses primarily on the methodologies Rausch et al. employ in executing their research. Strengths of their study include: the empirical replication and extension of prior claims; a priori specification of hypotheses and the methodology to test them; and the insight that prior claims may confound gender and generational status. Weaknesses include: the use of an untested (and unknown) scale to measure their dependent variable; the unfortunate and erroneous classification of majors into “hard” science vs. social science categories; a confound between graduate student status and generational status; and the number and interdependence of the statistical tests they use to test their hypotheses. All of the methodological weaknesses I identify (with the exception of their measurement of academic values) could be strengthened through changes to their procedures and analyses. Overall, their insight that Lukianoff and Haidt’s attribution of value differences to generational status may be confounded with gender is worthy of further research.

Effects of transcutaneous electrical acupoint stimulation on gastrointestinal dysfunction after gastrointestinal surgery: A meta-analysis.

Postoperative gastrointestinal dysfunction (PGD) is a common complication in patients undergoing gastrointestinal surgery. Several studies have evaluated the effect of transcutaneous electrical acupoint stimulation (TEAS) on PGD, so we conducted a systematic review and meta-analysis to better understand these studies methodologic limitations and summarize clinical effects. Articles (published from January 2010 to April 2022) were searched from the following databases: Wanfang Database, China National Knowledge Infrastructure (CNKI), Cochrane Library, PubMed, Web of Science and Embase. Two authors conducted literature selection, data extraction and statistical analysis independently. This meta-analysis used RevMan 5.4 software to implement statistical analysis and applied Cochrane bias risk tool to assess methodologic weaknesses of included articles. We assessed the effect of TEAS on time to first flatus, first defecation and bowel sound recovery through meta-analyses using a random-effects model. The meta-analysis included 10 articles including 1497 patients. This study showed that TEAS could effectively promote postoperative gastrointestinal function recovery by analyzing the time to first flatus (MD-14.81h, 95% CI -15.88 to -13.75h), time to first defecation (MD-14.68h, 95% CI -20.59 to -8.76h), time to bowel sound recovery (MD-5.79h, 95% CI -10.87 to -0.71h), length of hospital stay (MD-1.48d, 95% CI -1.86 to -1.11d), and the incidence of postoperative nausea and vomiting (PONV) (OR 0.41, 95% CI 0.29-0.58). In addition, we assessed the quality of the articles and found small sample sizes and lower methodological quality in some articles. Our meta-analysis revealed that TEAS could be a nonpharmacological treatment for PGD in patients after gastrointestinal surgery. However, positive findings should be treated carefully and future studies with high quality and large samples are needed to support this results.

Medical decision making beyond evidence: Correlates of belief in complementary and alternative medicine (CAM) and homeopathy.

Many people believe in and use complementary and alternative medicine (CAM) to address health issues or prevent diseases. Empirical evidence for those treatments is either lacking or controversial due to methodological weaknesses. Thus, practitioners and patients primarily rely on subjective references rather than credible empirical evidence from systematic research. This study investigated whether cognitive and personality factors explain differences in belief in CAM and homeopathy. We investigated the robustness of 21 predictors when examined together to obtain insights into key determinants of such beliefs in a sample of 599 participants (60% female, 18-81 years). A combination of predictors explained 20% of the variance in CAM belief (predictors: ontological confusions, spiritual epistemology, agreeableness, death anxiety, gender) and approximately 21% of the variance in belief in homeopathy (predictors: ontological confusions, illusory pattern perception, need for cognitive closure, need for cognition, honesty-humility, death anxiety, gender, age). Individuals believing in CAM and homeopathy have cognitive biases and certain individual differences which make them perceive the world differently. Findings are discussed in the context of previous literature and in relation to other unfounded beliefs.

Quantitative Scanning Transmission Electron Microscopy for Materials Science: Imaging, Diffraction, Spectroscopy, and Tomography

Scanning transmission electron microscopy (STEM) is one of the most powerful characterization tools in materials science research. Due to instrumentation developments such as highly coherent electron sources, aberration correctors, and direct electron detectors, STEM experiments can examine the structure and properties of materials at length scales of functional devices and materials down to single atoms. STEM encompasses a wide array of flexible operating modes, including imaging, diffraction, spectroscopy, and 3D tomography experiments. This review outlines many common STEM experimental methods with a focus on quantitative data analysis and simulation methods, especially those enabled by open source software. The hope is to introduce both classic and new experimental methods to materials scientists and summarize recent progress in STEM characterization. The review also discusses the strengths and weaknesses of the various STEM methodologies and briefly considers promising future directions for quantitative STEM research.

Lost in the mall again: a preregistered replication and extension of Loftus & Pickrell (1995)

ABSTRACT The seminal Lost in the Mall study has been enormously influential in psychology and is still cited in legal cases. The current study directly replicated this paper, addressing methodological weaknesses including increasing the sample size fivefold and preregistering detailed analysis plans. Participants (N = 123) completed a survey and two interviews where they discussed real and fabricated childhood events, based on information provided by an older relative. We replicated the findings of the original study, coding 35% of participants as reporting a false memory for getting lost in a mall in childhood (compared to 25% in the original study). In an extension, we found that participants self-reported high rates of memories and beliefs for the fabricated event. Mock jurors were also highly likely to believe the fabricated event had occurred and that the participant was truly remembering the event, supporting the conclusions of the original study.

Automatic Emotion Recognition in Clinical Scenario: A Systematic Review of Methods

Automatic emotion recognition has powerful opportunities in the clinical field, but several critical aspects are still open, such as heterogeneity of methodologies or technologies tested mainly on healthy people. This systematic review aims to survey automatic emotion recognition systems applied in real clinical contexts, to deeply analyse clinical and technical aspects, how they were addressed, and relationships among them. The literature review was conducted on: IEEEXplore, ScienceDirect, Scopus, PubMed, ACM. Inclusion criteria were the presence of an automatic emotion recognition algorithm and the enrollment of at least 2 patients in the experimental protocol. The review process followed the Preferred Reporting Items for Systematic Reviews and Meta-Analyses guidelines. Moreover, the works were analysed according to a reference model to deeply examine both clinical and technical topics. 52 scientific papers passed inclusion criteria. Most clinical scenarios involved neurodevelopmental, neurological and psychiatric disorders with the aims of diagnosing, monitoring, or treating emotional symptoms. The most adopted signals are video and audio, while supervised shallow learning is mostly used for emotion recognition. A poor study design, tiny samples, and the absence of a control group emerged as methodological weaknesses. Heterogeneity of performance metrics, datasets and algorithms challenges results comparability, robustness, reliability and reproducibility.

The Measurement of Acculturation in Neuropsychological Evaluations of Hispanic/Latino Individuals across the Lifespan: A Scoping Review of the Literature.

Acculturation has been linked to health outcomes in Hispanics/Latinos (H/Ls). However, there is equivocal evidence of a relationship between acculturation and neuropsychological outcomes. Various factors limit the ability to subject the evidence to systematic/meta-analytic review. We sought to examine the current state of the literature in the context of H/Ls and neuropsychology and describe the various limitations of measuring acculturation across the lifespan. Applying a scoping review approach, we identified unique stand-alone (e.g., questionnaires) measures of acculturation. We focused on psychometric (e.g., internal consistency) and other characteristics (e.g., language, structure/format) and description of the validation samples (e.g., cultural background/country of origin). A total of 40 unique acculturation measures were identified. Measures spanned various domains (e.g., language proficiency, food preference, music choice), and relied heavily on linguistic behavioral characteristics. Internal consistency varied from unacceptable to clinically acceptable ranges. Variable approaches to development and validation were reported. Validation samples varied from 22 to 2,048 respondents (median = 380), most of which represented a general adult population. Only eight measures were validated for use in pediatric populations; none were developed specifically for use with older adults. Published measures are outdated, evidence highly variable psychometric and methodological weaknesses, and lack a lifespan perspective. Several themes in the types of items considered elemental to the acculturative process are revealed and findings are summarized via an "ABC" framework, categorizing items as antecedents, behaviors, and consequent acculturative changes, that lends itself to clinical and research settings.

Relationship between parental exposure to radiofrequency electromagnetic fields and primarily hematopoietic neoplasms (lymphoma, leukemia) and tumors in the central nervous system in children: a systematic review.

Low-frequency electromagnetic fields have grown exponentially in recent years due to technological development and modernization. The World Health Organization (WHO)/International Agency for Research on Cancer (IARC) has classified radiofrequency electromagnetic fields (RF-EMFs) as possibly carcinogenic to humans (Group 2B), and recent studies have investigated the association between exposure to electromagnetic fields in parents and possible health effects in children, especially the development of tumours of the central nervous system (CNS). The objective of this systematic review was to collate all evidence on the relationship between parental occupational exposure to electromagnetic fields and the development of CNS cancer in children and to evaluate this association. This review was prepared according to the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) guidelines. PubMed, Embase, and Web of Science were searched from January 1990 to April 2021. The search was conducted using the following search string: "occupational" AND "child" AND "electromagnetic" AND "cancer". Seventeen articles met our inclusion criteria: 13 case-control studies, two cohort studies, and 2 meta-analyses. Most of the studies showed several methodological weaknesses that limited their results. Due to a lack of consistency regarding the outcome as well as the heterogeneity in the reviewed studies, the body of evidence for the effects of parental exposure to electromagnetic fields is not clear. Methodological heterogeneity in the way that studies were conducted could be responsible for the lack of consistency in the findings. Overall, the body of evidence allows no conclusion on the relationship between parental exposure to electromagnetic fields and the occurrence of CNS tumours in children.

Environmental hygiene in outdoor food markets in Africa: a scoping review

Abstract Outdoor food markets represent important locations where foodborne illnesses and other infectious diseases can spread. Countries in Africa face particular challenges given the importance of these markets in food supply and low rates of access to safely managed water and sanitation. We undertook a scoping review of evidence related to disease transmission in food markets in sub-Saharan Africa, North Africa and identified 46 papers for data extraction and synthesis. Vendor behaviour or awareness was reported in the majority of papers and about half reported on market infrastructure. Fewer studies have been reported on regulatory environments or food contamination. Studies on water supply, sanitation and handwashing facilities focused on the presence of services and did not evaluate quality, thus conclusions cannot be drawn on service adequacy. Studies of vendor behaviour were primarily based on self-reporting and subject to bias. Most studies reported high levels of vendor awareness of the need for hygiene, but where observations were also conducted, these showed lower levels of behaviours in practice. Our findings suggest that there are limited studies on environmental hygiene in outdoor food markets and this is an area warranting further research, including into the quality of services and addressing methodological weaknesses.

Risks and Benefits of Judo Training for Middle-Aged and Older People: A Systematic Review.

This systematic overview aimed to review studies investigating the benefits and risks of judo training in older people, and to explore practical methodological applications (Registration ID: CRD42021274825). Searches of EBSCOhost, ISI-WoS, and Scopus databases, with no time restriction up to December 2022, resulted in 23 records meeting the inclusion criteria. A quality assessment was performed through the following tools: ROBINS-I for 10 experimental studies, NIH for 7 observational studies, and AGREE-II for 6 methodological studies. A serious risk of bias emerged for 70% of the experimental studies, whereas 100% of the observational and 67% of the methodological studies presented a "fair" quality. When involving 1392 participants (63 ± 12 years; females: 47%), the studies investigated novice (n = 13), amateur/intermediate (n = 4), expert (n = 4), and unknown (n = 3) level judoka by means of device-based, self-reported, and visual evaluation measures. Mean training encompassed 2 ± 1 sessions. week-1 of 61 ± 17 min for 7 ± 6 months. In relation to judo training exposure and outcomes, three main themes emerged: (i) health (56% of studies; e.g., bones, anthropometry, quality of life); (ii) functional fitness (43%; e.g., balance, strength, walking speed); and iii) psychosocial aspects (43%; e.g., fear of falling, cognition, self-efficacy). Although the included studies presented relevant methodological weaknesses, the data support the positive effects of judo training with advancing age. Future research is needed to help coaches plan judo programs for older people.