Accelerate Literature Icon
Want to do a literature review? Try our new Literature Review workflow

Improving Research through Avoiding Common Statistical Errors: The Case of Piosphere

  • TL;DR
  • Abstract
  • Literature Map
  • Similar Papers
TL;DR

This review of 875 piosphere studies from 1915-2018 identifies frequent statistical errors, including improper technique selection and misinterpretation, which compromise result accuracy. The authors recommend early statistician consultation to improve research validity and reliability.

Abstract
Translate article icon Translate Article Star icon

For many years scientists studied the piosphere concept- a grazing gradient around a natural/artificial watering point. As is the case for other kinds of ecological studies, the method of statistical analyses applied in many publications is not always appropriate. We note there are many statistical errors and misapplication of data analysis techniques. We reviewed 875 piosphere-related publications between 1915-2018 to find the common statistical methods and common statistical errors in the design of the study, data analyses, presentation of results, and interpretation of study findings. One-way ANOVA, multiple linear regression, Pearson correlation coefficient, permutational multivariate analysis of variance, canonical correspondence analysis, and mean were the most frequent statistical methods applied. Seventy-one common statistical errors in piosphere publications were found. The most common errors were not choosing the proper or appropriate statistical techniques, not checking the assumptions and diagnostics of statistical methods, partial and wrong interpretation of results, and not using informative figures and tables to help readers. Negligence to the proper application of statistics by researchers results in inaccurate interpretation and spurious conclusions. It is recommended researchers seek advice from statisticians at the early stages of research to save resources, time, and labor and to provide increased trust in recommendations and findings.

Similar Papers
  • Research Article
  • 10.31254/jsir.2018.7105
A comparative analysis of quality of reporting statistics in two Indian journals
  • Mar 30, 2018
  • Journal of Scientific and Innovative Research
  • Mehta Manthan N + 1 more

Purpose: The importance of statistical analysis in medical research papers is ever increasing, hence, evaluation of statistical validity is crucial when evidence based medicine is highly valued. Studies with poor methodological quality and poor statistics cannot prove or disprove study hypothesis with certainty. This study was designed to evaluate, analyze and compare the reporting of statistical methods and errors in articles published in Indian Journal of Pharmacology (IJP) and Journal of Association of Physicians of India (JAPI). Materials and Methods: All original articles published in IJP and JAPI from January 2009 to September 2014 were reviewed and evaluated by using a checklist which included type of statistical test, common errors, etc. The statistical software used for analysis of data in these articles were also reviewed. Results: Three hundred articles (IJP=154; JAPI=146) were reviewed. The most commonly used statistical test in IJP was one-way ANOVA (53.8%) as compared to Chi-square test (50.6%) in JAPI. The statistical software used for analysis was mentioned in 43.5% and 50.7% articles published in IJP and JAPI respectively. The most commonly used software was GraphPad Prism (66.4%) in IJP and SPSS (67%) in JAPI. Statistical errors as per the checklist were more common in JAPI (63.5%) as against 49% in IJP. Use of mean+SE instead of Mean+SD was the most common statistical error in IJP (51.9%) whereas failure to mention the type of 't' test was the most common error (38%) in JAPI. Conclusion: Statistical errors are common in IJP as well as JAPI. To elevate the quality of articles published in Indian journals, every article must be sent for statistical review.

  • Research Article
  • Cite Count Icon 2
  • 10.47836/pjssh.30.3.26
Assessing Lower Secondary School Students’ Common Errors in Statistics
  • Sep 9, 2022
  • Pertanika Journal of Social Sciences and Humanities
  • Lim Hooi Lian + 2 more

Statistical literacy has been emphasised in the school mathematics curriculum, with the growing concern about students’ ability to think critically in solving statistical problem-solving tasks. However, the current studies revealed that secondary school students’ errors mainly involve the problem of basic concepts in statistics, data interpretation, and the selection of an appropriate representation of data. Therefore, this study aimed to analyse the common errors made by students in solving statistics tasks with multi-level complexity. A survey method was applied in this study. The sample of this study consisted of 356 Form One (Grade 7) students from eight secondary schools. The instrument of this study consisted of five superitem tasks, which represented the five content domains: line graph, bar graph, pie chart, dot plot, and histogram. There are four levels of items in each superitem task. Thus, the total number of items is 20. The format of all the 20 items in the five superitem tasks is open-ended. The common errors were then analysed based on all the participants’ solutions shown in their answer script. The findings found that most students could not achieve the highest level of statistical competency. They failed to think qualitatively while justifying data. This study provides a meaningful analysis that assists the teaching and learning of statistics to better link numeracy and literacy. The application of the superitem tasks provides valuable information that enables the teachers to understand their students’ statistical processes better.

  • Research Article
  • Cite Count Icon 8
  • 10.1080/00224065.2005.11980304
Common Errors in Statistics (and How to Avoid Them)
  • Jan 1, 2005
  • Journal of Quality Technology
  • Lloyd S Nelson

"Common Errors in Statistics (and How to Avoid Them)." Journal of Quality Technology, 37(1), pp. 87–88

  • Research Article
  • Cite Count Icon 6
  • 10.1198/tas.2004.s25
Common Errors in Statistics (and How to Avoid Them)
  • Nov 1, 2004
  • The American Statistician
  • Christine M Anderson-Cook

(2004). Common Errors in Statistics (and How to Avoid Them) The American Statistician: Vol. 58, No. 4, pp. 359-359.

  • Research Article
  • 10.1080/00949650802288619
A book on common statistics errors is reviewed
  • Apr 1, 2009
  • Journal of Statistical Computation and Simulation
  • Ramalingam Shanmugam

[1] Common Errors in Statistics (and How to Avoid Them), by Philip I. Good and James W. Hardin, 2006, John Wiley and Sons Inc., 111 River Street, MS 8-01, Hoboken, NJ 07030-5774, USA, ISBN: 0 471 7...

  • Supplementary Content
  • Cite Count Icon 16
  • 10.4097/kjae.2016.69.3.219
Avoiding negative reviewer comments: common statistical errors in anesthesia journals
  • Jun 1, 2016
  • Korean Journal of Anesthesiology
  • Sangseok Lee

Manuscripts submitted to journals should be understandable even to those who are not experts in a particular field. Moreover, they should use publicly available materials and the results should be verifiable and reproducible. Readers and reviewers will want to check the strengths and weaknesses of the research study design, and ways to make this determination should be clear through proper analysis methods. Studies should be described in detail so as to help readers understand the results. Statistical analysis is one of the key methods by which to do this. The inappropriate application of statistical methods could be misleading to readers and clinicians. While many researchers describe their general research methods in detail, statistical methods tend to be described briefly, with certain omissions or errors or other incorrect aspects. For instance, researchers should describe whether the median or mean was used, whether parametric or nonparametric tests were used, whether the data meet the normality test, whether confounding factors were corrected, and whether stratification or matching methods were used. Statistical analysis regardless of the program should be reported correctly. The results may be less reliable if the statistical assumptions before applying the statistical method are not met. These common errors in statistical methods originate from the researcher's lack of knowledge of statistics and/or from the lack of any statistical consultation. The aim of this work is to help researchers know what is important statistically and how to present it in papers.

  • Research Article
  • Cite Count Icon 7
  • 10.1136/bmjpo-2024-002755
Common errors in statistics and methods
  • Aug 1, 2024
  • BMJ Paediatrics Open
  • Peter Flom + 7 more

As statistical reviewers and editors for BMJ Paediatrics Open (BMJPO), we frequently see methodological and statistical errors in articles submitted to our journal. To make a list of these common...

  • Research Article
  • Cite Count Icon 3
  • 10.1111/anae.13506
Don't judge a book by its cover, don't judge a study by its abstract. Common statistical errors seen in medical papers.
  • May 9, 2016
  • Anaesthesia
  • S W Choi + 1 more

Don't judge a book by its cover, don't judge a study by its abstract. Common statistical errors seen in medical papers.

  • Report Series
  • Cite Count Icon 5
  • 10.29007/964b
Statistical Errors in Software Engineering Experiments: A Preliminary Literature Review
  • May 30, 2018
  • EasyChair preprint
  • Rolando Reyes + 3 more

<strong>Background: </strong>Statistical concepts and techniques are often applied incorrectly, even in mature disciplines such as medicine or psychology. Surprisingly, there are very few works that study statistical problems in software engineering (SE).<strong>Aim: </strong>Assess the existence of statistical errors in SE experiments.<strong>Method: </strong>Compile the most common statistical errors in experimental disciplines. Survey experiments published in ICSE to assess whether errors occur in high quality SE publications.<strong>Results:</strong> The same errors as identified in others disciplines were found in ICSE experiments, where 30% of the reviewed papers included several error types such as: a) missing statistical hypotheses, b) missing sample size calculation, c) failure to assess statistical test assumptions, and d) uncorrected multiple testing. This rather large error rate is greater for research papers where experiments are confined to the validation section. The origin of the errors can be traced back to: a) researchers not having sufficient statistical training, and, b) a profusion of exploratory research.<strong>Conclusions:</strong> This paper provides preliminary evidence that SE research suffers from the same statistical problems as other experimental disciplines. However, the SE community appears to be unaware of any shortcomings in its experiments, whereas other disciplines work hard to avoid these threats. Further research is necessary to find the underlying causes and set up corrective measures, but there are some potentially effective actions and are a priori easy to implement: a) improve the statistical training of SE researchers, and b) enforce quality assessment and reporting guidelines in SE publications.

  • Conference Article
  • Cite Count Icon 19
  • 10.1145/3180155.3180161
Statistical errors in software engineering experiments
  • May 27, 2018
  • Rolando P Reyes + 3 more

Background: Statistical concepts and techniques are often applied incorrectly, even in mature disciplines such as medicine or psychology. Surprisingly, there are very few works that study statistical problems in software engineering (SE). Aim: Assess the existence of statistical errors in SE experiments. Method: Compile the most common statistical errors in experimental disciplines. Survey experiments published in ICSE to assess whether errors occur in high quality SE publications. Results: The same errors as identified in others disciplines were found in ICSE experiments, where 30% of the reviewed papers included several error types such as: a) missing statistical hypotheses, b) missing sample size calculation, c) failure to assess statistical test assumptions, and d) uncorrected multiple testing. This rather large error rate is greater for research papers where experiments are confined to the validation section. The origin of the errors can be traced back to: a) researchers not having sufficient statistical training, and, b) a profusion of exploratory research. Conclusions: This paper provides preliminary evidence that SE research suffers from the same statistical problems as other experimental disciplines. However, the SE community appears to be unaware of any shortcomings in its experiments, whereas other disciplines work hard to avoid these threats. Further research is necessary to find the underlying causes and set up corrective measures, but there are some potentially effective actions and are a priori easy to implement: a) improve the statistical training of SE researchers, and b) enforce quality assessment and reporting guidelines in SE publications.

  • Abstract
  • Cite Count Icon 7
  • 10.1182/blood-2021-149881
Comprehensive Understanding of Gut Microbiota in Treatment Naïve Diffuse Large B Cell Lymphoma Patients
  • Nov 5, 2021
  • Blood
  • Sang Eun Yoon + 5 more

Comprehensive Understanding of Gut Microbiota in Treatment Naïve Diffuse Large B Cell Lymphoma Patients

  • Research Article
  • Cite Count Icon 1
  • 10.1080/10543400903406028
A Review of: “Common Errors in Statistics (and How to Avoid Them), Third Edition, by P. I. Good and J. W. Hardin”
  • Dec 31, 2009
  • Journal of Biopharmaceutical Statistics
  • Robert W Hayden

The first edition of this book was reviewed in this journal (Hayden, 2004) but not the second edition. This third edition sees the work expanded by about 50 pages, and the bibliography and indices ...

  • Research Article
  • 10.1007/s00362-007-0075-2
Phillip I. Good, James W. Hardin, Common errors in statistics
  • Aug 23, 2007
  • Statistical Papers
  • Roland Fried

Phillip I. Good, James W. Hardin, Common errors in statistics

  • Research Article
  • 10.1177/096228020501400211
Book Review: Common errors in statistics (and how to avoid them)
  • Apr 1, 2005
  • Statistical Methods in Medical Research
  • Peter L Bonate

Book Review: Common errors in statistics (and how to avoid them)

  • Research Article
  • 10.1111/j.1740-9713.2006.00205.x
Reviews
  • Nov 28, 2006
  • Significance

Books reviewed in this article: Common Errors in Statistics (and How to Avoid Them). 2d Edition Philip I. Good and James W. Hardin Statistical thinking in busineess, 2nd Edition J Bobe E J A John, D Whitaker & D G Johnson Mathematical Statistics with Applications. A S Kapadia, W Chan and L Moyé The Cambridge Dictionary of Statistics. 3rd Edition. B. S. Everitt The Oxford Dictionary of Statistical Terms. 6th edition Y. Dodge

Save Icon
Up Arrow
Open/Close
Notes

Save Important notes in documents

Highlight text to save as a note, or write notes directly

You can also access these Documents in Paperpal, our AI writing tool

Powered by our AI Writing Assistant