Abstract

The study of human behavior is severely hampered by logistical problems, ethical and legal constraints, and funding shortfalls. However, the biggest difficulty of conducting social and behavioral research is the extraordinary complexity of the study phenomena. In this article, we review the impact of complexity on research design, hypothesis testing, measurement, data analyses, reproducibility, and the communication of findings in psychological science. The systematic investigation of the world often requires different approaches because of the variability in complexity. Confirmatory testing, multi-factorial designs, survey methods, large samples, and modeling are frequently needed to study complex social and behavioral topics. Complexity impedes the measurement of general constructs, the reproducibility of results and scientific reporting, and the general rigor of research. Many of the benchmarks established by classic work in physical science are not attainable in studies of more complex phenomena. Consequently, the standards used to evaluate scientific research should be tethered to the complexity of the study topic.

Highlights

  • Researchers in the physical sciences have implored scientists in other fields to be like them

  • Social and behavioral scientists generally investigate more complex phenomena than natural scientists. They have learned that traditional scientific approaches are not always well suited for the examination of challenging topics, such as the dynamics of organizations and the machinations of the mind. Researchers in fields, such as psychology, anthropology, and sociology, have found it necessary to develop new methods and approaches to study phenomena that are lacking in regularity and predictability

  • We examine how the practice of science in psychology has been shaped by the complexity of the study phenomena

Read more

Summary

The Impact of Complexity on Methods and Findings in Psychological Science

Reviewed by: Liliann Manning, Independent Researcher, Strasbourg, France Donald Sharpe, University of Regina, Canada Robert Lickliter, Florida International University, United States. The study of human behavior is severely hampered by logistical problems, ethical and legal constraints, and funding shortfalls. The biggest difficulty of conducting social and behavioral research is the extraordinary complexity of the study phenomena. We review the impact of complexity on research design, hypothesis testing, measurement, data analyses, reproducibility, and the communication of findings in psychological science. Confirmatory testing, multi-factorial designs, survey methods, large samples, and modeling are frequently needed to study complex social and behavioral topics. Complexity impedes the measurement of general constructs, the reproducibility of results and scientific reporting, and the general rigor of research. Many of the benchmarks established by classic work in physical science are not attainable in studies of more complex phenomena. The standards used to evaluate scientific research should be tethered to the complexity of the study topic

INTRODUCTION
Impact of Complexity on Methods
SCIENCE IS NOT ALWAYS THE SAME
THE IMPACT OF COMPLEXITY ON THEORY DEVELOPMENT
CONFIRMATORY HYPOTHESIS TESTING IN PSYCHOLOGICAL SCIENCE
Research Design
Statistical Analyses
Scientific Reporting
The Problem of Generality
Internal Constructs and Processes
THE EFFECT OF COMPLEXITY ON REPLICATION
Replicating Variable and Weak Effects
Questionable Research Practices
The Importance of Replication Studies
What Do Replication Studies Say About Generalization?
The Most Straightforward Conclusion
Modest Goals
Building on Weakness
Easy Solutions
Findings
SOME TOPICS ARE HARDER TO STUDY THAN OTHERS

Talk to us

Join us for a 30 min session where you can share your feedback and ask us any queries you have

Schedule a call

Disclaimer: All third-party content on this website/platform is and will remain the property of their respective owners and is provided on "as is" basis without any warranties, express or implied. Use of third-party content does not indicate any affiliation, sponsorship with or endorsement by them. Any references to third-party content is to identify the corresponding services and shall be considered fair use under The CopyrightLaw.