Abstract
The National Academies of Sciences, Engineering, and Medicine (NASEM) 2019 report Reproducibility and Replicability in Science addresses issues related to reproducibility and replicability across science. In this article, we explore the implications of this report and its recommendations in the publishing sphere using our experiences with the ongoing reproducibility pilot for the IEEE Transactions on Parallel and Distributed Systems (TPDS), which involves badging based on the postpublication peer review of code and other artifacts associated with articles published in TPDS, to explore key opportunities and challenges in implementing the report’s recommendations.
Highlights
Reproducibility is foundational to solid scientific and technical research
We explore the implications of this report and its recommendations in the publishing sphere using our experiences with the ongoing reproducibility pilot for the Institute of Electrical and Electronics Engineers (IEEE) Transactions on Parallel and Distributed Systems (TPDS), which involves badging based on the postpublication peer review of code and other artifacts associated with articles published in TPDS, to explore key opportunities and challenges in implementing the report’s recommendations
We use our experiences with the ongoing reproducibility pilot for the journal IEEE Transactions on Parallel and Distributed Systems (TPDS) (Parashar, 2019) (IEEE Computer Society, 2020), which involves badging based on the postpublication peer review of code and other artifacts associated with articles published in TPDS, to explore key opportunities and challenges in implementing the report’s recommendations
Summary
Reproducibility is foundational to solid scientific and technical research. The ability to repeat the research that produced published results is a key approach for confirming the validity of a new scientific discovery. This report provides key insights and recommendations aimed at accelerating community efforts toward establishing reproducibility as a dissemination standard, including those engaged in by publishers It notes that “journal editors should consider ways to ensure reproducibility for publications that make claims based on computations, to the extent ethically and legally possible” (p.2), and outlines new opportunities to engage the community and consider avenues for the advancement of reproducibility, in particular, from the incentives perspective. We use our experiences with the ongoing reproducibility pilot for the journal IEEE Transactions on Parallel and Distributed Systems (TPDS) (Parashar, 2019) (IEEE Computer Society, 2020), which involves badging based on the postpublication peer review of code and other artifacts associated with articles published in TPDS, to explore key opportunities and challenges in implementing the report’s recommendations
Sign-in/Register to view highlights & summary Sign-in/Register to access full text options 
Free) 
Talk to us
Join us for a 30 min session where you can share your feedback and ask us any queries you have
Schedule a call
