Is there an intrinsic logical error in null hypothesis significance tests? Commentary on: “Null hypothesis significance tests. A mix-up of two different theories: the basis for widespread confusion and numerous misinterpretations”

Abstract

In Schneider (Scientometrics 102:411–432, 2015), the author argues that there is an intrinsic logical problem in null hypothesis significance test and thus urges to use it carefully. We agree with the conclusion but not with the main argument, although there are other arguments that we agree with. In this letter to editor, we want to clarify further this issue of validity and applicability of null hypothesis significance test.