Abstract

ABSTRACTThe mid-p-value is a proposed improvement on the ordinary p-value for the case where the test statistic is partially or completely discrete. In this case, the ordinary p-value is conservative, meaning that its null distribution is larger than a uniform distribution on the unit interval, in the usual stochastic order. The mid-p-value is not conservative. However, its null distribution is dominated by the uniform distribution in a different stochastic order, called the convex order. The property leads us to discover some new finite-sample and asymptotic bounds on functions of mid-p-values, which can be used to combine results from different hypothesis tests conservatively, yet more powerfully, using mid-p-values rather than p-values. Our methodology is demonstrated on real data from a cyber-security application.

Highlights

  • Let T be a real-valued test statistic, with probability measure P0 under the null hypothesis, denoted H0

  • We say that a random variable is sub-uniform if it is less variable than a uniform random variable, U, in the convex order

  • The convex order provides a formal platform for the treatment and interpretation of mid-p-values

Read more

Summary

Introduction

Let T be a real-valued test statistic, with probability measure P0 under the null hypothesis, denoted H0. Note that we can work with an unrealised version of the randomised p-value, known as the fuzzy or abstract p-value (Geyer and Meeden, 2005), and either stop there — leaving interpretation to the decision-maker — or propagate uncertainty through to any post-hoc analysis, e.g. multiple-testing (Kulinskaya and Lewin, 2009; Habiger, 2015). It can allow breaches of the nominal level, the mid-p-value is often deemed to better represent the evidence against the null hypothesis than the ordinary or randomised p-values.

Main results
Example: network intrusion detection
Meta-analysis of mid-p-values: further details
Sums of mid-p-values
Simulations
Conclusion

Talk to us

Join us for a 30 min session where you can share your feedback and ask us any queries you have

Schedule a call

Disclaimer: All third-party content on this website/platform is and will remain the property of their respective owners and is provided on "as is" basis without any warranties, express or implied. Use of third-party content does not indicate any affiliation, sponsorship with or endorsement by them. Any references to third-party content is to identify the corresponding services and shall be considered fair use under The CopyrightLaw.