Abstract

A randomization test (RndT) is a statistical significance test for which the validity is based on the random assignment of experimental units in a designed experiment. In a random sampling setting, it can also be applied in a very general way because its validity does not rely on distributional assumptions, homogeneity of variances, or independence of errors. However, the use of RndTs did not receive much attention in applied research because RndTs rely on computationally intensive algorithms and most popular and common statistical software packages do not provide facilities to easily perform randomization tests. In order to fill this gap, we present a software package, RT4Win. Unlike most stand-alone software and programs for RndTs, RT4Win is a fast Windows-based program with a user-friendly interface. It provides a facility to carry out RndTs in a series of experimental designs, for both systematic and Monte Carlo data partition methods. The program is free of charge and available upon request from the authors.

Highlights

  • A randomization test (RndT) is a statistical significance test for which the validity is based on the random assignment of experimental units in a designed experiment

  • RndTs did not receive much attention in applied research because RndTs rely on computationally intensive algorithms and most popular and common statistical software packages do not provide facilities to perform randomization tests

  • One of the reasons for this is probably that most of the introductions to inferential statistics focus on classical parametric statistical tests (t or F tests) and rarely include randomization tests and their rationale

Read more

Summary

KU Leuven

A randomization test (RndT) is a statistical significance test for which the validity is based on the random assignment of experimental units in a designed experiment. RndTs are formally defined as statistical significance tests for which the validity is based on the random assignment of experimental units in a designed experiment (Edgington & Onghena, 2007). This means that their p value can be derived in a valid way, just by taking into account the random assignment procedure that was used in the experiment. Fast and user-friendly software is not commonly available to the average researcher It is this gap that we want to fill with the presentation of RT4Win, a free Windows-based computer program for randomization psycho.belg.2012_4.book Page 389 Thursday, November 15, 2012 8:58 AM.

The rationale of randomization tests
Standard Treatment
Comparison with a parametric t test
Comparison with a nonparametric rank test
Systematic versus Monte Carlo randomization tests
Equivalent test statistics
Matching Test
Package Design
Data partitions p value
Findings
Discussion

Talk to us

Join us for a 30 min session where you can share your feedback and ask us any queries you have

Schedule a call

Disclaimer: All third-party content on this website/platform is and will remain the property of their respective owners and is provided on "as is" basis without any warranties, express or implied. Use of third-party content does not indicate any affiliation, sponsorship with or endorsement by them. Any references to third-party content is to identify the corresponding services and shall be considered fair use under The CopyrightLaw.