Skip to content

SMEP: Permutation Tests

josef-pkt edited this page Apr 28, 2013 · 1 revision

SMEP: Permutation Tests

needs more info

specific to statistical tests, this should be related to general resampling, bootstrap, cross-validation support and to application for specific models

Underlying assumptions or When do they work

example: comparing means, Wilcoxon–Mann–Whitney Test

Romano, Joseph P. 1990. “On the Behavior of Randomization Tests Without a Group Invariance Assumption.” Journal of the American Statistical Association 85 (411): 686–692. doi:10.2307/2290003.

Modarres, Reza, Joseph L Gastwirth, and Warren Ewens. 2005. “A Cautionary Note on the Use of Non‐parametric Tests in the Analysis of Environmental Data.” Environmetrics 16 (4) (June 1): 319–326. doi:10.1002/env.695.

Aickin, Mikel. 2010. “Invalid Permutation Tests.” International Journal of Mathematics and Mathematical Sciences 2010: 1–10. doi:10.1155/2010/769780.

Huang, Yifan, Haiyan Xu, Violeta Calian, and Jason C. Hsu. 2006. “To Permute or Not to Permute.” Bioinformatics 22 (18) (September 15): 2244–2248. doi:10.1093/bioinformatics/btl383. Fagerland, Morten W., and Leiv Sandvik. 2009. “The Wilcoxon–Mann–Whitney Test Under Scrutiny.” Statistics in Medicine 28 (10): 1487–1497. doi:10.1002/sim.3561.

Fay, Michael P. 2010. “Wilcoxon-Mann-Whitney or T-test? On Assumptions for Hypothesis Tests and Multiple Interpretations of Decision Rules.” Statistics Surveys 4: 1–39. doi:10.1214/09-SS051.

Kasuya, Eiiti. 2001. “Mann–Whitney U Test When Variances Are Unequal.” Animal Behaviour 61 (6) (June): 1247–1249. doi:10.1006/anbe.2001.1691.

Keller, Bryan. 2012. “Detecting Treatment Effects with Small Samples: The Power of Some Tests Under the Randomization Model.” Psychometrika 77 (2): 324–338. doi:10.1007/s11336-012-9249-5.

McElduff, Fiona, Mario Cortina-Borja, Shun-Kai Chan, and Angie Wade. 2010. “When T-tests or Wilcoxon-Mann-Whitney Tests Won’t Do.” Advances in Physiology Education 34 (3) (September 1): 128–133. doi:10.1152/advan.00017.2010.

Mewhort, D. 2005. “A Comparison of the Randomization Test with the<i>F</i> Test When Error Is Skewed.” Behavior Research Methods 37 (3): 426–435. doi:10.3758/BF03192711.

Mewhort, D., Matthew Kelly, and Brendan Johns. 2009. “Randomization Tests and the unequal-<i>N</i>/unequal-variance Problem.” Behavior Research Methods 41 (3): 664–667. doi:10.3758/BRM.41.3.664.

Ruxton, Graeme D. 2006. “The Unequal Variance T-test Is an Underused Alternative to Student’s T-test and the Mann–Whitney U Test.” Behavioral Ecology 17 (4) (July 1): 688–690. doi:10.1093/beheco/ark016.

Zimmerman, Donald W. 1987. “Comparative Power of Student T Test and Mann-Whitney U Test for Unequal Sample Sizes and Variances.” The Journal of Experimental Education 55 (3) (April 1): 171–174.