SMEP: stats interrater reliability and agreement

SMEP: stats - interrater reliability and agreement

various articles, ???

SAS manual for FREQ looks good: I used it for cohens_kappa

SPSS technical manual: ? haven't checked yet, but it should have many of those

Wikipedia: some information on individual measures, no details on statistical properties, tests

R: package irr for writing tests and to see what should be available

ICC is also in one of the nipy packages if I remember correctly nipype see https://github.com/statsmodels/statsmodels/issues/684

matlab - file-exchange BSD-licensed

http://www.mathworks.com/matlabcentral/fileexchange/22122-ipn-tools-for-test-retest-reliability-analysis: several correlation measures, ICC, CCC, Kendal W
http://www.mathworks.com/matlabcentral/fileexchange/22099-intraclass-correlation-coefficient-icc: 6 different ICC, used by above
http://www.mathworks.com/matlabcentral/fileexchange/21501-intraclass-correlation-coefficients: similar to previous above, 6 different ICC
http://www.mathworks.com/matlabcentral/fileexchange/26885-intraclass-correlation-coefficient-with-confidence-intervals: ?
http://www.mathworks.com/matlabcentral/fileexchange/22308-cohens-kappa-with-customizable-weightings: see also http://www.mathworks.com/matlabcentral/fileexchange/15365 I already have Cohen's kappa
http://www.mathworks.com/matlabcentral/fileexchange/15426-fleisses-kappa: I have fleiss_kappa but not the variance, test
http://www.mathworks.com/matlabcentral/fileexchange/36016-krippendorffs-alpha: R::irr has this also, haven't looked at what it is yet
http://www.mathworks.com/matlabcentral/fileexchange/22645-computing-kappa-index: I don't know what this is, clustering application