Nezlek, J. B., & Mrozinski, B. (2019, April 17). Applications of multilevel modeling in psychological science: Intensive repeated measures designs. Retrieved from osf.io/74m5r
Data, script and R outputs for Power section in Nezlek, J., Mrozinski, B., 2019, Applications of multilevel modeling in psychological science: Intensive repeated measures designs; L'Année psychologique (in print)
Multilevel modeling (MLM) is a statistical technique that can be used to analyze the data collected in various types of research. Although the use of and demand for MLM has increased dramatically over the past decade, instruction in MLM has not kept pace with these increases. The present paper provides an introduction to MLM that is intended to help researchers conduct MLM analyses and describe these results and to help them understand the results of MLM analyses that are presented in articles. Give the limits inherent in a single article, we do not cover all topics in depth. Nevertheless, we provide enough information so that readers should be able to conduct and understand MLM analyses. Examples of different types of analyses of diary style data (sometimes called intensive repeated measures), a design that is being used more an more often, are presented and sample data sets with worked examples are provided as on-line supplemental materials. Recommendations for best practice for conducting analyses and for reporting results are also provided.
Aguinis, H., Gottfredson, R. K., & Culpepper, S. A. (2013). Best-practice recommendations for estimating cross-level interaction effects using multilevel modeling. Journal of Management, 39(6), 1490-1528.
Bates, D., Machler, M., Bolker, B. and Walker, S. (2015) Fitting Linear Mixed-Effects Models Using lme4. Journal of Statistical Software, 67, 1-48.
Bryk, A. S., & Raudenbush, S. W. (1992). Hierarchical linear models. Newbury Park, CA: Sage.
Enders, C. K., & Tofighi, D. (2007). Centering predictor variables in cross-sectional multilevel models: A new look at an old issue. Psychological Methods, 12, 121–138.
Faul, F., Erdfelder, E., Buchner, A., & Lang, A. G. (2009). Statistical power analyses using G*Power 3.1: Tests for correlation and regression analyses. Behavior Research Methods, 41, 1149-1160.
Green, P., & MacLeod, C. J. (2016), SIMR: an R package for power analysis of generalized linear mixed models by simulation. Methods in Ecology and Evolution, 7, 493-498.
Johnson, P. C. D., Barry, S. J. E., Ferguson, H. M., & Müller, P. (2015). Power analysis for generalized linear mixed models in ecology and evolution. Methods in Ecology and Evolution, 6, 133–142.
Kain, M. P., Bolker, B. M,, & McCoy, M. W. (2015). A practical guide and power analysis for GLMMs: Detecting among treatment variation in random effects. PeerJ3, e1226
Kreft, I. G. G., & de Leeuw, J. (1998). Introducing multilevel modeling. Newbury Park, CA: Sage.
Nezlek, J. B., & Mrozinski, B. (2019, January 28). Annee Psychologique. Retrieved from osf.io/74m5r
Nezlek, J. B. (2001). Multilevel random coefficient analyses of event and interval contingent data in social and personality psychology research. Personality and Social Psychology Bulletin, 27, 771-785. doi:10.1177/0146167201277001
Nezlek, J. B., & Plesko, R. M. (2001). Day-to-day relationships among self-concept clarity, self-esteem, daily events, and mood. Personality and Social Psychology Bulletin, 27, 201-211.
Nezlek, J. B. (2003). Using multilevel random coefficient modeling to analyze social interaction diary data. Journal of Social and Personal Relationships, 20, 437-469.
Nezlek, J. B. (2007). A multilevel framework for understanding relationships among traits, states, situations, and behaviors. European Journal of Personality, 21, 789-810. doi: 10.1002/per.640
Nezlek, J. B. (2012a). Multilevel modeling of diary-style data. In M. R. Mehl & T. S. Conner (Eds.) Handbook of research methods for studying daily life. (pp. 357-383). New York: Guilford Press.
Nezlek, J. B. (2012b). Diary methods for social and personality psychology. In J. B. Nezlek (Ed.) The SAGE Library in Social and Personality Psychology Methods. London: Sage Publications.
R Core Team (2019). R: A language and environment for statistical computing. R Foundation for Statistical Computing, Vienna, Austria. URL https://www.R-project.org/.
Raudenbush, S. W., & Bryk, A. S. (2002). Hierarchical linear models (2nd ed.). Newbury Park, CA: Sage.
Richter, T. (2006). What is wrong with ANOVA and multiple regression? Analyzing sentence reading times with hierarchical linear models. Discourse Processes, 41, 221–250.
Scherbaum, C. M., & Ferreter, J. M. (2009). Estimating statistical power and required sample sizes for organizational research using multilevel modeling. Organizational Research Methods, 12, 237–367.
Snijders, T. A. (2005). Power and sample size in multilevel linear models. In B. S. Everitt and D. C. Howell (eds.), Encyclopedia of Statistics in Behavioral Science (V. 3), 1570–1573. Chicester: Wiley, 2005.
SSI (2019). http://ssicentral.com/index.php/products/hml/free-downloads-hlm
Yuan, K. H., & Maxwell, S. (2005). On the post hoc power in testing mean differences. Journal of Educational and Behavioral Statistics, 30, 141–167.