Some notes on statistical model selection and comparison, balanced model complexity and predictive accuracy. An overview of different information criteria (AIC, BIC, DIC, WAIC) and cross validation. Mostly taken from Gelman et al.’s recent paper: http://www.stat.columbia.edu/~gelman/research/unpublished/waic_understand.pdf.