Exhibit 1. Data configurations of Magnitude Simulation Covariates Properties each Time Variation Selection effect model Meas. Levels effect level Lags Size at Simple/baseline Constant Moderate 2 Low None None 1 (.2) (m=20,v=16) (prior effect=.8) Basic Asymmetric Moderate 3 Moderate Some Some 1 (.2) (school: (.0225 (2, both (prior m=20, at each N(0,1); effect=.8) v=100; level) coef = teacher .1,-.1) m=20, v=80) Two Lags Asymmetric Moderate 3 Moderate Some (2, both 2 (.2) (school: (.0225 N(0,1); (prior m=20, at each coef = effect=.8) v=100; level) .1,-.1 teacher m=20, v=80) Small effects Asymmetric Small 3 Moderate Some Some 1 (.05) (school: m=20, v=100; teacher m=20, v=80) Quality of model parameters Statistical indicators of quality included indicators of: Bias Precision Quality of standard errors Bias of estimated teacher effects Quality of standard errors of estimated teacher effects Exhibit 2 describes the indicators of bias and precision for the parameters of the model. Each simulation should recover unbiased estimates of the parameters.
Exhibit 1. Data configurations Simulation model Meas. Properties Magnitude of effect at each level Levels Size Variation Selection effect Covariates Time Lags Simple/baseline Constant Moderate (.2) 2 Low (m=20,v=16) None None 1 (prior effect=.8) Basic Asymmetric Moderate (.2) 3 Moderate (school: m=20, v=100; teacher m=20, v=80) Some (.0225 at each level) Some (2, both N(0,1); coef = .1,-.1) 1 (prior effect=.8) Two Lags Asymmetric Moderate (.2) 3 Moderate (school: m=20, v=100; teacher m=20, v=80) Some (.0225 at each level) (2, both N(0,1); coef = .1,-.1 2 (prior effect=.8) Small effects Asymmetric Small (.05) 3 Moderate (school: m=20, v=100; teacher m=20, v=80) Some Some 1 Quality of model parameters Statistical indicators of quality included indicators of: Bias Precision Quality of standard errors Bias of estimated teacher effects Quality of standard errors of estimated teacher effects Exhibit 2 describes the indicators of bias and precision for the parameters of the model. Each simulation should recover unbiased estimates of the parameters.