Deep Learning, Artificial Intelligence, Convolutional Network, Semi Supervised Learning, Self Supervised Learning.
teacher predictions are generated. Whereas the Π model uses θ’=θ, and Temporal Ensembling approximates f(x; θ’; η’) with a weighted average of successive predictions, Mean Teacher defines θ’t at training step t as the EMA of successive  weights: where α is a smoothing coefficient hyperparameter.