Deep Learning, Artificial Intelligence, Convolutional Network, Image Classification, Resnet.
between the softmax outputs from the teacher model and the learner model. where T=20 is the temperature hyper-parameter. One example is using a ResNet-152-D as the teacher model to help training ResNet-50. 4.4. mixup Training In mixup, each time, two examples (xi, yi) and (xj, yj) are randomly