Deep Learning, Incremental Learning, Computer Vision, Reset, Image Classification.
tasks. The model is updated using the joint loss defined as- Loss function The first term in the above loss function is the cross-entropy loss and the second term is the knowledge distillation loss which is defined as- Knowledge distillation loss, where F is the feature extractor The weights of the