10

0102030#Images per category0.70.80.9AccuracyMNIST0102030#Images per category0.30.40.50.60.7CIFAR100102030#Images per category0.000.250.500.751.00RatioMNIST0102030#Images per category0.20.40.6CIFAR100102030#Images per category0.000.250.500.751.00RatioMNIST0102030#Images per category0.20.40.6CIFAR10OursRandom realOptimized realk-meansAverage realREFERENCES

In CVPR, 2005. 3

Anelia Angelova, Yaser Abu-Mostafam, and Pietro Perona. Pruning training sets for learning of object categories.

Jimmy Ba and Rich Caruana. Do deep nets really need to be deep? In NIPS, 2014. 2

Olivier Bachem, Mario Lucic, and Andreas Krause. Practical coreset constructions for machine learning. arXiv

preprint arXiv:1703.06476, 2017. 3

David Bau, Bolei Zhou, Aditya Khosla, Aude Oliva, and Antonio Torralba. Network dissection: Quantifying

interpretability of deep visual representations. In CVPR, 2017. 3

Yoshua Bengio. Gradient-based optimization of hyperparameters. Neural computation, 12(8):1889–1900, 2000.
DATASET DISTILLATION