Deep Learning, Machine Learning, Self Supervised Learning, Aritificial Intelligence, Neural Networks.
an offline manner on the full dataset. However, in the online setting where we are working with mini-batches, using the discrete codes performs worse than using the continuous codes. An explanation is that the rounding needed to obtain discrete codes is a more aggressive optimization step than