Machine Learning, Software Development, Artificial Intelligence, Technology, Data Science.
“[AE]” token to tell it whether to autoencode or do next-token prediction. They find that you can compress your context by roughly a factor of 2 with little or no loss of quality, but it degrades hard past a certain point. Not sure this is a speed vs accuracy win (except maybe with quadratic