Machine Learning, Software Development, Artificial Intelligence, Technology, Data Science.
attention at long sequence lengths?), but it’s definitely interesting that 2x compression is possible. I wouldn’t be surprised if some sort of trained compression ends up replacing tokenizers. Self-consistency for open-ended generations One way of getting better LLM outputs is to sample a number of