Computer Vision, Artificial Intelligence, Large Language Models, Foundation Models, Edge Computing.
let the attention mechanisms mix these information to generate good outputs. Finally the development of techniques such as LoRA requires transformer architectures. But for most real time applications on low end devices, these large transformer models are not yet competitive in terms of efficiency