Collections

Phi-3 family of small language and multi-modal models. Language models are available in short- and long-context lengths.

Mamba2 distilled from Llama3 8B instruct. The Mamba in the Llama: Distilling and Accelerating Hybrid Models (https://arxiv.org/abs/2408.15237).