Machine Learning, AI, Deep Learning, NLP, Llm.
Meta released a collection of models ranging from 7B to 65B parameters. These models have been trained efficiently using Chinchilla’s scaling laws. These smaller models are cheaper at inference and trained on publicly available datasets. LLaMA-13B outperforms GPT-3 on most benchmarks, despite being