𝗔𝗿𝗰𝗲𝗲 𝗿𝗲𝗹𝗲𝗮𝘀𝗲𝘀 𝗦𝘂𝗽𝗲𝗿𝗡𝗼𝘃𝗮, 𝗯𝗲𝘁𝘁𝗲𝗿 𝗳𝗶𝗻𝗲-𝘁𝘂𝗻𝗲 𝗼𝗳 𝗟𝗹𝗮𝗺𝗮-𝟯.𝟭-𝟳𝟬𝗕!
text
𝗔𝗿𝗰𝗲𝗲 𝗿𝗲𝗹𝗲𝗮𝘀𝗲𝘀 𝗦𝘂𝗽𝗲𝗿𝗡𝗼𝘃𝗮, 𝗯𝗲𝘁𝘁𝗲𝗿 𝗳𝗶𝗻𝗲-𝘁𝘂𝗻𝗲 𝗼𝗳 𝗟𝗹𝗮𝗺𝗮-𝟯.𝟭-𝟳𝟬𝗕!
new_line
new_line
2️⃣ versions: 70B and 8B 
text
2️⃣ versions: 70B and 8B 
new_line
🧠 Trained by distilling logits from Llama-3.1-405B
text
🧠 Trained by distilling logits from Llama-3.1-405B
new_line
🐥 Used a clever compression method to reduce dataset weight from 2.9 Petabytes down to 50GB (may share it in a paper)
text
🐥 Used a clever compression method to reduce dataset weight from 2.9 Petabytes down to 50GB (may share it in a paper)
new_line
⚙️ Not all benchmarks are improved: GPQA and MUSR go down a slight bit
text
⚙️ Not all benchmarks are improved: GPQA and MUSR go down a slight bit
new_line
🤗 8B weights are available on HF (not the 70B)
text
🤗 8B weights are available on HF (not the 70B)
new_line
new_line
Read their blog post 👉 
text
Read their blog post 👉 
https://blog.arcee.ai/arcee-supernova-training-pipeline-and-model-composition/
https://blog.arcee.ai/arcee-supernova-training-pipeline-and-model-composition/
link
new_line
Model weights (8B) 👉 
text
Model weights (8B) 👉 
https://huggingface.co/arcee-ai/Llama-3.1-SuperNova-Lite
arcee-ai/Llama-3.1-SuperNova-Lite
model
resource
https://huggingface.co/arcee-ai/Llama-3.1-SuperNova-Lite
𝗔𝗿𝗰𝗲𝗲 𝗿𝗲𝗹𝗲𝗮𝘀𝗲𝘀 𝗦𝘂𝗽𝗲𝗿𝗡𝗼𝘃𝗮, 𝗯𝗲𝘁𝘁𝗲𝗿 𝗳𝗶𝗻𝗲-𝘁𝘂𝗻𝗲 𝗼𝗳 𝗟𝗹𝗮𝗺𝗮-𝟯.𝟭-𝟳𝟬𝗕!

2️⃣ versions: 70B and 8B 
🧠 Trained by distilling logits from Llama-3.1-405B
🐥 Used a clever compression method to reduce dataset weight from 2.9 Petabytes down to 50GB (may share it in a paper)
⚙️ Not all benchmarks are improved: GPQA and MUSR go down a slight bit
🤗 8B weights are available on HF (not the 70B)

Read their blog post 👉 https://blog.arcee.ai/arcee-supernova-training-pipeline-and-model-composition/
Model weights (8B) 👉 https://huggingface.co/arcee-ai/Llama-3.1-SuperNova-Lite
🔥
osanseviero cfahlgren1 calmodovar23 ucsahin John6666 DiamanteAmarelo mayurninama
🚀
DiamanteAmarelo den0620
🤯
DiamanteAmarelo win10
👍
mayurninama