image/png

Aplite-Instruct-4x8B-Llama-3

GGUF quant of Llama-3-Aplite-Instruct-4x8B.

<|eot_id|> bug has been fixed.

Disclaimer

This model is a research experiment and may generate incorrect or harmful content. The model's outputs should not be taken as factual or representative of the views of the model's creator or any other individual.

The model's creator is not responsible for any harm or damage caused by the model's outputs.

Join out Discord

If you'd like to discuss potential collaborations or applications, feel free to reach out to me on Discord: [https://discord.gg/KugcbJX5]

Meta Llama 3 is licensed under the Meta Llama 3 Community License, Copyright © Meta Platforms, Inc. All Rights Reserved.

Downloads last month
19
GGUF
Model size
24.9B params
Architecture
llama

3-bit

4-bit

5-bit

6-bit

Inference Providers NEW
This model is not currently available via any of the supported third-party Inference Providers, and HF Inference API was unable to determine this model's library.

Model tree for raincandy-u/Llama-3-Aplite-Instruct-4x8B-GGUF-MoE

Quantized
(202)
this model