content.raw: Excited to announce the release of our high-quality Llama-3.1 8B 4-bit HQQ/calibrated quantized model! Achieving an impressive 99.3% relative performance to FP16, it also delivers the fastest inference speed for transformers. 
content.type: text
content.value: Excited to announce the release of our high-quality Llama-3.1 8B 4-bit HQQ/calibrated quantized model! Achieving an impressive 99.3% relative performance to FP16, it also delivers the fastest inference speed for transformers. 
content.type: new_line
content.type: new_line
content.raw: https://huggingface.co/mobiuslabsgmbh/Llama-3.1-8b-instruct_4bitgs64_hqq_calib
content.id: mobiuslabsgmbh/Llama-3.1-8b-instruct_4bitgs64_hqq_calib
content.type: model
content.type: resource
content.url: https://huggingface.co/mobiuslabsgmbh/Llama-3.1-8b-instruct_4bitgs64_hqq_calib
rawContent: Excited to announce the release of our high-quality Llama-3.1 8B 4-bit HQQ/calibrated quantized model! Achieving an impressive 99.3% relative performance to FP16, it also delivers the fastest inference speed for transformers. 
  
  https://huggingface.co/mobiuslabsgmbh/Llama-3.1-8b-instruct_4bitgs64_hqq_calib
reactions.reaction: 🔥
reactions.users: mobicham victor CountOfMonteCrypto AtAndDev nbroad zsolx2 osanseviero gabrielmbmb Tonic
commentators._id: 6569216f9c96f1a47bf45788
commentators.avatarUrl: https://cdn-avatars.huggingface.co/v1/production/uploads/6569216f9c96f1a47bf45788/mCLqmAs4dOjKdxNQVAp1w.png
commentators.fullname: Sica Rius
commentators.name: SicariusSicariiStuff
commentators.type: user