OpenVINO IR model

#1
by fakezeta - opened

Hi,
thank you for your work: I find it excellent!

I converted your model to OpenVINO IR with the information to use it in LocalAI

fakezeta/Llama3-Aloe-8B-Alpha-ov-int8

HPAI@BSC (High Performance Artificial Intelligence at Barcelona Supercomputing Center) org

That's great! Thanks.
Stay tuned as we will soon update Aloe Alpha 8B model to use the new tokenizer.

I'll hold my breath!

G-AshwinKumar changed discussion status to closed
Your need to confirm your account before you can post a new comment.

Sign up or log in to comment