Can this be used with bitnet.cpp?

#1
by MaZeNsMz - opened

Hi there,

Thanks for making this.
I am just wondering if this model can be used by Bitnet.cpp.
Or what client can use it? Or how to convert it to gguf?

Thanks again.

Regards...

Thank you for reaching me out. This model was just made yesterday. I believe it's not ready yet, need more tests. Before using that with bitnetcpp (or a recent version of LLAMMACpp which suporta Bitnet) you first meet to convert it to GGUF format. I am working in a GGUF version to be included on this repository soon.

Thank you for reaching me out. This model was just made yesterday. I believe it's not ready yet, need more tests. Before using that with bitnetcpp (or a recent version of LLAMMACpp which suporta Bitnet) you first meet to convert it to GGUF format. I am working in a GGUF version to be included on this repository soon.

Thanks, I am just too exceited to test the Bitnet.cpp.

Regards...

Sign up or log in to comment