Can this model be coverted to ONNX format and used as embedding model for vector searches?

#1
by batonoff - opened

Hello!

I want to load embedding model into Oracle 23ai database. The model must be in ONNX format and meet number of requirements. Can Bielik be converted into such a model?

Regards,
Marcin.

It should be possible, use optimum-cli. Then you can quantize the ONNX model and upload it to HF for others to use.

SpeakLeash | Spichlerz org

Not sure what would be the quality of such embeddings.

Sign up or log in to comment