ONNX

by cnmoro - opened Mar 20

Mar 20

Is it possible to convert this model to onnx and use it?

I've been looking for a small enough model that would be a good fit to be actually embedded into a pypi package (torch library automatically downloads nvidia dependencies and is huge)

Surprisingly, this 100M parameter model is amazing for it's size. Awesome!

BlinkDL

Owner 26 days ago

Hi you can use llama.cpp https://github.com/ggml-org/llama.cpp/pull/12412

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

Your need to confirm your account before you can post a new comment.

· Sign up or log in to comment