4k or 128k?
#1
by
pavidu
- opened
The name of this model says 128k, but the creation code snippet shows that it was created from the 4k version. Can you verify the correct version?
pavidu
changed discussion title from
4k or 128k
to 4k or 128k?
Thanks for bringing up the error. The 128k model was used to create the quantized model, not the 4k version. We updated the model card to reflect that.
pavidu
changed discussion status to
closed