What's the max context on this?

by ThePabli - opened 3 days ago

3 days ago

•

Assuming 32k. Can't find any data, but this is extremely efficient. Lowest VRAM usage out of the hundreds of models that I've tested.

Z.ai & THUKEG org 2 days ago

Check our github.
32K -> 128K

zRzRzRzRzRzRzR changed discussion status to closed 2 days ago

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

Your need to confirm your account before you can post a new comment.

· Sign up or log in to comment