Max Context Token Length

by lazyDataScientist - opened Oct 30, 2023

Oct 30, 2023

How many tokens should we expect from this model? 8k, 32k?

Owner Oct 31, 2023

This model is 4k, although various scaling techniques should work fairly easily.

Nov 1, 2023

Awesome! Thank you!

lazyDataScientist changed discussion status to closed Nov 1, 2023

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

Your need to confirm your account before you can post a new comment.

· Sign up or log in to comment