works on 48GB

by gtkunit - opened Apr 13, 2024

Apr 13, 2024

Works great so far on 2x3090. Using cache in 8-bit, 4096 context and 2 experts. Can I recommend you add exl2 or similar in the title and files so other people can find this?

blockblockblock

Owner Apr 15, 2024

Works great so far on 2x3090. Using cache in 8-bit, 4096 context and 2 experts. Can I recommend you add exl2 or similar in the title and files so other people can find this?

Sure, can work on this soon

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

Your need to confirm your account before you can post a new comment.

· Sign up or log in to comment