Any tips to make it run faster on an RTX 3060 12GB?

by IAModelexplorer - opened Apr 22

Discussion

IAModelexplorer

Apr 22

Thanks, soob. Any tips to make it run faster on an RTX 3060 12GB? Does Q2_K lose capability?

soob3123

Owner Apr 22

Q2 will definitely be dumber than the rest. Q4_K_M is the smallest ill go, but thats is more than your available VRAM.

Go with my Veiled Calla 12B, you can fit that Q4 easily on your 12GB VRAM.

IAModelexplorer

Apr 23

Q2 will definitely be dumber than the rest. Q4_K_M is the smallest ill go, but thats is more than your available VRAM.

Go with my Veiled Calla 12B, you can fit that Q4 easily on your 12GB VRAM.

thank

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

· Sign up or log in to comment