Running large language models like ChatGPT on a single GPU
Any chance these work on CPUs with any acceptable performance?<p>I have a 10-core 20-thread monster CPU, but didn't bother with a dedicated GPU because I can't control something as simple as its temperature. See the complicated procedure that only works with the large proprietary driver here:<p><a href="https://wiki.archlinux.org/title/NVIDIA/Tips_and_tricks#Overclocking_and_cooling" rel="nofollow">https://wiki.archlinux.org/title/NVIDIA/Tips_and_tricks#Over...</a>