FauxPilot – An open-source GitHub Copilot server
From the setup.sh, the VRAM requirements are:<p><pre><code>    echo "[1] codegen-350M-mono (2GB total VRAM required; Python-only)"
    echo "[2] codegen-350M-multi (2GB total VRAM required; multi-language)"
    echo "[3] codegen-2B-mono (7GB total VRAM required; Python-only)"
    echo "[4] codegen-2B-multi (7GB total VRAM required; multi-language)"
    echo "[5] codegen-6B-mono (13GB total VRAM required; Python-only)"
    echo "[6] codegen-6B-multi (13GB total VRAM required; multi-language)"
    echo "[7] codegen-16B-mono (32GB total VRAM required; Python-only)"
    echo "[8] codegen-16B-multi (32GB total VRAM required; multi-language)"
</code></pre>
So I could try the 350M models on a laptop with an NVidia card of 2GB.<p>Another factoid, I noticed vultr is offering fauxpilot images in their GPU instance provisioning menu.<p>The model used (Salesforce Codegen) is on huggingface: <a href="https://huggingface.co/models?search=salesforce+codegen" rel="nofollow">https://huggingface.co/models?search=salesforce+codegen</a>