Dalai: Automatically install, run, and play with LLaMA on your computer
Hey guys, I was so inspired by the llama.cpp project that I spent all day today to build a weekend side project.<p>Basically it lets you one-click install LLaMA on your machine with no bullshit. All you need is just run &quot;npx dalai llama&quot;.<p>I see that the #1 post today is a whole long blog post about how to walk through and compile cpp and download files and all that to finally run LLaMA on your machine, but basically I have 100% automated this with a simple NPM package&#x2F;application.<p>On top of that, the whole thing is a single NPM package and was built with hackability in mind. With just one line of JS function call you can call LLaMA from YOUR app.<p>Lastly, EVEN IF you don&#x27;t use JavaScript, Dalai exposes a socket.io API, so you can use whatever language you want to interact with Dalai programmatically.<p>I discussed a bit more about this on a Twitter thread. Check it out: <a href="https:&#x2F;&#x2F;twitter.com&#x2F;cocktailpeanut&#x2F;status&#x2F;1635040322471489537" rel="nofollow">https:&#x2F;&#x2F;twitter.com&#x2F;cocktailpeanut&#x2F;status&#x2F;163504032247148953...</a><p>It should &quot;just work&quot;. Have fun!