Llama.rs – Rust port of llama.cpp for fast LLaMA inference on CPU
From the readme, to preempt the moaning: "I just like collecting imaginary internet points, in the form of little stars, that people seem to give to me whenever I embark on pointless quests for rewriting X thing, but in Rust."<p>OK? Just don't. Let us have this. :)