Title: Using threaded emscripten to speed up the generation and offload the main loop. No SIMD or other optimizations. Might work faster with #enable-experimental-webassembly-features enabled.<p>Tested in x86 Chrome and Firefox, Apple Silicon Safari<p>Run it yourself: <a href="https:&#x2F;&#x2F;github.com&#x2F;lxe&#x2F;ggml&#x2F;tree&#x2F;wasm-demo">https:&#x2F;&#x2F;github.com&#x2F;lxe&#x2F;ggml&#x2F;tree&#x2F;wasm-demo</a><p>Thanks, <a href="https:&#x2F;&#x2F;github.com&#x2F;ggerganov&#x2F;ggml">https:&#x2F;&#x2F;github.com&#x2F;ggerganov&#x2F;ggml</a>,
Upvote: