LLM Python/CLI tool adds support for embeddings
There's a lot of stuff in this release.<p>Don't miss the new llm-cluster plugin, which can both calculate clusters from embeddings and use another LLM call to generate a name for each cluster: <a href="https://github.com/simonw/llm-cluster">https://github.com/simonw/llm-cluster</a><p>Example usage:<p>Fetch all issues, embed them and store the embeddings and content in SQLite:<p><pre><code>    paginate-json 'https://api.github.com/repos/simonw/llm/issues?state=all&filter=all' \
      | jq '[.[] | {id: .id, title: .title}]' \
      | llm embed-multi llm-issues - \
        --database issues.db \
        --model sentence-transformers/all-MiniLM-L6-v2 \
        --store
</code></pre>
Group those in 10 clusters and generate a summary for each one using a call to GPT-4:<p><pre><code>    llm cluster llm-issues --database issues.db 10 --summary --model gpt-4</code></pre>