Numbers every LLM developer should know
I’m confused. If I am an LLM <i>developer</i> why do I need to know the cost per token? That’s not the GPU cost, that’s a business decision from a company.<p>If I am an LLM <i>user</i> maybe that’s relevant but prone to being out of date. I’m not going to use this page as the source of truth on that anyways.<p>Since the article seems to be targeted at developers who <i>use</i> LLMs to e.g. generate Embeddings for semantic search, the title is about as accurate as saying a software engineer is a “keyboard developer” because they use a keyboard.