Against LLM Maximalism
Sorry if this is a bit ignorant, I don't work in the space, but if a single LLM invocation is considered too slow, how could splitting it up into a pipeline of LLM invocations which need to happen in sequence help?<p>Same with reliability - you don't trust the results of one prompt, but you trust multiple piped one into another? Even if you test the individual components, which is what this approach enables and this article heavily advocates for, I still can't imagine that 10 unreliable systems, which have to interact with rach other, are more reliable than one.<p>80% accuracy of one system is  80% accuracy.<p>95% accuracy on 10 systems is 59% accuracy in total if you need all of them to work and they fail independently.