AI, Artificial Intelligence, Large Language Models, Machine Learning, Generative Ai Tools.
the structured output format from JSON to YAML to reduce the number of tokens. Leveraging speculative decoding and Streaming one step at a time back to the user instead of the entire generated workflow. This is in keeping with recent agentic developments from LlamaIndex where a step-wise approach