Machine Learning, Programming, Ml System Design, Data Science, Artificial Intelligence.
the inference pipeline As we follow the feature/training/inference (FTI) pipeline architecture, the communication between the 3 core components is clear. Our LLM inference pipeline needs 2 things: a fine-tuned LLM: pulled from the model registry features for RAG: pulled from a vector DB (which we