Machine Learning, Programming, Ml System Design, Data Science, Artificial Intelligence.
can be split into 2 big layers: the LLM service: where the actual inference is being done the business service: domain-specific logic We can design our inference pipeline in 2 ways. Option 1: Monolithic LLM & business service In a monolithic scenario, we implement everything into a single service.