Llm, Mlflow, Arize Phoenix, Llamaindex.
that in an API below is the response. LLM’s response to the query but what exactly happened in the background like, how many chunks are created on the data we provided?, what context is extracted from which pages of data?, what kind of prompt template is used? etc all these questions are answered