Mlflow, Llm, Evaluation Metric, Ai Gateway, Llm Evaluation.
service serves as a powerful tool aimed at streamlining the utilization and administration of various large language model (LLM) providers, like OpenAI and Anthropic, within an organization. It provides a high-level interface that simplifies interactions with these services by offering a unified