Mlflow, Llm, Evaluation Metric, Ai Gateway, Llm Evaluation.
exposure of sensitive API keys across the system. Moreover, it eliminates the need to expose these keys in code or require end-users to handle them securely. The gateway is designed to be flexible and adaptable, allowing for easy definition and management of routes through updates to the