Mlflow, Llm, Evaluation Metric, Ai Gateway, Llm Evaluation.
the assistance of LLM observability solutions like Phoenix. AI Gateway: The very first step in spinning up the MLflow AI Gateway is to create the config file routes-config.yaml as below. save this file to a location routes: - name: completions route_type: llm/v1/completions model: provider: openai