Mlflow, Llm, Evaluation Metric, Ai Gateway, Llm Evaluation.
openai_api_key: $OPENAI_API_KEY Save the OpenAI API key so that its accessible to this config file. export OpenAI_API_KEY=sk-************************* Now let us spin the Gateway server using the bellow cli command. Note: if you don't specify port, host and worker parameters then the default values