Llm, Model Selection, Model Evaluation, Genai.
Infrastructure, software requirement to host the model. Compare the cost per unit of throughput. Estimate the average size of a response in terms of tokens and number of requests in a specific time-period for model as service utilization patterns. Pricing mode: Hosted models are typically priced