Machine Learning, Prompt Engineering, Llm, Generative Ai Tools, Mlops.
of the great things about PromptBench is that it provides an evaluation metric. As such, we can compare results on different tasks, using different datasets, against different models. The definition of the metric function is as follows, which, in plain English, is the average performance drop rate: