I don’t have a great metric, but what I’ve been doing is a mock real application. I use the embedder to convert ~100 examples to embeddings. I then turn a few queries into vectors and see which examples are closest using cosine similarity. I have a list of 5 queries and a general idea of what results I would want to see for each query.