dataset can improve the overall data diversity. For a base dataset Dbase = {xi = (qi, ri, ai)}N
i=1 with
N samples, and a new dataset Dnew = {xi = (qi, ri, ai)}M
i=1 with M samples, the diversity gain
is defined as: Dnew relative to Dbase as: dgain = 1
minxj∈Dbase (∥f (xi) − f (xj)∥2
2),
where f is the feature extractor and we use the OpenAI Embedding API text-embedding-ada-002 for
feature extraction. For Figure 2, we change the data size of base data and select a fixed set of 20K
new data points that the model has not encountered to form Dnew.
METAMATH