This is fantastic feedback Sayak - one of the first things I think the TFMA team will ask for when presented with a FR for a new metric implementation is a set of (or at least 1) large benchmark they can use to test/finetune the metric implementation.
So if you’re (or anyone else) aware of popular tasks defined on large datasets where modelers are interested in computing such accuracy metrics, please do add them