True that. Let’s just continue putting together our hacks and benchmark them. Who knows, future readers may find these incredibly useful.
On a slightly related note, as you may already know this kind of stratified sampling is pretty common for few-shot classification tasks (particularly for models like Prototypical Networks 6). Might be a good idea to work on a tutorial concerning this topic.