bro, here are my suggestions:
firstly you should post this question to github repo instead of here…
secondly…you can try to write the evaluation dataloader by your own…and see if it works
you spend maybe 2 days to debug but maybe if you use 10min re-write the dataloader the problem solved.