This is the default collate 165 function trying to make batched things of everything.
You could make your own version skipping descending into dictionaries.
Probably wrapping the data you want per sample in your own class would also work.
Best regards
Thomas