Pytorch dataloader is working well. I am talking about more efficient dataloader. Dataloader is a bottleneck for training.
(new)tensorflow data api can load data while optimizasyon process going on. Dataloading process doesn’t depend on training process. It look like asynchronously streaming.