I found out that when I used this same dataset as a script util file, the loading was very low.
When I added this same code in the main notebook, the data loading time decreased drastically… Not sure why…