Hi,
It seems that the model itself doesn’t take as much time to process the data as much as the dataloader takes to load it [ Note that you are timing the ‘prediction time’ after the dataloader has loaded and as such this is not reflected in the ‘prediction time’ ]. It might be due to the fact that your data is huge and the model is pretty lightweight. Also, your methods of reading data using the dataloader might be inefficient which is causing the delay. Pre-processing the data in the dataloader can also cause delays like these.