Ladies and gentlemen, new to the world of ML and its great fun, however I’m slowly but surely going crazy trying to solve this.
I’ll do my best to explain my problem, but I think it’s the DataLoader that’s the issue or its a very easy fix but I cant see the forest because of all the threes.
Any kind soul(s) out there that can help, many thanks in advance!
Have used this as reference for my model:

  
      

      GitHub
  

  
    

GitHub - nklingen/Transformer-Time-Series-Forecasting 1

  Contribute to nklingen/Transformer-Time-Series-Forecasting development by creating an account on GitHub.


  

  
    
    
  

  


Everything is working well but when I’m trying to reuse the DataLoader & inference for my timeseries data for predictions I´m just not getting the results I need. The DataSet is a timeseries where batches are linked to a Re-index. Let’s say that I have 5 batches / indexes in my data and I want a prediction made for each one in sequence. Since the DataLoader is pulling the index from getitem and that in turn pulls an index between 1 and len from the data, DataLoader set to shuffle can give me predictions of index 2,2,3,2,5 = 3 predictions when I want it to do 1,2,3,4,5 = 5 predictions.
Giving getitem a fixed index and turning of shuffle I get (1)5 predictions of the same index.
Surely not the right way to do it but I have tried to iterate in the getitem to achieve above but nothing is working. I saw some documentation on itterableDataset with start / end, but couldn’t get that to work either (I’m just to inexperienced at the moment to get my head around it).
Please help so I can continue my project.