@ptrblck, yes you are right!
Yes, the overall accuracy was around ~40% when i used a global mean and std of the entire training set, this works better since it highlights the difference between the videos in my positive and negative samples (Gives me ~75% accuracy for each model so the average is quite good i think).
I thought about relocating the standardization into the Dataset but was afraid it will blow up my RAM (the machine i’m using for experiments has only 64GB at the moment with 4 GPUs of 1080 ti).
I tried to perform inference of my 6 models one after the other and then concatenate the results into another module that just have Linear layer that has 6 channels but my i ran out of memory on the GPU and the RAM almost blew up.
I’m just afraid that my 6 models are too big (i’m using I3D) to use as inference together (maybe i’m wrong) on the gpu.
I can’t tell the overall accuracy of the ensemble model yet since i’m trying to make it work but I just keep getting out of memory errors.