I am sorry, I forgot to mention that I used a different encoder than the one in the Colab Notebook. I used S3dg encoder with  videos as input not images but I don’t think its affect anything because the encoder outputs 128 embedding vector anyways.
Thanks