I have a question abou using video with Conv3D.
My input is like [batch_size=128, channels=3, depth=32, height=64, width=64]
Like 32 RGB videos with size 64 * 64
I want to feed this input to resnet3D (3D version of resnet model) and fine tune it.
I am not sure how to feed 32 videos to resnet.
Does it matter to feed the input like:
first case: [batch_size=128, channels=3, depth=32, height=64, width=64]
or
second case: [batch_size=128, channels=3, height=64, width=64, depth=32]
It accepts both of the cases, but I dont know which one is the right way.
If I feed like second case, what will happen? The network will not learn or it will not learn efficiently?
Thank you