I’m trying to make a video classification model. I pass 1-N frames from a single video. The number of frames from a single video, depends on the size of video. I want to be able to send variable number of frames for a single video. The problem is, how to pass variable number of frames to my LSTM layer. Is padding the only solution for it (I really don’t want to go for padding since the length of videos is ranging from 15 seconds to 6 mins or even more). I also don’t want to keep my batch size constant (i.e:batch size=1).
Please help
Thanks