This might be a possible reason, but you could still run some sanity checks with your current video data.
E.g. if your video contains some frames with ImageNet objects, such as dogs, I would recommend to try to classify them using your current code. If the model fails completely, you might have some bugs e.g. in the preprocessing.