Solved by ayalaa2 in post #2 
              
              
                Conv3D wants in the form of batch_size x channels x depth x height x width. Your number of frames is the depth. Your channels can be RGB or whatever information you have on your frames. You may need to use a library to process raw videos into this format.