Solved by ptrblck in post #2 
              
              
                Based on the error message, it looks like the BatchNorm layer after conv1 is using 96 input channels, while you are passing 64. 
Try to change the number of kernels to 96 and try it again.