Solved by googlebot in post #3 
              
              
                I think you need to add a leading batch dimension to input. Additionally,  internal_batch_size argument may be needed to limit cuda memory requirements.