I guess NHWC may matter …
https://devtalk.nvidia.com/default/topic/1071156/jetson-nano/poor-group-convolution-performance-in-fp16/ 12

  
      github.com/pytorch/pytorch
  
  
    
  
	  
  

  
    
      Channels Last (NHWC) support plan. 6
    

    
      
        opened 
        
          
        
        Oct 24, 2019
      
      


      
        
          
          VitalyFedyunin
        
      
    
  



  Release goals:
Support ResNet50, AlexNet, ResNeXt and proof performance gain on mixed precision models + Volta GPUs.
Unlock developers to extend channels last...



    topic: memory format
    triaged


  
  
    
    
  
  


since it’s still on progress, I guess I could try it later when pytorch is update to date.
With these updates for pytorch I can apply my models to NHWC kernels without aplex’s updates, right?