Solved by ptrblck in post #7 
              
              
                I’m not deeply familiar with the Tegra family. If you don’t have TensorCores, then the benefit would be the lower memory footprint, which might be used to increase the batch size and thus the throughput. 
However, depending on your use case, this might not be interesting (e.g. for an inference use c…