---------------------------  ---------------  ---------------  ---------------  ---------------  ---------------  ---------------  ---------------  ---------------  ---------------
Name                         Self CPU total %  Self CPU total   CPU total %      CPU total        CPU time avg     CUDA total %     CUDA total       CUDA time avg    Number of Calls
---------------------------  ---------------  ---------------  ---------------  ---------------  ---------------  ---------------  ---------------  ---------------  ---------------
conv2d                       3.07%            13.165ms         42.23%           181.103ms        90.551us         19.28%           278.898ms        139.449us        2000
convolution                  3.44%            14.748ms         39.16%           167.937ms        83.969us         18.64%           269.652ms        134.826us        2000
_convolution                 6.31%            27.039ms         35.72%           153.189ms        76.595us         17.82%           257.776ms        128.888us        2000
cudnn_convolution            27.42%           117.591ms        27.42%           117.591ms        58.796us         15.84%           229.185ms        114.593us        2000
batch_norm                   3.47%            14.885ms         38.57%           165.399ms        82.700us         8.48%            122.629ms        61.315us         2000
_batch_norm_impl_index       11.03%           47.299ms         35.10%           150.514ms        75.257us         7.81%            112.969ms        56.485us         2000
cudnn_batch_norm             18.00%           77.173ms         18.00%           77.173ms         38.586us         3.93%            56.870ms         28.435us         2000
relu_                        8.11%            34.773ms         8.11%            34.773ms         20.455us         2.08%            30.042ms         17.672us         1700
contiguous                   8.14%            34.914ms         8.14%            34.914ms         2.885us          1.97%            28.449ms         2.351us          12100
add_                         3.78%            16.191ms         3.78%            16.191ms         20.239us         1.02%            14.801ms         18.501us         800
to                           2.89%            12.375ms         3.12%            13.363ms         133.634us        0.91%            13.126ms         131.262us        100
adaptive_avg_pool2d          0.46%            1.954ms          1.63%            6.982ms          69.815us         0.48%            6.873ms          68.725us         100
max_pool2d                   0.20%            859.574us        0.85%            3.662ms          36.618us         0.35%            5.001ms          50.011us         100
addmm                        0.99%            4.265ms          0.99%            4.265ms          42.647us         0.32%            4.568ms          45.685us         100
max_pool2d_with_indices      0.65%            2.802ms          0.65%            2.802ms          28.022us         0.31%            4.461ms          44.609us         100
view                         0.67%            2.873ms          0.67%            2.873ms          9.578us          0.20%            2.943ms          9.809us          300
mean                         0.63%            2.697ms          0.63%            2.697ms          26.970us         0.20%            2.822ms          28.224us         100
flatten                      0.16%            684.070us        0.51%            2.188ms          21.880us         0.15%            2.153ms          21.531us         100
reshape                      0.15%            649.266us        0.35%            1.504ms          15.039us         0.10%            1.491ms          14.906us         100
empty                        0.23%            988.832us        0.23%            988.832us        9.888us          0.07%            985.961us        9.860us          100
unsigned short               0.21%            909.201us        0.21%            909.201us        9.092us          0.06%            872.228us        8.722us          100
---------------------------  ---------------  ---------------  ---------------  ---------------  ---------------  ---------------  ---------------  ---------------  ---------------
Self CPU time total: 428.835ms
CUDA time total: 1.447s

The CUDA time total is just sum of everything from table above. And I assume the operations in the table CUDA category are for compute. If it is for API call, then the time should fall under CPU time category right?