flyerjia:

Do you know what toolkits can anaylze the arithmetic workload of GPU, which can be used in pytorch?


I’ve never used anything more fancy than nvvp (though I guess nsight is the more modern thing).
Most kernels I write are memory bandwith bound, so that and the parallelization pattern are the first two things to look at.
Best regards
Thomas