Mamdouh_Aljoud:


Will parallelization help speed up the algorithm? I am trying to parallelize on one GPU only.



This really depends on the algorithm.



 Mamdouh_Aljoud:


What other ways can I look into that can help with speeding up the algorithm?
Slightly related question, Isn’t PyTorch already trying to use maximum GPU resources to produce output as fast as possible? I monitored the GPU utilization and it was between 38 and 50%. Is there a way I can ensure that the GPU is used to the fullest?



If you could share some sample PyTorch code for the algorithm, I can look into it to see if there are some optimization opportunities.