eduardo4jesus:

How does the number of stream affects speed?


Thank you so much.
How does the number of stream affects speed? I am also trying to understand which streams have the potential to benefit from stream.
Would the following mindset be accurate?
A grid of blocks is dispatched for a task A on the Main stream. For certain sizes of grids and blocks it could happen that towards the end of the computation some SM become available, while others are still busy. For those scenarios, if multiple if a second stream (S) is used to process a second task (B), at that point, those idle SM would be able to be allocated to start processing the operations for B, given they would not depend on the result of A.