Thanks, I’ve exported chrome trace from profiler, but I’m not sure how to interpret it.   What are those “cpu_to_cuda” event lines?   What are “Outgoing flow” and “Preceding/Following events”, which appear in the lower panel when I click something?
Also, this does not seem to help with my second problem (unintentional synchronization).