Checked the time cost for forward, backward, parameter update, data loading, and find the time cost of forwarding becomes large. The network is based on efficient-det’s backbone + faster-rcnn. SyncBN is used here. drop-connect is also applied by masking the output as all-0, which should have no dependency on the old iterations.


forward time
image787×521 20.6 KB


backward time
image786×512 26.4 KB


update time
image757×477 19.5 KB


data loading time
image776×477 21.3 KB