You can try using blocks that initially output zeros. To do that, initialize final linear layer of a block with zeros (example implementation 22).
Untrained blocks in original resnet offset outputs by Normal(0,1) I believe. In any case, non-residual final layer should be used, to calibrate output ranges.