Oh, of course ”that goes without saying. We had walked, as we talked, and now we passed through the little gate into the garden. 
We passed through the gate and stopped, thinking we were alone and out of sight.