Given that he couldn't see the probe from the ledge he'd climbed, it must have kept following the waterline. A few moments later, that hypothesis appears to be correct, as it scurries back, bumping into walls, before flying up to him, and floating behind him, making 'scared' beeping noises.