After retiring as a player Rowley managed Shrewsbury for another four years before becoming manager of Sheffield United on 11 July 1968. United had just been relegated to Division Two but despite good signings who would later gain the team promotion, results were disappointing and he was sacked on 6 August 1969.