They were given guest quarters at Blue Harbour, another house farther down the hill that Coward also owned; it can clearly be seen from Firefly's garden.
The guest quarters at Blue Harbour can be seen from Firefly's garden.