Yellow Rock is situated on the eastern, lower slopes of the Blue Mountains and the western side of the Nepean River extending back some way from it, the elevation rising from the river to a peak of 245 meters AHD.