I don’t think so. I checked some of the images of dataset (not all of them) and there were only car images. there is not empty roads. all the images have at least 1 car in the image.
That might be another solution, adding empty road images without cars. That may reduce false positives of object detection of which Faster R-CNN is tend to.