Depending on the task, the conceptually simpler U-Nets might also work very well. Our book, which used to be available for download from the PyTorch website, uses it to find nodules in CT scans.
The disadvantage is that U-Nets don’t deal with overlap etc. and you need a connected component finding step to get the sites.
Best regards
Thomas