After changing color map to ‘Paired’ I got follow segmentation maps:

newcolormap.png1343×918 113 KB

For some cases like detecting boat in an image and generating its segmentation map, my current model completely fails at it and gives blank predictions. But for some examples like displayed above gives better results. Does this mean for better accuracy than this I should use FCN-16 or FCN-8 architecture ?