[1,4,240,240,155] is quite a large size, and an encoder-decoder network is a very memory demanding framework. You may have to use patch-wise training or use fewer channels in the first and latest blocks. Using detection prior to segmentation is also a good idea.