I see, so I was visualizing the output of the final channels, my expectation was that since I only select a specific channel maybe one of them should be similar to the mask, and the other should be different.
however, when I visualize them all of them look very similar.
as an example, if I send a cat image, most of the channels show the mask of the cat, while my expectation was to only see the channel that is correspond to the cat shows the cat. One thought was maybe it is because I am using sigmoid instead of softmax (?) but I was not sure if it still should be like that