Solved by iArunava in post #2 
              
              
                Okay. Got it!! 
They don’t apply the ToTensor and Normalize to the masks even though they are passed into the functions!  I was going crazy over this! 
Here the two snippets of code, that brought me back from crazy 
In this file, here 
 
 

 
See, the transforms are never applied to the masks! YAY! 
…