Solved by SimonW in post #8 
              
              
                What do you want exactly? Do you want there to be learnable scale and bias or not? If there are, they will show up. If there aren’t, they won’t.