Solved by pytorcher in post #7 
              
              
                Figured it out my mistake.  I was trying to print the grad not of the entire tensor.  variableName in the original post was actually variableName[index1][index2][index3] where variableName is a dict, variableName[index1] is a tensor, and index2 and index3 are going to specific rows and columns.  Loo…