Solved by spruceb in post #2 
              
              
                The sum of a Tensor is a float, but a Variable containing a Tensor is not a Tensor. Think of Variable like a wrapper that can hold most numeric objects. Operations performed on a Variable produce the expected result, but wrapped in a Variable.