Solved by smth in post #2 
              
              
                some fundamental parts need to be added to aten/C10, similar to how we added ComplexFloat. 
The rest can be done out-of-source. 
If it’s bfloat16, we are interested in adding it into aten/c10 for some accelerators.