Hi, it is called broadcast.
Here 28 is Numpy broadcast.
Here 212 is PyTorch broadcast.

Two tensors are “broadcastable” if the following rules hold:

Each tensor has at least one dimension.
When iterating over the dimension sizes, starting at the trailing dimension, the dimension sizes must either be equal, one of them is 1, or one of them does not exist.