In a neural network unit, each neuron processing unit (NPU) of an array of N neural processing units receives a first high byte and a first low byte of 2N bits respectively from a first random accessmemory and a second random access memory. In a first mode, each NPU performs a symbolic extension on the first high byte to form a first 16-bit word and performs arithmetic operations on the first 16-bit word and a second 16-bit word formed by a second high byte and a second low byte. In a second mode, each NPU performs a symbolic extension on the first lower byte to form a third 16-bit word, andperforms arithmetic operations on the third 16-bit word and the second 16-bit word formed by the second high byte and the second low byte. In a third mode, each NPU performs arithmetic operations on afourth 16-bit word formed by the first high byte and the second low byte and the second 16-bit word formed by the second high byte and the second low byte.
Neural network unit with data size and weight size hybrid computing capabilities