A system and a method provide lossless compression of an activation map of a neural network. The system includes a formatter and an encoder. The formatter formats a tensor corresponding to an activation map into at least one block of values in which the tensor has a size of H×W×C and in which H represents a height of the tensor, W represents a width of the tensor, and C represents a number of channels of the tensor. The encoder encodes the at least one block independently from other blocks of the tensor using at least one lossless compression mode. The at least one lossless compression mode selected to encode the at least one block may different from a lossless compression mode selected to encode another block of the tensor.
LOSSLESS COMPRESSION OF SPARSE ACTIVATION MAPS OF NEURAL NETWORKS