Interpretable global minima of deep ReLU neural networks on sequentially separable data
<|reference_start|>Interpretable global minima of deep ReLU neural networks on sequentially separable data: We explicitly construct zero loss neural network classifiers. We write the weight matrices and bias vectors in terms of cumulative parameters, which determine truncation maps acting recursively on input space. The configurations for the training data considered are (i) sufficiently small, well separated clusters corresponding to each class, and (ii) equivalence classes which are sequentially linearly separable. In the best case, for $Q$ classes of data in $\mathbb{R}^M$, global minimizers can be described with $Q(M+2)$ parameters.<|reference_end|>
@article{chen2024interpretable,
    title={Interpretable global minima of deep ReLU neural networks on sequentially
  separable data},
    author={Thomas Chen and Patricia Mu~noz Ewald},
    journal={arXiv preprint arXiv:2405.07098},
    year={2024},
    archivePrefix={arXiv},
    eprint={2405.07098},
    primaryClass={cs.LG cs.AI math-ph math.MP math.OC stat.ML}
}