Dimension-independent learning rates for high-dimensional classification problems
<|reference_start|>Dimension-independent learning rates for high-dimensional classification problems: We study the problem of approximating and estimating classification functions that have their decision boundary in the $RBV^2$ space. Functions of $RBV^2$ type arise naturally as solutions of regularized neural network learning problems and neural networks can approximate these functions without the curse of dimensionality. We modify existing results to show that every $RBV^2$ function can be approximated by a neural network with bounded weights. Thereafter, we prove the existence of a neural network with bounded weights approximating a classification function. And we leverage these bounds to quantify the estimation rates. Finally, we present a numerical study that analyzes the effect of different regularity conditions on the decision boundaries.<|reference_end|>
@article{lerma-pineda2024dimension-independent,
    title={Dimension-independent learning rates for high-dimensional classification
  problems},
    author={Andres Felipe Lerma-Pineda, Philipp Petersen, Simon Frieder, Thomas
  Lukasiewicz},
    journal={arXiv preprint arXiv:2409.17991},
    year={2024},
    archivePrefix={arXiv},
    eprint={2409.17991},
    primaryClass={cs.LG cs.NA math.NA stat.ML}
}