Artificial Intelligence, Deep Learning, Neural Networks, Large Language Models, Machine Learning.
limited computational capacity. Since gradient-based training does not work with 1-bit or binarized networks, non-gradient-based technologies become relevant, like genetic algorithms or other gradient-free technologies. There are open-source libraries like PyGAD for genetic algorithms or nevergrad