Artificial Intelligence, Deep Learning, Neural Networks, Large Language Models, Machine Learning.
three values, {-1,0,1}. This is why the authors call this architecture a 1.58-bit network. In the paper, the authors prove that networks using these 1.58-bit weights do not perform much worse than their counterparts using 8-bit weights. Why is this such a big deal? If these three values are