Crypto, AI, Cryptoeconomics, Machine Learning, Ethereum.
Almost all operations in GPUs are done on floating point numbers. Floating points are finicky because they’re not associative — that is, it’s not true that (a + b) + c is always the same as a + (b + c) for floating points. Because GPUs are highly parallelized, the ordering of additions or