How GPU Computing Works [video]
> (Almost) Nobody (really) cares about flops ...because we should really be caring about memory bandwidthIn university, I was shocked to learn in a database class that CPU costs are dwarfed by the I/O costs in the memory hierarchy. This was after spending a whole year on data structures and algorithms, where we obsessed over runtime complexity and # of operations.It seems that the low-hanging fruit of optimization is all gone. New innovations for performance will have to happen in transporting data.