How GPU Computing Works [video]
<i>> (Almost) Nobody (really) cares about flops ...because we should really be caring about memory bandwidth</i><p>In university, I was shocked to learn in a database class that CPU costs are dwarfed by the I/O costs in the memory hierarchy. This was after spending a whole year on data structures and algorithms, where we obsessed over runtime complexity and # of operations.<p>It seems that the low-hanging fruit of optimization is all gone. New innovations for performance will have to happen in transporting data.