Memory Hierarchy
[Virtual Memory](https://texonom.com/virtual-memory-07bf10ba636b42e9818c009b17f893f0) [SSD](https://texonom.com/ssd-6ebdda8bb9c94c338b027894bd62eb33) [RAM](https://texonom.com/ram-402640023e8f43bc949627cac6f660c4) 


![](https://www.notion.so/image/https%3A%2F%2Fs3-us-west-2.amazonaws.com%2Fsecure.notion-static.com%2Fbf2eff6a-062b-4f71-b628-19b5f8e1ca13%2FUntitled.png?table=block&id=86983ec7-b18e-4a77-af4e-3f4f3e6e570d&cache=v2)



> [How Nvidia's CUDA Monopoly In Machine Learning Is Breaking - OpenAI Triton And PyTorch 2.0](https://www.semianalysis.com/p/nvidiaopenaitritonpytorch)





