Moores Law, Computer Science, Photonics, Electronics, Integrated Circuits.
world” thesis by Marc Andreeson was entirely based on the fact that compute had become cheap enough that new software applications could be profitably deployed. As an example, cheap compute allows AI applications such as ChatGPT to be deployed for millions of users. However, scaling model size is