GPT 4
[Mixture-of-Experts](https://texonom.com/mixture-of-experts-eb0cadda3237429dbc3b61d14fab81d1) 


10000 [H100](https://texonom.com/h100-572cbc29dbbd4bc598522bc4b3da0d38) 



### 8 Experts? It is meaningful tho
> [GPT-4's Secret Has Been Revealed](https://thealgorithmicbridge.substack.com/p/gpt-4s-secret-has-been-revealed)

> [OpenAI’s GPT-4 exhibits “human-level performance” on professional benchmarks](https://arstechnica.com/information-technology/2023/03/openai-announces-gpt-4-its-next-generation-ai-language-model)

> [Product Hunt 😸 on Twitter](https://twitter.com/ProductHunt/status/1633954325994119170)

> [GPT-4 Rumors From Silicon Valley](https://thealgorithmicbridge.substack.com/p/gpt-4-rumors-from-silicon-valley)

> [12ft |](https://12ft.io/proxy?q=https://towardsdatascience.com/gpt-4-is-coming-soon-heres-what-we-know-about-it-64db058cfd45)

> [The Multi-modal, Multi-model, Multi-everything Future of AGI](https://lspace.swyx.io/p/multimodal-gpt4)

> [GPT-4 Is a Reasoning Engine](https://every.to/chain-of-thought/gpt-4-is-a-reasoning-engine)





