text: @rohanpaul_ai https://x.com/rohanpaul_ai/status/1862162649624236285 #x-rohanpaul_ai 
  
  
  
  Cheapest hardware go run 32B models
  
  Some possibiliteis from this Reddit post.
  
  →exllama v2 can run 32B models with 5 bits per weight, 32K context, and Q6 cache on a single RTX 3090 with flash attenti...