text: @rohanpaul_ai https://x.com/rohanpaul_ai/status/1862164280981983740 #x-rohanpaul_ai 
  
  
  
  Another brilliant release from @Nvidia
  
  Star Attention, a novel mechanism for LLM inference that achieves up to 11x speedup while maintaining 95-100% accuracy through a block-sparse approximation appr...