text: Title: [BUG] Pascal performance halved with new version.
  Body: **Describe the bug**
  I went to try new autogptq since there were changes to the kernel.
  
  Performance gets cut in half now if you enable fused attention where as of 0.3.2 it was doing better.
  
  30b-int4
  
  ```
  latest:
  Output generated in 47.31 seconds (4.21 tokens/s, 199 tokens, context 22, seed 1602137517
  Output generated in 47.34 seconds (4.20 tokens/s, 199 tokens, context 22, seed 734386331)
  
  disabled fused attention
  Output generated in 23.74 seconds (8.38 tokens/s, 199 tokens, context 22, seed 565801207)
  
  0.3.2 + fused attention
  Output generated in 23.03 seconds (8.64 tokens/s, 199 tokens, context 22, seed 988359984)
  Output generated in 22.64 seconds (8.79 tokens/s, 199 tokens, context 22, seed 513951538)
  
  0.3.2 no fused attn
  Output generated in 24.04 seconds (8.28 tokens/s, 199 tokens, context 22, seed 528918284)
  
  ```
  
  
  **Hardware details**
  P6000/P40 Compute 6.1
  
  **Software version**
  Git Autogptq
  
  **Expected behavior**
  
  Identical to previous autogptq when disable_exllama=True
  
  **Additional context**
  
  Some change to fused attn must be using FP16. Obviously at full context this will blow up to unusable. The reason it sort of matters is that for my 3090s I can simply use exllama but for older cards I can't really use anything else.
  
  