content.raw: Managed to get my hands on a 5090FE, it's beefy
content.type: text
content.value: Managed to get my hands on a 5090FE, it's beefy
content.type: new_line
content.type: new_line
content.raw: | llama 8B Q8_0                  |   7.95 GiB |     8.03 B | CUDA       |  99 |         pp512 |    12207.44 ± 481.67 |
content.type: text
content.value: | llama 8B Q8_0                  |   7.95 GiB |     8.03 B | CUDA       |  99 |         pp512 |    12207.44 ± 481.67 |
content.type: new_line
content.raw: | llama 8B Q8_0                  |   7.95 GiB |     8.03 B | CUDA       |  99 |         tg128 |        143.18 ± 0.18 |
content.type: text
content.value: | llama 8B Q8_0                  |   7.95 GiB |     8.03 B | CUDA       |  99 |         tg128 |        143.18 ± 0.18 |
content.type: new_line
content.type: new_line
content.raw: Comparison with others GPUs
content.type: text
content.value: Comparison with others GPUs
content.type: new_line
content.type: text
content.href: http://devquasar.com/gpu-gguf-inference-comparison/
content.raw: http://devquasar.com/gpu-gguf-inference-comparison/
content.type: link
rawContent: Managed to get my hands on a 5090FE, it's beefy
  
  | llama 8B Q8_0                  |   7.95 GiB |     8.03 B | CUDA       |  99 |         pp512 |    12207.44 ± 481.67 |
  | llama 8B Q8_0                  |   7.95 GiB |     8.03 B | CUDA       |  99 |         tg128 |        143.18 ± 0.18 |
  
  Comparison with others GPUs
   http://devquasar.com/gpu-gguf-inference-comparison/
reactions.reaction: 👍
reactions.users: schekin hasanhuseynov eaddario John6666 4dy5o03fd xinnn63 Takugen dantezxcd