content.raw: I used three posts to explain GPU/CPU and LLM performances, now finally circle back to my own model.😅
content.type: text
content.value: I used three posts to explain GPU/CPU and LLM performances, now finally circle back to my own model.😅
content.type: new_line
content.type: new_line
content.raw: OneSQL needs GPU because it processes long prompt. It is not a chatbot which replies short prompts with long answers. I call models of my kind workhorse models.
content.type: text
content.value: OneSQL needs GPU because it processes long prompt. It is not a chatbot which replies short prompts with long answers. I call models of my kind workhorse models.
content.type: new_line
content.type: new_line
content.raw: We all have to scramble for GPUs to get adoption. Below are a few ways.
content.type: text
content.value: We all have to scramble for GPUs to get adoption. Below are a few ways.
content.type: new_line
content.type: new_line
content.raw: You can inherit it. If you have a new Mac machine. Congratulations, you have GPU.
content.type: text
content.value: You can inherit it. If you have a new Mac machine. Congratulations, you have GPU.
content.type: new_line
content.type: new_line
content.raw: You can leverage it. Get inference providers to adopt your model, then you switch from CapEx to OpEx.
content.type: text
content.value: You can leverage it. Get inference providers to adopt your model, then you switch from CapEx to OpEx.
content.type: new_line
content.type: new_line
content.raw: Or you buy it. Go frugal. Find older GPUs with enough HBMs to house your model.
content.type: text
content.value: Or you buy it. Go frugal. Find older GPUs with enough HBMs to house your model.
rawContent: I used three posts to explain GPU/CPU and LLM performances, now finally circle back to my own model.😅
  
  OneSQL needs GPU because it processes long prompt. It is not a chatbot which replies short prompts with long answers. I call models of my kind workhorse models.
  
  We all have to scramble for GPUs to get adoption. Below are a few ways.
  
  You can inherit it. If you have a new Mac machine. Congratulations, you have GPU.
  
  You can leverage it. Get inference providers to adopt your model, then you switch from CapEx to OpEx.
  
  Or you buy it. Go frugal. Find older GPUs with enough HBMs to house your model.
reactions.reaction: 👍
reactions.users: John6666 hal900000
reactions.reaction: 🤗
reactions.users: mura4k