Answers.Body: <p>Usually the difference is mainly about drivers and amount of VRAM (other than price..).</p>
  <p>For example, high-end NVIDIA GPUs tend to even share the same architecture, having the same amount of &quot;compute units&quot;, between RTX and A series (or the older P and V). The difference is that professional GPUs have more optimized drivers which are both more stable and faster for supported applications.</p>
  <p>Another difference is that the A series (e.g. A6000 or A100) tend to have way larger VRAM capacity (e.g. 48GB and even 80GB) which are more suitable to handle large models, and even large batch sizes during training.</p>
  <p>In principle, when picking a GPU for DL you should care more about VRAM than execution speed.</p>
  
Answers.ContentLicense: CC BY-SA 4.0
Answers.CreationDate: 2023-06-29T07:37:31.890Z
Answers.Text: Nvidia also claim that the server-based GPUs like the A100 are built to handle higher demands of services, mainly uptime and constant use at max capacity. In addition, and very important to OP's question, Nvidia block use of gaming GPUs in the cloud with a legal mechanism - they refuse to license the driver software for e.g. 4080 series for servers
Answers.UserDisplayName: Neil Slater
Answers.ContentLicense: CC BY-SA 4.0
Answers.CreationDate: 2023-06-28T17:18:15.733Z
Answers.LastActivityDate: 2023-06-28T17:18:15.733Z
Answers.UserDisplayName: Luca Anzalone
Body: <p>I have a seemingly innocent question. I was looking to buy a computer for deep learning development using large language models. When I searched online on consumer e-commerce websites, I could not find any computer with NVIDIA P100, V100 for sale. Why? These are the GPUs used for deep learning on cloud VMs. Consumer GPUs (I use this term to mean GPUs available in computers you will find on sale on e-commerce websites such as Amazon.com) on the other hand seem to be centered around so-called RTX series built for gaming applications. I tried looking for GPU benchmarks on 3 different sites [<a href="https://www.tomshardware.com/reviews/gpu-hierarchy,4388.html" rel="nofollow noreferrer">1</a>,<a href="https://www.videocardbenchmark.net/" rel="nofollow noreferrer">2</a>,<a href="https://gpu.userbenchmark.com/" rel="nofollow noreferrer">3</a>] and cannot find any mention of P100, V100 etc. All of them are filled with RTX.</p>
  <p>What is the difference between these chipsets? And more specifically, is there some inherent difference that will make RTX GPUs suboptimal if I were to use one for ML tasks (as opposed to gaming)?</p>
  
Tags: <gpu>
Title: How are gaming GPUs different from GPUs for ML?
UserDisplayName: morpheus
ThreadText: # How are gaming GPUs different from GPUs for ML?
  
  (Asked by: username_0 on 2023-06-28)
  
  I have a seemingly innocent question. I was looking to buy a computer for deep learning development using large language models. When I searched online on consumer e-commerce websites, I could not find any computer with NVIDIA P100, V100 for sale. Why? These are the GPUs used for deep learning on cloud VMs. Consumer GPUs (I use this term to mean GPUs available in computers you will find on sale on e-commerce websites such as Amazon.com) on the other hand seem to be centered around so-called RTX series built for gaming applications. I tried looking for GPU benchmarks on 3 different sites [[1](https://www.tomshardware.com/reviews/gpu-hierarchy,4388.html),[2](https://www.videocardbenchmark.net/),[3](https://gpu.userbenchmark.com/)] and cannot find any mention of P100, V100 etc. All of them are filled with RTX.
  
  What is the difference between these chipsets? And more specifically, is there some inherent difference that will make RTX GPUs suboptimal if I were to use one for ML tasks (as opposed to gaming)?
  
  **Tags:** gpu
  
  ---
  
  ## 1 answers
  
  ### Answer by username_1 on 2023-06-28. Score: 2
  
  Usually the difference is mainly about drivers and amount of VRAM (other than price..).
  
  For example, high-end NVIDIA GPUs tend to even share the same architecture, having the same amount of "compute units", between RTX and A series (or the older P and V). The difference is that professional GPUs have more optimized drivers which are both more stable and faster for supported applications.
  
  Another difference is that the A series (e.g. A6000 or A100) tend to have way larger VRAM capacity (e.g. 48GB and even 80GB) which are more suitable to handle large models, and even large batch sizes during training.
  
  In principle, when picking a GPU for DL you should care more about VRAM than execution speed.
  
  > **Comments:**
  > **username_2**: Nvidia also claim that the server-based GPUs like the A100 are built to handle higher demands of services, mainly uptime and constant use at max capacity. In addition, and very important to OP's question, Nvidia block use of gaming GPUs in the cloud with a legal mechanism - they refuse to license the driver software for e.g. 4080 series for servers  
  
  ---
  
  