Answers.Body: <p>Both are two class of computing devices, It depends on - usage, performance ,form factor and  cost</p>
  <p>USB Accelerator is co - processor,TPU - Tensor Processing Unit primarily used for inferencing . We can build a compact Inferencing device when combined with a raspberry but cannot be used independently.</p>
  <p>And also , it may not have computations capabilities for  training, not sure how much RAM it has got on it, to train a model you need more computing resources on the other had Jetson Orin is complete desktop with Powerful Model Training Capabilities and inferencing too.</p>
  <p>Hope the above info helps in making decision between USB Accelerator vs Jetson Orin</p>
  
Answers.ContentLicense: CC BY-SA 4.0
Answers.CreationDate: 2024-08-10T01:13:20.940Z
Answers.LastActivityDate: 2024-08-10T01:27:11.643Z
Answers.LastEditDate: 2024-08-10T01:27:11.643Z
Answers.UserDisplayName: Biku
Body: <p>I'd like to buy a computer for deep learning experiments.</p>
  <p>I found various articles, which proposed a PC system with an NVIDIA RTX 3060 card.</p>
  <p>Recently, I discovered Jetson Orin NX Systems, which seem to consume much less power as ordinary PCs.</p>
  <p>Especially, I found the <a href="https://www.seeedstudio.com/reComputer-J4012-p-5586.html" rel="nofollow noreferrer">JETSON ORIN 4012 System with 16 GByte</a> of graphics RAM. A seller claims 100 TOP AI performance [for around 1000 EUR].</p>
  <p>I found various pages in NVIDIA's web, which <strong>explain how to install ready-made models</strong>.</p>
  <p>While inferencing Performance is certainly of interest, <strong>I'd like to do deep learning training.</strong></p>
  <p>On no NIVIDIA page, I found <strong>hints regarding training performance</strong> with Jetson Orin 4012.</p>
  <p>At the other side, I read, that <a href="https://coral.ai/products/accelerator/" rel="nofollow noreferrer">Coral's USB accelerator</a> isn't suitable for training by design. As far as I understand, this means, that the USB accelerator doesn't speed up much versus conventional CPUs performance.</p>
  <p><strong>Q: Would a JETSON ORIN 4012 be useful for deep learning training [useful = generate significant speedup]?</strong></p>
  
Tags: <training><hardware><hardware-evaluation>
Title: Jetson Orin NX for deep learning training
UserDisplayName: SteAp
ThreadText: # Jetson Orin NX for deep learning training
  
  (Asked by: username_0 on 2024-08-09)
  
  I'd like to buy a computer for deep learning experiments.
  
  I found various articles, which proposed a PC system with an NVIDIA RTX 3060 card.
  
  Recently, I discovered Jetson Orin NX Systems, which seem to consume much less power as ordinary PCs.
  
  Especially, I found the [JETSON ORIN 4012 System with 16 GByte](https://www.seeedstudio.com/reComputer-J4012-p-5586.html) of graphics RAM. A seller claims 100 TOP AI performance [for around 1000 EUR].
  
  I found various pages in NVIDIA's web, which **explain how to install ready-made models**.
  
  While inferencing Performance is certainly of interest, **I'd like to do deep learning training.**
  
  On no NIVIDIA page, I found **hints regarding training performance** with Jetson Orin 4012.
  
  At the other side, I read, that [Coral's USB accelerator](https://coral.ai/products/accelerator/) isn't suitable for training by design. As far as I understand, this means, that the USB accelerator doesn't speed up much versus conventional CPUs performance.
  
  **Q: Would a JETSON ORIN 4012 be useful for deep learning training [useful = generate significant speedup]?**
  
  **Tags:** training, hardware, hardware-evaluation
  
  ---
  
  ## 1 answers
  
  ### Answer by username_1 on 2024-08-10. Score: 1
  
  Both are two class of computing devices, It depends on - usage, performance ,form factor and cost
  
  USB Accelerator is co - processor,TPU - Tensor Processing Unit primarily used for inferencing . We can build a compact Inferencing device when combined with a raspberry but cannot be used independently.
  
  And also , it may not have computations capabilities for training, not sure how much RAM it has got on it, to train a model you need more computing resources on the other had Jetson Orin is complete desktop with Powerful Model Training Capabilities and inferencing too.
  
  Hope the above info helps in making decision between USB Accelerator vs Jetson Orin
  
  
  ---
  
  