Yes hogwild training is a special lock free approach to training that exploits some of the benefits of a multipurpose CPU when the time taken for locks have become a bottleneck for certain model training

  
      people.eecs.berkeley.edu
  
  
    
hogwildTR.pdf 14

267.20 KB