I wouldn&#x27;t call it stupid.  It was fine for when they wrote it.  I would say their solution is a bit outdated though.  I am a bit surprised that NVIDIA isn&#x27;t allocating more engineering support to Caffe to make sure they support all of NVIDIA&#x27;s latest features in a timely fashion.  Torch at least tries to use nccl for nn.DataParallelTable by default.