I have issues with nvprof and I’m not sysadmin so it’ll take some time to fix that, but I managed to reproduce the issue on a dual GPU machine (2 x V100)

  
      gist.github.com
  
  
    https://gist.github.com/iacolippo/d7e7c26e980cbd4a9b86c24db6ca922e 1
async_processing_2gpus.ipynb
{
 "cells": [
  {
   "cell_type": "code",
   "execution_count": 1,
   "metadata": {},
   "outputs": [],
   "source": [
    "from time import time\n",
    "\n",
This file has been truncated. show original




  
  
    
    
  
  


hope this helps in figuring this out!