Solved by dslate in post #7 
              
              
                Turns out I had declared the Variable tensors holding a batch of features and labels outside the loop over the 20000 batches, then filled them up for each batch.  Moving the declarations of those tensors inside the loop (which I thought would be less efficient) solved my slowdown problem.  Now the f…