Solved by tensorfoe in post #4 
              
              
                I believe I do now have it working. 
The key was to just remove all the additional labels from the label.pbtxt file. Then change the number of classes in the configuration file to 1. 
I had tried this before and it didn’t work. I suspect the reason was that some of my train images had pictures in it…