Solved by arturml in post #2 
              
              
                You just send the raw output. Check out this this thread for small discussion about this topic: VGG output layer - no softmax?