Solved by ptrblck in post #2 
              
              
                You could use the ROC to pick a threshold value and create the predictions using this threshold. 
Once you have the predictions you could check all misclassified samples, compute a confusion matrix etc. for further investigation.