Error Analysis on Binary classification

You could use the ROC to pick a threshold value and create the predictions using this threshold.
Once you have the predictions you could check all misclassified samples, compute a confusion matrix etc. for further investigation.