When building a classifier we want to minimize the number of misclassified observations. In binary cases, we talk about true positives, false positives, true negatives and false negatives that can be visualized in a confusion matrix:
The main classification metrics are:
Their usage depends on the classification task.