Machine learning systems utilize what is known as a classifier to learn from data. A classifier is an interface that takes a matrix of what is known as feature values and produces an output vector, also known as the class. These feature values may be discrete or continuously valued. There are three core components of classifiers:

• Representation: What type of classifier is it?
• Evaluation: How good is the classifier?
• Optimization: How can you search among the alternatives?