Theoretical Machine Learning

Introductory lecture notes from a class taught by Professor Rob Schapire who is a leader in the field.  This is a good place to start for a beginner in machine learning.

www.cs.princeton.edu/courses/archive/spr08/cos511/scribe_notes/0204.pdf