Foundations of Machine LearningIntroduction of Machine LearningContents1Classical Machine Learning234What is machine learning?Ensemble MethodsReinforcement Learning5Deep LearningAbout machine learningFrom Learning to Machine LearningLearning: Acquiring skillWith experience accumulated from observationsFrom Learning to Machine LearningLearning: Acquiring skillWith experience accumulated from observationsMachine Learning: Acquiring skillWith experience accumulated / computed from dataWhat is skill?A More Concrete Definitionskill⇔ improve some performance measure (e.g. prediction accuracy)Machine Learning: improving performance measure with experience computed from dataA More Concrete DefinitionA program can be said to learn from experience E with respect to some class of tasks T and performance measure P, if its performance at tasks in T, as measured by P, improved with experience E.Improve on Task with respect to Performance metric based on ExperienceT: Playing checkersP: Percentage of games won against an arbitrary opponent E: Playing practice games against itselfWhy use machine learningML: an alternative route to build complicated systemLearn from this picture and recognize: 3-year-old can do Define flowers and hand-program: difficultML-based flowers recognition system can be easier to build than hand-programmed systemML RouteML: an alternative route to build complicated system Some Scenarios to use ML– when human cannot program the system manually• Navigating on Mars– when human cannot define the solution easily• Speech recognition– When needing rapid decisions that human cannot do• High-frequency trading– When needing to be user-oriented in a massive scale• Consumer-targeted marketingKey essence of MLKey essence: help decide...