Location & Time: Chemistry Building 120  MW 17:30-19:00

Machine learning is the study of algorithms that learn how to perform a task from prior experience. Machine learning algorithms find widespread application in diverse problem areas, including machine perception, natural language processing, search engines, medical diagnosis, bioinformatics, brain-machine interfaces, financial analysis, gaming and robot navigation.  This course will thus provide students with marketable skills and also with a foundation for further, more in-depth study of machine learning topics.

This course introduces the student to machine learning concepts and techniques applied to pattern recognition problems in a diversity of application areas.  The course takes a probabilistic perspective, but also incorporates a number of non-probabilistic techniques. 

Instructor Information:

James H. Elder

0003G Computer Science and Engineering Building
tel: (416) 736-2100  ext. 66475  fax: (416) 736-5857
email: jelder@yorku.ca   website: www.yorku.ca/jelder

Office Hour:  Friday 12:30-13:30

Complete Syllabus & Schedule


I will post lectures on this website, but will use Moodle to post supplementary readings. We will also use Moodle for discussion - I encourage you to make full use of this facility, but please remember that the two graded assignments must be done individually - do not post solutions or partial solutions.


  1. Introduction
  2. Bayesian Decision Theory
  3. Linear Regression
  4. Linear Classifiers
  5. Feaure Selection
  6. Dimensionality Reduction
  7. Nonlinear Methods for Classification and Regression
  8. Boosting

I will generally post the slides for each lecture the night before class. However, I reserve the right to make changes to the lectures up to the time of the class. Small changes may also be made after class, e.g., to correct errors. I will indicate in each set of slides the date they were last modified: please verify that you have the most recent versions


Please note that datasets for assignments are posted on the moodle site for the course.

Assignment 1:

  1. Assignment 1 Instructions
  2. Assignnent 1 Slides

Congratulations to Assignment 1 Contest Winners:

    1. Ron Tal
    2. Albert VanderMeulen
    3. Alex Yakubovich

Assignment 2:

  1. Assignment 2 Instructions