Networks for Learning: Regression and Classification

Diagram showing a method of predicting the type of cancer from DNA chips.

Predicting the type of cancer from DNA chips. Learning from example. (Image courtesy of Poggio Laboratory, MIT Department of Brain and Cognitive Sciences.)

Instructor(s)

MIT Course Number

9.520-A

As Taught In

Spring 2001

Level

Graduate

Cite This Course

Course Description

Course Features

Course Highlights

During this course we will examine applications of several learning techniques in areas such as computer vision, computer graphics, database search and time-series analysis and prediction. Supervised learning with the use of regression and classification networks with sparse data sets will be explored. The extensive reading list grounds the future researcher in the field of learning networks. Lecture notes provide an overview of each topic covered in the class.

Course Description

The course focuses on the problem of supervised learning within the framework of Statistical Learning Theory. It starts with a review of classical statistical techniques, including Regularization Theory in RKHS for multivariate function approximation from sparse data. Next, VC theory is discussed in detail and used to justify classification and regression techniques such as Regularization Networks and Support Vector Machines. Selected topics such as boosting, feature selection and multiclass classification will complete the theory part of the course. During the course we will examine applications of several learning techniques in areas such as computer vision, computer graphics, database search and time-series analysis and prediction. We will briefly discuss implications of learning theories for how the brain may learn from experience, focusing on the neurobiology of object recognition. We plan to emphasize hands-on applications and exercises, paralleling the rapidly increasing practical uses of the techniques described in the subject.

Other Versions

Related Content

Tomaso Poggio, and Alessandro Verri. 9.520-A Networks for Learning: Regression and Classification. Spring 2001. Massachusetts Institute of Technology: MIT OpenCourseWare, https://ocw.mit.edu. License: Creative Commons BY-NC-SA.


For more information about using these materials and the Creative Commons license, see our Terms of Use.


Close