ACIT4510 Statistical Learning Course description

The course covers the foundations and recent advances in Machine Learning from the point of view of Statistical Learning Theory. The goal of this course is to provide students with the practical skills to support the theoretical knowledge to (1) develop machine learning solutions to challenging problems and (2) to be able to develop the acquired expertise further.

The theoretical aspects of statistical learning will be illustrated with concrete problems and tasks in Python.

The participants are expected to know basic concepts in linear algebra, programming and statistics (within the scope and content of e.g. DATA3800 - Introduction to Data Science with Scripting).

No formal requirements over and above the admission requirements.

The student should have the following outcomes upon completing the course:

Knowledge

Upon successful completion of the course, the student:

• will have a good understanding the different concepts and methods of supervised and unsupervised statistical learning and how to apply them on large data.
• has advanced knowledge of probabilistic formulation of the various learning problems.
• has focused knowledge of theoretical aspects of the different methods in machine learning and statistical learning, as well as a deep knowledge of concepts and assumptions behind each method.

Skills

Upon successful completion of the course, the student:

• can apply different high-dimensional regression techniques on data
• can apply different classification techniques on data
• can apply clustering techniques on data
• can apply dimension reduction techniques on data
• can make informed decisions on which method suits best for a particular problem and/or data set
• can derive learning algorithms for new models and analyze new data with them.

General competence

Upon successful completion of the course, the student:

• can apply different predictive models on data and assess their performance
• can use supervised and unsupervised learning in different real life problem

This course has three main parts.

The first three weeks cover revisions on statistics and scientific method, briefly presenting also the basics in (Python) programming, selection of a problem, etc. (i.e. revisions of several of the focus points in DATA3800).

After that there will be 7 weeks with presenting and solving exercises, covering the book "Introduction to Statistical Learning".

Finally the course has 3 to 4 weeks bridging the content presented during the weeks before with other scientific fields and topics, namely in Applied AI and in Mathematical Modelling. In particular, connections to the courses " Applied and Computational Mathematics (ACIT4310)" and "Evolutionary Artificial Intelligence and Robotics (ACIT4610)" will be addressed.

The weekly classes will be divided in three parts: (1) a theoretical exposition of the new content introduced each week, (2) one set of exercises/problems implementing the content presented during the theoretical exposition, and (3) supervision of each student in his/her specific project (see "Assignment").

The following required coursework must be approved before the student can take the exam:

A project plan document containing a description of the chosen data set, a preliminary research question and suggested tools and method to apply.

An individual project report approximately 2500 - 5000 words, excluding appendixes.

The exam can be appealed,

New/postponed exam

In case of failed exam or legal absence, the student may apply for a new or postponed exam. New or postponed exams are offered within a reasonable time span following the regular exam. The student is responsible for registering for a new/postponed exam within the time limits set by OsloMet. The Regulations for new or postponed examinations are available in Regulations relating to studies and examinations at OsloMet.

All aids are permitted, provided the rules for plagiarism and source referencing are complied with.

Grade scale A-F.

One internal examiner. External examiners are used periodically.

Professor Pedro Lind