Machine Learning (SS 2026)

Machine Learning

 

In this course we will introduce the mathematical foundations of machine learning (ML). In particular, we will focus on understanding the theoretical aspects of ML that have made ML successful in a wide range of applications such as bioinformatics, computer vision, information retrieval, computer linguistics, robotics, etc.

The course gives a broad introduction into machine learning methods from a theoretical point of view. After the lecture the students should be able to solve and analyze learning problems. The lecture is based on the previous machine learning courses offered by Matthias Hein and Peter Ochs.

The tentative list of topics cover:

• Probability theory
• Maximum Likelihood/Maximum A Posteriori Estimators
• Bayesian decision theory
• Linear classification and regression
• Model selection and evaluation
• Convex Optimization
• Kernel methods
• Societal Impact of Machine Learning
• Unsupervised learning (Clustering, Dimensionality Reduction)
• Introduction to Deep Learning

 

Prerequisites: The course is targeted to students in computer science, bioinformatics, math, and related areas with a mathematical background. Students should know linear algebra and have good basic knowledge of statistics, for example by having taken Mathematics for Computer Scientists I and II (for linear algebra) and Statistics Lab or Mathematics for Computer Scientists III (for statistics). In addition, prior attendance to machine learning related courses, e.g., Elements of Machine Learning, is considered as additional useful background.

 

Organizational Information

Lectures:

• Mondays at 14:15h  -- Building E2.2, Günter-Hotz Lecture hall I (0.01) 
• Thursdays at 12:15h -- Building E2.2, Günter-Hotz Lecture hall I (0.01) 

Lectures will start on April 18th! 

Tutorials (to pick between):  

• Mondays at 12:15h -- Building E1.3, Room HS002
• Mondays at 14:15h -- Building E1.3, Room HS001
• Tuesdays at 10:15h -- Building E1.3, Room HS001
  • 05.05.26 and 07.07.26 at Building E2.2, Room GHH
• Tuesdays at 12:15h -- Building E1.3, Room HS002
• Wednesdays at 14:15h -- Building E1.3, Room HS002
  • 06.05.26 at Building E1.3, Room HS001
• Wednesdays at 16:15h -- Building E1.3, Room HS002

Exams: 

Main exam: TBC
Re-exam:   TBC

 

Schedule: TBC

 

 

Bibliography

[Bishop] Bishop, C. M. Pattern recognition and machine learning. Springer, 2006

[DSH] Duda, R. O., Hart, P.E., and Stork, D.G. Pattern classification (2nd edition). Wiley-Interscience 2000

[Boyd]   Boyd, S., Boyd, S. P., and Vandenberghe, L. . Convex optimization. Cambridge university press, 2004

[eML]    Hastie, T., Tibshirani, R., and Friedman, J. The Elements of Statistical Learning. Springer, 2009.

[Kernels] Smola, A. J.,  & Schölkopf, B. Learning with kernels. GMD-Forschungszentrum Informationstechnik, 1998.

[DL]   Goodfellow, I., Courville, A., and Bengio, Y. Deep learning. MIT press, 2016.

[DL]   Simon J.D. Prince Understanding Deep Learning. MIT press, 2023.