Machine Learning (FSI-VSC)

Academic year 2026/2027
Supervisor: doc. Ing. Pavel Škrabánek, Ph.D.  
Supervising institute: ÚAI all courses guaranted by this institute
Teaching language: Czech
Course type: departmental course
Aims of the course unit:

The aim of the course is to familiarize students with machine learning methods and their applications in classification, regression, and clustering. Students will learn about both parametric and non-parametric classification and regression models, as well as key concepts such as error metrics, regularization, cross-validation, gradient descent, and modern approaches, including boosting and Gaussian mixture models. The course bridges theory and practice, focusing on the design and implementation of machine learning models.

Learning outcomes and competences:
 
Prerequisites:
 
Course contents:
 
Teaching methods and criteria:
 
Assesment methods and criteria linked to learning outcomes:
 
Controlled participation in lessons:
 
Type of course unit:
    Lecture  13 × 2 hrs. optionally                  
    Computer-assisted exercise  13 × 2 hrs. compulsory                  
Course curriculum:
    Lecture

  1. Introduction to Machine Learning: the machine learning model life cycle, learning paradigms and task types, model generalization, cross-validation.

  2. Data Preprocessing: missing values, outliers, normalization/standardization, categorical encoding, variable transformations, basic feature selection.

  3. Regression: linear and polynomial regression, the least squares method, gradient descent, loss functions, performance metrics, redundant variables (multicollinearity), regularization.

  4. Linear Regression-Based Classification, Logistic and Regularized Logistic Regression: basic loss functions and performance metrics for classifiers, the impact of class imbalance on training, classifier performance and evaluation.

  5. Support Vector Machines for Classification and Regression, Kernel Functions.

  6. Perceptron, Multilayer Perceptron, Extreme Learning Machine, Forward and Backpropagation, Gradient Descent Variants, Methods for Reducing Overfitting.

  7. Tree-Based Methods for Classification and Regression: decision trees, splitting criteria, pruning, ensemble methods.

  8. Memory-Based Methods for Classification and Regression: k-nearest neighbors, distance metrics, choice of k and weighting.

  9. Introduction to Probability Theory, Bayesian Classifier, Gaussian Discriminant Analysis, Naive Bayes Classifier.

  10. Gaussian Mixture Models, EM Algorithm.

  11. Clustering: k-means clustering, Gaussian mixture–based clustering, density-based clustering.

  12. Dimensionality Reduction, Boosting.

  13. Review.

    Computer-assisted exercise

  1. Introduction to the programming environment.

  2. Data preprocessing.

  3. Linear and polynomial regression using least squares and regularized least squares.

  4. Classification of linearly separable data.

  5. Classification of nonlinearly separable data.

  6. Using multilayer perceptrons for classification and regression tasks.

  7. Using decision trees for classification and regression tasks.

  8. Using the k-nearest neighbors method for classification and regression tasks.

  9. Bayesian classifier, Gaussian discriminant analysis, and Naive Bayes classifier.

  10. Using Gaussian mixture models for classification and regression tasks.

  11. Data clustering.

  12. Dimensionality reduction, Boosting.

  13. Final assessment.

Literature - fundamental:
1.

BISHOP, Christopher M. Pattern recognition and machine learning. Information science and statistics. New York: Springer, c2006. ISBN 978-0-387-31073-2.

2. Sima,J., Neruda,R.: Theoretical questions of neural networks, MATFYZPRESS, 1996, ISBN 80-85863-18-9
3.

ALPAYDIN, Ethem. Introduction to machine learning. Third edition. Adaptive computation and machine learning. Cambridge: The MIT Press, [2014]. ISBN 978-0-262-02818-9.

Literature - recommended:
1. B. Kosko: Neural Networks and fuzzy systems. Prentice Hall 1992
2. Bishop, C. M.: Pattern Recognition, Springer Science + Business Media, LLC, 2006, ISBN 0-387-31073-8.
The study programmes with the given course:
Programme Study form Branch Spec. Final classification   Course-unit credits     Obligation     Level     Year     Semester  
N-AIŘ-P full-time study --- no specialisation -- Cr,Ex 5 Compulsory 2 1 S
C-AKR-P full-time study CLS -- Cr,Ex 5 Elective 1 1 S