Study programme 2019-2020 | Français | ||
Advanced optimization | |||
Programme component of Master's in Computer Engineering and Management à la Faculty of Engineering |
Students are asked to consult the ECTS course descriptions for each learning activity (AA) to know what assessment methods are planned for the end of Q3 |
---|
Code | Type | Head of UE | Department’s contact details | Teacher(s) |
---|---|---|---|---|
UI-M2-IRIGIG-301-M | Optional UE | TUYTTENS Daniel | F151 - Mathématique et Recherche opérationnelle |
|
Language of instruction | Language of assessment | HT(*) | HTPE(*) | HTPS(*) | HR(*) | HD(*) | Credits | Weighting | Term |
---|---|---|---|---|---|---|---|---|---|
| Anglais | 19 | 41 | 0 | 0 | 0 | 5 | 5.00 | 1st term |
AA Code | Teaching Activity (AA) | HT(*) | HTPE(*) | HTPS(*) | HR(*) | HD(*) | Term | Weighting |
---|---|---|---|---|---|---|---|---|
I-MARO-231 | Multi-Objective Optimization | 3 | 9 | 0 | 0 | 0 | Q1 | |
I-MARO-232 | Topics in Convex Optimization | 8 | 16 | 0 | 0 | 0 | Q1 | |
I-MARO-303 | First-Order Methods for Large Scale Machine Learning | 8 | 16 | 0 | 0 | 0 | Q1 |
Programme component |
---|
Objectives of Programme's Learning Outcomes
Learning Outcomes of UE
AA - Multi-Objective Optimization This class serves as an introduction the most fundamentals in Multi-Objective Optimization and introduces representative algorithms (illustrating their working principles and discussing their application scope and performance). After the course, the students must be able to understand why Multi-Objective Optimization methods are needed, understand optimality concept in Multi-Objective Optimization, understand different approaches to solve Multi-Objective Optimization problems and understand basics of choosing and implementing Multi-Objective Optimization methods. AA - First-Order Methods for Large Scale Machine Learning This class serves as an introduction to first-order methods to tackle large-scale ooptimization problems that arise for example in data analysis and machine learning. A particular attention will be given to stochastic gradient methods that are used to compute the weights in deep neural networks. The students must be able to undertsand the theoretical concepts behind these methods (in particular, convergence issues), and to implement and use them on real-world problems. AA - Topics in Convex Optimization The main subject of this course is to cover some techniques of convex optimization, a field that has undergone considerable development over the last three decades. This course is based on I-MARO-035 (Linear Optimization) and I-MARO-036 (Nonlinear Optimization). The heart of this course is conic optimization and more specifically semidefinite optimization that allows the modelisation of many problems in applied science. The students must be able to undertsand the theoretical concepts behind these methods and to implement and use them on real-world problems.
Content of UE
AA - Multi-Objective Optimization Organization of the class: Introduction and background on Multi-Objective Optimization (search space, objective space, Pareto optimality, Pareto front,...). Several basic and advanced optimization methods are presented to solve Multi-Objective Optimization problems. Some tools are presented to evaluate the performance of Multi-Objective algorithms. AA - First-Order Methods for Large Scale Machine Learning Organization of the class: - Introduction and motivation to the use of firt-order methods. - Optimal first-order methods for convex optimization. - Stochastic gradient methods.
- Project: Comparison of first-order methods for solving a classification problem. AA - Topics in Convex Optimization Organization of the class: - Introduction to conic optimization. - Second-order cone programming. - Semidefinite programming - Sum-of-squares. - Project: modeling and solving problems.
Prior Experience
Good knowledge of optimization techniques and modelling.
Type of Assessment for UE in Q1
Q1 UE Assessment Comments
For each AA, the project is the evaluation (gruops of 2 students). An additional written exam may be organised. Attending the class is part of the evaluation. For the UE, it concerns a global evaluation that is calculated as follows : If X = evaluation/20 of AA-Multi-Objective Optimization, Y = evaluation20 of AA-First-Order Methods for Large Scale Machine Learning, Z = evaluation/20 of AA-Topics in Convex Optimization. If Min(X,Y,Z) < 8, then the Global evaluation of UE = Min(X,Y,Z). If Min(X,Y,Z) >= 8, then the Global evaluation of UE = 0.2 * X + 0.4 * Y + 0.4 * Z
Type of Assessment for UE in Q3
Q3 UE Assessment Comments
For each AA, the project is the evaluation (gruops of 2 students). An additional written exam may be organised. Attending the class is part of the evaluation. For the UE, it concerns a global evaluation that is calculated as follows : If X = evaluation/20 of AA-Multi-Objective Optimization, Y = evaluation20 of AA-First-Order Methods for Large Scale Machine Learning, Z = evaluation/20 of AA-Topics in Convex Optimization. If Min(X,Y,Z) < 8, then the Global evaluation of UE = Min(X,Y,Z). If Min(X,Y,Z) >= 8, then the Global evaluation of UE = 0.2 * X + 0.4 * Y + 0.4 * Z
Type of Resit Assessment for UE in Q1 (BAB1)
Q1 UE Resit Assessment Comments (BAB1)
Not applicable
Type of Teaching Activity/Activities
AA | Type of Teaching Activity/Activities |
---|---|
I-MARO-231 |
|
I-MARO-232 |
|
I-MARO-303 |
|
Mode of delivery
AA | Mode of delivery |
---|---|
I-MARO-231 |
|
I-MARO-232 |
|
I-MARO-303 |
|
Required Reading
AA | |
---|---|
I-MARO-231 | |
I-MARO-232 | |
I-MARO-303 |
Required Learning Resources/Tools
AA | Required Learning Resources/Tools |
---|---|
I-MARO-231 | Not applicable |
I-MARO-232 | Not applicable |
I-MARO-303 | Slides and other references available on Moodle |
Recommended Reading
AA | |
---|---|
I-MARO-231 | |
I-MARO-232 | |
I-MARO-303 |
Recommended Learning Resources/Tools
AA | Recommended Learning Resources/Tools |
---|---|
I-MARO-231 | Not applicable |
I-MARO-232 | Not applicable |
I-MARO-303 | Bottou, L., Curtis, F. E., & Nocedal, J. (2018). Optimization methods for large-scale machine learning. Siam Review, 60(2), 223-311. Newton, D., Yousefian, F., & Pasupathy, R. (2018). Stochastic Gradient Descent: Recent Trends. In Recent Advances in Optimization and Modeling of Contemporary Problems (pp. 193-220). INFORMS. |
Other Recommended Reading
AA | Other Recommended Reading |
---|---|
I-MARO-231 | Not applicable |
I-MARO-232 | Not applicable |
I-MARO-303 | Not applicable |