Enrollment year
2020/2021
Academic discipline
MAT/08 (NUMERICAL ANALYSIS)
Department
DEPARTMENT OF MATHEMATICS "FELICE CASORATI"
Curriculum
PERCORSO COMUNE
Period
2nd semester (01/03/2021 - 11/06/2021)
Lesson hours
24 lesson hours
Prerequisites
Standard courses of Mathematical Analysis and Numerical Analysis
Learning outcomes
The course offers an overview of the theory and applications of Optimization, showing the main results and their aplication to concrete problems arising fro the applications.
Course contents
1. Introduction to Optimization methods. Matlab Optimization Toolbox.
2. Derivative – free methods: Nelder – Mead.
3. Newton method.
4. Descent methods (line search):
- stepsize selection, Wolfe conditions, backtracking.
- Newton direction.
- Quasi – Newton directions(rank 1 update, DFP and BFGS methods)
- Gradient direction.
- Conjugate gradient (methods of Fletcher – Reeves, Polak – Ribiere, Hestenes – Stiefel).
5. Trust – Region methods.
6. Nonlinear Least – Square:
- Gauss – Newton.
- Levenberg - Marquardt.
7. Application to neural networks and Deep Learning.
Teaching methods
Lectures and Matlab laboratory
Reccomended or required readings
Nocedal, Jorge; Wright, Stephen J. Numerical optimization. Second edition. Springer, 2006.
Assessment methods
Final project, presentation and oral examination
Sustainable development goals - Agenda 2030