Deep Learning, Transfer Learning - application to NLP and Image Recognition

Catalog of Télécom SudParis courses

Code

IGFE CSC 7015

Level

MSc

Graduate

PostGraduate

Domain

Informatique

Program

Master of Science

Language

Anglais/English

ECTS Credits

4

Class hours

26

Program Manager(s)

Department

  • Réseaux et Services Multimédia Mobiles

Educational team

Organisation

Cours/TD/TP/projet/examen :

Content

- Introduction to deep learning
- Architecture and core components of NN
- NN optimization
- Hyperparameter selection
- Implement, train and validate their own NN
- Discussion and hands-on session on MNIST dataset
- Introduction to Transfer Learning
- Architecture of the Transformer
- Pre-training transformer-based models
- Implement and train transformer-based models
- Discussion and hands-on session on an NLP application
- Deep transfer learning

Evaluation

Practical session grading