Deep Learning, Transfer Learning - application to NLP and Image Recognition

Catalogue des cours de Télécom SudParis

Code

IGFE CSC 7015

Niveau

MSc

Graduate

PostGraduate

Domaine

Informatique

Programme

Master of Science

Langue

Anglais/English

Crédits ECTS

4

Heures programmées

26

Coordonnateur(s)

Département

  • Réseaux et Services Multimédia Mobiles

Equipe pédagogique

Organisation

Cours/TD/TP/projet/examen :

Contenu

- Introduction to deep learning
- Architecture and core components of NN
- NN optimization
- Hyperparameter selection
- Implement, train and validate their own NN
- Discussion and hands-on session on MNIST dataset
- Introduction to Transfer Learning
- Architecture of the Transformer
- Pre-training transformer-based models
- Implement and train transformer-based models
- Discussion and hands-on session on an NLP application
- Deep transfer learning

Evaluation

Practical session grading