Study programme 2022-2023Français
Deep Learning for Natural Language and Sequence Processing
Learning Activity
CodeLecturer(s)Associate Lecturer(s)Subsitute Lecturer(s) et other(s)Establishment
S-INFO-810
  • DUPONT Stéphane
      • UMONS
      Language
      of instruction
      Language
      of assessment
      HT(*) HTPE(*) HTPS(*) HR(*) HD(*) Term
      Anglais, FrançaisAnglais, Français1818000Q2


      Content of Learning Activity

      This course deals with advances in artificial intelligence through deep learning applied to the modeling of temporal sequences with long-term dependencies, and in particular to natural language processing:
      - Contemporary AI using deep neural networks: DNN, CNN, RNN, LSTM, GRU, Attention, Transformers, GPT, generative models, GANs, auto-encoders, etc.
      - Applications to natural language processing: natural language processing (NLP) and modeling, machine translation (neural machine translation), text classification and document information extraction, "chatbots" and answering questions, extraction and search of information in "big data" unstructured text / images, human-computer dialogue systems, situated interaction (language + vision) for example in games, text generation.
      - Artificial intelligence models comprising billions of parameters and able to memorize and exploit the structure of language as well as knowledge and facts; importance of studying the equity and biases of AI in this context.
      - You will also be offered articles for reading, in order to better understand the wide range of possible applications of these models: mining, infectiology, smart cities, traffic prediction, etc.

      This course will include practicals to acquire the theory.
       

      Required Learning Resources/Tools

      All learning resources and tools required for this cours are available via Moodle, the online e-learning platform of UMONS.

      Recommended Learning Resources/Tools

      Additional recommended material is also accessible through Moodle, the online e-learning platform of UMONS.

      Other Recommended Reading

      Not applicable

      Mode of delivery

      • Face-to-face

      Type of Teaching Activity/Activities

      • Cours magistraux
      • Travaux pratiques
      • Travaux de laboratoire
      • Projet sur ordinateur

      Evaluations

      The assessment methods of the Learning Activity (AA) are specified in the course description of the corresponding Educational Component (UE)

      (*) HT : Hours of theory - HTPE : Hours of in-class exercices - HTPS : hours of practical work - HD : HMiscellaneous time - HR : Hours of remedial classes. - Per. (Period), Y=Year, Q1=1st term et Q2=2nd term
      Date de dernière mise à jour de la fiche ECTS par l'enseignant : 25/05/2022
      Date de dernière génération automatique de la page : 20/06/2023
      20, place du Parc, B7000 Mons - Belgique
      Tél: +32 (0)65 373111
      Courriel: info.mons@umons.ac.be