Esam Ghaleb

Affiliation - ILLC at UvA. Address - LAB42 (room L6.39), Science Park 900, 1012 WX, Amsterdam, The Netherlands.


Esam Ghaleb is a postdoctoral researcher in the Dialogue Modelling Group at the Institute for Logic, Language & Computation (ILLC), University of Amsterdam. Currently, he is working on modeling face-to-face dialogue using NLP, computer vision, and machine learning. His work is embedded within the Language in Interaction consortium.

Previously, Ghaleb was a postdoctoral researcher in the Department of Advanced Computing Sciences at Maastricht University, working on the Horizon 2020 project, ProCare4Life. In the ProCare4Life project, his research focused on human behavioral analysis, mainly for people with neurodegenerative diseases. During his postdoctoral research, he worked on XAI for bodily expressed emotion recognition as well. Previously, Ghaleb completed his doctoral research at Maastricht University. During his Ph.D., he carried out research on bimodal emotion recognition through audio-visual cues. His work utilized facial expressions and speech signals in video clips and proposed progressive computational methodologies to capture their complementary information for emotion recognition. Ghaleb’s Ph.D. research was supported by the Horizon 2020 project MaTHiSiS. Besides his research and project work, he was a teaching assistant for the computer vision course at DACS at Maastricht University.

Before joining UM, Ghaleb completed his BA (2013) and MA (2015) degrees in the Department of Computer Engineering at Istanbul Technical University (ITU). In his Master’s thesis, he studied the aging effect on face recognition utilizing Harry Potter movies. Early academic work experiences include his position as a research assistant in the Smart Interaction, Mobile Intelligence, and Multimedia Technologies (SiMiT) Research Group at Istanbul Technical University (ITU). Furthermore, Ghaleb conducted two internships in the Computer Vision for Human-Computer Interaction (CVHCI) laboratory at Karlsruhe Institute of Technology (2014 & 2015).


Oct 18, 2022 NLPitch at the ILLC!
Sep 1, 2022 I joined the Dialogue Modelling Group as a postdoc to work on modelling face-to-face dialogue within the Language in Interaction consortium! ✨ 😄
Jul 15, 2022 New paper published in Multimedia Tools and Applications
Nov 15, 2021 Paper accepted at FG21!
Jul 8, 2021 I defended my PhD thesis!

Selected Publications

  1. Joint Modelling of Audio-visual Cues Using Attention Mechanism for Emotion Recognition
    Esam Ghaleb, Jan Niehues, and Stylianos Asteriadis
    Multimedia Tools and Applications Jul 2022
  2. Skeleton-Based Explainable Bodily Expressed Emotion Recognition Through Graph Convolutional Networks
    Esam Ghaleb, André Mertens, Stylianos Asteriadis, and 1 more author
    In 2021 16th IEEE International Conference on Automatic Face and Gesture Recognition (FG 2021) Jul 2021