CV

A full CV is available upon request.

General Information

Full Name Esam Ghaleb
Affiliation Max Planck Institute for Psycholinguistics (Multimodal Language Department)
Languages Arabic (native), English (fluent), Turkish (fluent), Dutch (upper-intermediate—B2)

Appointments

  • 09/2024–present
    Research Scientist, Multimodal Language Department, Max Planck Institute for Psycholinguistics
    • Research: multimodal communication and behaviour (representation learning, analysis, generation).
    • Department role: leads the Multimodal Modelling Cluster.
  • 09/2022–08/2024
    Postdoctoral Researcher, Dialogue Modeling Group, Institute for Logic, Language and Computation (ILLC), University of Amsterdam
    • Research: face-to-face dialogue modelling; co-speech gesture segmentation/representation; multimodal (speech–gesture) alignment.
  • 03/2020–08/2022
    Postdoctoral Researcher, Cognitive Systems Group, Department of Advanced Computing Sciences, Maastricht University
    • Research: explainable AI for emotion recognition; behavioural analysis in healthcare; self-supervised learning for sensor-based activity recognition.
    • Leadership: work package leader (EU H2020 ProCare4Life).
  • 03/2016–02/2020
    Doctoral Researcher, Cognitive Systems Group, Maastricht University
    • Research: affective computing and machine learning; multimodal (audio–visual) emotion recognition.
    • Project role: co-represented Maastricht University tasks (EU H2020 MaTHiSiS).
  • 07/2013–02/2016
    Research Assistant, Smart Interaction and Machine Intelligence Technologies (SiMiT) Lab, Istanbul Technical University
    • Research: computer vision and HCI; face recognition/tracking; retrieval of faces across age.
  • 06/2014–08/2014
    Research Intern, CVHCI Lab, Karlsruhe Institute of Technology (KIT)
    • Built and annotated the Accio dataset for face track retrieval in movies (Harry Potter); revisited lab in Summer 2015 for thesis research.

Education

  • 2016–2021
    Ph.D., Affective Computing and Machine Learning, Maastricht University
  • 2013–2015
    M.Sc., Computer Engineering, Istanbul Technical University
  • 2009–2013
    B.Sc., Computer Engineering, Istanbul Technical University
    • Graduated with honors
    • Bachelor thesis: An Energy-Efficient Routing Technique and Implementation in Wireless Sensor Networks

Funding (selected)

  • 2025
    NWO Open Competition Domain Science (XS)
    • PI for the project titled: “Grounded Gesture Generation in Context: Object- and Interaction-Aware Generative AI Models of Language Use”.
  • 2025
    Donders Research Stimulation Fund
    • Co-applicant for the project with Sara Bögels (PI) and Iris Hendrickx on temporal dynamics of communicative effort reduction and alignment.
  • 2007–2013
    Scholarships (Yemen & Turkey Ministries of Higher Education)
    • Scholarships supporting BSc/MSc studies (approx. USD 60,000 total).
  • 2014
    Internship grant, Istanbul Technical University (KIT visit)
    • Grant supporting summer research internship at KIT (Germany).

Honors & Awards

  • 2021
    Nomination for Best Paper Award (IJCB)
    • “Contrastive self-supervised learning for sensor-based human activity recognition”.
  • 2016
    Ranked 1st, International Challenge on Biometric Recognition in the Wild (ICB-RW)
  • 2006
    Graduated in the top 0.2% nationwide (high school), Yemen

Invited Talks (recent)

  • 09/2025
    Speech and Gesture Interaction in Face-to-Face Dialogue (analysis and generation)
    • Utrecht University (NLP@U)
  • 10/2024
    Learning representations in dialogue through contrastive learning
    • SignLab Amsterdam, University of Amsterdam
  • 06/2024
    Understanding and modelling multimodal dialogue coordination
    • Tilburg University