CV
A full CV is available upon request.
Contact Information
| Name | Esam Ghaleb |
| Professional Title | Research Scientist |
Experience
-
2024 - present Nijmegen, The Netherlands
Research Scientist, Multimodal Language Department
Max Planck Institute for Psycholinguistics
Research on multimodal communication and behaviour, including representation learning, analysis, and generation.
- Leads the Multimodal Modelling Cluster.
-
2022 - 2024 Amsterdam, The Netherlands
Postdoctoral Researcher, Dialogue Modeling Group
University of Amsterdam, Institute for Logic, Language and Computation (ILLC)
Research on face-to-face dialogue modelling, co-speech gesture segmentation and representation, and multimodal speech-gesture alignment.
-
2020 - 2022 Maastricht, The Netherlands
Postdoctoral Researcher, Cognitive Systems Group
Maastricht University, Department of Advanced Computing Sciences
Research on explainable AI for emotion recognition, behavioural analysis in healthcare, and self-supervised learning for sensor-based activity recognition.
- Work package leader for the EU H2020 ProCare4Life project.
-
2016 - 2020 Maastricht, The Netherlands
Doctoral Researcher, Cognitive Systems Group
Maastricht University
Research on affective computing and machine learning, with a focus on multimodal audio-visual emotion recognition.
- Co-represented Maastricht University tasks in the EU H2020 MaTHiSiS project.
-
2013 - 2016 Istanbul, Turkey
Research Assistant
Istanbul Technical University, Smart Interaction and Machine Intelligence Technologies (SiMiT) Lab
Research on computer vision and HCI, including face recognition, tracking, and retrieval of faces across age.
-
2014 - 2014 Karlsruhe, Germany
Research Intern
Karlsruhe Institute of Technology (KIT), CVHCI Lab
Built and annotated the Accio dataset for face track retrieval in movies (Harry Potter).
- Revisited the lab in Summer 2015 for thesis research.
General Information
Languages
Education
-
2016 - 2021 The Netherlands
Ph.D.
Maastricht University
Affective Computing and Machine Learning
- Doctoral thesis: Bimodal Emotion Recognition Through Audio-Visual Cues
-
2013 - 2015 Turkey
M.Sc.
Istanbul Technical University
Computer Engineering
- Graduated with honors.
- Master thesis: Face Track Retrieval and Recognition Across Age
-
2009 - 2013 Turkey
B.Sc.
Istanbul Technical University
Computer Engineering
- Graduated with honors.
- {“Bachelor thesis”=>”An Energy-Efficient Routing Technique and Implementation in Wireless Sensor Networks.”}
Funding
-
2025 NWO Open Competition Domain Science (XS)
Netherlands Organisation for Scientific Research (NWO), The Netherlands
Amount: To be added
PI for the project titled: “Grounded Gesture Generation in Context: Object- and Interaction-Aware Generative AI Models of Language Use”.
-
2025 Donders Research Stimulation Fund
Donders Institute, Nijmegen, The Netherlands
Amount: To be added
Co-applicant for a project with Sara Bögels (PI) and Iris Hendrickx on the temporal dynamics of communicative effort reduction and alignment.
-
2007 Scholarships (Yemen & Turkey Ministries of Higher Education)
Yemen & Turkey Ministries of Higher Education
Amount: Approx. USD 60,000 total
Scholarships supporting B.Sc. and M.Sc. studies.
-
2014 Internship Grant, Istanbul Technical University (KIT Visit)
Istanbul Technical University
Amount: To be added
Grant supporting a summer research internship at Karlsruhe Institute of Technology, Germany.
Awards
-
2021 Nomination for Best Paper Award (IJCB)
International Joint Conference on Biometrics
For the paper: “Contrastive self-supervised learning for sensor-based human activity recognition”.
-
2016 Ranked 1st, International Challenge on Biometric Recognition in the Wild (ICB-RW)
International Conference on Biometrics
-
2006 Graduated in the Top 0.2% Nationwide (High School), Yemen
National ranking, Yemen
Talks
-
2025 Speech and Gesture Interaction in Face-to-Face Dialogue (analysis and generation)
Utrecht University (NLP@U)
Invited talk.
-
2024 Learning Representations in Dialogue Through Contrastive Learning
SignLab Amsterdam, University of Amsterdam
Invited talk.
-
2024 Understanding and Modelling Multimodal Dialogue Coordination
Tilburg University
Invited talk.