Home

My interests lie in the automatic analysis and understanding of verbal and nonverbal (vocal) behaviors in human-human and human-machine interaction, and the design of socially interactive technology to support human needs. Using methods from affective computing and social signal processing, I aim to develop socially and affective intelligent interfaces (e.g. virtual conversational agents, social robots) that can recognize and display social and affective signals and to study how humans interact with this new kind of technology. Coming from a background in (computational) paralinguistics and speech analysis, my main focus is on analysing vocal cues in addition to visual cues (e.g. facial expressions, eye gaze) and physiological (e.g. heart rate, galvanic skin response) measurements in social interaction.

Prior to HMI, I was employed by TNO Human Factors in Soesterberg where I worked towards my PhD on automatic emotion recognition in speech and automatic laughter detection. During my master research at Radboud University in Nijmegen, I worked on automatic pronunciation error detection in second language learners’ speech.

social signal processing / affective computing / multimodal interaction / paralinguistics / speech prosody / non-verbal vocalisations / laughter / dialogue / embodied conversational agents / human-human interaction / human-robot interaction / computer-assisted language learning / pronunciation error detection

Quick links

featured scientist (Feb 2021)
student assignments (updated March 2021)


Most recent news:

BNNVARA TV program “We Gaan Het Maken”

I participated in a TV program from BNNVARA "We Gaan Het Maken" (also known as "The Big Life Fix" from ...
Read More
/ Uncategorized

ICMI 2020, it’s a wrap.

We did it, ICMI 2020 is over. It was a bumpy ride, especially when we had to make the difficult ...
Read More
/ Uncategorized

ICMI 2019, Suzhou, China

ICMI 2019 took place in Suzhou, China this year. I am happy to announce that the 22nd ACM International Conference ...
Read More
/ Uncategorized

Interspeech 2019, Graz

With over 2000 participants, this was the largest Interspeech to date! We presented our work on laughter annotation (together with ...
Read More
/ Uncategorized

ACII 2019 in Cambridge, UK

We attended ACII 2019 in Cambridge, UK with several members of HMI. Deniece Nazareth presented her PhD work about emotional ...
Read More
/ Uncategorized

Talks about speech tech and AI

Together with Roeland Ordelman, we were present at the Drongo Language Festival in Nijmegen, explaining to the general public (and ...
Read More
/ Uncategorized