Home

My interests lie in the automatic analysis and understanding of verbal and nonverbal (vocal) behaviors in human-human and human-machine interaction, and the design of socially interactive technology to support human needs. Using methods from affective computing and social signal processing, I aim to develop socially and affective intelligent interfaces (e.g. virtual conversational agents, social robots) that can recognize and display social and affective signals and to study how humans interact with this new kind of technology. Coming from a background in (computational) paralinguistics and speech analysis, my main focus is on analysing vocal cues in addition to visual cues (e.g. facial expressions, eye gaze) and physiological (e.g. heart rate, galvanic skin response) measurements in social interaction.

Prior to HMI, I was employed by TNO Human Factors in Soesterberg where I worked towards my PhD on automatic emotion recognition in speech and automatic laughter detection. During my master research at Radboud University in Nijmegen, I worked on automatic pronunciation error detection in second language learners’ speech.

social signal processing / affective computing / multimodal interaction / paralinguistics / speech prosody / non-verbal vocalisations / laughter / dialogue / embodied conversational agents / human-human interaction / human-robot interaction / computer-assisted language learning / pronunciation error detection


Most recent news:

Back from Interspeech 2017 (Stockholm)!

Interspeech 2017 was held this year in Stockholm. It was great seeing everybody again. Jaebok Kim presented our paper on ...
Read More
/ Uncategorized

Talks & Media

Our work in collaboration with J├╝rgen Trouvain (Saarland University) has been mentioned in an article by Scientific American, see https://www.scientificamerican.com/article/scientists-are-teaching-robots-to-laugh/ ...
Read More
/ Uncategorized

Lecture Universiteit van Nederland online

Thank you to Universiteit van Nederland for inviting me to record a lecture on the 25th of January, 2017 (in ...
Read More
/ Uncategorized

Squirrel project review year 3 was succesful!

On March 28th - March 29th, 2017, we had our 3rd year review meeting in Freiburg, Germany. The reviewers were ...
Read More
/ Uncategorized

Back from TEI2017, Yokohama, Japan

Together with future concepts biomedia designer Kristin Neidlinger (Sensoree) and others, we had a full paper accepted at this year's ...
Read More
/ Uncategorized

Back from ICMI 2016 in Tokyo

The 18th ACM International Conference on Multimodal Interaction was held in Tokyo. I was one of the mentors for the ...
Read More
/ Uncategorized