Sprecher
Beschreibung
Abstract:
“Okay Google, set a timer for 10 minutes” The ability to interact with AI assistants using natural speech has become a reality for millions of households worldwide. Yet, beyond smart speakers, spoken conversations are sparse in interactive devices, despite being one of the most natural forms of human engagement. Even in the field of Human-Robot Interaction (HRI), spoken dialogue is often overlooked, largely because it’s perceived as too challenging to implement with a satisfying result. Enter Pre-trained Large Language Models. These models, now widely commercially available, promise seamless natural conversation and hence spark excitement that robots could soon achieve similar conversational capabilities with just a simple API call.
In this talk, I will argue for caution. While generative models seem to excel in written contexts, they struggle with the complexity and nuances of spoken interaction. More importantly, pre-trained models are designed to be passive responders, following a user's lead - an approach that falls short in real-world robotic applications where systems must pursue specific, often complex, goals. Ensuring robots adhere to these objectives is far from straightforward with current AI solutions.
Despite these challenges, the potential for natural conversations with robots is immense, spanning disciplines from industrial robotics to in-home support, and from social to task-oriented applications. The message is clear: It is time to make your robots more conversational. Generative AI provides a powerful foundation, but we are still only beginning the journey to robust, goal-oriented spoken interactions.
CV: I'm an Associate Research Scientist at Disney Research Imagineering where I research how humans interact with AI characters. Before joining Disney, I received my PhD from Uppsala University, Sweden, in Computer Science with a Specialization in Human-Computer Interaction in October 2020 and did a PostDoc at the colab Potsdam (University of Potsdam, Germany).
Originally I studied Computer Science at the University of Hamburg, Germany, and focused on both humanoid robotics and conversational interaction. I wrote my Master thesis in cooperation with the University of Southern California on building an incremental dialogue system. Apart from Human-Robot Interaction, my heart belongs to the RoboCup community. Since 2011 I'm involved in the RoboCup Humanoid League, first as one of the founders of the team Hamburg Bit-Bots and since 2015, I'm actively engaged in the RoboCup Organization. Since 2023, I am serving on the board of Trustees of the RoboCup Federation.
When I'm not researching or tinkering with robots, you will most likely find me on the dance floor dancing Kizomba, Urban Kiz, Bachata or ballroom dances, bouldering, playing cooperative boardgames with friends, or reading a book.
