At Cornell Tech, researchers are rethinking communication for people with speech impairments by weaving in humour that most traditional tools overlook. They’re using AI to help users slip in a well-timed joke, making interactions feel natural and engaging.
Tobias Weinberg, a Ph.D. student at Cornell Tech who relies on augmentative and alternative communication (AAC) himself after losing his voice at 15, puts it plainly: ‘Humour isn’t just a bit of fun—it’s a vital way to connect with others. For someone with a speech impairment, getting the timing right can be a real challenge.’ His personal journey has been a key driver behind this innovative work.
The project, celebrated at the 2025 CHI Conference, is a collaborative effort involving Cornell Tech, the Cornell Ann S. Bowers College of Computing and Information Science, and the University of Maryland. It explores four distinct AI-powered interfaces—Full-auto, Keywords, Context Bubble Selection, and Wizard—each designed to find a balance between swift performance and user control.
With the Full-auto mode, the system crafts jokes with minimal input, while the Keywords interface lets users steer the process with specific terms. For those who want a bit more say, the Context Bubble and Wizard options offer greater customisation, ensuring the humour lands just when it should.
Assistant professor Thijs Roumen emphasises the delicate balance between keeping control and maintaining the flow of conversation. ‘The time window for a well-timed joke is incredibly short,’ Weinberg explains. ‘Even if the humour isn’t entirely my own, it still gets a laugh—and that connection is what matters.’
Of course, challenges persist. Input limitations—especially for eye-gaze or joystick users—and the sometimes flat tone of text-to-speech voices highlight the need for more expressive AAC tools that go beyond mere functionality.
Roumen hopes this research inspires further innovation in accessibility tech, encouraging creators to focus not just on essential communication needs but also on empowering self-expression, humour, and emotional connectivity.
