CHAI Research Talk: Human+AI Approaches to Improve Real-world Accessibility by Jon Froehlich

RIT's Center for Human Aware AI (CHAI) 2021 Fall Seminar Series

CHAI Research Talk: Human+AI Approaches to Improve Real-world Accessibility by Jon Froehlich, PhD and Associate Professor, University of Washington

Abstract: In our work, we are exploring how to leverage advances in mobile sensing and machine learning (ML) to create novel interactive systems that improve real-world accessibility. My talk will describe two large-scale research efforts: first, Project Sidewalk, which combines crowdsourcing, ML, and online imagery to scalably map and assess sidewalk accessibility. Working with local government and NGO partners, Project Sidewalk has expanded into seven cities, including two in Mexico, with over 550,000 sidewalk labels across 10,000 km of city streets. Second, I will discuss our ML-based sound awareness research and tools for people who are d/Deaf or hard of hearing (DHH) such as our work with AR-based captioning, smarthome-based sound notification and visualization techniques (HomeSound), and, most recently, our work with smartwatches (SoundWatch). My talk will close with opportunities and challenges for the future of Human+AI accessibility tools.

Biography: Jon Froehlich is an Associate Professor in the University of Washington's Allen School, a Sloan Fellow, and NSF CAREER Awardee. His research is in Human-Computer Interaction (HCI) with a focus on high-value social domains such as accessibility, environmental sustainability, and STE(A)M education. At UW, he directs the Makeability Lab, and he teaches computing courses that explore the materiality of computing and the ever-changing relationships between humans, bits, and atoms. While studying for his PhD in Computer Science at the University of Washington, he received a Microsoft Research Graduate Fellowship and the 2010 College of Engineering “Graduate Innovator of the Year” award. His work has been published in premiere computing venues, including ACM CHI, UbiComp, ASSETS, IJACI, DIS, MobiSys, and ICSE, and he has received seven Best Papers Awards and nine Best Paper Honorable Mentions for his research.


Contact
Matt Huenerfauth
Event Snapshot
When and Where
November 10, 2021
3:00 pm - 4:00 pm
Room/Location: Webinar
Who

Open to the Public

CostFREE
Interpreter Requested?

No

Topics
artificial intelligence
research