Carpenter
First Name
Rebecca
Last Name
Carpenter
Department
Science and Mathematics
Scholarship Year
2025
Research Center
Center on Access Technology (CAT)
Scholarship Type
Peer Reviewed/Juried Poster Presentation or Conference Paper
Contributors List
Michael Stinson, Shaun Kane & Kristen Shinohara
Project Title
Effects of Text Release Features on Communication and Problem-Solving in Teams with a Deaf/Hard of Hearing and a Hearing Member Using Automatic Speech Recognition
Start Date - Month
October
Start Date - Year
2020
End Date Anticipated - Month
September
End Date Anticipated - Year
2025
Review Types
Blind Peer Reviewed
Student Assistance
None
Projected Cost
$0.00
Funding Source
Grant
Resulting Product
Presentation
Citation

Stinson, Michael. "Effects of Text Release Features on Communication and Problem-Solving in Teams with a Deaf/Hard of Hearing and a Hearing Member Using Automatic Speech Recognition." Proceedings of the ASSETS 2025 October 25-29, 2025. Ed. Shaun Kane & Kristen Shinohara. New York, New York: Association of Computing Machinery. *

Abstract

Abstract: This study examined effects of three text release features used with Automatic Speech Recognition (ASR)-based automatic captioning and of hearing status on quality of performance on problem-solving tasks, number of words two team members exchanged with each other, and on member’s judgments regarding the extent the ASR generated text contained errors. Each of 36 teams, consisting of one deaf/hard of hearing (DHH) and one hearing member, worked online to complete three mapping tasks. These mapping tasks required naming of map locations that were marked by numbers along a pathway indicated by a line with numerous turns. For each of three mapping tasks, the hearing member used a different ASR-based text release feature to produce captions for the DHH member to read, either: (a) controlled release; (b) automatic release with no editing; or (c) automatic release with editing. Results suggested that for DHH and hearing members to solve a problem using automatic captioning with ASR synchronously, it is important for the captioning technology to facilitate rapid exchange of words between members and, at the same time, facilitate dealing with the errors produced by the ASR. Consistent with this proposition, problem-solving performance was highest under the automatic release with editing feature.

264616