{"id":29556,"date":"2025-11-07T11:00:00","date_gmt":"2025-11-07T16:00:00","guid":{"rendered":"https:\/\/michigan.it.umich.edu\/news\/?p=29556"},"modified":"2025-11-10T10:32:32","modified_gmt":"2025-11-10T15:32:32","slug":"open-your-eyes-co-designing-accessible-tech","status":"publish","type":"post","link":"https:\/\/michigan.it.umich.edu\/news\/2025\/11\/07\/open-your-eyes-co-designing-accessible-tech\/","title":{"rendered":"Open Your Eyes: Co-Designing Accessible Tech"},"content":{"rendered":"\n
Originally published on Discover Rackham<\/a>.<\/pre>\n\n\n\n
Solving for the Real World<\/h2>\n\n\n\n
Imagine having to live your everyday life without access to a cell phone, computer, or tablet. Beyond feeling a prickling annoyance that the information superhighway is just beyond your fingertips, the absence of tech would severely limit your professional opportunities, personal autonomy, and ability to accomplish things in a world dependent on comprehensive connectivity. Without screen readers\u2014technology that interprets and speaks aloud text and describes images on computing devices\u2014that\u2019s what life would be like for people living with blindness.<\/p>\n\n\n\n
Rackham Ph.D. candidate and human-computer interaction researcher Jaylin Herskovitz is interested in developing a deep understanding of the needs of blind technology users so that she can co-design more accessible tech with them, leveraging artificial intelligence (AI) to help blind people get precise information with efficiency and accuracy. <\/p>\n\n\n\n
\u201cI am fulfilled in work that solves tangible, real-world problems that are impacting people\u2019s everyday lives,\u201d she says.<\/p>\n\n\n\n
Collaboration Across Difference<\/h2>\n\n\n\n
\n
One area where Herskovitz seeks to create greater accessibility is the collaborative functionality of Google Docs. While screen readers can recite the text in Google Docs, they cannot detect new text being added.<\/p>\n<\/div>
\"Jaylin<\/figure><\/div>\n\n\n\n
Herskovitz designed audio cues to alert blind users when another collaborator is adding new text to the document. The cues are louder when the collaborator is closer to the blind user\u2019s cursor, and softer when the collaborator is further away. Users can customize the cues, which range from chimes to verbal indicators. <\/p>\n\n\n\n
\u201cWe want to provide people with both modes of interaction, because some people prefer one over another \u2014 and it\u2019s nice to have a higher verbosity explanation when you\u2019re new to a system,\u201d she explains.<\/p>\n\n\n\n
Herskovitz\u2019s Google Docs modifications also include audio cues to indicate that someone has used the \u201ccomments\u201d function of the software, inviting users to inspect the comment further. Comment and edit summaries also offer blind users a more efficient way to collaborate in the software.<\/p>\n\n\n\n
\u201cThroughout the design process, we\u2019re conducting research to figure out the ideal way to communicate with blind users. If the results are negative, or if people actually prefer the old way, well, it\u2019s back to the drawing board,\u201d she says.<\/p>\n\n\n\n
A Legacy of Access<\/h2>\n\n\n\n
\n
The user-first spirit of Herskovitz\u2019s work follows a proud legacy of shifting agency away from the limiting use-cases that sighted developers can imagine, and empowers blind users to create the customizations that they need.<\/p>\n<\/div>
\"Rackham<\/figure><\/div>\n\n\n\n
In the mid-1980s, Rackham alum and one of U-M\u2019s first doctoral graduates in computer science, Jim Thatcher (Ph.D. 1963), and his U-M advisor-turned-colleague, Jesse Wright, worked together in the Mathematical Sciences Department of IBM Research to create the first computer screen readers. <\/p>\n\n\n\n
While Thatcher is often solely credited with the invention, in an interview for the American Association for the Blind, Thatcher cites Wright and other blind employees at IBM as essential collaborators on the project. <\/p>\n\n\n\n
\u201cI had no idea it would become an IBM product because I was just having fun, making the PC accessible for Jesse,\u201d he was quoted as saying.<\/p>\n\n\n\n
Herskovitz notes that when personal computers were released, IBM hadn\u2019t yet released screen readers for commercial use, leaving people living with disabilities to create their own work-arounds and supports.<\/p>\n\n\n\n
\u201cAccessibility is often people with disabilities taking matters into their own hands because they have no other option,\u201d she affirms.<\/p>\n\n\n\n
Exactly What You\u2019re Looking For<\/h2>\n\n\n\n
\n
While screen reading assistance is one aspect of creating access for people with vision disabilities, technology is also used to help blind people see the offline world.<\/p>\n<\/div>
\"A<\/figure><\/div>\n\n\n\n
Be My Eyes is a popular technology that connects blind or low vision users with volunteers or AI to help them interpret their surroundings using live video captured from the camera on their phone. While this service provides essential support for so many people, it is also one of the platforms that has inspired Herskovitz\u2019s appetite for improvement.<\/p>\n\n\n\n
Herskovitz\u2019s research reveals that blind users are frustrated by AI\u2019s current capacity for interpreting imagery, finding it far too general to be efficient. If a blind user wanted to know the expiration date on a jar of salsa, AI wouldn\u2019t necessarily know how to hone in on that one detail, forcing the user to sit through a tedious computer read-out of every bit of text on the jar\u2019s label to get that information.<\/p>\n\n\n\n
To address this issue, Herskovitz used techniques from the field of end-user programming \u2014 the practice of designing for non-programmers to create and modify software for their own specific needs \u2014 to create ProgramAlly, an application for blind people to write small custom programs to target the specifics of what they\u2019d like to see.<\/p>\n\n\n\n
\u201cPrograms could include things like finding a specific route number on a bus or finding the title of a book \u2014 essentially creating simple commands for people to specify exactly what they\u2019re looking for that the AI can understand,\u201d she says.<\/p>\n\n\n\n
Herskovitz\u2019s vision for the application is to use existing models as building blocks that users can customize to create something that fits their unique everyday needs. Her study involving blind participants revealed that even though most users did not describe themselves as tech savvy, there was a lot of enthusiasm around ProgramAlly and its capacity for customization.<\/p>\n\n\n\n
\u201cA really rewarding part of my work is to co-design and build something with blind participants \u2014 and actually get to experience people\u2019s reactions to it, or how they would use it,\u201d Herskovitz says.<\/p>\n","protected":false},"excerpt":{"rendered":"
Rackham doctoral candidate and human-computer interaction researcher Jaylin Herskovitz co-designs accessible tech with blind people, improving their experience with the world, online and off.<\/p>\n","protected":false},"author":224,"featured_media":29561,"comment_status":"open","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"_uag_custom_page_level_css":"","_umich_oidc_access":"","_monsterinsights_skip_tracking":false,"_monsterinsights_sitenote_active":false,"_monsterinsights_sitenote_note":"","_monsterinsights_sitenote_category":0,"_ef_editorial_meta_date_first-draft-date":"","_ef_editorial_meta_paragraph_assignment":"","_ef_editorial_meta_checkbox_needs-photo":"","_ef_editorial_meta_number_word-count":"","footnotes":""},"categories":[5],"tags":[95,854,852],"class_list":["post-29556","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-campus-news","tag-accessibility","tag-computer-science","tag-engineering"],"uagb_featured_image_src":{"full":["https:\/\/michigan.it.umich.edu\/news\/wp-content\/uploads\/2025\/11\/AdobeStock_1664245477-1356x644-1.jpeg",1356,644,false],"thumbnail":["https:\/\/michigan.it.umich.edu\/news\/wp-content\/uploads\/2025\/11\/AdobeStock_1664245477-1356x644-1-400x266.jpeg",400,266,true],"medium":["https:\/\/michigan.it.umich.edu\/news\/wp-content\/uploads\/2025\/11\/AdobeStock_1664245477-1356x644-1-300x142.jpeg",300,142,true],"medium_large":["https:\/\/michigan.it.umich.edu\/news\/wp-content\/uploads\/2025\/11\/AdobeStock_1664245477-1356x644-1-768x365.jpeg",665,316,true],"large":["https:\/\/michigan.it.umich.edu\/news\/wp-content\/uploads\/2025\/11\/AdobeStock_1664245477-1356x644-1-600x285.jpeg",600,285,true],"1536x1536":["https:\/\/michigan.it.umich.edu\/news\/wp-content\/uploads\/2025\/11\/AdobeStock_1664245477-1356x644-1.jpeg",1356,644,false],"2048x2048":["https:\/\/michigan.it.umich.edu\/news\/wp-content\/uploads\/2025\/11\/AdobeStock_1664245477-1356x644-1.jpeg",1356,644,false],"excerpt-thumbnail":["https:\/\/michigan.it.umich.edu\/news\/wp-content\/uploads\/2025\/11\/AdobeStock_1664245477-1356x644-1-200x140.jpeg",200,140,true],"themonic-thumbnail":["https:\/\/michigan.it.umich.edu\/news\/wp-content\/uploads\/2025\/11\/AdobeStock_1664245477-1356x644-1-60x42.jpeg",60,42,true],"ioslider-thumbnail":["https:\/\/michigan.it.umich.edu\/news\/wp-content\/uploads\/2025\/11\/AdobeStock_1664245477-1356x644-1-658x300.jpeg",658,300,true],"post-thumbnail":["https:\/\/michigan.it.umich.edu\/news\/wp-content\/uploads\/2025\/11\/AdobeStock_1664245477-1356x644-1-665x316.jpeg",665,316,true],"400x250-crop":["https:\/\/michigan.it.umich.edu\/news\/wp-content\/uploads\/2025\/11\/AdobeStock_1664245477-1356x644-1-400x250.jpeg",400,250,true]},"uagb_author_info":{"display_name":"Truly Render, Communications Specialist, Rackham Communications","author_link":"https:\/\/michigan.it.umich.edu\/news\/author\/trender\/"},"uagb_comment_info":0,"uagb_excerpt":"Rackham doctoral candidate and human-computer interaction researcher Jaylin Herskovitz co-designs accessible tech with blind people, improving their experience with the world, online and off.","_links":{"self":[{"href":"https:\/\/michigan.it.umich.edu\/news\/wp-json\/wp\/v2\/posts\/29556","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/michigan.it.umich.edu\/news\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/michigan.it.umich.edu\/news\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/michigan.it.umich.edu\/news\/wp-json\/wp\/v2\/users\/224"}],"replies":[{"embeddable":true,"href":"https:\/\/michigan.it.umich.edu\/news\/wp-json\/wp\/v2\/comments?post=29556"}],"version-history":[{"count":4,"href":"https:\/\/michigan.it.umich.edu\/news\/wp-json\/wp\/v2\/posts\/29556\/revisions"}],"predecessor-version":[{"id":29562,"href":"https:\/\/michigan.it.umich.edu\/news\/wp-json\/wp\/v2\/posts\/29556\/revisions\/29562"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/michigan.it.umich.edu\/news\/wp-json\/wp\/v2\/media\/29561"}],"wp:attachment":[{"href":"https:\/\/michigan.it.umich.edu\/news\/wp-json\/wp\/v2\/media?parent=29556"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/michigan.it.umich.edu\/news\/wp-json\/wp\/v2\/categories?post=29556"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/michigan.it.umich.edu\/news\/wp-json\/wp\/v2\/tags?post=29556"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}