Skip to main content
Accessibility|Contact|Privacy|Terms|Cookies

Screen Reader Plus Keyboard Helps Blind, Low-Vision Users Browse Modern Webpages

  • Published: 2018-04-18 : *Press Release by University of Washington : Contact: washington.edu
  • Synopsis: SPRITEs lets blind and low-vision users navigate sites much more successfully using the keyboard as a two-dimensional way to access tables, maps and nested lists than screen readers alone.

Quote: "This study demonstrates that we can use the keyboard to bring tangible, structured information back, and the benefits are enormous."

Main Document

Browsing through offerings on Airbnb means clicking on rows of photos to compare options from prospective hosts. This kind of table-based navigation is increasingly central to our digital lives - but it can be tedious or impossible for people who are blind or have low vision to navigate these modern webpages using traditional screen readers.

A new approach developed by engineers at the University of Washington and Carnegie Mellon University uses the keyboard as a two-dimensional way to access tables, maps and nested lists. Results to be presented April 25 at the CHI 2018 conference in Montreal find this tool lets blind and low-vision users navigate these kinds of sites much more successfully than screen readers alone.

"We're not trying to replace screen readers, or the things that they do really well," said senior author Jennifer Mankoff, a professor in the UW's Paul G. Allen School of Computer Science. "But tables are one place that it's possible to do better. This study demonstrates that we can use the keyboard to bring tangible, structured information back, and the benefits are enormous."

The new tool, Spatial Recognition Interaction Techniques, or SPRITEs, maps different parts of the keyboard to areas or functions on the screen.

A research trial asked 10 people, eight of whom were blind and two with low vision, to complete a series of tasks using their favorite screen reader technology, and then using that technology plus SPRITEs. After a 15-minute tutorial, three times as many participants were able to complete spatial web-browsing tasks within the given time limit using SPRITEs, even though all were experienced with screen readers.

A user presses keys to select a top-level menu, submenu, and then click through options on a nested list to book a sightseeing activity through Airbnb - Image Credit: University of Washington.
About This Image: A user presses keys to select a top-level menu, submenu, and then click through options on a nested list to book a sightseeing activity through Airbnb - Image Credit: University of Washington.

The tool has users press keys to prompt the screen reader to move to certain parts of the website.

"Rather than having to browse linearly through all the options, our tool lets people learn the structure of the site and then go right there," Mankoff said. "You can learn which part of the keyboard you need to jump right down and check, say, whether dogs are allowed."

Most of the test participants couldn't complete a task such as find an item in a submenu or find specific information in a table using their favorite screen reader, but could complete it using SPRITEs.

"A lot more people were able to understand the structure of the webpage if we gave them a tactile feedback," said co-author Rushil Khurana, a doctoral student at Carnegie Mellon University who conducted the tests in Pittsburgh. "We're not trying to replace the screen reader, we're trying to work in conjunction with it."

For straightforward text-based tasks such as finding a given section header, counting headings in a page or finding a specific word, participants were able to complete them successfully using either tool.

SPRITEs is one of a suite of tools that Mankoff's group is developing to help visually impaired users navigate items on a two-dimensional screen.

An ethnographic study in 2016 led by doctoral student Mark Baldwin and faculty member Gillian Hayes, both at the University of California, Irvine, observed about a dozen students over four months while they learned to use accessible computing tools, in order to find areas for improvement in screen reading technology.

Now that the team has developed and tested SPRITEs, it plans to make the system more robust for any website and then add it to WebAnywhere, a free, online screen reader developed at the UW.

Adding SPRITEs would let users navigate with their keyboard while using the WebAnywhere plugin to read information displayed on a webpage. The team also plans to develop a similar technique that would augment screen-reading technology on mobile devices.

"We hope to deploy something that will make a difference in people's lives," Mankoff said.

Other co-authors of the paper presented at the CHI meeting are Duncan McIsaac and Elliot Lockerman at Carnegie Mellon University. The research was funded by the U.S. Department of Health and Human Services.

Discussion

• Have your say! Add your comment or discuss this article on our FaceBook Page.

Similar Topics

1 : Screen Reader Plus Keyboard Helps Blind, Low-Vision Users Browse Modern Webpages : University of Washington.
2 : HopkinsPD Smartphone App Helps Doctors Track Severity of Parkinson's Disease Symptoms : Johns Hopkins University.
3 : Cleen App Aims to Improve UK Public Washroom Standards and Accessibility : Sarah Jenkin-Jones.
4 : Libby App Enables Free Ebooks and Audiobooks From the Library : Rakuten OverDrive.
5 : Mobile Phone App to Control Diabetes May be Possible Someday : Rutgers University.
From our Disability and Health Apps section - Full List (116 Items)


Submit disability news, coming events, as well as assistive technology product news and reviews.


Loan Information for low income singles, families, seniors and disabled. Includes home, vehicle and personal loans.


Famous People with Disabilities - Well known people with disabilities and conditions who contributed to society.


List of awareness ribbon colors and their meaning. Also see our calendar of awareness dates.


Blood Pressure Chart - What should your blood pressure be, and information on blood group types/compatibility.





1 : Turnstone Center Designated as Official Paralympic Training Site by US Olympic Committee
2 : Help Your Child in School by Adding Language to The Math
3 : 50% of Retirees Saw Little or No COLA Increase in Net 2018 Social Security Benefits
4 : Turnstone Endeavor Games Concludes with National Records Broken
5 : Spinning in Circles and Learning From Myself by Tsara Shelton
6 : St. Louis HELP Medical Equipment Donation Drive Generates Record-Breaking Results
7 : People Who Snore Suffer from Palate Nerve and Muscle Damage
8 : How Our Ancestors with Autistic Traits Led a Revolution in Ice Age Art

*Press Release by University of Washington: Disabled World makes no warranties or representations in connection therewith. If you are connected with this page and want it corrected/updated please contact us.



Disclaimer: This site does not employ and is not overseen by medical professionals. Content on Disabled World is not intended to be a substitute for professional medical advice, diagnosis, or treatment. Always seek the advice of a physician or other qualified health provider with any questions you may have regarding a medical condition. See our Terms of Service for more information.

Reporting Errors: Disabled World is an independent website, your assistance in reporting outdated or inaccurate information is appreciated. If you find an error please let us know.

© 2004 - 2018 Disabled World™