A11yBoard Google Slides Extension Makes Presentation Software More Accessible for the Blind
Topic: Electronics/Software
Author: University of Washington
Published: 2023/10/30
Publication Type: Reports and Proceedings
Contents: Summary - Introduction - Main Item - Related Topics
Synopsis: A11yBoard for Google Slides is a browser extension and phone app that allows blind users to navigate through complex slide layouts and text. A11yBoard lets users work with audio, touch, gesture, speech recognition and search to understand where different objects are located on a slide and move these objects around to create rich layouts. A11yBoard for Google Slides builds on a line of research in Wobbrock's lab exploring how blind users interact with "artboards" - digital canvases on which users work with objects such as textboxes, shapes, images and diagrams.
Introduction
Screen readers, which convert digital text to audio, can make computers more accessible to many disabled users - including those who are blind, low vision or dyslexic. Yet slideshow software, such as Microsoft PowerPoint and Google Slides, isn't designed to make screen reader output coherent. Such programs typically rely on Z-order - which follows the way objects are layered on a slide - when a screen reader navigates through the contents. Since the Z-order doesn't adequately convey how a slide is laid out in two-dimensional space, slideshow software can be inaccessible to people with disabilities.
Main Item
A team led by researchers at the University of Washington has created A11yBoard for Google Slides, a browser extension and phone app that allows blind users to navigate through complex slide layouts and text. Combining a desktop computer with a mobile device, A11yBoard lets users work with audio, touch, gesture, speech recognition and search to understand where different objects are located on a slide and move these objects around to create rich layouts. For instance, a user can touch a textbox on the screen, and the screen reader will describe its color and position. Then, using a voice command, the user can shrink that textbox and left-align it with the slide's title.
The team presented its research Oct. 25 at ASSETS 2023 in New York. A11yBoard is not yet available to the public.
"For a long time and even now, accessibility has often been thought of as, 'We're doing a good job if we enable blind folks to use modern products.' Absolutely, that's a priority," said senior author Jacob O. Wobbrock, a UW professor in the Information School. "But that is only half of our aim, because that's only letting blind folks use what others create. We want to empower people to create their own content, beyond a PowerPoint slide that's just a title and a text box."
A11yBoard for Google Slides builds on a line of research in Wobbrock's lab exploring how blind users interact with "artboards" - digital canvases on which users work with objects such as textboxes, shapes, images and diagrams. Slideshow software relies on a series of these artboards. When lead author Zhuohao (Jerry) Zhang, a UW doctoral student in the iSchool, joined Wobbrock's lab, the two sought a solution to the accessibility flaws in creativity tools, like slideshow software. Drawing on earlier research from Wobbrock's lab on the problems blind people have using artboards, Wobbrock and Zhang presented a prototype of A11yBoard in April. They then worked to create a solution that's deployable through existing software, settling on a Google Slides extension.
For the current paper, the researchers worked with co-author Gene S-H Kim, an undergraduate at Stanford University, who is blind, to improve the interface. The team tested it with two other blind users, having them recreate slides. The testers both noted that A11yBoard greatly improved their ability to understand visual content and to create slides themselves without constant back-and-forth iterations with collaborators; they needed to involve a sighted assistant only at the end of the process.
The testers also highlighted spots for improvement: Remaining continuously aware of objects' positions while trying to edit them still presented a challenge, and users were forced to do each action individually, such as aligning several visual groups from left to right, instead completing these repeated actions in batches. Because of how Google Slides functions, the app's current version also does not allow users to undo or redo edits across different devices.
Ultimately, the researchers plan to release the app to the public. But first they plan to integrate a large language model, such as GPT, into the program.
"That will potentially help blind people author slides more efficiently, using natural language commands like, 'Align these five boxes using their left edge,'" Zhang said. "Even as an accessibility researcher, I'm always amazed at how inaccessible these commonplace tools can be. So with A11yBoard we've set out to change that."
This research was funded in part by the University of Washington's Center for Research and Education on Accessible Technology and Experiences (UW CREATE).
Attribution/Source(s):
This quality-reviewed publication was selected for publishing by the editors of Disabled World due to its significant relevance to the disability community. Originally authored by University of Washington, and published on 2023/10/30, the content may have been edited for style, clarity, or brevity. For further details or clarifications, University of Washington can be contacted at washington.edu. NOTE: Disabled World does not provide any warranties or endorsements related to this article.
Explore Related Topics
1 - Advanced Touch-Feedback System Creates Consistent Tactile Experience on Screens - Consistent virtual haptic technology for virtual reality (VR) and augmented reality (AR) users.
2 - HeardAI Making Voice Activated Artificial Intelligence Accessible - HeardAI has advanced to Phase 2 of National Science Foundation's Convergence Accelerator program to make voice-activated AI accessible and fair to people who stutter.
3 - A11yBoard Google Slides Extension Makes Presentation Software More Accessible for the Blind - A11yBoard for Google Slides is a browser extension and phone app that allows blind users to navigate through complex slide layouts and text.
4 - Neuromorphic Computer Chip Mimics Human Vision and Memory Abilities - The neuromorphic invention is a single chip enabled by a sensing element, doped indium oxide, that's thousands of times thinner than a human hair and requires no external parts to operate.
5 - Neural Prosthesis: Using Brain Activity to Decode Speech - Speech decoding from a small set of spatially segregated minimally invasive intracranial EEG electrodes with a compact and interpretable neural network.
Page Information, Citing and Disclaimer
Disabled World is a comprehensive online resource that provides information and news related to disabilities, assistive technologies, and accessibility issues. Founded in 2004 our website covers a wide range of topics, including disability rights, healthcare, education, employment, and independent living, with the goal of supporting the disability community and their families.
Cite This Page (APA): University of Washington. (2023, October 30). A11yBoard Google Slides Extension Makes Presentation Software More Accessible for the Blind. Disabled World. Retrieved October 10, 2024 from www.disabled-world.com/assistivedevices/computer/a11yBoard.php
Permalink: <a href="https://www.disabled-world.com/assistivedevices/computer/a11yBoard.php">A11yBoard Google Slides Extension Makes Presentation Software More Accessible for the Blind</a>: A11yBoard for Google Slides is a browser extension and phone app that allows blind users to navigate through complex slide layouts and text.
Disabled World provides general information only. Materials presented are never meant to substitute for qualified medical care. Any 3rd party offering or advertising does not constitute an endorsement.