Skip to main content
Accessibility|Contact|Privacy|Terms|Cookies

Wearable Device to Guide Visually Impaired

  • Published: 2016-02-11 : Author: MIT : Contact: mit.edu
  • Synopsis: Low-power chip processes 3-D camera data, could enable wearable device to guide the visually impaired.

Quote: "There are many problems that have been solved for visually impaired people, but a real one that is still open is navigating and walking alone in a safe way, going around in a big city..."

Main Document

MIT researchers have developed a low-power chip for processing 3-D camera data that could help visually impaired people navigate their environments. The chip consumes only one-thousandth as much power as a conventional computer processor executing the same algorithms.

Using their chip, the researchers also built a prototype of a complete navigation system for the visually impaired. About the size of a binoculars case and similarly worn around the neck, the system uses an experimental 3-D camera from Texas Instruments. The user carries a mechanical Braille interface developed at MIT's Computer Science and Artificial Intelligence Laboratory (CSAIL), which conveys information about the distance to the nearest obstacle in the direction the user is moving.

The researchers reported the new chip and the prototype navigation system in a paper presented earlier this week at the International Solid-State Circuits Conference in San Francisco.

"There was some prior work on this type of system, but the problem was that the systems were too bulky, because they require tons of different processing," says Dongsuk Jeon, a postdoc at MIT's Microsystems Research Laboratories (MTL) when the work was done who joined the faculty of Seoul National University in South Korea this year. "We wanted to miniaturize this system and realized that it is critical to make a very tiny chip that saves power but still provides enough computational power."

A new chip could enable devices that help visually impaired users navigate their environments - Image Credit MIT
About This Image: A new chip could enable devices that help visually impaired users navigate their environments - Image Credit MIT
Jeon is the first author on the new paper, and he's joined by Anantha Chandrakasan, the Vannevar Bush Professor of electrical engineering and computer science; Daniela Rus, the Andrew and Erna Viterbi professor of electrical engineering and computer science; Priyanka Raina, a graduate student in electrical engineering and computer science; Nathan Ickes, a former research scientist at MTL who's now at Apple Computer; and Hsueh-Cheng Wang, a postdoc at CSAIL when the work was done who will join the National Chiao Tung University in Taiwan as an assistant professor this month.

In work sponsored by the Andrea Bocelli Foundation, which was founded by the blind singer Andrea Bocelli, Rus' group had developed an algorithm for converting 3-D camera data into useful navigation aids. The output of any 3-D camera can be converted into a 3-D representation called a "point cloud," which depicts the spatial locations of individual points on the surfaces of objects. The Rus group's algorithm clustered points together to identify flat surfaces in the scene, then measured the unobstructed walking distance in multiple directions.

For the new paper, the researchers modified this algorithm, with power conservation in mind. The standard way to identify planes in point clouds, for instance, is to pick a point at random, then look at its immediate neighbors, and determine whether any of them lie in the same plane. If one of them does, the algorithm looks at its neighbors, determining whether any of them lie in the same plane, and so on, gradually expanding the surface.

This is computationally efficient, but it requires frequent requests to a chip's main memory bank. Because the algorithm doesn't know in advance which direction it will move through the point cloud, it can't reliably preload the data it will need into its small working-memory bank.

Fetching data from main memory, however, is the biggest energy drain in today's chips, so the MIT researchers modified the standard algorithm. Their algorithm always begins in the upper left-hand corner of the point cloud and scans along the top row, comparing each point only to the neighbor on its left. Then it starts at the leftmost point in the next row down, comparing each point only to the neighbor on its left and to the one directly above it, and repeats this process until it has examined all the points. This enables the chip to load as many rows as will fit into its working memory, without having to go back to main memory.

This and similar tricks drastically reduced the chip's power consumption. But the data-processing chip isn't the component of the navigation system that consumes the most energy; the 3-D camera is. So the chip also includes a circuit that quickly and coarsely compares each new frame of data captured by the camera with the one that immediately preceded it. If little changes over successive frames, that's a good indication that the user is still; the chip sends a signal to the camera, which can lower its frame rate, saving power.

Although the prototype navigation system is less obtrusive than its predecessors, it should be possible to miniaturize it even further. Currently, one of its biggest components is a heat dissipation device atop a second chip that converts the camera's output into a point cloud. Adding the conversion algorithm to the data-processing chip should have a negligible effect on its power consumption but would significantly reduce the size of the system's electronics.

"There are many problems that have been solved for visually impaired people, but a real one that is still open is navigating and walking alone in a safe way, going around in a big city," said Bocelli, at an event in Milan during which the new system was demonstrated. "I've seen today a big step toward the solution to the problem. Together we will soon cross the great ocean. We will soon have a small device in our pocket to help us in walking in a city, going everywhere alone."

In addition to the Andrea Bocelli Foundation, the work was cosponsored by Texas Instruments, and the prototype chips were manufactured through the Taiwan Semiconductor Manufacturing Company's University Shuttle Program.

Discussion

• Have your say! Add your comment or discuss this article on our FaceBook Page.

Similar Topics

1 : eSight Pledges to Make Blindness History by 2020 : Jeffrey Fenton - Director of Outreach and Communications - eSight.
2 : Genetic Treatment for Blindness May Soon Be Possible : American Academy of Ophthalmology.
3 : Student Creates First Synthetic Retina For Visually Impaired : University of Oxford.
4 : BrailleSense Polaris - Virtual Braille Tablet for the Blind : HIMS, Inc..
5 : GuideSense Device Helps Visually Impaired Sense Their Environment : VTT Technical Research Centre.
From our Visual Aid Products and Information section - Full List (74 Items)


Submit disability news, coming events, as well as assistive technology product news and reviews.


Loan Information for low income singles, families, seniors and disabled. Includes home, vehicle and personal loans.


Famous People with Disabilities - Well known people with disabilities and conditions who contributed to society.


List of awareness ribbon colors and their meaning. Also see our calendar of awareness dates.


Blood Pressure Chart - What should your blood pressure be, and information on blood group types/compatibility.





1 : Help Your Child in School by Adding Language to The Math
2 : 50% of Retirees Saw Little or No COLA Increase in Net 2018 Social Security Benefits
3 : Turnstone Endeavor Games Concludes with National Records Broken
4 : Spinning in Circles and Learning From Myself by Tsara Shelton
5 : St. Louis HELP Medical Equipment Donation Drive Generates Record-Breaking Results
6 : People Who Snore Suffer from Palate Nerve and Muscle Damage
7 : How Our Ancestors with Autistic Traits Led a Revolution in Ice Age Art
8 : Housing and Disabled People: Britains Hidden Crisis


Disclaimer: This site does not employ and is not overseen by medical professionals. Content on Disabled World is not intended to be a substitute for professional medical advice, diagnosis, or treatment. Always seek the advice of a physician or other qualified health provider with any questions you may have regarding a medical condition. See our Terms of Service for more information.

Reporting Errors: Disabled World is an independent website, your assistance in reporting outdated or inaccurate information is appreciated. If you find an error please let us know.

© 2004 - 2018 Disabled World™