Skip to main content
• Social Media: Connect with UsAccessibility  |  About  |  Contact  |  Privacy  |  Terms

Robotic Object Recognition to Aid Blind and Visually Impaired

  • Published: 2015-12-19 : University of Nevada, Reno (unr.edu).
  • Synopsis: Robotic device will help blind and visually impaired people navigate movable obstacles and assist in ability to pre-locate, pre-sense and grasp objects.

Main Document

Quote: "The technology will combine vision, tactile, force, temperature and audio sensors and actuators to help the wearer pre-sense an object - telling its location, feeling its shape and size - and then grasp it."

A hand-worn robotic device is being developed that will help millions of blind and visually impaired people navigate past movable obstacles or assist in their ability to pre-locate, pre-sense and grasp an object.

In a collaboration between the University of Nevada, Reno and the University of Arkansas, Little Rock, researchers will develop new technology, with co-robotic functions currently unavailable in assistive devices, for the wearable robotic device. The team received an $820,000, three-year National Robotics Initiative grant from the National Institutes of Health's National Eye Institute division.

"The miniaturized system will contribute to the lives of visually impaired people by enabling them to identify and move objects, both for navigational purposes or for more simple things such as grasping a door handle or picking up a glass," Yantao Shen, assistant professor and lead researcher on the project from the University of Nevada, Reno's College of Engineering, said. "We will pre-map the hand, and build a lightweight form-fitting device that attaches to the hand using key locations for cameras and mechanical and electrical sensors. It will be simpler than a glove, and less obtrusive."

Yantao Shen, a biomedical engineering researcher at the University of Nevada, Reno, is developing a hand-worn robotic device that may help millions of blind and visually impaired people navigate past movable obstacles or assist in their ability to pre-locate, pre-sense and grasp an object - Photo Credit: Mike Wolterbeek, University of Nevada, Reno.
About This Image: Yantao Shen, a biomedical engineering researcher at the University of Nevada, Reno, is developing a hand-worn robotic device that may help millions of blind and visually impaired people navigate past movable obstacles or assist in their ability to pre-locate, pre-sense and grasp an object - Photo Credit: Mike Wolterbeek, University of Nevada, Reno.
The technology will combine vision, tactile, force, temperature and audio sensors and actuators to help the wearer pre-sense an object - telling its location, feeling its shape and size - and then grasp it.

"The visual sensors, very high resolution cameras, will first notify the wearer of the location and shape, and the proximity touch sensors kick in as the hand gets closer to the object," Shen said. "The multiple sensors and touch actuators array will help to dynamically 'describe' the shape of the object to the hand when the hand is close to the object, allowing people with vision loss to have more independence and ability to navigate and to safely grasp and manipulate."

Shen and his research partner Cang Ye, a UALR professor in the Department of Systems Engineering, will guide their team of postdoctoral, graduate and undergraduate students as they develop the technology, design the device and test its usability. Shen will include the project in the senior design course he teaches, guiding students as they develop their own ideas for the device, and perhaps expand the technology past its original intentions.

"Not only will this device help blind and visually impaired people, the methods and technology we develop will have great potential in advancing small and wearable robot autonomy with many potential applications in space exploration, military surveillance, law enforcement and search and rescue," Shen said.

Associate Professor Shen, a recipient of a National Science Foundation CAREER Award, is director of the Lab for bio-instrumentation and Automation in the Department of Electrical and Biomedical Engineering at his University. He leads the advanced manufacturing sector of the University's Nevada Advanced Autonomous Systems Innovation Center.

He conducts research in the areas of bio-instrumentation and automation, biomechatronics/robotics, sensors and actuators, and tactile/haptic interfaces. Shen has published more than 100 research papers in these fields. His research has been supported by federal agencies such as the National Science Foundation and NASA.

"This is a major nationally competitive project that will result in cutting-edge research," Manos Maragakis, dean of the College of Engineering, said. "It is a big success for Dr. Shen and a clear evidence of the continuous growth of our biomedical engineering and autonomous systems programs, which have become major areas of focus for the College of Engineering."

Note: Research reported in this publication was supported by the National Eye Institute of the National Institutes of Health under Award Number R01EY026275. The content is solely the responsibility of the authors and does not necessarily represent the official views of the National Institutes of Health.

Similar Topics

1 - eSight Pledges to Make Blindness History by 2020 - Jeffrey Fenton - Director of Outreach and Communications - eSight.
2 - Genetic Treatment for Blindness May Soon Be Possible - American Academy of Ophthalmology.
3 - Student Creates First Synthetic Retina For Visually Impaired - University of Oxford.
4 - BrailleSense Polaris - Virtual Braille Tablet for the Blind - HIMS, Inc..
5 - GuideSense Device Helps Visually Impaired Sense Their Environment - VTT Technical Research Centre.
From our Visual Aid Products and Information section - Full List (74 Items)

Submit disability news, coming events, as well as assistive technology product news and reviews.


Loan Information for low income singles, families, seniors and disabled. Includes home, vehicle and personal loans.


Famous People with Disabilities - Well known people with disabilities and conditions who contributed to society.


List of awareness ribbon colors and their meaning. Also see our calendar of awareness dates.


Blood Pressure Chart - What should your blood pressure be, and information on blood group types/compatibility.



1 - Genes That Repair the Spinal Cord in Fish Are Also Present in Humans
2 - Slight Fluctuations in Movement Correspond to Autism Diagnoses
3 - wheelAIR Innovative New Cooling Wheelchair Backrest Wins Support on Dragons Den
4 - DIVAS Rule the Runway at The Woodlands
5 - Ultra-thin Optical Fibers Provide Way to Print 3D Microstructures



Citation


Disclaimer: This site does not employ and is not overseen by medical professionals. Content on Disabled World is not intended to be a substitute for professional medical advice, diagnosis, or treatment. Always seek the advice of a physician or other qualified health provider with any questions you may have regarding a medical condition. See our Terms of Service for more information.

Reporting Errors: Disabled World is an independent website, your assistance in reporting outdated or inaccurate information is appreciated. If you find an error please let us know.