Skip to main content
Accessibility|Contact|Privacy|Terms|Cookies

Feet Operated Game Controller for Upper-limb Amputees

  • Published: 2016-06-29 (Revised/Updated 2018-05-01) : *Press Release by Johns Hopkins University : Contact: jhu.edu
  • Synopsis: Novel controller allows video gamer who lacks hands to compete with his feet - device for upper-limb amputees earns honors for biomedical engineering grad students.

Quote: "The GEAR controller allows people to socialize in a way in which their disability is not a factor..."

Main Document

It's tough to play video games when you have no fingers to push buttons on the controller.

Just ask Gyorgy (George) Levay, an avid gamer who lost both hands to a meningitis infection five years ago. But Levay and two fellow Johns Hopkins grad students have devised a clever way get him, and others with similar disabilities, back in the game.

Their solution - a sandal-like controller that allows a player to control the on-screen action with his or her feet - recently won the $7,500 grand prize in the 2016 Intel-Cornell Cup, in which student inventors were judged on innovative applications of embedded technology.

The team, dubbed GEAR for Game Enhancing Augmented Reality, also was a finalist in the 2016 Johns Hopkins Healthcare Design Competition, organized by the university's Center for Bioengineering Innovation and Design, based within the Department of Biomedical Engineering.

To master's degree candidate Levay, the project is about much more than recovering his ability to play video games.

"About 200,000 people in the United States alone have lost at least some part of an upper limb," he said, "and 20 to 30 percent of all amputees suffer from depression. They have a hard time socializing, especially young people."

Especially for those with highly visible impairments, online video games can be a boon, Levay said, because a player's appearance is not typically on view.

"The GEAR controller allows people to socialize in a way in which their disability is not a factor," Levay said. "That was a key point we wanted to make with this device."

Johns Hopkins biomedical engineering grad students, from left, Adam Li, Nhat (Nate) Tran and Gyorgy (George) Levay displayed their innovative video gaming shoes at a recent design competition. Photo by John Bidlack/homewoodphoto.jhu.edu
About This Image: Johns Hopkins biomedical engineering grad students, from left, Adam Li, Nhat (Nate) Tran and Gyorgy (George) Levay displayed their innovative video gaming shoes at a recent design competition. Photo by John Bidlack/homewoodphoto.jhu.edu

To create a hands-free control system, Levay, who is from Budapest, Hungary, teamed up last year with two other biomedical engineering grad students from his Johns Hopkins instrumentation course: Adam Li from Los Angeles and Nhat (Nate) Tran, from Ho Chi Minh City in Vietnam.

The students decided to design a game interface that could be operated by a player's lower limbs. "Next to our hands," Li said, "our feet are probably the most dexterous part of our body."

By the time their third prototype was built, the team had produced adjustable padded footwear that could enable a seated player to participate in video games. Beneath each shoe's padding are three sensors that can pick up various foot movements, such as tilting or raising the front or heel of each foot.

The GEAR team devised these game controller shoes that respond to different foot movements. Photo by John Bidlack /homewoodphoto.jhu.edu
About This Image: The GEAR team devised these game controller shoes that respond to different foot movements. Photo by John Bidlack /homewoodphoto.jhu.edu

The students designed intricate circuitry within each shoe that translates each foot movement into a different command to guide the activity in a video game. In its most basic setup, two of the high-tech shoes can control eight different game buttons. But the inventors say that with practice, this number could increase to as many as 20 buttons.

The GEAR team has successfully used the technology to play popular games such as Counter-Strike, Fallout 4 and World of Warcraft. The students also set up a small online survey, putting four virtual characters through the same challenging segment of a video game. When the game clips were posted online, viewers were asked to identify which character was being controlled by an amputee using the GEAR technology. Of the 51 viewers who participated in the survey, 81 percent failed to identify the correct GEAR-controlled character.

"This is a very simple design," Tran said, "but it can potentially help a lot of people since it's wearable, and it's adjustable."

For team member Li, the project was particularly rewarding because it allowed him to apply his knowledge to a real-life challenge, not just a teacher's test questions. Sometimes as an engineering student, he said, "you're stuck in a classroom, and you're learning about all these theories, but you don't get to put it into practice. This problem really allowed us to design a solution and actually implement it."

The GEAR team members have worked with the Johns Hopkins Technology Ventures staff to obtain a provisional patent covering their invention. Their goal is to license their work to a company that can help make their device widely available.

The GEAR team was advised by Nitish V. Thakor, a professor of biomedical engineering, and Luke Osborn, a biomedical engineering doctoral student. At Johns Hopkins, the Department of Biomedical Engineering is shared by the university's Whiting School of Engineering and its School of Medicine.

Video Clip: Team GEAR - Device Allows Gamers to Compete With Their Feet

Video Icon

YouTube Video Clip - The GEAR team members have worked with the Johns Hopkins Technology Ventures staff to obtain a provisional patent covering their invention. Their goal is to license their work to a company that can help make their device widely available - Device Allows Gamers to Compete With Their Feet Video.

Discussion

• Have your say! Add your comment or discuss this article on our FaceBook Page.

Similar Topics

1 : Equal Access to Racing Video Games for Blind Gamers : Columbia University School of Engineering and Applied Science.
2 : Video Game Improves Balance in Youth With Autism : University of Wisconsin-Madison.
3 : Social Mobile Gaming Boosts Rehabilitation for Patients with Physical Disabilities : Imperial College London.
4 : Enabling Devices - Toys for Special Needs Children - Launches New Website : Enabling Devices.
5 : When Children Are Allowed TV, Video Games in Bedroom, School, Health and Behavior Suffer : Iowa State University.
From our Games and Gaming section - Full List (61 Items)


Submit disability news, coming events, as well as assistive technology product news and reviews.


Loan Information for low income singles, families, seniors and disabled. Includes home, vehicle and personal loans.


Famous People with Disabilities - Well known people with disabilities and conditions who contributed to society.


List of awareness ribbon colors and their meaning. Also see our calendar of awareness dates.


Blood Pressure Chart - What should your blood pressure be, and information on blood group types/compatibility.





1 : 20 New Episodes of Letters to Lynette with Dr. Lynette Louise to Air on The Autism Channel in 2018
2 : Turnstone Center Designated as Official Paralympic Training Site by US Olympic Committee
3 : Help Your Child in School by Adding Language to The Math
4 : 50% of Retirees Saw Little or No COLA Increase in Net 2018 Social Security Benefits
5 : Turnstone Endeavor Games Concludes with National Records Broken
6 : Spinning in Circles and Learning From Myself by Tsara Shelton
7 : St. Louis HELP Medical Equipment Donation Drive Generates Record-Breaking Results
8 : People Who Snore Suffer from Palate Nerve and Muscle Damage

*Press Release by Johns Hopkins University: Disabled World makes no warranties or representations in connection therewith. If you are connected with this page and want it corrected/updated please contact us.



Disclaimer: This site does not employ and is not overseen by medical professionals. Content on Disabled World is not intended to be a substitute for professional medical advice, diagnosis, or treatment. Always seek the advice of a physician or other qualified health provider with any questions you may have regarding a medical condition. See our Terms of Service for more information.

Reporting Errors: Disabled World is an independent website, your assistance in reporting outdated or inaccurate information is appreciated. If you find an error please let us know.

© 2004 - 2018 Disabled World™