Lip Reading Computer Interprets Human Emotions
Ian C. Langtree - Content Writer/Editor for Disabled World
Published: 2012/09/10 - Updated: 2022/02/07
Topic: Electronics/Software (Publications Database)
Page Content: Synopsis Introduction Main Item
Synopsis: A computer taught to interpret human emotions based on lip pattern could improve how we interact with computers and allow disabled people to use computer-based communications devices such as voice synthesizers.
• In recent years, there has been a growing interest in improving all aspects of interaction between humans and computers especially in the area of human emotion recognition by observing facial expression.
• However, the inverse process in which a computer recognizes the emotion behind a real human face is still a difficult problem to tackle.
Introduction
Computer, read my lips - Emotion detector developed using a genetic algorithm. A computer is being taught to interpret human emotions based on lip pattern, according to research published in the International Journal of Artificial Intelligence and Soft Computing.
Main Item
The system could improve the way we interact with computers and perhaps allow disabled people to use computer-based communications devices, such as voice synthesizers, more effectively and more efficiently.
Karthigayan Muthukaruppanof Manipal International University in Selangor, Malaysia, and co-workers have developed a system using a genetic algorithm that gets better and better with each iteration to match irregular ellipse fitting equations to the shape of the human mouth displaying different emotions.
They have used photos of individuals from South-East Asia and Japan to train a computer to recognize the six commonly accepted human emotions - happiness, sadness, fear, angry, disgust, surprise - and a neutral expression. The upper and lower lip is each analyzed as two separate ellipses by the algorithm.
"In recent years, there has been a growing interest in improving all aspects of interaction between humans and computers especially in the area of human emotion recognition by observing facial expression," the team explains.
Earlier researchers have developed an understanding that allows emotion to be recreated by manipulating a representation of the human face on a computer screen. Such research is currently informing the development of more realistic animated actors and even the behavior of robots. However, the inverse process in which a computer recognizes the emotion behind a real human face is still a difficult problem to tackle.
It is well known that many deeper emotions are betrayed by more than movements of the mouth. A genuine smile for instance involves flexing of muscles around the eyes and eyebrow movements are almost universally essential to the subconscious interpretation of a person's feelings. However, the lips remain a crucial part of the outward expression of emotion. The team's algorithm can successfully classify the seven emotions and a neutral expression described.
The researchers suggest that initial applications of such an emotion detector might be helping disabled patients lacking speech to interact more effectively with computer-based communication devices, for instance.
"Lip pattern in the interpretation of human emotions " in Int. J. Artificial Intelligence and Soft Computing, 2012, 3, 95-107
1 - VR Helps Youth With Autism Develop Safe Travel Skills - As autism diagnoses surge, Easterseals SoCal utilizes Virtual Reality (VR) to help youth develop safe travel skills.
2 - Risks of the Metaverse and Virtual Reality for American Youth - Dangers of the metaverse and VR for US youth revealed in study that explores risks and harm by experiences, gender, prevention and response measures.
3 - Advanced Touch-Feedback System Creates Consistent Tactile Experience on Screens - Consistent virtual haptic technology for virtual reality (VR) and augmented reality (AR) users.
Page Information, Citing and Disclaimer
Disabled World is a comprehensive online resource that provides information and news related to disabilities, assistive technologies, and accessibility issues. Founded in 2004 our website covers a wide range of topics, including disability rights, healthcare, education, employment, and independent living, with the goal of supporting the disability community and their families.
Cite This Page (APA): Langtree, I. C. (2012, September 10 - Last revised: 2022, February 7). Lip Reading Computer Interprets Human Emotions. Disabled World. Retrieved December 12, 2024 from www.disabled-world.com/assistivedevices/computer/lipreading.php
Permalink: <a href="https://www.disabled-world.com/assistivedevices/computer/lipreading.php">Lip Reading Computer Interprets Human Emotions</a>: A computer taught to interpret human emotions based on lip pattern could improve how we interact with computers and allow disabled people to use computer-based communications devices such as voice synthesizers.
While we strive to provide accurate and up-to-date information, it's important to note that our content is for general informational purposes only. We always recommend consulting qualified healthcare professionals for personalized medical advice. Any 3rd party offering or advertising does not constitute an endorsement.