Skip to main content
Accessibility  |  Contact  |  Privacy  |  Terms of Service

Lip Reading Computer Interprets Emotions

  • Published: 2012-09-10 : Author: Inderscience Publishers
  • Synopsis: A computer taught to interpret human emotions based on lip pattern could improve how we interact with computers and allow disabled people to use computer-based communications devices such as voice synthesizers.
Lip Reading
Lip Reading - The interpreting of spoken words by watching a speaker's lip and facial movements without actually hearing a voice. Lip Reading is sometimes referred to as speech reading, which technically also includes the reading of facial expressions and body language.

Main Document

Computer, read my lips - Emotion detector developed using a genetic algorithm. A computer is being taught to interpret human emotions based on lip pattern, according to research published in the International Journal of Artificial Intelligence and Soft Computing.

The system could improve the way we interact with computers and perhaps allow disabled people to use computer-based communications devices, such as voice synthesizers, more effectively and more efficiently.

Karthigayan Muthukaruppanof Manipal International University in Selangor, Malaysia, and co-workers have developed a system using a genetic algorithm that gets better and better with each iteration to match irregular ellipse fitting equations to the shape of the human mouth displaying different emotions.

They have used photos of individuals from South-East Asia and Japan to train a computer to recognize the six commonly accepted human emotions - happiness, sadness, fear, angry, disgust, surprise - and a neutral expression. The upper and lower lip is each analyzed as two separate ellipses by the algorithm.

"In recent years, there has been a growing interest in improving all aspects of interaction between humans and computers especially in the area of human emotion recognition by observing facial expression," the team explains.

Earlier researchers have developed an understanding that allows emotion to be recreated by manipulating a representation of the human face on a computer screen. Such research is currently informing the development of more realistic animated actors and even the behavior of robots. However, the inverse process in which a computer recognizes the emotion behind a real human face is still a difficult problem to tackle.

It is well known that many deeper emotions are betrayed by more than movements of the mouth.

A genuine smile for instance involves flexing of muscles around the eyes and eyebrow movements are almost universally essential to the subconscious interpretation of a person's feelings. However, the lips remain a crucial part of the outward expression of emotion. The team's algorithm can successfully classify the seven emotions and a neutral expression described.

The researchers suggest that initial applications of such an emotion detector might be helping disabled patients lacking speech to interact more effectively with computer-based communication devices, for instance.

"Lip pattern in the interpretation of human emotions " in Int. J. Artificial Intelligence and Soft Computing, 2012, 3, 95-107

Similar Topics

1 : Epihunter Classroom - Making Silent Epileptic Seizures Visible : Mark Winters.
2 : Access Stylus Makes Touchscreens Accessible for Everyone : Arnoldware Applications.
3 : GlassOuse Assistive Device V1.2 and G-Switch Series are Ready for Pre-order : GlassOuse Assistive Devices.
4 : Wearable Stretchable Electronics Aid Stroke Recovery Treatment : Northwestern University.
5 : Augmented Reality ProjectDR Lets Doctors See Under the Skin : University of Alberta.
From our Electronic Devices and Software section - Full List (182 Items)

Submit disability news, coming events, as well as assistive technology product news and reviews.

Loan Information for low income singles, families, seniors and disabled. Includes home, vehicle and personal loans.

Famous People with Disabilities - Well known people with disabilities and conditions who contributed to society.

List of awareness ribbon colors and their meaning. Also see our calendar of awareness dates.

Blood Pressure Chart - What should your blood pressure be, and information on blood group types/compatibility.

1 : Epihunter Classroom - Making Silent Epileptic Seizures Visible
2 : Prostate MRI Reveals More Treatable Cancers and Reduces Overdiagnosis
3 : Poetry Event by Those with Aphasia and Trouble Speaking
4 : Siblings of Cot Death Victims Have Four Times SIDS Risk
5 : Exploring Upper Limb Dysfunction After Spinal Cord Injury


Disclaimer: This site does not employ and is not overseen by medical professionals. Content on Disabled World is not intended to be a substitute for professional medical advice, diagnosis, or treatment. Always seek the advice of a physician or other qualified health provider with any questions you may have regarding a medical condition. See our Terms of Service for more information.

Reporting Errors: Disabled World is an independent website, your assistance in reporting outdated or inaccurate information is appreciated. If you find an error please let us know.