Autism & Beyond: Autism Facial Expressions App
Topic: Disability Apps
Author: Office of Naval Research
Published: 2015/12/30 - Updated: 2020/11/25
Contents: Summary - Introduction - Main Item - Related Topics
Synopsis: Autism & Beyond App screens for autism by reading facial expressions of children for emotional cues. Parents or caregivers use a cell phone user-facing "selfie" camera to record children's facial movements for evaluation by doctors, researchers and software. Once the autism studies are complete, Sapiro hopes to eventually expand and tailor the app to conditions suffered by warfighters, including PTSD, TBI and depression.
Introduction
There's an app for everything these days - from weight loss to working out. Now, thanks in part to support from the Office of Naval Research (ONR), there's an app that may screen for autism by reading kids' facial expressions for emotional cues.
Main Item
"The long-term implications of this research are huge," said Dr. Predrag Neskovic, a program officer in ONR's Mathematical Data Science program. "Not only could the app be used to learn more about childhood autism, it could possibly reveal signs of post-traumatic stress disorder (PTSD) and mild traumatic brain injury (TBI) in warfighters - conditions that often have subtle symptoms and are difficult to diagnose."
The app, called "Autism & Beyond," was developed by researchers and software developers at Duke University and the Duke Medical Center. It currently is available for free download from the Apple App Store to families wishing to participate in a six-month medical research study by Duke University.
"Autism & Beyond" has children complete a series of questionnaires and watch short videos designed to make them smile, laugh and be surprised. Parents or caregivers use an iPhone's user-facing "selfie" camera to record children's facial movements for evaluation by doctors, researchers and software.
The app's core technical component - the ONR-sponsored technology - is a complex mathematical algorithm that automatically maps key landmarks on children's faces and assesses emotional responses based on movements of facial muscles.
"We analyze the video to track position and movement of the head and face, including the lips, eyes and nose - all of which indicate emotions," said Dr. Guillermo Sapiro, a professor at Duke University, who developed the algorithm. "For example, while watching stimuli like a funny video, does the child smile, look toward the caregiver or ask the caregiver to view the video as well? We study all of that. Lack of emotion and social sharing are possible characteristics of childhood autism."
Sapiro stresses the app isn't a self-diagnosis resource, but is intended to serve as a potential screening tool for autism and other developmental challenges, and encourage users to contact a physician for specialized testing.
Once the autism studies are complete, Sapiro hopes to eventually expand and tailor the app to conditions suffered by warfighters, including PTSD, TBI and depression. As with autism, facial expressions can indicate the presence of such disorders. For example, many individuals suffering from PTSD or depression smile often, but their grins tend to be forced and short. Improved analysis of such facial expressions could lead to more accurate diagnoses by doctors and, consequently, enhanced treatment options for military personnel and veterans.
"The great thing about the algorithm and video analysis tool is they can be universally applied to various research apps and studies," said Sapiro. "Today it's autism, in the future it could be PTSD. How can we take 'Autism & Beyond' beyond its current state and to the next level? Autism is just the start."
"We hope to find the right partner and develop a research app studying PTSD," he continued. "We've already received interest from a nearby Veterans Affairs center about using this technology in veterans' homes to monitor behavior for signs of depression."
Sapiro's research aligns with the Naval S&T Strategy, which emphasizes health and resilience as key components of warfighter performance. For more about the "Autism & Beyond" study, visit autismandbeyond.researchkit.duke.edu
Attribution/Source(s):
This quality-reviewed publication was selected for publishing by the editors of Disabled World due to its significant relevance to the disability community. Originally authored by Office of Naval Research, and published on 2015/12/30 (Edit Update: 2020/11/25), the content may have been edited for style, clarity, or brevity. For further details or clarifications, Office of Naval Research can be contacted at onr.navy.mil. NOTE: Disabled World does not provide any warranties or endorsements related to this article.
Explore Related Topics
1 - Abilibee App: Enhancing Daily Life for Those with Developmental Challenges - Abilibee app is an all-in-one lifeline designed to guide users through critical NY State system changes and life transitions, from Early Intervention to adulthood.
2 - MaMoo App Transforms Stock Charts Into Music for Accessibility - App transforms stock chart movements into real-time music, offering an accessible and innovative tool for traders, especially those with visual impairments.
3 - All Aboard App Assists Blind and Visually Impaired Find Bus Stops - Micro-navigation smartphone app provides assistance to those who are blind or visually impaired (BVI) in finding bus stops.
4 - Panopreter Review: Transforming Text into Speech with Ease - In this article we breakdown the key features and performance of Panopreter text-to-speech software that transforms written text into natural-sounding audio.
5 - How to Tell if Your Cellphone Has Spyware - Smartphone spyware apps that allow people to spy on each other are hard to notice and detect, and they easily leak sensitive personal information.
Page Information, Citing and Disclaimer
Disabled World is a comprehensive online resource that provides information and news related to disabilities, assistive technologies, and accessibility issues. Founded in 2004 our website covers a wide range of topics, including disability rights, healthcare, education, employment, and independent living, with the goal of supporting the disability community and their families.
Cite This Page (APA): Office of Naval Research. (2015, December 30 - Last revised: 2020, November 25). Autism & Beyond: Autism Facial Expressions App. Disabled World. Retrieved October 7, 2024 from www.disabled-world.com/assistivedevices/apps/cues.php
Permalink: <a href="https://www.disabled-world.com/assistivedevices/apps/cues.php">Autism & Beyond: Autism Facial Expressions App</a>: Autism & Beyond App screens for autism by reading facial expressions of children for emotional cues.
Disabled World provides general information only. Materials presented are never meant to substitute for qualified medical care. Any 3rd party offering or advertising does not constitute an endorsement.