Predicting Cognitive Scores by Utilizing Movie Watching FMRI and Eye Tracking

Author: West China Hospital of Sichuan University
Published: 2023/09/16
Publication Type: Announcement / Notification - Peer-Reviewed: Yes
Contents: Summary - Main - Related Publications

Synopsis: Researchers unveil groundbreaking Attention-CensNet (A-CensNet), a fusion model that predicts cognitive scores by amalgamating movie-watching mfMRI and eye-tracking data. A-CensNet outperforms models based solely on individual modalities and other leading techniques, underscoring the synergy between brain functionality and behavior in gauging cognitive traits.

Main Digest

In a recent article published in Volume 3 of the journal Psychoradiology, researchers from Northwestern Polytechnical University have unveiled the groundbreaking "Attention-CensNet" (A-CensNet), a fusion model that predicts cognitive scores by amalgamating movie-watching functional magnetic resonance imaging (mfMRI) and eye-tracking data.

In this model, participants serve as nodes, mfMRI data are translated into node features, and eye-tracking details forge the connections between participants, creating graph edges.

By employing multiple graphs as channels, A-CensNet merges graph embeddings to offer a consolidated interpretation.

Remarkably, A-CensNet outperforms models based solely on individual modalities and other leading techniques, underscoring the synergy between brain functionality and behavior in gauging cognitive traits. This synergy is not only pivotal for understanding cognitive aberrations and potential psychiatric markers but also suggests potential in diagnosing disorders like autism, characterized by attention disparities. Although initial tests on emotion scores were less definitive, the incorporation of advanced algorithms, such as LSTM and BERT, in future iterations may enhance predictions.

While the model is primarily tailored for movie-watching, its application isn't limited. Combining other modalities like resting-state fMRI could predict other personal traits. Most importantly, integrating varied data sources as shown in this study can amplify cognitive prediction accuracy, crucial for distinguishing between patients and controls in disease research.

Continued below image.
The preprocessings and flowchart of A-CensNet - Image Credit: Psychoradiology.
The preprocessings and flowchart of A-CensNet - Image Credit: Psychoradiology.
Continued...

Funding information

The National Natural Science Foundation of China (31971288, U1801265, 61936007, 62276050, 61976045, U20B2065, U1801265 and 61936007); The National Key R&D Program of China under Grant 2020AAA0105701; High-level researcher start-up projects (06100-22GH0202178); Innovation Foundation for Doctor Dissertation of Northwestern Polytechnical University (CX2022052).

About Psychoradiology

Psychoradiology is an open-access journal co-published byOxford University Press and West China Hospital. lt has been indexed by Scopus and DOAJ, and the APC is waived during its early stage. We welcome interdisciplinary submissions in the fields of radiology, psychology,psychiatry, neurology and neuroscience, as well as medical imaging, interventional medicine, artificial intelligence, and computer science, etc. A fast-track production mode will be adopted to ensure the manuscript is published as soon as possible.

Attribution/Source(s):

This peer reviewed publication pertaining to our Medical Research News section was selected for circulation by the editors of Disabled World due to its likely interest to our disability community readers. Though the content may have been edited for style, clarity, or length, the article "Predicting Cognitive Scores by Utilizing Movie Watching FMRI and Eye Tracking" was originally written by West China Hospital of Sichuan University, and submitted for publishing on 2023/09/16. Should you require further information or clarification, West China Hospital of Sichuan University can be contacted at the academic.oup.com/psyrad website. Disabled World makes no warranties or representations in connection therewith.

📢 Discover Related Topics


👍 Share This Information To:
𝕏.com Facebook Reddit

Page Information, Citing and Disclaimer

Disabled World is an independent disability community founded in 2004 to provide disability news and information to people with disabilities, seniors, their family and/or carers. You can connect with us on social media such as X.com and our Facebook page.

Cite This Page (APA): West China Hospital of Sichuan University. (2023, September 16). Predicting Cognitive Scores by Utilizing Movie Watching FMRI and Eye Tracking. Disabled World. Retrieved April 17, 2024 from www.disabled-world.com/news/research/attention-censnet.php

Permalink: <a href="https://www.disabled-world.com/news/research/attention-censnet.php">Predicting Cognitive Scores by Utilizing Movie Watching FMRI and Eye Tracking</a>: Researchers unveil groundbreaking Attention-CensNet (A-CensNet), a fusion model that predicts cognitive scores by amalgamating movie-watching mfMRI and eye-tracking data.

Disabled World provides general information only. Materials presented are never meant to substitute for qualified professional medical care. Any 3rd party offering or advertising does not constitute an endorsement.