Scientists to Establish Imageomics Field

Imageomics

Author: Virginia Tech
Published: 2022/03/09 - Updated: 2024/02/18
Publication Type: Announcement / Notification - Peer-Reviewed: Yes
Contents: Summary - Definition - Introduction - Main - Related

Synopsis: Establishing an imageomics institute to create biological information using image data, digital collections from national centers, field stations, museums, and individual laboratories. We will inject structured biological knowledge in machine learning frameworks to obtain explanations from images that are both generalizable and scientifically meaningful. Our goal is to use what we have learned in the emerging field of KGML to open the next frontier of biological discoveries.

Introduction

Researchers in three different disciplines at Virginia Tech are partnering in a $15 million grant from the National Science Foundation (NSF) to establish an institute in the new field of "imageomics," aimed at creating a new frontier of biological information using vast stores of existing image data, such as publicly funded digital collections from national centers, field stations, museums, and individual laboratories.

Main Digest

The goal of the institute is to characterize and discover patterns or biological traits of organisms from images and gain insights into how function follows form in all areas of biology. It will expand public understanding of the rules of life on Earth and how life evolves.

Imageomics is one of five Harnessing the Data Revolution institutes receiving support from the NSF.

Anuj Karpatne, assistant professor in the Department of Computer Science and faculty at the Sanghani Center for Artificial Intelligence and Data Analytics, is serving as one of four co-investigators for the multi-university project led by the Ohio State University. Leanna House, associate professor in the Department of Statistics and faculty at the Sanghani Center, and Josef Uyeda, assistant professor in the Department of Biological Sciences, are designated senior personnel. All three researchers are part of the executive leadership team of the institute and investigators on Virginia Tech's $1.4 million portion of the grant.

Continued below image.
Researchers from left to right: Anuj Karpatne, Leanna House, and Josef Uyeda.
Researchers from left to right: Anuj Karpatne, Leanna House, and Josef Uyeda - Image Credit: Virginia Tech.
Continued...

For the project, Karpatne is using his expertise in knowledge-guided machine learning (KGML) to develop novel machine learning architectures for extracting and interpreting biological traits from images that will bring the revolution of computing to image-based biology. A previously-funded NSF grant is serving as a crucial building block for this work.

Currently, Karpatne said, researchers use millions of images of biological specimens collected by scientists; captured by drones, camera traps, and citizen scientists; or posted by tourists on social media to record the vast array of biodiverse organisms on the planet.

"While these provide a tipping point to unlocking novel trait information from biological images, current 'black-­box' machine learning is not fully equipped to extract meaningful information from these kinds of images," Karpatne said.

"We will inject structured biological knowledge in machine learning frameworks to obtain explanations from images that are both generalizable and scientifically meaningful. Just as large­-scale image datasets have fundamentally transformed computer vision, our goal is to use what we have learned in the emerging field of KGML to open the next frontier of biological discoveries," said Karpatne.

He also is leading the convergence working group on knowledge-guided machine learning within the institute to bring together computer scientists and biologists and cross-pollinate ideas across disciplines.

Continued below image.
Four combined images show an elephant and calf (top left), A whale tail (top right), A turtle swimming (bottom left), and three zebras (bottom right).
Four combined images show an elephant and calf (top left), A whale tail (top right), A turtle swimming (bottom left), and three zebras (bottom right). The Imageomics Institute will create a new field of study that uses images of living organisms to understand biological life processes - Image Credit: Virginia Tech.
Continued...

House, whose research focuses on the intersection of human computer interaction and statistics, will direct the institute's education and community effort. Collaborating with Daniel Rubenstein from Princeton University and a newly formed committee, she will be responsible for coordinating education and outreach programs across all of the participating institutions and overseeing efforts to build an expansive, inclusive imageomics community.

"Images are data that everyone can relate to. Our goal is to combine human experiences with images and machine learning/statistical methods in a way that introduces imageomics as a common, accepted, and accessible science, similar to the way genomics has successfully infiltrated research agendas, mass media, and education curricula from primary to graduate school," House said.

Uyeda, who received an NSF CAREER grant in 2020, is serving as the lead for a trait-based biology convergence working group in the institute.

Uyeda uses the evolutionary tree of life to make sense of how and why traits evolve over millions of years. Experts can look at highly modified structures that are almost absent or highly elaborated and deduce how that trait developed and evolved based on its location on the body, its relationship to other traits, and knowledge of where that species lies on the tree of life even when the image is of a completely new, never-before-seen species, he said.

"But because computers are so much more sensitive than the human eye, knowledge-guided machine learning approaches are an exciting addition to our toolkit," Uyeda said. "If we can train KGML methods to use this biological knowledge like experts do, it would open up new ways of studying organismal form and function."

The NSF grant also is providing opportunities for graduate student research. Among the Ph.D. students who will work on the project are Mohannad Elhamod and M. Maruf, advised by Karpatne at the Sanghani Center, and Bailey Howell and Nicholas Bone in biological sciences, advised by Uyeda.

Attribution/Source(s):

This peer reviewed publication was selected for publishing by the editors of Disabled World due to its significant relevance to the disability community. Originally authored by Virginia Tech, and published on 2022/03/09 (Edit Update: 2024/02/18), the content may have been edited for style, clarity, or brevity. For further details or clarifications, Virginia Tech can be contacted at vt.edu. NOTE: Disabled World does not provide any warranties or endorsements related to this article.

Related Publications

Share This Information To:
𝕏.com Facebook Reddit

Page Information, Citing and Disclaimer

Disabled World is a comprehensive online resource that provides information and news related to disabilities, assistive technologies, and accessibility issues. Founded in 2004 our website covers a wide range of topics, including disability rights, healthcare, education, employment, and independent living, with the goal of supporting the disability community and their families.

Cite This Page (APA): Virginia Tech. (2022, March 9 - Last revised: 2024, February 18). Scientists to Establish Imageomics Field. Disabled World. Retrieved July 20, 2024 from www.disabled-world.com/assistivedevices/ai/imageomics/establishing.php

Permalink: <a href="https://www.disabled-world.com/assistivedevices/ai/imageomics/establishing.php">Scientists to Establish Imageomics Field</a>: Establishing an imageomics institute to create biological information using image data, digital collections from national centers, field stations, museums, and individual laboratories.

Disabled World provides general information only. Materials presented are never meant to substitute for qualified medical care. Any 3rd party offering or advertising does not constitute an endorsement.