Pristine Annotations-Based Multi-modal Trained Artificial Intelligence Solution to Triage Chest X-Ray for COVID-19

  • Tao Tan
  • , Bipul Das
  • , Ravi Soni
  • , Mate Fejes
  • , Sohan Ranjan
  • , Daniel Attila Szabo
  • , Vikram Melapudi
  • , K. S. Shriram
  • , Utkarsh Agrawal
  • , Laszlo Rusko
  • , Zita Herczeg
  • , Barbara Darazs
  • , Pal Tegzes
  • , Lehel Ferenczi
  • , Rakesh Mullick
  • , Gopal Avinash

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

1 Citation (Scopus)

Abstract

The COVID-19 pandemic continues to spread and impact the well-being of the global population. The front-line imaging modalities computed tomography (CT) and X-ray play an important role for triaging COVID-19 patients. Considering the limited access to resources (both hardware and trained personnel) and decontamination, CT may not be ideal for triaging suspected subjects. Artificial intelligence (AI) assisted X-ray based applications for triaging and monitoring COVID-19 patients in a timely manner with the additional ability to delineate the disease region boundary are seen as a promising solution. Our proposed solution differs from existing solutions by industry and academic communities. We demonstrates a functional AI model to triage by inferencing using a single x-ray image, while the AI model is trained using both X-ray and CT data. We report on how such a multi-modal training improves the solution compared to X-ray only training. The multi-modal solution increases the AUC (area under the receiver operating characteristic curve) from 0.89 to 0.93 for the classification between COVID-19 and non-COVID-19 cases. It also positively impacts the Dice coefficient (0.59 to 0.62) for segmenting the COVID-19 pathology.

Original languageEnglish
Title of host publicationMedical Image Computing and Computer Assisted Intervention – MICCAI 2021 - 24th International Conference, Proceedings
EditorsMarleen de Bruijne, Philippe C. Cattin, Stéphane Cotin, Nicolas Padoy, Stefanie Speidel, Yefeng Zheng, Caroline Essert
PublisherSpringer Science and Business Media Deutschland GmbH
Pages325-334
Number of pages10
ISBN (Print)9783030872335
DOIs
Publication statusPublished - 2021
Externally publishedYes
Event24th International Conference on Medical Image Computing and Computer Assisted Intervention, MICCAI 2021 - Virtual, Online
Duration: 27 Sept 20211 Oct 2021

Publication series

NameLecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Volume12907 LNCS
ISSN (Print)0302-9743
ISSN (Electronic)1611-3349

Conference

Conference24th International Conference on Medical Image Computing and Computer Assisted Intervention, MICCAI 2021
CityVirtual, Online
Period27/09/211/10/21

Keywords

  • Artificial intelligence
  • COVID-19
  • Multi-modal

Fingerprint

Dive into the research topics of 'Pristine Annotations-Based Multi-modal Trained Artificial Intelligence Solution to Triage Chest X-Ray for COVID-19'. Together they form a unique fingerprint.

Cite this