Prospective Real-Time Validation of a Lung Ultrasound Deep Learning Model in the Intensive Care Unit

Saturday, January 21, 2023

5:45 PM – 6:00 PM PT

Location: 206

First Author(s)

Chintan Dave, MD

Western University
London, Ontario, Canada

Disclosure information not submitted.

Co-Author(s)

DW

Derek Wu, MD

Internal Medicine Resident Physician
London Health Sciences Centre, United States

Disclosure information not submitted.
JT

Jared Tschirhart, MSc

Medical Student
University of Western Ontario, London, Canada, United States

Disclosure information not submitted.
DS

Delaney Smith, MS

Deep Learning Researcher
University of Waterloo, United States

Disclosure information not submitted.
BV

Blake VanBerlo, BE

Deep Learning Researcher
University of Waterloo, United States

Disclosure information not submitted.
JD

Jason Deglint, PhD

Deep Learning Researcher
University of Waterloo, United States

Disclosure information not submitted.
FA

Faraz Ali, N/A

Deep Learning Researcher
University of Waterloo, United States

Disclosure information not submitted.
RC

Rushil Chaudhury, MD

Internal Medicine Resident Physician
London Health Sciences Centre, United States

Disclosure information not submitted.
BV

Bennett VanBerlo, BE

Deep Learning Researcher
University of Waterloo, United States

Disclosure information not submitted.
AF

Alex Ford, BSc

Deep Learning Researcher
N/A, United States

Disclosure information not submitted.
MA

Marwan A Rahman, N/A

Deep Learning Researcher
University of Western Ontario, London, Canada, United States

Disclosure information not submitted.
JM

Joseph McCauley, BASc

Deep Learning Researcher
University of Waterloo, United States

Disclosure information not submitted.
BW

Benjamin Wu, BCS

Deep Learning Researcher
N/A, United States

Disclosure information not submitted.
JH

Jordan Ho, MD

Family Medicine Resident Physician
London Health Sciences Centre, United States

Disclosure information not submitted.
BL

Brian Li, N/A

Deep Learning Researcher
University of Western Ontario, London, Canada, United States

Disclosure information not submitted.
RA

Robert Arntfield, MD

Principal Investigator, Critical Care Medicine Physician
London Health Sciences Centre, United States

Disclosure information not submitted.

INTRODUCTION: Lung ultrasound (LUS) shows diagnostic superiority to chest radiography in the ICU setting however its widespread deployment is challenged by limited user base and its dependence on clinical expertise. Artificial intelligence models have been developed to overcome these barriers through LUS automation; however, bedside pragmatic performance has never been demonstrated. In this study, we aimed to evaluate the accuracy of a bedside, real-time deployment of a deep learning model capable of distinguishing between normal (A line pattern) and abnormal (B line pattern) lung parenchyma on lung ultrasound in critically ill patients.

METHODS : Prospective, observational study evaluating the performance of a previously-trained LUS deep learning (DL) model on 100 admitted patients to an academic intensive care unit (ICU). Enrolled patients received an anterior zone LUS exam (4 views) with frame-by-frame DL model predictions using a portable device. Clip-level model predictions were analyzed and compared to blinded expert review for A vs B line pattern. Four clip-level prediction cutoffs were applied to maximize model sensitivity and specificity at bedside.

RESULTS: A total of 100 unique ICU patients (400 clips) were enrolled from two tertiary care sites. The majority of patients were receiving mechanical ventilation (56/100), 12 patients were in the weaning process with ongoing trach-mask trials, 4 patients were on High-Flow Nasal Cannula, 4 were on non-invasive ventilation (BiPAP), and 25 patients were on nasal prongs. The Mindray M9 and Sonosite X-Porte ultrasound machines were used to scan 50 patients each. When compared to gold-standard expert annotation, the real-time inference yielded an accuracy of 95%, sensitivity of 93%, and specificity of 96% for identification of the B line pattern. Varying the prediction cutoffs reveal that diagnostic performance may be readily customized to suit the clinical environment.

CONCLUSIONS: Promoting the feasibility and direct application of bedside AI in the ICU, we have shown that a binary DL ultrasound model demonstrates excellent bedside accuracy in distinguishing between normal and abnormal lungs when deployed in real-time in the ICU.