Taeyong Sim, Eun Young Cho, Ji-hyun Kim, Kyung Hyun Lee, Kwang Joon Kim, Sangchul Hahn, Eun Yeong Ha, Eunkyeong Yun, In-Cheol Kim, Sun Hyo Park, Chi-Heum Cho, Gyeong Im Yu, Byung Eun Ahn, Yeeun Jeong, Joo-Yun Won, Hochan Cho, Ki-Byung Lee
Acute Crit Care. 2025;40(2):197-208. Published online May 30, 2025
Background Acute deterioration of patients in general wards often leads to major adverse events (MAEs), including unplanned intensive care unit transfers, cardiac arrest, or death. Traditional early warning scores (EWSs) have shown limited predictive accuracy, with frequent false positives. We conducted a prospective observational external validation study of an artificial intelligence (AI)-based EWS, the VitalCare - Major Adverse Event Score (VC-MAES), at a tertiary medical center in the Republic of Korea.
Methods Adult patients from general wards, including internal medicine (IM) and obstetrics and gynecology (OBGYN)—the latter were rarely investigated in prior AI-based EWS studies—were included. The VC-MAES predictions were compared with National Early Warning Score (NEWS) and Modified Early Warning Score (MEWS) predictions using the area under the receiver operating characteristic curve (AUROC), area under the precision-recall curve (AUPRC), and logistic regression for baseline EWS values. False-positives per true positive (FPpTP) were assessed based on the power threshold.
Results Of 6,039 encounters, 217 (3.6%) had MAEs (IM: 9.5%, OBGYN: 0.26%). Six hours prior to MAEs, the VC-MAES achieved an AUROC of 0.918 and an AUPRC of 0.352, including the OBGYN subgroup (AUROC, 0.964; AUPRC, 0.388), outperforming the NEWS (0.797 and 0.124) and MEWS (0.722 and 0.079). The FPpTP was reduced by up to 71%. Baseline VC-MAES was strongly associated with MAEs (P<0.001).
Conclusions The VC-MAES significantly outperformed traditional EWSs in predicting adverse events in general ward patients. The robust performance and lower FPpTP suggest that broader adoption of the VC-MAES may improve clinical efficiency and resource allocation in general wards.
Citations
Citations to this article as recorded by
Clinical Context Is More Important than Data Quantity to the Performance of an Artificial Intelligence-Based Early Warning System Taeyong Sim, Eunyoung Cho, Jihyun Kim, Ho Gwan Kim, Soo-Jeong Kim Journal of Clinical Medicine.2025; 14(13): 4444. CrossRef
Artificial intelligence and machine learning approaches for patient safety in complex surgery: a review Mohamed Mustaf Ahmed, Zhinya Kawa Othman, Uthman Okikiola Adebayo, Omar Kasimieh, Olalekan John Okesanya, Shuaibu Saidu Musa, Francesco Branda, Victor C. Cañezo , Edgar G. Cue, Don Eliseo Lucero Prisno III Patient Safety in Surgery.2025;[Epub] CrossRef
The inactivated influenza vaccination is generally safe with mostly mild side effects. We report a rare but fatal adverse event following influenza vaccination. A previously healthy 27-yearold woman who received the influenza vaccination 3 days before presenting to the emergency department had rapidly aggravating dyspnea and mental deterioration. She was diagnosed as having acute fulminant myocarditis with refractory cardiogenic shock, which was successfully managed with veno-arterial extracorporeal membrane oxygenation. The cardiac function of the patient recovered in 3 weeks.
Citations
Citations to this article as recorded by
Endosomal Toll-Like Receptors intermediate negative impacts of viral diseases, autoimmune diseases, and inflammatory immune responses on the cardiovascular system Fatemeh Sadat Tabatabaei, Melika Shafeghat, Amirali Azimi, Ashley Akrami, Nima Rezaei Expert Review of Clinical Immunology.2025; 21(2): 195. CrossRef
Clinical Characteristics and Mechanisms of Acute Myocarditis Stephane Heymans, Sophie Van Linthout, Sarah Mignon Kraus, Leslie T. Cooper, Ntobeko A.B. Ntusi Circulation Research.2024; 135(2): 397. CrossRef
Clinical Manifestations and Adverse Cardiovascular Events in Patients with Cardiovascular Symptoms after mRNA Coronavirus Disease 2019 Vaccines William D. Kim, Min Jae Cha, Subin Kim, Dong-Gil Kim, Jae-Jin Kwak, Sung Woo Cho, Joon Hyung Doh, Sung Uk Kwon, June Namgung, Sung Yun Lee, Jiwon Seo, Geu-ru Hong, Ji-won Hwang, Iksung Cho Yonsei Medical Journal.2024; 65(11): 629. CrossRef
Active surveillance for adverse events of influenza vaccine safety in elderly cancer patients using self-controlled tree-temporal scan statistic analysis Na-Young Jeong, Chung-Jong Kim, Sang Min Park, Ye-Jee Kim, Joongyub Lee, Nam-Kyong Choi Scientific Reports.2023;[Epub] CrossRef
The Incidence of Myocarditis Following an Influenza Vaccination: A Population-Based Observational Study Wen-Hwa Wang, Kai-Che Wei, Yu-Tung Huang, Kuang-Hua Huang, Tung-Han Tsai, Yu-Chia Chang Drugs & Aging.2023; 40(2): 145. CrossRef
Comparison of COVID-19 Vaccine-Associated Myocarditis and Viral Myocarditis Pathology Kamron Reza Hamedi, Gannett Loftus, Lawson Traylor, Richard Goodwin, Sergio Arce Vaccines.2023; 11(2): 362. CrossRef
Myocarditis and autoimmunity Akira Matsumori Expert Review of Cardiovascular Therapy.2023; 21(6): 437. CrossRef
Cardiovascular magnetic resonance (CMR) and positron emission tomography (PET) imaging in the diagnosis and follow-up of patients with acute myocarditis and chronic inflammatory cardiomyopathy Federico Caobelli, Jordi Broncano Cabrero, Nicola Galea, Philip Haaf, Christian Loewe, Julian A. Luetkens, Giuseppe Muscogiuri, Marco Francone The International Journal of Cardiovascular Imaging.2023; 39(11): 2221. CrossRef
Clinical Syndromes Related to SARS-CoV-2 Infection and Vaccination in Pediatric Age: A Narrative Review Maria Vincenza Mastrolia, Camilla De Cillia, Michela Orlandi, Sarah Abu-Rumeileh, Ilaria Maccora, Valerio Maniscalco, Edoardo Marrani, Ilaria Pagnini, Gabriele Simonini Medicina.2023; 59(11): 2027. CrossRef
Clinically Suspected Myocarditis Temporally Related to COVID-19 Vaccination in Adolescents and Young Adults: Suspected Myocarditis After COVID-19 Vaccination Dongngan T. Truong, Audrey Dionne, Juan Carlos Muniz, Kimberly E. McHugh, Michael A. Portman, Linda M. Lambert, Deepika Thacker, Matthew D. Elias, Jennifer S. Li, Olga H. Toro-Salazar, Brett R. Anderson, Andrew M. Atz, C. Monique Bohun, M. Jay Campbell, M Circulation.2022; 145(5): 345. CrossRef
Myocarditis Following rAd26 and rAd5 Vector-Based COVID-19 Vaccine: Case Report Farah Naghashzadeh, Shadi Shafaghi, Atosa Dorudinia, Seyed Alireza Naji, Majid Marjani, Ahmad Amin, Arezoo Mohamadifar, Sima Noorali, Babak Sharif Kashani ESC Heart Failure.2022; 9(2): 1483. CrossRef
Myocarditis following COVID-19 vaccination in adolescents and adults: a cumulative experience of 2021 Onyedika J. Ilonze, Maya E. Guglin Heart Failure Reviews.2022; 27(6): 2033. CrossRef
Chest Pain and Suspected Myocarditis Related to COVID-19 Vaccination in Adolescents—A Case Series Da-Eun Roh, Hyejin Na, Jung-Eun Kwon, Insu Choi, Yeo-Hyang Kim, Hwa-Jin Cho Children.2022; 9(5): 693. CrossRef
Cardiac Adverse Events after Vaccination—A Systematic Review Kanak Parmar, Sai Subramanyam, Gaspar Del Rio-Pertuz, Pooja Sethi, Erwin Argueta-Sosa Vaccines.2022; 10(5): 700. CrossRef
A case of myocarditis after COVID-19 vaccination: incidental or consequential? Leona S. Alizadeh, Vitali Koch, Ibrahim Yel, Leon D. Grünewald, Daniel Mathies, Simon Martin, Thomas J. Vogl, Dominic Rauschning, Christian Booz Heliyon.2022; 8(6): e09537. CrossRef
COVID-19 Vaccination and the Rate of Immune and Autoimmune Adverse Events Following Immunization: Insights From a Narrative Literature Review Naim Mahroum, Noy Lavine, Aviran Ohayon, Ravend Seida, Abdulkarim Alwani, Mahmoud Alrais, Magdi Zoubi, Nicola Luigi Bragazzi Frontiers in Immunology.2022;[Epub] CrossRef
COVID-19 vaccination and carditis in children and adolescents: a systematic review and meta-analysis Oscar Hou In Chou, Jonathan Mui, Cheuk To Chung, Danny Radford, Simon Ranjithkumar, Endurance Evbayekha, Ronald Nam, Levent Pay, Danish Iltaf Satti, Sebastian Garcia-Zamora, George Bazoukis, Göksel Çinier, Sharen Lee, Vassilios S. Vassiliou, Tong Liu, Gar Clinical Research in Cardiology.2022; 111(10): 1161. CrossRef
Myopericarditis after vaccination, Vaccine Adverse Event Reporting System (VAERS), 1990–2018 John R. Su, Michael M. McNeil, Kerry J. Welsh, Paige L. Marquez, Carmen Ng, Ming Yan, Maria V. Cano Vaccine.2021; 39(5): 839. CrossRef
Sipuleucel-T Associated Inflammatory Cardiomyopathy: A Case Report and Observations from a Large Pharmacovigilance Database Melissa Y.Y. Moey, Rahim A. Jiwani, Kotaro Takeda, Karyn Prenshaw, R. Wayne Kreeger, John Inzerillo, Darla K. Liles, C. Bogdan Marcu, Bénédicte Lebrun-Vignes, D. Lynn Morris, Sivakumar Ardhanari, Joe-Elie Salem ESC Heart Failure.2021; 8(4): 3360. CrossRef
Myocarditis following COVID-19 vaccination Elisabeth Albert, Gerard Aurigemma, Jason Saucedo, David S. Gerson Radiology Case Reports.2021; 16(8): 2142. CrossRef
Myocarditis and Other Cardiovascular Complications of the mRNA-Based COVID-19 Vaccines Mahesh K Vidula, Marietta Ambrose, Helene Glassberg, Neel Chokshi, Tiffany Chen, Victor A Ferrari, Yuchi Han Cureus.2021;[Epub] CrossRef
Patients With Acute Myocarditis Following mRNA COVID-19 Vaccination Han W. Kim, Elizabeth R. Jenista, David C. Wendell, Clerio F. Azevedo, Michael J. Campbell, Stephen N. Darty, Michele A. Parker, Raymond J. Kim JAMA Cardiology.2021; 6(10): 1196. CrossRef
Acute myocarditis following Comirnaty vaccination in a healthy man with previous SARS-CoV-2 infection Anna Patrignani, Nicolò Schicchi, Francesca Calcagnoli, Elena Falchetti, Nino Ciampani, Giulio Argalia, Antonio Mariani Radiology Case Reports.2021; 16(11): 3321. CrossRef
Myocarditis and pericarditis after vaccination for COVID‐19 Blake Hudson, Ryan Mantooth, Matthew DeLaney JACEP Open.2021; 2(4): e12498. CrossRef
Myocarditis, Pericarditis and Cardiomyopathy After COVID-19 Vaccination Salvatore Pepe, Ann T. Gregory, A. Robert Denniss Heart, Lung and Circulation.2021; 30(10): 1425. CrossRef
Cardiac Manifestations of Multisystem Inflammatory Syndrome in Children (MIS-C) Following COVID-19 Eveline Y. Wu, M. Jay Campbell Current Cardiology Reports.2021;[Epub] CrossRef
Hemodynamic Collapse After Influenza Vaccination: A Vaccine-Induced Fulminant Myocarditis? Nobutaka Nagano, Toshiyuki Yano, Yugo Fujita, Masayuki Koyama, Ryo Hasegawa, Jun Nakata, Ryo Nishikawa, Naoto Murakami, Takefumi Fujito, Atsushi Mochizuki, Hidemichi Kouzu, Atsuko Muranaka, Nobuaki Kokubu, Tetsuji Miura Canadian Journal of Cardiology.2020; 36(9): 1554.e5. CrossRef
Fatal influenza myocarditis with incessant ventricular tachycardia Nidhi Saraiya, Supriya Singh, Marilou Corpuz BMJ Case Reports.2019; 12(7): e228201. CrossRef