CardioAI: A Multimodal AI-based System to Support Symptom Monitoring and Risk Prediction of Cancer Treatment-Induced Cardiotoxicity

Picture of Siyi Wu
Siyi Wu
Picture of Weidan Cao
Weidan Cao
Picture of Shihan Fu
Shihan Fu
Picture of Bingsheng Yao
Bingsheng Yao
Picture of Ziqi Yang
Ziqi Yang
Picture of Changchang Yin
Changchang Yin
Picture of Daniel Addison
Daniel Addison
Picture of Ping Zhang
Ping Zhang
Picture of Dakuo Wang
Dakuo Wang
Published at Proceedings of the Conference on Human Factors in Computing Systems (CHI) 2025

Abstract

Despite recent advances in cancer treatments that prolong patients' lives, treatment-induced cardiotoxicity (i.e., the various heart damages caused by cancer treatments) emerges as one major side effect. The clinical decision-making process of cardiotoxicity is challenging, as early symptoms may happen in non-clinical settings and are too subtle to be noticed until life-threatening events occur at a later stage; clinicians already have a high workload focusing on the cancer treatment, no additional effort to spare on the cardiotoxicity side effect. Our project starts with a participatory design study with 11 clinicians to understand their decision-making practices and their feedback on an initial design of an AI-based decision-support system. Based on their feedback, we then propose a multimodal AI system, CardioAI, that can integrate wearables data and voice assistant data to model a patient's cardiotoxicity risk to support clinicians' decision-making. We conclude our paper with a small-scale heuristic evaluation with four experts and the discussion of future design considerations.

Materials