Performance Comparison of Machine Learning Classifiers and Cardio-Sense Ensemble for Heart Disease Detection

Abstract

Objective: Heart disease remains a leading cause of global mortality; consequently, accurate, reliable, and interpretable predictive models are needed for early diagnosis. This study was aimed at developing a robust hybrid ensemble learning framework that improves heart disease predictive accuracy while preserving clinical interpretability. Methods: The Cardio-Sense Ensemble Framework (CSEF) for heart disease prediction was developed by using the publicly available Behavioral Risk Factor Surveillance System dataset. Laplacian binary optimization was used for optimized feature selection, to eliminate redundancy and enhance discriminative information. The refined feature set was used to train multiple baseline classifiers, including logistic regression, random forest, K-nearest neighbors, and XGBoost. Their outputs were combined with Light Gradient Boosting Machine as a meta-classifier. Model performance was assessed with accuracy, sensitivity, specificity, and the area under the receiver operating characteristic curve (AUC). Results: The CSEF achieved an accuracy of 0.98 and an AUC of 0.98, thus outperforming conventional machine learning models while demonstrating improved sensitivity and specificity. Conclusion: Our hybrid ensemble framework offers superior predictive performance and interpretability; therefore, it is suitable for early cardiovascular risk screening and clinical decision-support integration.

Keywords

heart disease prediction / cardiovascular diseases / SMOTE / edited nearest neighbor / ladybug beetle optimization Light Gradient Boosting Machine

^{Data Availability Statement Ethics Statement Funding/Acknowledgements Conflict of Interest Consent to Participation Consent to Publication Competing Interests Author Contributions}

References

[1] Ahmad GN, Ullah S, Algethami A, Fatima H, Akhter SMH. Comparative study of optimum medical diagnosis of human heart disease using machine learning technique with and without sequential feature selection. IEEE Access. 2022. Vol. 10:23808-28

[2] Almazroi AA, Aldhahri EA, Bashir S, Ashfaq S. A clinical decision support system for heart disease prediction using deep learning. IEEE Access. 2023. Vol. 11:61646-59

[3] Savarese G, Becher PM, Lund LH, Seferovic P, Rosano GMC, Coats AJS. Global burden of heart failure: a comprehensive and updated review of epidemiology. Cardiovasc Res. 2023. Vol. 118(17):3272-87

[4] Manikandan G, Pragadeesh B, Manojkumar V, Karthikeyan AL, Manikandan R, Gandomi AH. Classification models combined with Boruta feature selection for heart disease prediction. Inform Med Unlocked. 2024. Vol. 44:101442

[5] Poznyak AV, Sadykhov NK, Kartuesov AG, Borisov EE, Melnichenko AA, Grechko AV, et al.. Hypertension as a risk factor for atherosclerosis: cardiovascular risk assessment. Front Cardiovasc Med. 2022. Vol. 9:959285

[6] Hossain MI, Maruf MH, Khan MAR, Prity FS, Fatema S, Ejaz MS, et al.. Heart disease prediction using distinct artificial intelligence techniques: performance analysis and comparison. Iran J Comput Sci. 2023. Vol. 6(4):397-417

[7] Naija A, Yalcin HC. Evaluation of cadmium and mercury on cardiovascular and neurological systems: effects on humans and fish. Toxicol Rep. 2023. Vol. 10:498-508

[8] Swathy M, Saruladha K. A comparative study of classification and prediction of Cardio-Vascular Diseases (CVD) using Machine Learning and Deep Learning techniques. ICT Express. 2022. Vol. 8(1):109-16

[9] Narkhede M, Pardeshi A, Bhagat R, Dharme G. Review on emerging therapeutic strategies for managing cardiovascular disease. Curr Cardiol Rev. 2024. Vol. 20(4):86-100

[10] Karki A, Manandhar L. Understanding ischemic stroke: symptoms, risks, and the importance of timely intervention. Am J Patient Health Info. 2024. Vol. 1(2)

[11] Bonham PA, Droste LR, González A, Kelechi TJ, Ratliff CR. 2024 Guideline for management of wounds in patients with lower extremity arterial disease: an executive summary. J Wound Ostomy Continence Nurs. 2024. Vol. 51(5):357-70

[12] Qadri AM, Raza A, Munir K, Almutairi MS. Effective feature engineering technique for heart disease prediction with machine learning. IEEE Access. 2023. Vol. 11:56214-24

[13] Dhakal B, Pokharel B. Coronary artery disease (CAD) demystified-causes, symptoms & treatment. Am J Patient Health Info. 2024. Vol. 1(1)

[14] Upadhyay RK. High cholesterol disorders, myocardial infarction and its therapeutics. World J Cardiovasc Dis. 2023. Vol. 13(8):433-69

[15] Wang Y, Li G, Yang L, Luo R, Guo G. Development of innovative biomaterials and devices for the treatment of cardiovascular diseases. Adv Mater. 2022. Vol. 34(46):e2201971

[16] Bhatt CM, Patel P, Ghetia T, Mazzeo PL. Effective heart disease prediction using machine learning techniques. Algorithms. 2023. Vol. 16(2):88

[17] Ramesh TR, Lilhore UK, Poongodi M, Simaiya S, Kaur A, Hamdi M. Predictive analysis of heart diseases with machine learning approaches. Malays J Comput Sci. 2022. Vol. 2022(1):132-48

[18] Khan A, Qureshi M, Daniyal M, Tawiah K. A novel study on machine learning algorithm-based cardiovascular disease prediction. Health Soc Care Community. 2023. Vol. 2023(1):1406060

[19] Guazzi M, Wilhelm M, Halle M, Van Craenenbroeck E, Kemps H, de Boer RA, et al.. Exercise testing in heart failure with preserved ejection fraction: an appraisal through diagnosis, pathophysiology and therapy-A clinical consensus statement of the Heart Failure Association and European Association of Preventive Cardiology of the European Society of Cardiology. Eur J Heart Fail. 2022. Vol. 24(8):1327-45

[20] Rashid Y, Bhat JI. Topological to deep learning era for identifying influencers in online social networks: a systematic review. Multimed Tools Appl. 2024. Vol. 83(5):14671-714

[21] Arumugam K, Naved M, Shinde PP, Leiva-Chauca O, Huaman-Osorio A, Gonzales-Yanac T. Multiple disease prediction using Machine learning algorithms. Mater Today Proc. 2023. Vol. 80:3682-5

[22] Ahsan MM, Siddique Z. Machine learning-based heart disease diagnosis: a systematic literature review. Artif Intell Med. 2022. Vol. 128:102289

[23] Qi X, Wang S, Fang C, Jia J, Lin L, Yuan T. Machine learning and SHAP value interpretation for predicting comorbidity of cardiovascular disease and cancer with dietary antioxidants. Redox Biol. 2025. Vol. 79:103470

[24] Baghdadi NA, Farghaly Abdelaliem SM, Malki A, Gad I, Ewis A, Atlam E. Advanced machine learning techniques for cardiovascular disease early detection and diagnosis. J Big Data. 2023. Vol. 10(1):144

[25] Naser MA, Majeed AA, Alsabah M, Al-Shaikhli TR, Kaky KM. A review of machine learning’s role in cardiovascular disease prediction: recent advances and future challenges. Algorithms. 2024. Vol. 17(2):78

[26] El-Sofany HF. Predicting heart diseases using machine learning and different data classification techniques. IEEE Access. 2024. Vol. 12:106146-60

[27] Rath A, Mishra D, Panda G. Imbalanced ECG signal-based heart disease classification using ensemble machine learning technique. Front Big Data. 2022. Vol. 5:1021518

[28] Kumar A, Singh KU, Kumar M. A clinical data analysis based diagnostic system for heart disease prediction using ensemble method. Big Data Min Anal. 2023. Vol. 6(4):513-25

[29] Asif D, Bibi M, Arif MS, Mukheimer A. Enhancing heart disease prediction through ensemble learning techniques with hyperparameter optimization. Algorithms. 2023. Vol. 16(6):308

[30] Ghasemieh A, Lloyed A, Bahrami P, Vajar P, Kashef R. A novel machine learning model with stacking ensemble learner for predicting emergency readmission of heart-disease patients. Decis Anal J. 2023. Vol. 7:100242

[31] Nissa N, Jamwal S, Neshat M. A technical comparative heart disease prediction framework using boosting ensemble techniques. Computation. 2024. Vol. 12(1):15

[32] Mondal S, Maity R, Omo Y, Ghosh S, Nag A. An efficient computational risk prediction model of heart diseases based on dual-stage stacked machine learning approaches. IEEE Access. 2024. Vol. 12:7255-70

[33] Sultan SQ, Javaid N, Alrajeh N, Aslam M. Machine learning-based stacking ensemble model for prediction of heart disease with explainable AI and K-fold cross-validation: a symmetric approach. Symmetry. 2025. Vol. 17(2):185

[34] Ahmed M, Sulaiman MH, Hassan MM, Bhuiyan T. Predicting the classification of heart failure patients using optimized machine learning algorithms. IEEE Access. 2025. 13

[35] Chaurasia V, Chaurasia A. Novel method of characterization of heart disease prediction using sequential feature selection-based ensemble technique. Biomed Mater Devices. 2023. Vol. 1(2):932-41

[36] Polepaka S, Ram Kumar RP, Palakurthy D, Manasa V, Saritha A, Dixit S, et al.. Optimized convolutional neural network using grasshopper optimization technique for enhanced heart disease prediction. Cogent Eng. 2024. Vol. 11(1):2423847

[37] Ram Kumar RP, Raju S, Annapoorna E, Hajari M, Hareesa K, Vatin NI, et al.. Enhanced heart disease prediction through hybrid CNN-TLBO-GA optimization: a comparative study with conventional CNN and optimized CNN using FPO algorithm. Cogent Eng. 2024. Vol. 11(1):2384657