Ensemble Machine Learning for Cardiovascular Disease Prediction

Due to the fact 17.9 million people die from heart attacks each year, machine learning (ML) is revolutionizing healthcare by improving the prediction of the onset of coronary heart disease, which is vital for rapid identification. Effective models can significantly enhance patient outcomes and save costs. traditional tools for assessing risk, such as the Middlesex Danger Score., often overlook the complex interplay of risk factors, while ML approaches use large datasets to discover complicated patterns that enhance predictive accuracy and allow for individualized risk assessment in a wide range of clinical and demographic contexts. Recent research demonstrates the effectiveness of various computational learning techniques, specifically randomly generated forests, decision trees, and neural networks, for predicting cardiac disease. As an example, the XG Boost algorithm scored 93% accuracy by detecting major predictors such as age, gender, BMI, and lifestyle. Active learning methods have even achieved prediction rates of 98.7% through Learning Vector Quantization models. Applying ML to heart disease prediction allows for timely intervention and helps doctors tailor interventions and allocate resources as effectively as possible. Health systems can implement interventions to reduce the incidence of heart disease and enhance overall health outcomes through these new approaches. [1] [2] Because of its high degree of efficiency along with its capacity to manage intricate datasets, Random Forest is a sophisticated composite machine learning method that has become widely recognized for its ability to predict cardiac disease. Accurate prediction models are important either timely treatment or diagnosis because cardiovascular diseases are still a leading cause of death globally. To enhance reliability and reduce the likelihood of too much fitting, random forest creation creates multiple decision trees and averages their assumptions. While cardiac arrest is among those global leading causes of death, accurate forecasting protocols are necessary to assist with early detection. The machine-learning method called Random Forest has proven to be highly effective in predicting the onset of cardiac disease with its ensemble strategy, which combines different decision trees to obtain accurate and reliable results. Research studies are plagued by seemingly Random Forest shows high accuracy, like 92.16% in coronary diseases forecasting, outperforming other algorithms, like selection foliage techniques and Support Vector Machines. By analysing clinical visits and demographic factors dimensions, Random Forest allows identify key the probability factors, making timely therapy and tailored rehabilitation strategy available to maximize receptive outcomes. [3,4 XG Boost (Extreme Gradient Boosting) is a sophisticated machine learning technique that is commonly utilized for predicting cardiac disease due to its effectiveness as well as precision. Investigations have shown that XG Boost may achieve up to 98.04% accuracy through applying sophisticated strategies such as hyperparameter values tweaking and feature selection. Its ability to examine enormous amounts of data and detect substantial risk variables, such as age and way of life constitutes an invaluable tool for medical professionals. XG Boost promotes cardiovascular care through lowering false positives and negatives, facilitating swift actions and tailored treatment options (45). [5]. Heterogeneous classifiers integrate multiple strategies to enhance forecasting heart attacks accuracy. Using strategies like hard voting (majority class selection) and soft voting (probability averaging), classifiers may surpass distinct models (33). Another investigation leveraged 57 electoral votes to achieve 98.38% accuracy, while another framework using six machine learning models achieved 88.70% accuracy by focusing on key parameters including cholesterol levels and resting blood pressure. [6]. Machine learning, a niche branch of Artificial Intelligence (AI), is all about making machines capable of replicating human abilities. Machine Intelligence is the quality of such systems where they can process and utilize data. We utilize biological variables such as cholesterol, blood pressure, gender, and age as data sets to compare the two algorithms' accuracy: XG Boost and Random Forest in this paper. Heart disease is a top cause of mortality across the globe, with the World Health Organization attributing 12 million deaths annually to cardiovascular conditions. Early diagnosis greatly reduces complications, reminding us that prevention is better than cure. Using machine learning, we seek to forecast heart disease by examining different patient characteristics and comparing algorithmic performance to identify the best predictive model.

LITRATURE REVIEW

This study investigates how data science might be used in the medical field to anticipate cardiac illness. The prediction's dependability still has to be increased because there is a lot of research being done on that subject. Therefore, the goal of this work is to improve precision through feature selection approaches and methods that use a lot of data sets for cardiac disease in experimental computation. We propose an innovative approach for determining key features through the application of machine learning methods, enhancing the accuracy of the prediction of cardiovascular disease. The forecasting framework is proposed through various configurations of features and familiar methods of classification. In this dissertation, they explore the widely employed classification techniques in the medical data set that help predict cardiac diseases, which are the primary cause of death across the globe. Predicting a cardiovascular attack is challenging for physicians and clinicians to venture into since the process involves acumen as well as understanding. The healthcare industry today holds latent but consequential information for decision-making. The tests conducted uncover this algorithm. As expected. The study report offers a stacking ensemble model termed NCDG for heart disease prediction, which uses Naive Bayes, Categorical Boosting, and Decision Tree as base learners and Gradient acceleration as the meta-learner. The model addresses data class imbalance using SMOTE techniques and achieves high performance metrics, including an accuracy, F1-Score, precision, and recall of 0.91. The K-Fold Cross-Validation method further validates the model's predictions, demonstrating its effectiveness in early heart disease detection. [7] El-Sofany established a systematic method for forecasting cardiac disease using machine learning, highlighting the necessity of model validation and the advantages of ensemble learning techniques. The dissertation proposed an application for smartphones based on XG Boost for real-time heart disease prediction using raw symptoms, the SF-2 feature subset, and SMOTE data balance. Using the SF-2 feature subset with SMOTE analysis evidence juxtaposing, this suggested model achieved an accuracy of 97.57%. [8] Rajni Gandhaet's entire research demonstrates the need of employing a strong dataset and multiple machine learning algorithms to efficiently identify cardiac disease, with a focus upon enhancing the diagnostic performance via ensemble learning techniques. This model achieved high accuracy of 98.04% after hyperparameter adjustment. [9] Hossain et al. (2024) [10] investigated the use of machine learning to predict cardiovascular disease (CVD) risk in Bangladesh. Using cross-sectional data, multiple machine learning models were used to identify significant CVD risk factors and evaluate model performance. The work emphasizes the potential of machine learning for early CVD identification and risk assessment, bringing insights into public health policies in Bangladesh. The good accuracy obtained indicates a possibility of application in clinical practice, even though the precise details of the system are not well defined. They proposed with a precision of 98.04%. In 2023, an authoritative assessment put forward a strategy for forecasting heart failure outcomes using Random Forest and XG Boost. The inquiry into the subject recommends incorporating XG Boost and Random Forest models into healthcare systems for enhancing the preciseness of cardiovascular disease foresight, using a Kaggle dataset with tenfold cross-validation They advocated XG Boost with an accuracy of 91.56% after cross-validation. [11] Hossain MI [12] constructed a strategy for heart disease prediction using concentrated artificial intelligence tactics, and Random Forest achieved 90% accuracy irrespective of all machine learning. According to Halima EL Hamdaoui's research, amalgamating Random Forest with AdaBoost will increase prediction accuracy. This hybrid technique was tested on a heart disease dataset and shown outstanding results compared to individual models. This model manufactures an accuracy of 95.98% for Random Forest alone and 96.16% when utilized together with AdaBoost. [13] Yang L developed a method for studying cardiovascular disease prediction models using random forests. They employed multiple methods to develop prediction model such as multivariate regression model, classification and regression tree(CART),Naive Bayas, Bagged trees ,Ada Boost and Random forest. They employed the multivariate regression model as reference for performance Evaluation. This model hypothesized precision Gained an AUC score of 0.787, suggesting good prediction capabilities in relation to other models. [14]. This study offers a predictive framework for heart failure that employs k-mode clustering with Huang initialization to improve classification accuracy. Models such as Random Forest, Decision Tree, Multilayer Perceptron, and XG Boost were tuned with GridSearchCV and implemented to a Kaggle dataset of 70,000 incidences (80:20 split). The highest accuracy was achieved by Multilayer Perceptron with cross-validation (87.28%), outperforming others such as Random Forest (87.05%), XG Boost (86.87%), and Decision Tree (86.37%). The areas under the curve (AUC) values for every single model consisted between 0.94 and 0.95, showing high predictive performance. [15]. Shamsuddin Sultan presents a stacking ensemble model named NCDG for heart disease classification, utilizing Naive Bayes, Categorical Boosting, and Decision Tree as base learners, with Gradient Boosting as the meta-learner. This framework uses SMOTE and BorderLine SMOTE techniques to address issues with data class imbalance. It demonstrated its effectiveness in predicting heart illness by producing exceptional results in metrics like as accuracy, F1-Score, precision, and recall of 0.91 each, which were confirmed by K-Fold Cross-Validation. [16] This research utilizes batch classification models in the explicable artificial intelligence (XAI) paradigm to predict heart disease on a 303-example dataset with 14 variables. Methods employed are support vector machine (SVM), k-nearest neighbor (KNN), decision tree (DT), and random forest (RF). The XAI-driven programs have an incredible 99% accuracy, surpassing conventional classification methods and enhancing the validity and understandability of cardiovascular disease diagnosis and prediction [17]. This paper constructs a heart disease classification model by using a group approach with a Stacking structure comprising BiGRU, BiLSTM, and XG Boost. The BiGRU and BiLSTM models serve as basis models for feature extraction from sequential data, while the XG Boost model serves as a meta-model for final classification. The outcomes show that classification accuracy is enhanced by the Stacking method from 0.85 (BiLSTM) to 0.92, verifying its utility in heart disease detection. [18]. This work shows how an ensemble machine learning approach, specifically a Voting Classifier that incorporates Decision Tree, k-Nearest Neighbors, and Gaussian Naive Bayes classifiers, can effectively classify heart disease. Using a dataset of 70,000 clinical records, the model obtained average accuracies, precision, recall, and F1-scores over 99% through 5-fold cross-validation. The results demonstrate that ensemble models improve cardiovascular disease classification prediction accuracy and reliability, with important ramifications for early intervention and individualized patient care. [19]. In order to improve diagnostic accuracy, the study suggests an ensemble-based deep learning method for classifying heart disease that combines many machine learning classifiers. It obtains a high 98.3% accuracy on a UCI dataset, beating stand-alone models such as AdaBoost, XG Boost, and Random Forest. Incorporating the application of Correlation-based Feature Selection (CFS) enhances the model by filtering appropriate features, hence increasing accuracy, recall, precision, and f1-score. The process significantly leads to accurate cardiovascular health prediction and classification. [20]. The article illustrates the performance of ensemble machine learning methods, in this case the Random Forest classifier, in classifying heart disease. It recorded an extraordinary accuracy of 98.54% and a very close to perfect AUC value of 1.00, which underscores its strong predictive capability. The research compares several algorithms, highlighting the strengths of ensemble methods over individual classifiers, thus improving early heart disease detection and management via optimized prediction from a holistic data set of cardiovascular health metrics. [21]. A study investigation targets cardiovascular disease classification based on community machine learning techniques. For predicting cardiac disorders, it applies a range of methodologies including logistic regression, decision trees, support vector machines, random forests, and multilayer perceptron. The data used was retrieved from Kaggle, and the predictions were enhanced through hyperparameter tuning and voting classifier methodology. The inquiry concludes by comparing the expected performance parameters of the collective system, establishing that it is effective in early detection and treatment of heart-related disorders. [22]. For this study, we use data on cardiovascular disease. This data set contains about 1025 patients and 76 features; we use all sorts of machine learning and deep learning algorithms to see which one of them has the highest potential to detect potential cardiovascular disease.

Proposed Approach

This section describes the methodologies used for predicting cardiovascular disease. Describes the methodology proposed, which includes six phases. Selecting an adequate dataset for the trial is the first step in the procedure. The cardiovascular disease database serves as the foundation for the preliminary analysis of the study. A number of crucial procedures are included in the preprocessing step prior to model training. A feature acquisition technique is then used to gauge the features' significance, and a number of machine learning and deep learning classification models are used for preliminary explanations. Deep learning techniques for the identification of cardiovascular disease are also assessed in this study. Four unstable machine learning predictive models—Random Forest (RF), Extreme Gradient Boosting (XGB), and Voting Ensemble Classifier—are used to detect cardiovascular disease outbreaks. Two distinct machine learning classifications are used to assess how well machine learning models perform on the given dataset.

Heart disease dataset description

Researchers at a University of California, Irvine (UCI) online data exploration and machine learning repository provided Cleveland's cardiovascular illness dataset for our research. Six of the 303 subject record instances in the sample contained missing class values. Although each person in the dataset has 76 variables, previous research has shown that 13 criteria are useful in identifying heart disease. We list the dataset's numerical and categorical properties in Table 1. Its motive is to predict whether a subject has heart ailments based on the results from the numerous medical tests that have been conducted on them. The dataset's "num" field indicates whether an individual has heart disease or not. The values of the "num" variable vary between 0 (no existence) to 4. Previous research on the the city of Cleveland dataset has tried to discriminate between the presence (values 1, 2, 3, and 4) and absence (value) of cardiac disease.

Table 1: Features of the data collection on coronary disease.