<?xml version="1.0" encoding="UTF-8"?><!DOCTYPE article  PUBLIC "-//NLM//DTD Journal Publishing DTD v3.0 20080202//EN" "http://dtd.nlm.nih.gov/publishing/3.0/journalpublishing3.dtd"><article xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink" dtd-version="3.0" xml:lang="en" article-type="research article"><front><journal-meta><journal-id journal-id-type="publisher-id">OJS</journal-id><journal-title-group><journal-title>Open Journal of Statistics</journal-title></journal-title-group><issn pub-type="epub">2161-718X</issn><publisher><publisher-name>Scientific Research Publishing</publisher-name></publisher></journal-meta><article-meta><article-id pub-id-type="doi">10.4236/ojs.2024.143011</article-id><article-id pub-id-type="publisher-id">OJS-133508</article-id><article-categories><subj-group subj-group-type="heading"><subject>Articles</subject></subj-group><subj-group subj-group-type="Discipline-v2"><subject>Physics&amp;Mathematics</subject></subj-group></article-categories><title-group><article-title>
 
 
  Advanced Computing for Cardiovascular Disease Prediction
 
</article-title></title-group><contrib-group><contrib contrib-type="author" xlink:type="simple"><name name-style="western"><surname>Santosh</surname><given-names>Gaire</given-names></name><xref ref-type="aff" rid="aff1"><sup>1</sup></xref></contrib><contrib contrib-type="author" xlink:type="simple"><name name-style="western"><surname>Poshan</surname><given-names>Belbase</given-names></name><xref ref-type="aff" rid="aff2"><sup>2</sup></xref></contrib><contrib contrib-type="author" xlink:type="simple"><name name-style="western"><surname>Amrit</surname><given-names>Kafle</given-names></name><xref ref-type="aff" rid="aff1"><sup>1</sup></xref></contrib><contrib contrib-type="author" xlink:type="simple"><name name-style="western"><surname>Rajendra</surname><given-names>Bhandari</given-names></name><xref ref-type="aff" rid="aff1"><sup>1</sup></xref></contrib></contrib-group><aff id="aff2"><addr-line>Department of Physics, The Catholic University of America, Washington DC, USA</addr-line></aff><aff id="aff1"><addr-line>Vitreous State Laboratory, The Catholic University of America, Washington DC, USA</addr-line></aff><pub-date pub-type="epub"><day>29</day><month>05</month><year>2024</year></pub-date><volume>14</volume><issue>03</issue><fpage>228</fpage><lpage>242</lpage><history><date date-type="received"><day>18,</day>	<month>April</month>	<year>2024</year></date><date date-type="rev-recd"><day>27,</day>	<month>May</month>	<year>2024</year>	</date><date date-type="accepted"><day>30,</day>	<month>May</month>	<year>2024</year></date></history><permissions><copyright-statement>&#169; Copyright  2014 by authors and Scientific Research Publishing Inc. </copyright-statement><copyright-year>2014</copyright-year><license><license-p>This work is licensed under the Creative Commons Attribution International License (CC BY). http://creativecommons.org/licenses/by/4.0/</license-p></license></permissions><abstract><p>
 
 
  Developing a predictive model for detecting cardiovascular diseases (CVDs) is crucial due to its high global fatality rate. With the advancements in artificial intelligence, the availability of large-scale data, and increased access to computational capability, it is feasible to create robust models that can detect CVDs with high precision. This study aims to provide a promising method for early diagnosis by employing various machine learning and deep learning techniques, including logistic regression, decision trees, random forest classifier, extreme gradient boosting (XGBoost), and a sequential model from Keras. Our evaluation identifies the random forest classifier as the most effective model, achieving an accuracy of 0.91, surpassing other machine learning and deep learning approaches. Close behind are XGBoost (accuracy: 0.90), decision tree (accuracy: 0.86), and logistic regression (accuracy: 0.70). Additionally, our deep learning sequential model demonstrates promising classification performance, with an accuracy of 0.80 and a loss of 0.425 on the validation set. These findings underscore the potential of machine learning and deep learning methodologies in advancing cardiovascular disease prediction and management strategies.
 
</p></abstract><kwd-group><kwd>Machine Learning</kwd><kwd> Deep Learning</kwd><kwd> Classification</kwd><kwd> Performance Matrix</kwd><kwd> Accuracy</kwd></kwd-group></article-meta></front><body><sec id="s1"><title>1. Introduction</title><p>The proper functioning of the cardiovascular system ensures a healthy heart, which is the most essential aspect of the well-being of our body. The problems that arise in the system cause cardiovascular diseases (CVDs). According to National Health Services, UK, cardiovascular disease is a general term for the conditions affecting the heart or blood vessels. Generally, CVDs encompass all types of diseases that affect the heart or blood vessels, including coronary heart disease, cerebrovascular disease, rheumatic heart disease, and other conditions like chest pain, stroke, and heart attack [<xref ref-type="bibr" rid="scirp.133508-ref1">1</xref>] . The effects of behavioral risk factors for CVDs like unhealthy diet, physical inactivity, and consumption of tobacco and alcohol [<xref ref-type="bibr" rid="scirp.133508-ref2">2</xref>] , may appear as high blood pressure, blood glucose, raised blood lipids, overweight, and obesity in an individual. [<xref ref-type="bibr" rid="scirp.133508-ref3">3</xref>] . Most patients experience shortness of breath, arm, shoulder, and chest pain along with an overall feeling of weakness. These symptoms increase the risk of stroke, angina, and heart attack due to restricted or clogged blood vessels, which primarily cause the untimely death of patients [<xref ref-type="bibr" rid="scirp.133508-ref4">4</xref>] .</p><p>The World Health Organization reports that 32 percent of the 17 million deaths globally in 2019 that were related to non-communicable diseases were caused by CVDs [<xref ref-type="bibr" rid="scirp.133508-ref5">5</xref>] . More than 75 percent deaths from the CVDs occur in least-developed countries and it badly affects the mid- and low-income people [<xref ref-type="bibr" rid="scirp.133508-ref6">6</xref>] . More than four out of five CVD deaths are due to heart attacks and strokes, and one-third of these deaths occur prematurely in people under 70 years of age [<xref ref-type="bibr" rid="scirp.133508-ref7">7</xref>] . However, clinical decision-making during diagnosis and treatment is complex, and cardiologists face difficulties in detecting and treating patients in the early stages [<xref ref-type="bibr" rid="scirp.133508-ref8">8</xref>] . Early and accurate detection and diagnosis of CVDs is a must to provide appropriate treatments to the patients, which helps to prevent the premature death of the person [<xref ref-type="bibr" rid="scirp.133508-ref9">9</xref>] .</p><p>The diagnosis and treatment of CVDs rely on data in several forms, such as patient history, physical examination, laboratory data, and invasive and non-invasive imaging techniques [<xref ref-type="bibr" rid="scirp.133508-ref10">10</xref>] . Invasive imaging techniques such as cardiac catheterization and intravascular ultrasound are associated with more risk factors and require a unique hospital setting [<xref ref-type="bibr" rid="scirp.133508-ref11">11</xref>] . Angiography is more dependable among other non-invasive imaging techniques like X-ray and magnetic resonance imaging (MRI), however, it requires solid technological knowledge and has side effects [<xref ref-type="bibr" rid="scirp.133508-ref12">12</xref>] [<xref ref-type="bibr" rid="scirp.133508-ref13">13</xref>] [<xref ref-type="bibr" rid="scirp.133508-ref14">14</xref>] . Such conventional methods are time-consuming and expensive, making detecting CVDs more complicated than it needs to be. On the other hand, machine learning (ML) can solve this issue by enabling an automatic method to assess examples and draw consistent and accurate conclusions.</p><p>A higher degree of accuracy in predicting the risk of CVDs can be achieved by appropriately processing the data mined with various ML algorithms to identify patterns, trends, and relationships between distinct parameters. Classification models, for example, make it possible to design more individualized and efficient treatment plans, improving patient care [<xref ref-type="bibr" rid="scirp.133508-ref15">15</xref>] . This study examines a comparative computational approach, using supervised classification machine learning to forecast cardiovascular diseases. The research framework, outlined in <xref ref-type="fig" rid="fig1">Figure 1</xref>, progresses from basic to advanced models, including artificial neural networks (ANN). Model selection is based on performance evaluation metrics including sensitivity, precision, F1 score, accuracy, and the area under the Receiver Operating Characteristic (ROC) curve (AUC). Our work is organized into</p><p>several sections. Chapter 2 summarizes key findings from relevant literature. Chapter 3 delves into our methodology, encompassing discussions on data structure, data engineering, data visualization, and concise descriptions of the models employed. Furthermore, Chapter 4 presents the results, followed by a detailed discussion that leads to the conclusive findings in Chapter 5.</p></sec><sec id="s2"><title>2. Literature Review</title><p>Numerous studies have delved into machine learning methods for forecasting CVDs. The findings from these investigations consistently demonstrate the capability of machine learning to accurately predict CVDs. Here we review a few literature and compare the results that have been obtained using different models.</p><p>Degroat et al. [<xref ref-type="bibr" rid="scirp.133508-ref16">16</xref>] combined classical statistical methods with advanced Machine Learning (ML) algorithms to improve disease prediction in CVD patients. They proposed four feature selection algorithms: Chi-Square Test, Pearson Correlation, Recursive Feature Elimination (RFE), and Analysis of Variance (ANOVA). Using these methods, they identified 18 transcriptome biomarkers in the CVD population with up to 96% predictive accuracy. The study included 61 CVD patients and 10 healthy individuals as controls.</p><p>In a study published in 2020, Drod et al. [<xref ref-type="bibr" rid="scirp.133508-ref17">17</xref>] employed machine learning, utilizing liver ultrasonography and biochemical analysis in 191 CVD patients, revealing the association between metabolic-associated fatty liver disease (MAFLD) and CVD risk factors. They utilized techniques like principle component analysis (PCA) and logistic regression to construct a predictive model for high CVD risk, focusing on diabetes duration, plaque scores, and hypercholesterolemia. Evaluation via receiver operating characteristic (ROC) curves yielded Area Under the ROC Curve (AUCs) ranging from 0.84 to 0.87. The optimal model, utilizing five variables, accurately detected 85.11% of high-risk and 79.17% of low-risk patients. These findings emphasize ML’s utility in identifying MAFLD patients at CVD risk based on readily available patient data.</p><p>Ambekar et al.’s paper [<xref ref-type="bibr" rid="scirp.133508-ref18">18</xref>] suggested employing unimodel disease risk algorithms based on convolutional neural networks to estimate a patient’s risk level based on the heart disease dataset, i.e., high or low. They carry out data imputation and cleaning procedures to turn unstructured data into structured data. Later on, the KNN and na&#239;ve bayes algorithm is applied to the input values and heart disease is predicted based on this information. They contrast the outcomes of the KNN and Na&#239;ve Bayes algorithms, noting that NB has an accuracy of 82%, which is higher than that of the KNN algorithm. They were able to forecast disease risk with about 65% accuracy because of the organized dataset.</p><p>Larroza et al. [<xref ref-type="bibr" rid="scirp.133508-ref19">19</xref>] employed machine learning and MRI texture features to differentiate between acute myocardial infarction (AMI) and chronic myocardial infarction (CMI). Analyzing 44 cases (22 AMI, 22 CMI) with cine and late gadolinium enhancement (LGE) MRI, 279 texture features were extracted from infarcted areas on LGE and the entire myocardium on cine. Classification was performed using three prediction models: random forest, SVM with Gaussian kernel, and SVM with polynomial kernel. The study demonstrated that texture analysis when paired with machine learning, may effectively differentiate between AMI and CMI on both LGE and cine MRI. The SVM with a polynomial kernel showed the best performance, achieving AUC of 0.86 &#177; 0.06 on LGE MRI (72 features) and 0.82 &#177; 0.06 on cine MRI (75 features).</p><p>Oyewola et al. [<xref ref-type="bibr" rid="scirp.133508-ref20">20</xref>] compare different algorithms between long short-term memory (LSTM), feedforward neural network (FFNN), cascade forward neural network (CFNN), Elman Neural Network (ELMAN), and ensemble deep learning (EDL) to predict the best model using the Kaggle cardiovascular dataset with 12 attributes and 70,000 patients. The EDL model surpasses other algorithms with an incredible 98.45% accuracy. After more investigation, EDL’s 100% classification accuracy for CVD diagnosis was shown to exceed LSTM, FFNN, CFNN, and ELMAN. Overall, the study suggests that EDL model could be a robust tool for the early detection of CVDs.</p><p>Alaa et al. [<xref ref-type="bibr" rid="scirp.133508-ref21">21</xref>] analyzed 437 characteristics of 423,604 individuals in the UK Biobank who did not have CVDs at baseline. The AutoPrognosis model outperformed established techniques such as the Framingham score area under the receiver operating characteristic curve (AUCROC: 0.724, 95%), Cox proportional hazards models with conventional risk factors (AUCROC: 0.734, 95%), and Cox proportional hazards with all UK Biobank variables (AUCROC: 0.758, 95%) in terms of risk prediction (AUCROC: 0.774, 95%). AutoPrognosis correctly identified 368 more occurrences of CVDs after 5 years than the Framingham score. They also emphasized how the addition of more risk variables outweighed than use of complex models.</p></sec><sec id="s3"><title>3. Methodology</title><sec id="s3_1"><title>3.1. Data Engineering</title><p>The dataset analyzed in this study was sourced from the renowned data science community, Kaggle, specifically identified as the cardiovascular risk prediction dataset within Kaggle’s repository. This dataset comes from the Behavioral Risk Factor Surveillance System (BRFSS), which is known as the nation’s top system for health-related telephone surveys. It contains a thorough collection of health-related information. Comprising 19 carefully selected variables and spanning 308,854 rows, the dataset encapsulates various aspects of an individual’s lifestyle that may contribute to their susceptibility to cardiovascular diseases. Through meticulous curation and analysis, this dataset offers valuable insights into the intricate interplay between lifestyle factors and cardiovascular health, facilitating informed decision-making and intervention strategies in public health initiatives.</p><p>The dataset contained 19 variables, with 12 being categorical and the rest being of float or integer type. Some of the categorical columns included lengthy string names such as green vegetable consumption or Fried potato consumption, which could be challenging to handle. Therefore, we opted to convert them into a more precise format using the renaming feature in pandas.</p><p>To enhance data clarity, we have restructured some features in our dataset. One significant change is seen in the Body Mass Index (BMI) and Age categories. Initially, BMI was represented as individual values but is now categorized into standard groups. Similarly, Age, initially in-class format, has been transformed into categories for better understanding. The rationale behind this modification, elucidated in detail in <xref ref-type="table" rid="table1">Table 1</xref>, facilitates clearer communication.</p></sec><sec id="s3_2"><title>3.2. Data Visualization</title><p>Our scope encompasses not merely the focus on model performance, but also the illumination of critical insights extracted from our data analysis through visualization techniques. Employing methods such as heat map visualization, we try to understand the important connection between heart disease and key features. In the subsequent analysis, we present various variables with instances of heart disease, elucidating their significance and implications.</p><table-wrap id="table1" ><label><xref ref-type="table" rid="table1">Table 1</xref></label><caption><title> Categories of age and BMI</title></caption><table><tbody><thead><tr><th align="center" valign="middle"  colspan="2"  >BMI Index</th><th align="center" valign="middle"  colspan="2"  >Age category</th></tr></thead><tr><td align="center" valign="middle" >BMI Index range</td><td align="center" valign="middle" >BMI category</td><td align="center" valign="middle" >Age class</td><td align="center" valign="middle" >Age category</td></tr><tr><td align="center" valign="middle" >12.02 - 18.5</td><td align="center" valign="middle" >Under weight</td><td align="center" valign="middle" >18 - 24</td><td align="center" valign="middle" >Young</td></tr><tr><td align="center" valign="middle" >18.5 - 25</td><td align="center" valign="middle" >healthy weight</td><td align="center" valign="middle" >25 - 39</td><td align="center" valign="middle" >Adult</td></tr><tr><td align="center" valign="middle" >25 - 30</td><td align="center" valign="middle" >Over weight</td><td align="center" valign="middle" >40 - 54</td><td align="center" valign="middle" >Mid-aged</td></tr><tr><td align="center" valign="middle" >30 - 35</td><td align="center" valign="middle" >Obese-I</td><td align="center" valign="middle" >55 - 64</td><td align="center" valign="middle" >Senior-Adult</td></tr><tr><td align="center" valign="middle" >35 - 40</td><td align="center" valign="middle" >Obese-II</td><td align="center" valign="middle" >65 - 79</td><td align="center" valign="middle" >Elderly</td></tr><tr><td align="center" valign="middle" >40 above</td><td align="center" valign="middle" >severe Obesity</td><td align="center" valign="middle" >80+</td><td align="center" valign="middle" >Elderly</td></tr></tbody></table></table-wrap><p>In <xref ref-type="fig" rid="fig2">Figure 2</xref>, we have highlighted some important factors closely tied to heart disease using histograms. <xref ref-type="fig" rid="fig2">Figure 2</xref>(a), shows how heart disease relates to people’s body weights. For example, among those with a healthy weight (BMI: 18.5 - 25), only about 6% have heart disease. But among those categorized as overweight or obese, the rates are higher: around 15% for overweight, 22% for moderately obese, and approximately 25% for severely obese individuals. For the corresponding BMI ranges please refer to <xref ref-type="table" rid="table1">Table 1</xref>.</p><p>In addition, <xref ref-type="fig" rid="fig2">Figure 2</xref>(b) elucidates the relationship between smoking and the prevalence of cardiovascular disease. In terms of percentage, heart disease affects approximately 11.6% of smokers while it affects only 5.6% of non-smokers. This clearly indicates that smokers are more likely to get affected by heart disease. <xref ref-type="fig" rid="fig2">Figure 2</xref>(c) and <xref ref-type="fig" rid="fig2">Figure 2</xref>(d), show that individuals with diabetes and arthritis are more susceptible to heart disease on their own. Based on statistical data, around 20.85% of individuals with diabetes have heart disease, whereas only 6.06% of non-diabetics have the condition. Furthermore, an examination of the arthritis data shows that 14.09% of those with arthritis also had heart disease, compared to 5.43% of those without arthritis.</p><p><xref ref-type="fig" rid="fig3">Figure 3</xref> illustrates the crucial role of regular exercise and checkups in mitigating the risk of heart disease. In <xref ref-type="fig" rid="fig3">Figure 3</xref>(a), we observe a comparison of heart disease cases relative to regular exercise habits. The data indicates that 8% of individuals who do not engage in regular exercise are afflicted with heart disease, compared to only 3% among those who exercise regularly. Similarly, in <xref ref-type="fig" rid="fig3">Figure 3</xref>(b), we analyze heart disease cases in relation to regular checkup habits. The findings suggest that individuals who undergo regular checkups are at a lower risk of developing heart disease compared to those who schedule checkups every two years, every five years, or never. These insights underscore the significance of maintaining both a regular exercise routine and a consistent checkup schedule in reducing the likelihood of heart disease or facilitating early detection.</p></sec><sec id="s3_3"><title>3.3. Used Models</title><p>This study employs four supervised machine learning algorithms and one deep learning algorithm for training, validating, and testing the dataset. Below, we provide a brief overview of each model used.</p><sec id="s3_3_1"><title>3.3.1. Logistic Regression</title><p>The method of modeling the probability of a discrete result given input variables is known as logistic regression. The most frequent logistic regression models include a binary result, which can accept two values like true/false, yes/no scenarios. Multinomial logistic regression can be used to model events with more than two discrete outcomes. Despite its name, logistic regression is a classification model rather than a regression model. For binary and linear classification problems, logistic regression is a simpler and more efficient method [<xref ref-type="bibr" rid="scirp.133508-ref22">22</xref>] . Furthermore, logistic regression, unlike linear regression, does not require a linear connection between input and output variables [<xref ref-type="bibr" rid="scirp.133508-ref23">23</xref>] . In logistic regression, the goal is to model the probability that a given instance belongs to a particular class (positive or negative). The logistic regression model uses a linear combination of input features, transformed by a sigmoid function. The linear combination is represented as:</p><p>z = b 0 + b 1 ⋅ x 1 + b 2 ⋅ x 2 + ⋯ + b k ⋅ x k (1)</p><p>where b 0 is the bias term and b 1 , b 2 , ⋯ , b k are the coefficients associated with the features x 1 , x 2 , ⋯ , x k . The probability of belonging to the positive or negative class is then given by the sigmoid function:</p><p>P ( Y = 1 ) = 1 1 + e − z (2)</p><p>The logistic regression model predicts the class based on whether the probability is above a certain threshold (typically 0.5) [<xref ref-type="bibr" rid="scirp.133508-ref22">22</xref>] .</p></sec><sec id="s3_3_2"><title>3.3.2. Decision Tree</title><p>A well-known machine learning technique called a decision tree divides data into multiple groups according to predetermined criteria. Nodes and leaves are the two navigable components of the tree. Decision nodes divide data, whereas leaves represent choices or results. Combining decision trees with other techniques can help solve problems (ensemble learning). Using fundamental decision rules generated from data properties, the objective is to construct a model that predicts the value of a target variable. A piecewise constant approximation can be seen in a decision tree [<xref ref-type="bibr" rid="scirp.133508-ref24">24</xref>] [<xref ref-type="bibr" rid="scirp.133508-ref25">25</xref>] . Assume that samples with quantities for the categorical attribute “A” that have “n” different potential values make up training dataset “D”. The parameter and information obtained for attribute “A” can be obtained using the following formula:</p><p>G a i n ( A , D ) = E n t r o p y ( D ) − ∑ i = 1 n | D i | | D | ⋅ E n t r o p y ( D i ) (3)</p><p>Here, D i represents the subset of instances in D where attribute A has the i-th value. | D i | is the number of instances in D i . E n t r o p y ( D ) is the entropy of the dataset D. E n t r o p y ( D i ) is the entropy of the i-th subset D i [<xref ref-type="bibr" rid="scirp.133508-ref26">26</xref>] .</p></sec><sec id="s3_3_3"><title>3.3.3. Random Forest</title><p>Random forest is a popular machine learning technique that combines the output of numerous decision trees to produce a single conclusion. Its ease of use and flexibility, as well as its ability to tackle classification and regression challenges, has boosted its popularity [<xref ref-type="bibr" rid="scirp.133508-ref26">26</xref>] [<xref ref-type="bibr" rid="scirp.133508-ref27">27</xref>] . The random forest algorithm is a bagging method extension that uses both bagging and feature randomness to produce an uncorrelated forest of decision trees. The forecast determination will differ depending on the type of difficulty. Individual decision trees will be averaged for a regression task, and a majority vote—i.e. the most common categorical variable—will produce the predicted class for a classification problem. Finally, the odd sample is used for cross-validation, which completes the prediction [<xref ref-type="bibr" rid="scirp.133508-ref23">23</xref>] . In order to minimize overfitting and enhance the model’s capacity for generalization, randomization is incorporated into the feature selection process as well as the data selection process. The Random Forest technique is made more effective overall by the Gini impurity, which is used as a criterion for dividing nodes in the decision trees. The Gini impurity for a set with n classes is calculated using the formula:</p><p>Gini = 1 − ∑ i = 1 n ( p i ) 2 (4)</p><p>where p i is the probability of an object being classified into the i-th class. In the context of decision trees and random forests, gini impurity is used as a criterion to evaluate the purity of a node. The algorithm aims to split nodes in a way that minimizes the gini impurity [<xref ref-type="bibr" rid="scirp.133508-ref26">26</xref>] [<xref ref-type="bibr" rid="scirp.133508-ref27">27</xref>] .</p></sec><sec id="s3_3_4"><title>3.3.4. Extreme Gradient Boosting</title><p>Extreme gradient boosting (XGBoost) is a type of ensemble machine learning method that may be used to solve predictive modeling tasks like classification and regression. It is extremely effective as well as computationally efficient [<xref ref-type="bibr" rid="scirp.133508-ref28">28</xref>] . Using an ensemble approach called “boosting,” errors produced by previous models are corrected by adding new models. To minimize the loss when adding new models, it makes use of a gradient descent approach [<xref ref-type="bibr" rid="scirp.133508-ref29">29</xref>] . Consider a dataset ( X i , Y i ) having M features and N records. T predict the best output Y ^ , we need the best set of function to minimize the overall loss such that,</p><p>l ( ϕ ) = ∑ i     L ( Y i , Y ^ i ) + ∑ k     Ω ( f k ) (5)</p><p>The loss function, denoted by L ( Y i , Y ^ i ) , is the difference between the actual output ( Y i ) and the projected output Y ^ i . Where ∑ k     Ω ( f k ) indicates the complexity of the model, this helps prevent the model from being overfit [<xref ref-type="bibr" rid="scirp.133508-ref30">30</xref>] .</p></sec><sec id="s3_3_5"><title>3.3.5. Sequential Model</title><p>A sequential model is a fundamental type of model used to construct neural networks layer by layer, following a sequential order. In this project, a sequential model is composed of several layers interconnected within the widely-used deep learning framework, Keras. Deep learning, a subset of machine learning, utilizes artificial neural networks (ANNs) which are computer algorithms inspired by the biological functioning of the human brain in processing information. Instead of learning through programming, ANNs are trained through experience by looking for patterns and relationships in data [<xref ref-type="bibr" rid="scirp.133508-ref31">31</xref>] [<xref ref-type="bibr" rid="scirp.133508-ref32">32</xref>] . <xref ref-type="fig" rid="fig4">Figure 4</xref> displays the model’s flow. The dense layer, which is the fully connected layer, receives the characteristics, activates using Relu function and passes it forward. Other dense layer gives the output with the help of sigmoid activation function [<xref ref-type="bibr" rid="scirp.133508-ref33">33</xref>] .</p></sec></sec><sec id="s3_4"><title>3.4. Hyper-Parameter Tuning</title><p>In this study, we did not explicitly tune or use any specific hyperparameters for machine-learning models except for deep learning. The deep learning sequential model underwent careful tuning for optimal performance. This included setting the learning rate to 0.001 for the Adam optimizer, utilizing a first Dense layer with 256 neurons and a rectified linear unit (ReLU) activation function, and employing a sigmoid activation function in the output layer for classification tasks. Additionally, we implemented an early stopping mechanism with a patience of 3 epochs, monitoring validation loss and restoring the best weights when training stops, ensuring the model’s robustness and generalization ability.</p></sec><sec id="s3_5"><title>3.5. Model Evaluation</title><p>We assess the developed machine learning model using performance metrics like precision, recall, F1 score, accuracy, ROC curve and AUC. Additionally, we evaluate the deep learning model for predicting cardiovascular disease based on accuracy and loss curves. The essential criteria for evaluating machine learning models are derived from the components of the confusion matrix. <xref ref-type="table" rid="table2">Table 2</xref> outlines the analytical structure of a confusion matrix.</p><table-wrap id="table2" ><label><xref ref-type="table" rid="table2">Table 2</xref></label><caption><title> Confusion matrix for the evaluation of machine learning models</title></caption><table><tbody><thead><tr><th align="center" valign="middle"  colspan="3"  >Confusion Matrix</th></tr></thead><tr><td align="center" valign="middle" ></td><td align="center" valign="middle" >Actual positive</td><td align="center" valign="middle" >Actual negative</td></tr><tr><td align="center" valign="middle" >Predictive positive</td><td align="center" valign="middle" >True positive (TP)</td><td align="center" valign="middle" >False positive (FP)</td></tr><tr><td align="center" valign="middle" >Predictive negative</td><td align="center" valign="middle" >False negative (FN)</td><td align="center" valign="middle" >True negative (TN)</td></tr></tbody></table></table-wrap><p>The precision, recall (sensitivity) and F1 scores are calculated with the help of confusion matrix using following mathematical expressions:</p><p>Precision = TP TP + FP (6)</p><p>Recall = TP TP + FN (7)</p><p>F1   score = 2 ∗ Precision ∗ Recall Precision + Recall (8)</p><p>And, the accuracy is the percentage of cases that are correctly anticipated (forecasted negative for patients without CVD and correctly predicted positive for individuals with CVD) and is mathematically represented as,</p><p>Accuracy = TP + TN TP + TN + FP + FN (9)</p><p>Along with this, model’s performance is measured with the help of AUC. Its value is in the range of 0 and 1. If a model’s AUC is near to 1, it is considered good. The model is better if the AUC is greater, and vice versa.</p><p>As previously stated, the deep learning sequential model is validated using accuracy and loss curve. Out of all the cases, the percentage of correctly categorized instances by the model is known as accuracy. Consequently, the accuracy curve enhances the model’s capacity to produce precise predictions by providing insight into how well the model matches the data. The loss curve, on the other hand, measures the inaccuracy or dissimilarity between the model’s anticipated output and the true parameter and provides us with information about how the model performs over time. The loss shows how much the actual values deviate from the model’s predictions. The model attempts to approximate the true values as closely as possible by minimizing the loss. Thus, the loss curve illustrates how the model’s inaccuracy diminishes with learning, signifying a boost in its overall effectiveness.</p></sec></sec><sec id="s4"><title>4. Results and Discussion</title><p>The study employed various performance metrics including precision, recall, accuracy, F1 score, ROC curve and AUC to evaluate the effectiveness of four ML classifiers: logistic regression, random forest (RF), decision tree, and XGBoost. The dataset underwent a 70 - 30 split for training and testing, respectively, to identify cardiovascular disease presence.</p><p>Results showcased that the RF algorithm achieved the highest cross-validation accuracy of 0.91, with notable precision, recall, and F1 score of 0.90, 0.92, and 0.91, respectively, for predicting negative results (0—absence of cardiovascular disease). Furthermore, for positive results (1—presence of cardiovascular disease), the RF model demonstrated a precision, recall, and F1 score of 0.90, 0.92, and 0.91, respectively (<xref ref-type="table" rid="table3">Table 3</xref>). Similarly, the XGBoost, decision tree, and logistic regression algorithms produced accuracies of 0.90, 0.86, and 0.70, with corresponding precision, recall, and F1 score ranges as follows; XGBoost: (0.89, 0.91), (0.91, 0.89), (0.90, 0.90), Decision tree: (0.88, 0.85), (0.84, 0.89), (0.86, 0.87), Logistic regression: (0.69, 0.70), (0.72, 0.67), (0.70, 0.69). The AUC curve (<xref ref-type="fig" rid="fig5">Figure 5</xref>) displayed that RF had the highest AUC score of 0.91, followed by XGBoost at 0.89, while decision tree and logistic regression scored 0.86 and 0.70, respectively.</p><p>Transitioning to the deep learning sequential model, it demonstrated superior accuracy and loss on both training (accuracy: 0.8113, loss: 0.4149) and validation sets (accuracy: 0.8142, loss: 0.4100) before early stopping at the 15th epoch. The learning curve for this model is depicted in <xref ref-type="fig" rid="fig6">Figure 6</xref>.</p><p>Comparing to Lupague et al.’s findings on the same data in 2023 using logistic regression, they achieved accuracies of 79.18% for CVDs classification and 73.46% for healthy individuals, with an AUC value of 0.837. However, our study obtained an AUC score of 0.70, possibly due to different hyperparameters. Nonetheless, RF outperformed both, our other models and earlier studies mentioned.</p><table-wrap id="table3" ><label><xref ref-type="table" rid="table3">Table 3</xref></label><caption><title> Evaluation matrix</title></caption><table><tbody><thead><tr><th align="center" valign="middle" >ML Models</th><th align="center" valign="middle" >Precision (0, 1)</th><th align="center" valign="middle" >Recall (0, 1)</th><th align="center" valign="middle" >F1-Score (0, 1)</th><th align="center" valign="middle" >Accuracy</th></tr></thead><tr><td align="center" valign="middle" >Logistic Regression</td><td align="center" valign="middle" >0.69/0.70</td><td align="center" valign="middle" >0.72/0.67</td><td align="center" valign="middle" >0.70/0.69</td><td align="center" valign="middle" >0.70</td></tr><tr><td align="center" valign="middle" >Decision Tree</td><td align="center" valign="middle" >0.88/0.85</td><td align="center" valign="middle" >0.84/0.89</td><td align="center" valign="middle" >0.86/0.87</td><td align="center" valign="middle" >0.86</td></tr><tr><td align="center" valign="middle" >Random Forest Classifier</td><td align="center" valign="middle" >0.92/0.90</td><td align="center" valign="middle" >0.90/0.92</td><td align="center" valign="middle" >0.91/0.91</td><td align="center" valign="middle" >0.91</td></tr><tr><td align="center" valign="middle" >XGBoost</td><td align="center" valign="middle" >0.89/0.91</td><td align="center" valign="middle" >0.91/0.89</td><td align="center" valign="middle" >0.90/0.90</td><td align="center" valign="middle" >0.90</td></tr></tbody></table></table-wrap></sec><sec id="s5"><title>5. Conclusions</title><p>In this study, we tackled the urgent global health challenge posed by CVDs, aggravated by behavioral risk factors like poor diet, physical inactivity, and substance use. Early detection of CVDs is critical for effective intervention and averting premature mortality. Leveraging a repertoire of machine learning and deep learning techniques, including logistic regression, decision trees, random forest classifier, XGBoost, and a sequential model, our objective was to devise a robust method for early diagnosis using data from the BRFSS program. Our investigation unveiled the RF classifier as the standout performer, boasting an impressive accuracy of 0.91, surpassing alternative machine learning and deep learning methodologies. Following closely were XGBoost (accuracy: 0.90), decision tree (accuracy: 0.86), and logistic regression (accuracy: 0.70). Furthermore, our deep learning sequential model exhibited promising classification performance, recording an accuracy of 0.80 and a loss of 0.425 on the validation set.</p><p>These findings underscore the potency of machine learning and deep learning approaches in bolstering cardiovascular disease prediction and management strategies. By harnessing publicly available datasets and employing advanced computational methodologies, we are positioned to make significant strides in improving public health outcomes and combating the scourge of cardiovascular disease.</p></sec><sec id="s6"><title>Conflicts of Interest</title><p>The authors declare no conflicts of interest regarding the publication of this paper.</p></sec><sec id="s7"><title>Cite this paper</title><p>Gaire, S., Belbase, P., Kafle, A. and Bhandari, R. (2024) Advanced Computing for Cardiovascular Disease Prediction. Open Journal of Statistics, 14, 228-242. https://doi.org/10.4236/ojs.2024.143011</p></sec></body><back><ref-list><title>References</title><ref id="scirp.133508-ref1"><label>1</label><mixed-citation publication-type="other" xlink:type="simple">Du, X., Su, X., Zhang, W., Yi, S., Zhang, G., Jiang, S., Li, H., Li, S. and Xia, F. (2021) Progress, Opportunities, and Challenges of Troponin Analysis in the Early Diagnosis of Cardiovascular Diseases. &lt;i&gt;Analytical Chemistry&lt;/i&gt;, 94, 442-463. &lt;br&gt;https://doi.org/10.1021/acs.analchem.1c04476</mixed-citation></ref><ref id="scirp.133508-ref2"><label>2</label><mixed-citation publication-type="other" xlink:type="simple">Fern&amp;#225;ndez-Ruiz, I. (2019) Artificial Intelligence to Improve the Diagnosis of Cardiovascular Diseases. &lt;i&gt;Nature Reviews Cardiology&lt;/i&gt;, 16, Article No. 133. &lt;br&gt;https://doi.org/10.1038/s41569-019-0158-5</mixed-citation></ref><ref id="scirp.133508-ref3"><label>3</label><mixed-citation publication-type="other" xlink:type="simple">Cercato, C. and Fonseca, F.A. (2019) Cardiovascular Risk and Obesity. &lt;i&gt;Diabetology&lt;/i&gt;&lt;i&gt; &amp; Metabolic Syndrome&lt;/i&gt;, 11, Article No. 74. &lt;br&gt;https://doi.org/10.1186/s13098-019-0468-0</mixed-citation></ref><ref id="scirp.133508-ref4"><label>4</label><mixed-citation publication-type="other" xlink:type="simple">Dalal, S., Goel, P., Onyema, E., Alharbi, A., Mahmoud, A., Algarni, M. and Awal, H. (2023) Application of Machine Learning for Cardiovascular Disease Risk Prediction. &lt;i&gt;Computational Intelligence and Neuroscience&lt;/i&gt;, 2023, Article ID: 9418666. &lt;br&gt;https://doi.org/10.1155/2023/9418666</mixed-citation></ref><ref id="scirp.133508-ref5"><label>5</label><mixed-citation publication-type="other" xlink:type="simple">Pal, M., Parija, S., Panda, G., Dhama, K. and Mohapatra, R. (2022) Risk Prediction of Cardiovascular Disease Using Machine Learning Classifiers. &lt;i&gt;Open Medicine&lt;/i&gt;, 17, 1100-1113. &lt;br&gt;https://doi.org/10.1515/med-2022-0508</mixed-citation></ref><ref id="scirp.133508-ref6"><label>6</label><mixed-citation publication-type="book" xlink:type="simple">Awuah, R., Afrifa-Anane, E. and Agyemang, C. (2015) Cardiovascular Diseases and Established Risk Factors in Low-and Middle-Income Countries. In: de Graft Aikins, A. and Agyemang, C., Eds., &lt;i&gt;Chronic Non-Communicable Diseases in Low&lt;/i&gt; &lt;i&gt;and&lt;/i&gt; &lt;i&gt;Middle&lt;/i&gt;-&lt;i&gt;Income Countries&lt;/i&gt;, CABI Digital Library, Wallingford, 1-13. &lt;br&gt;https://doi.org/10.1079/9781780643328.0001</mixed-citation></ref><ref id="scirp.133508-ref7"><label>7</label><mixed-citation publication-type="other" xlink:type="simple">Hasani, W., Muhamad, N., Hanis, T., Maamor, N., Chen, X., Omar, M., Cheng Kueh, Y., Abd Karim, Z., Hassan, M. and Musa, K. (2023) The Global Estimate of Premature Cardiovascular Mortality: A Systematic Review and Meta-Analysis of Age-Standardized Mortality Rate. &lt;i&gt;BMC Public Health&lt;/i&gt;, 23, Article No. 1561. &lt;br&gt;https://doi.org/10.1186/s12889-023-16466-1</mixed-citation></ref><ref id="scirp.133508-ref8"><label>8</label><mixed-citation publication-type="other" xlink:type="simple">Itchhaporia, D. (2022) Artificial Intelligence in Cardiology. &lt;i&gt;Trends in Cardiovasc&lt;/i&gt;&lt;i&gt;u&lt;/i&gt;&lt;i&gt;lar Medicine&lt;/i&gt;, 32, 34-41. &lt;br&gt;https://doi.org/10.1016/j.tcm.2020.11.007</mixed-citation></ref><ref id="scirp.133508-ref9"><label>9</label><mixed-citation publication-type="other" xlink:type="simple">Mathur, P., Srivastava, S., Xu, X. and Mehta, J. (2020) Artificial Intelligence, Machine Learning, and Cardiovascular Disease. &lt;i&gt;Clinical Medicine Insights: Cardiology&lt;/i&gt;, 14. &lt;br&gt;https://doi.org/10.1177/1179546820927404</mixed-citation></ref><ref id="scirp.133508-ref10"><label>10</label><mixed-citation publication-type="other" xlink:type="simple">Muhammad, Y., Tahir, M., Hayat, M. and Chong, K. (2020) Early and Accurate Detection and Diagnosis of Heart Disease Using Intelligent Computational Model. &lt;i&gt;Scientific Reports&lt;/i&gt;, 10, Article No. 19747. &lt;br&gt;https://doi.org/10.1038/s41598-020-76635-9</mixed-citation></ref><ref id="scirp.133508-ref11"><label>11</label><mixed-citation publication-type="other" xlink:type="simple">Regar, E. (2011) Invasive Imaging Technologies: Can We Reconcile Light and Sound? &lt;i&gt;Journal of Cardiovascular Medicine&lt;/i&gt;, 12, 562-570. &lt;br&gt;https://doi.org/10.2459/JCM.0b013e3283492b5a</mixed-citation></ref><ref id="scirp.133508-ref12"><label>12</label><mixed-citation publication-type="other" xlink:type="simple">Groepenhoff, F., Klaassen, R., Valstar, G., Bots, S., Onland-Moret, N., Den Ruijter, H., Leiner, T. and Eikendal, A. (2021) Evaluation of Non-Invasive Imaging Parameters in Coronary Microvascular Disease: A Systematic Review. &lt;i&gt;BMC Medical Imaging&lt;/i&gt;, 21, Article No. 5. &lt;br&gt;https://doi.org/10.1186/s12880-020-00535-7</mixed-citation></ref><ref id="scirp.133508-ref13"><label>13</label><mixed-citation publication-type="other" xlink:type="simple">Karatzia, L., Aung, N. and Aksentijevic, D. (2022) Artificial Intelligence in Cardiology: Hope for the Future and Power for the Present. &lt;i&gt;Frontiers in Cardiovascular Medicine&lt;/i&gt;, 9, Article 945726. &lt;br&gt;https://doi.org/10.3389/fcvm.2022.945726</mixed-citation></ref><ref id="scirp.133508-ref14"><label>14</label><mixed-citation publication-type="other" xlink:type="simple">Chattu, V. (2021) A Review of Artificial Intelligence, Big Data, and Blockchain Technology Applications in Medicine and Global Health. &lt;i&gt;Big Data and Cognitive Computing&lt;/i&gt;, 5, Article 41. &lt;br&gt;https://doi.org/10.3390/bdcc5030041</mixed-citation></ref><ref id="scirp.133508-ref15"><label>15</label><mixed-citation publication-type="other" xlink:type="simple">Ahmed, Z., Mohamed, K., Zeeshan, S. and Dong, X. (2020) Artificial Intelligence with Multi-Functional Machine Learning Platform Development for Better Healthcare and Precision Medicine. &lt;i&gt;Database&lt;/i&gt;, 2020, baaa010. &lt;br&gt;https://doi.org/10.1093/database/baaa010</mixed-citation></ref><ref id="scirp.133508-ref16"><label>16</label><mixed-citation publication-type="other" xlink:type="simple">DeGroat, W., Abdelhalim, H., Patel, K., Mendhe, D., Zeeshan, S. and Ahmed, Z. (2024) Discovering Biomarkers Associated and Predicting Cardiovascular Disease with High Accuracy Using a Novel Nexus of Machine Learning Techniques for Precision Medicine. &lt;i&gt;Scientific Reports&lt;/i&gt;, 14, Article No. 1. &lt;br&gt;https://doi.org/10.1038/s41598-023-50600-8</mixed-citation></ref><ref id="scirp.133508-ref17"><label>17</label><mixed-citation publication-type="other" xlink:type="simple">Dro&amp;#380;d&amp;#380;, K., Nabrdalik, K., Kwiendacz, H., Hendel, M., Olejarz, A., Tomasik, A., Bartman, W., Nalepa, J., Gumprecht, J. and Lip, G. (2022) Risk Factors for Cardiovascular Disease in Patients with Metabolic-Associated Fatty Liver Disease: A Machine Learning Approach. &lt;i&gt;Cardiovascular &lt;/i&gt;&lt;i&gt;Diabetology&lt;/i&gt;, 21, Article No. 240. &lt;br&gt;https://doi.org/10.1186/s12933-022-01672-9</mixed-citation></ref><ref id="scirp.133508-ref18"><label>18</label><mixed-citation publication-type="other" xlink:type="simple">Ambekar, S. and Phalnikar, R. (2018) Disease Risk Prediction by Using Convolutional Neural Network. 2018&lt;i&gt; Fourth International Conference on Computing Communication Control and Automation &lt;/i&gt;(&lt;i&gt;ICCUBEA&lt;/i&gt;), Pune, 16-18 August 2018, 1-5. &lt;br&gt;https://doi.org/10.1109/ICCUBEA.2018.8697423</mixed-citation></ref><ref id="scirp.133508-ref19"><label>19</label><mixed-citation publication-type="other" xlink:type="simple">Larroza, A., Materka, A., L&amp;#243;pez-Lereu, M.P., Monmeneu, J.V., Bod&amp;#237;and, V. and Moratal, D. (2017) Differentiation between Acute and Chronic Myocardial Infarction by Means of Texture Analysis of Late Gadolinium Enhancement and Cine Cardiac Magnetic Resonance Imaging. &lt;i&gt;European Journal of Radiology&lt;/i&gt;, 92, 78-83. &lt;br&gt;https://doi.org/10.1016/j.ejrad.2017.04.024</mixed-citation></ref><ref id="scirp.133508-ref20"><label>20</label><mixed-citation publication-type="other" xlink:type="simple">Oyewola, D., Dada, E. and Misra, S. (2024) Diagnosis of Cardiovascular Diseases by Ensemble Optimization Deep Learning Techniques. &lt;i&gt;International Journal of &lt;/i&gt;&lt;i&gt;Healthcare Information Systems and Informatics&lt;/i&gt;. 19, 1-21. &lt;br&gt;https://doi.org/10.4018/IJHISI.334021</mixed-citation></ref><ref id="scirp.133508-ref21"><label>21</label><mixed-citation publication-type="other" xlink:type="simple">Alaa, A., Bolton, T., Di Angelantonio, E., Rudd, J. and Schaar, M. (2019) Cardiovascular Disease Risk Prediction Using Automated Machine Learning: A Prospective Study of 423,604 UK Biobank Participants. &lt;i&gt;PLOS ONE&lt;/i&gt;, 14, e0213653. &lt;br&gt;https://doi.org/10.1371/journal.pone.0213653</mixed-citation></ref><ref id="scirp.133508-ref22"><label>22</label><mixed-citation publication-type="other" xlink:type="simple">Musa, A. (2013) Comparative Study on Classification Performance between Support Vector Machine and Logistic Regression. &lt;i&gt;International Journal of Machine Lear&lt;/i&gt;&lt;i&gt;n&lt;/i&gt;&lt;i&gt;ing and Cybernetics&lt;/i&gt;, 4, 13-24. &lt;br&gt;https://doi.org/10.1007/s13042-012-0068-x</mixed-citation></ref><ref id="scirp.133508-ref23"><label>23</label><mixed-citation publication-type="other" xlink:type="simple">Nashif, S., Raihan, M., Islam, M. and Imam, M. (2018) Heart Disease Detection by Using Machine Learning Algorithms and a Real-Time Cardiovascular Health Monitoring System. &lt;i&gt;World Journal of Engineering and Technology&lt;/i&gt;, 6, 854-873. &lt;br&gt;https://doi.org/10.4236/wjet.2018.64057</mixed-citation></ref><ref id="scirp.133508-ref24"><label>24</label><mixed-citation publication-type="other" xlink:type="simple">Baghdadi, N., Farghaly Abdelaliem, S., Malki, A., Gad, I., Ewis, A. and Atlam, E. (2023) Advanced Machine Learning Techniques for Cardiovascular Disease Early Detection and Diagnosis. &lt;i&gt;Journal of Big Data&lt;/i&gt;, 10, Article No. 144. &lt;br&gt;https://doi.org/10.1186/s40537-023-00817-1</mixed-citation></ref><ref id="scirp.133508-ref25"><label>25</label><mixed-citation publication-type="book" xlink:type="simple">Kecman, V. (2005) Support Vector Machines&amp;#8212;An Introduction. In: Wang, L., Ed., &lt;i&gt;Support Vector Machines&lt;/i&gt;:&lt;i&gt; Theory and Applications&lt;/i&gt;, Springer, Berlin, 1-47. &lt;br&gt;https://doi.org/10.1007/10984697_1</mixed-citation></ref><ref id="scirp.133508-ref26"><label>26</label><mixed-citation publication-type="other" xlink:type="simple">Uddin, K., Ripa, R., Yeasmin, N., Biswas, N. and Dey, S. (2023) Machine Learning-Based Approach to the Diagnosis of Cardiovascular Vascular Disease Using a Combined Dataset. &lt;i&gt;Intelligence-Based Medicine&lt;/i&gt;, 7, Article 100100. &lt;br&gt;https://doi.org/10.1016/j.ibmed.2023.100100</mixed-citation></ref><ref id="scirp.133508-ref27"><label>27</label><mixed-citation publication-type="other" xlink:type="simple">Pal, M. and Parija, S. (2021) Prediction of Heart Diseases Using Random Forest. &lt;i&gt;Journal of Physics&lt;/i&gt;:&lt;i&gt; Conference Series&lt;/i&gt;, 1817, Article 012009. &lt;br&gt;https://doi.org/10.1088/1742-6596/1817/1/012009</mixed-citation></ref><ref id="scirp.133508-ref28"><label>28</label><mixed-citation publication-type="other" xlink:type="simple">Chen, T. and Guestrin, C. (2016) XGBoost: A Scalable Tree Boosting System. &lt;i&gt;Pr&lt;/i&gt;&lt;i&gt;o&lt;/i&gt;&lt;i&gt;ceedings of the &lt;/i&gt;22&lt;i&gt;nd ACM&lt;/i&gt;&lt;i&gt; &lt;/i&gt;&lt;i&gt;SIGKDD International Conference on Knowledge Di&lt;/i&gt;&lt;i&gt;s&lt;/i&gt;&lt;i&gt;covery and Data Mining&lt;/i&gt;, San Francisco, 13-17 August 2016, 785-794. &lt;br&gt;https://doi.org/10.1145/2939672.2939785</mixed-citation></ref><ref id="scirp.133508-ref29"><label>29</label><mixed-citation publication-type="other" xlink:type="simple">Ogunleye, A. and Wang, Q. (2019) XGBoost Model for Chronic Kidney Disease Diagnosis. &lt;i&gt;IEEE/ACM Transactions on Computational Biology and Bioinformatics&lt;/i&gt;, 17, 2131-2140. &lt;br&gt;https://doi.org/10.1109/TCBB.2019.2911071</mixed-citation></ref><ref id="scirp.133508-ref30"><label>30</label><mixed-citation publication-type="other" xlink:type="simple">Osman, A., Ahmed, A., Chow, M., Huang, Y. and El-Shafie, A. (2021) Extreme Gradient Boosting (Xgboost) Model to Predict the Groundwater Levels in Selangor Malaysia. &lt;i&gt;Ain&lt;/i&gt;&lt;i&gt; Shams Engineering Journal&lt;/i&gt;, 12, 1545-1556. &lt;br&gt;https://doi.org/10.1016/j.asej.2020.11.011</mixed-citation></ref><ref id="scirp.133508-ref31"><label>31</label><mixed-citation publication-type="other" xlink:type="simple">Agatonovic-Kustrin, S. and Beresford, R. (2000) Basic Concepts of Artificial Neural Network (ANN) Modeling and Its Application in Pharmaceutical Research. &lt;i&gt;Journal of Pharmaceutical and Biomedical Analysis&lt;/i&gt;, 22, 717-727. &lt;br&gt;https://doi.org/10.1016/S0731-7085(99)00272-1</mixed-citation></ref><ref id="scirp.133508-ref32"><label>32</label><mixed-citation publication-type="other" xlink:type="simple">Dahal, K., Dahal, J., Banjade, H. and Gaire, S. (2021) Prediction of Wine Quality Using Machine Learning Algorithms. &lt;i&gt;Open Journal of Statistics&lt;/i&gt;, 11, 278-289. &lt;br&gt;https://doi.org/10.4236/ojs.2021.112015</mixed-citation></ref><ref id="scirp.133508-ref33"><label>33</label><mixed-citation publication-type="other" xlink:type="simple">Aggarwal, S., Bhatia, M., Madaan, R. and Pandey, H. (2021) Optimized Sequential Model for Plant Recognition in Keras. &lt;i&gt;IOP Conference Series&lt;/i&gt;:&lt;i&gt; Materials Science and Engineering&lt;/i&gt;, 1022, Article 012118. &lt;br&gt;https://doi.org/10.1088/1757-899X/1022/1/012118</mixed-citation></ref></ref-list></back></article>