<?xml version="1.0" encoding="UTF-8"?><!DOCTYPE article PUBLIC "-//NLM//DTD Journal Publishing DTD v3.0 20080202//EN" "http://dtd.nlm.nih.gov/publishing/3.0/journalpublishing3.dtd">
<article xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink" dtd-version="3.0" xml:lang="en" article-type="research article">
 <front>
  <journal-meta>
   <journal-id journal-id-type="publisher-id">
    jcc
   </journal-id>
   <journal-title-group>
    <journal-title>
     Journal of Computer and Communications
    </journal-title>
   </journal-title-group>
   <issn pub-type="epub">
    2327-5219
   </issn>
   <issn publication-format="print">
    2327-5227
   </issn>
   <publisher>
    <publisher-name>
     Scientific Research Publishing
    </publisher-name>
   </publisher>
  </journal-meta>
  <article-meta>
   <article-id pub-id-type="doi">
    10.4236/jcc.2024.126009
   </article-id>
   <article-id pub-id-type="publisher-id">
    jcc-134130
   </article-id>
   <article-categories>
    <subj-group subj-group-type="heading">
     <subject>
      Articles
     </subject>
    </subj-group>
    <subj-group subj-group-type="Discipline-v2">
     <subject>
      Computer Science 
     </subject>
     <subject>
       Communications
     </subject>
    </subj-group>
   </article-categories>
   <title-group>
    Insights into Manipulation: Unveiling Tampered Images Using Modified ELA, Deep Learning, and Explainable AI
   </title-group>
   <contrib-group>
    <contrib contrib-type="author" xlink:type="simple">
     <name name-style="western">
      <surname>
       Md. Mehedi
      </surname>
      <given-names>
       Hasan
      </given-names>
     </name> 
     <xref ref-type="aff" rid="aff1"> 
      <sup>1</sup>
     </xref>
    </contrib>
    <contrib contrib-type="author" xlink:type="simple">
     <name name-style="western">
      <surname>
       Md. Masud
      </surname>
      <given-names>
       Rana
      </given-names>
     </name> 
     <xref ref-type="aff" rid="aff1"> 
      <sup>1</sup>
     </xref>
    </contrib>
    <contrib contrib-type="author" xlink:type="simple">
     <name name-style="western">
      <surname>
       Abu Sayed Md. Mostafizur
      </surname>
      <given-names>
       Rahaman
      </given-names>
     </name> 
     <xref ref-type="aff" rid="aff2"> 
      <sup>2</sup>
     </xref>
    </contrib>
   </contrib-group> 
   <aff id="aff1">
    <addr-line>
     aDepartment of Information and Communication Technology, Bangladesh University of Professionals, Dhaka, Bangladesh
    </addr-line> 
   </aff> 
   <aff id="aff2">
    <addr-line>
     aDepartment of Computer Science and Engineering, Jahangirnagar University, Dhaka, Bangladesh
    </addr-line> 
   </aff> 
   <pub-date pub-type="epub">
    <day>
     21
    </day> 
    <month>
     06
    </month>
    <year>
     2024
    </year>
   </pub-date> 
   <volume>
    12
   </volume> 
   <issue>
    06
   </issue>
   <fpage>
    135
   </fpage>
   <lpage>
    151
   </lpage>
   <history>
    <date date-type="received">
     <day>
      22,
     </day>
     <month>
      March
     </month>
     <year>
      2024
     </year>
    </date>
    <date date-type="published">
     <day>
      24,
     </day>
     <month>
      March
     </month>
     <year>
      2024
     </year> 
    </date> 
    <date date-type="accepted">
     <day>
      24,
     </day>
     <month>
      June
     </month>
     <year>
      2024
     </year> 
    </date>
   </history>
   <permissions>
    <copyright-statement>
     © Copyright 2014 by authors and Scientific Research Publishing Inc. 
    </copyright-statement>
    <copyright-year>
     2014
    </copyright-year>
    <license>
     <license-p>
      This work is licensed under the Creative Commons Attribution International License (CC BY). http://creativecommons.org/licenses/by/4.0/
     </license-p>
    </license>
   </permissions>
   <abstract>
    Digital image forgery (DIF) is a prevalent issue in the modern age, where malicious actors manipulate images for various purposes, including deception and misinformation. Detecting such forgeries is a critical task for maintaining the integrity of digital content. This thesis explores the use of Modified Error Level Analysis (ELA) in combination with a Convolutional Neural Network (CNN), as well as, Feedforward Neural Network (FNN) model to detect digital image forgeries. Additionally, incorporation of Explainable Artificial Intelligence (XAI) to this research provided insights into the process of decision-making by the models. The study trains and tests the models on the CASIA2 dataset, emphasizing both authentic and forged images. The CNN model is trained and evaluated, and Explainable AI (SHapley Additive exPlanation— SHAP) is incorporated to explain the model’s predictions. Similarly, the FNN model is trained and evaluated, and XAI (SHAP) is incorporated to explain the model’s predictions. The results obtained from the analysis reveals that the proposed approach using CNN model is most effective in detecting image forgeries and provides valuable explanations for decision interpretability.
   </abstract>
   <kwd-group> 
    <kwd>
     IFD
    </kwd> 
    <kwd>
      DIF
    </kwd> 
    <kwd>
      ELA
    </kwd> 
    <kwd>
      CNN
    </kwd> 
    <kwd>
      FNN
    </kwd> 
    <kwd>
      XAI
    </kwd> 
    <kwd>
      SHAP
    </kwd> 
    <kwd>
      CASIA2.0
    </kwd>
   </kwd-group>
  </article-meta>
 </front>
 <body>
  <sec id="s1">
   <title>1. Introduction</title>
   <p>Digital image forgery, also known as image tampering, involves manipulating a digital image to deceive the viewer into believing that the image is authentic. The rapid advancement of digital imaging technologies in recent years has made it easier than ever to manipulate and alter digital images. The prevalence of image editing software and the effortless dissemination of digital content have amplified the challenge of digital image manipulation in the current digital era <xref ref-type="bibr" rid="scirp.134130-1">
     [1]
    </xref>.</p>
   <sec id="s1_1">
    <title>1.1. Overview of the Research</title>
    <p>This research proposes a noble approach to digital image forensics, combining traditional ELA techniques with advanced deep learning models like CNNs or FNNs <xref ref-type="bibr" rid="scirp.134130-2">
      [2]
     </xref> <xref ref-type="bibr" rid="scirp.134130-3">
      [3]
     </xref>. This combination is further enhanced by XAI to ensure transparency and trust in the detection process <xref ref-type="bibr" rid="scirp.134130-3">
      [3]
     </xref>. By addressing the need for robust IFD methods, this research holds the potential to safeguard against the harmful consequences of image forgery across various domains <xref ref-type="bibr" rid="scirp.134130-4">
      [4]
     </xref> like journalism, law enforcement, content verification, and digital forensics by ensuring the authenticity of images and supporting investigations with reliable evidence.</p>
   </sec>
   <sec id="s1_2">
    <title>1.2. Literature Review</title>
    <p>Detecting digital image forgeries is vital in image forensics, achieved through a blend of ELA and advanced Deep Learning models such as CNNs or traditional neural networks like FNNs, supplemented by Explainable Artificial Intelligence (XAI) techniques. ELA scrutinizes error levels to unveil tampering, while CNNs offer superior capabilities in detecting various forms of image manipulation compared to traditional methods. The integration of ELA with CNNs or FNNs has led to robust and efficient forgery detection systems. Additionally, XAI techniques enhance interpretability, facilitating a deeper understanding of the detection process.</p>
    <p>Huang et al. <xref ref-type="bibr" rid="scirp.134130-5">
      [5]
     </xref> pioneered an innovative IFD approach that combines convolutional long short-term memory (ConvLSTM) and CNNs, which demonstrated exceptional effectiveness, reaching a 99.2% accuracy rate on the CASIA image forgery dataset.</p>
    <p>Pan et al. <xref ref-type="bibr" rid="scirp.134130-6">
      [6]
     </xref> propose a powerful forgery detection method, combining ELA to pinpoint manipulated image regions and metadata analysis to uncover inconsistencies, effectively detecting diverse forgery techniques like copy-move, splicing, and inpainting.</p>
    <p>Chen et al. <xref ref-type="bibr" rid="scirp.134130-7">
      [7]
     </xref> evaluated the ELA-CNN model for image forgery detection, demonstrating its superiority to other advanced methods on a public dataset. This suggests ELA-CNN’s effectiveness and potential for accurate forgery detection.</p>
    <p>Li et al. <xref ref-type="bibr" rid="scirp.134130-8">
      [8]
     </xref> extensively investigated image forgery methods employing various deep learning architectures to assess their efficacy in identifying forged images.</p>
    <p>XAI techniques enhance the transparency and trustworthiness of deep learning models in image forensics by improving their understandability and interpretability <xref ref-type="bibr" rid="scirp.134130-4">
      [4]
     </xref> <xref ref-type="bibr" rid="scirp.134130-9">
      [9]
     </xref>.</p>
    <p>Huang et al. <xref ref-type="bibr" rid="scirp.134130-5">
      [5]
     </xref> introduced a novel approach to detect image forgery through a hybrid model, merging ConvLSTM and CNN. The ConvLSTM captures temporal features from image sequences, while the CNN extracts spatial features from image frames. Their model surpasses existing methods on a public dataset of forged images.</p>
    <p>He et al. <xref ref-type="bibr" rid="scirp.134130-2">
      [2]
     </xref> and Huang et al. <xref ref-type="bibr" rid="scirp.134130-10">
      [10]
     </xref> conducted comprehensive surveys on image forgery detection methods utilizing deep learning. Their studies offer insights into the strengths and limitations of different CNN and FNN architectures for detecting image forgery.</p>
    <p>Various CNN and FNN architectures, including ResNet, VGGNet, DenseNet, AlexNet, and LeNet-5, have been explored for image classification tasks. CNNs like ResNet, VGGNet, and DenseNet have gained popularity for their effectiveness in capturing spatial features from images, while FNN architectures like AlexNet and LeNet-5 offer versatility across diverse tasks by adjusting parameters. Despite CNNs generally outperforming FNNs in image classification due to their spatial feature extraction capabilities, FNNs remain versatile across different tasks compared to CNNs, which are specifically crafted for image-related tasks.</p>
   </sec>
   <sec id="s1_3">
    <title>1.3. Objectives</title>
    <p>Despite progress in image forgery detection, there are significant gaps in integrating Error Level Analysis (ELA) with deep learning models like CNNs and FNNs, and in employing Explainable Artificial Intelligence (XAI) in image forensics. This study introduces a noble framework that combines ELA and deep learning models to enhance transparency and interpretability in detecting image forgeries.</p>
    <p>The primary objective of this thesis is to develop an image forgery detection framework that combines modified ELA, CNN, FNN, and Explainable AI (SHAP). Specifically, the objectives include:</p>
    <sec id="s1">
     <title>2. Model Design and Implementation</title>
     <p>Deep convolutional neural network (CNN) models have excelled in image classification tasks, notably surpassing other methods in challenges like the ImageNet challenge <xref ref-type="bibr" rid="scirp.134130-11">
       [11]
      </xref> <xref ref-type="bibr" rid="scirp.134130-12">
       [12]
      </xref> <xref ref-type="bibr" rid="scirp.134130-13">
       [13]
      </xref>. This success stems from training these networks on extensive datasets containing millions of images. Notably, pre-trained weights of various models are accessible through platforms like Keras, serving as an open resource for researchers. This availability facilitates transfer learning, enabling the application of knowledge gained from solving one problem to similar tasks, thereby enhancing the efficiency of subsequent endeavors. The following diagram</p>
     <fig id="fig1" position="float">
      <label>Figure 1</label>
      <caption>
       <title>Figure 1. Proposed framework.</title>
      </caption>
      <graphic mimetype="image" position="float" xlink:type="simple" xlink:href="https://html.scirp.org/file/1732639-rId13.jpeg?20240627024259" />
     </fig>
     <p>(<xref ref-type="fig" rid="fig1">
       Figure 1
      </xref>) illustrated the proposed framework of this research.</p>
     <p>The proposed model acquire data from a dataset which contains both authentic and forged images. Subsequently these data are preprocessed with modified ELA algorithm. Preprocessing contains image classification, segmentation and denoising. Through preprocessing, two subsets named as training subset and validation subset are generated. These data are transferred to the models (CNN model and FNN model) for training, validation and evaluation. The results obtained through evaluation; the results are transferred to SHAP explainer. Finally, the results generated from SHAP explainer are compared to decide the best model for detecting image forgeries. The process and relevant topics are described in the subsequent phases of this paper.</p>
    </sec>
    <sec id="s2_4">
     <title>2.1. Data Acquisition</title>
     <p>The process of collecting and preparing data for analysis is referred as Data acquisition <xref ref-type="bibr" rid="scirp.134130-14">
       [14]
      </xref> <xref ref-type="bibr" rid="scirp.134130-15">
       [15]
      </xref>. It involves identifying the sources of the data, collecting the data, cleaning and preprocessing the data, and storing the data in a format that is accessible and usable for analysis <xref ref-type="bibr" rid="scirp.134130-16">
       [16]
      </xref>. To collect data for this research, the CASIA 2.0 Image Tampering Detection Dataset was used <xref ref-type="bibr" rid="scirp.134130-13">
       [13]
      </xref>.</p>
     <p>The methodology entails fine-tuning the model by training the entire network with pre-processed images from the CASIA2.0 dataset <xref ref-type="bibr" rid="scirp.134130-13">
       [13]
      </xref>, which contains both original and tampered images. Standardization involves resizing all images to 224 × 224 pixels and dividing the dataset into training and test subsets. These subsets categorize images as authentic or forged. Preprocessing includes normalization and evaluating compression-induced errors. CNN architecture, aided by ELA <xref ref-type="bibr" rid="scirp.134130-17">
       [17]
      </xref>, discerns authentic from forged images, with XAI using SHapley Additive exPlanations (SHAP) <xref ref-type="bibr" rid="scirp.134130-3">
       [3]
      </xref> <xref ref-type="bibr" rid="scirp.134130-9">
       [9]
      </xref> <xref ref-type="bibr" rid="scirp.134130-18">
       [18]
      </xref> to elucidate predictions. The outcomes of training, testing, and prediction processes determine the superior architecture for image forgery detection.</p>
    </sec>
    <sec id="s2_5">
     <title>2.2. Preprocessing with Error Level Analysis (ELA)</title>
     <p>Preprocessing, a crucial step in image processing and computer vision applications like forgery detection, recognition, and classification, involves preparing image data for subsequent processing stages such as feature extraction and analysis, aiming to enhance image quality and extract relevant information. Error Level Analysis (ELA), developed by Neal Krawetz <xref ref-type="bibr" rid="scirp.134130-17">
       [17]
      </xref>, detects image forgery by analyzing errors introduced during image compression, highlighting regions where manipulation likely occurred. Adjustments made during code implementation of the basic algorithm significantly improved forgery detection. The modified algorithm is as follows <xref ref-type="table" rid="table1">
       Table 1
      </xref>:</p>
     <table-wrap id="table1">
      <label>
       <xref ref-type="table" rid="table1">
        Table 1
       </xref></label>
      <caption>
       <title>
        <xref ref-type="bibr" rid="scirp.134130-"></xref>Table 1. Modified Error level analysis.</title>
      </caption>
      <table class="MsoTableGrid custom-table" border="0" cellspacing="0" cellpadding="0"> 
       <tr> 
        <td class="custom-top-td acenter" width="9.36%"><p style="text-align:center">1</p></td> 
        <td class="custom-top-td acenter" width="90.64%"><p style="text-align:center">Open the original image.</p></td> 
       </tr> 
       <tr> 
        <td class="acenter" width="9.36%"><p style="text-align:center">2</p></td> 
        <td class="acenter" width="90.64%"><p style="text-align:center">Try to save the original image with the specified quality. If the save is unsuccessful, convert the image to RGB and try to save it again.</p></td> 
       </tr> 
       <tr> 
        <td class="acenter" width="9.36%"><p style="text-align:center">3</p></td> 
        <td class="acenter" width="90.64%"><p style="text-align:center">Open the temporary image.</p></td> 
       </tr> 
       <tr> 
        <td class="acenter" width="9.36%"><p style="text-align:center">4</p></td> 
        <td class="acenter" width="90.64%"><p style="text-align:center">Calculate the absolute difference between corresponding pixels in the original and temporary images.</p></td> 
       </tr> 
       <tr> 
        <td class="acenter" width="9.36%"><p style="text-align:center">5</p></td> 
        <td class="acenter" width="90.64%"><p style="text-align:center">Apply a scaling factor to the absolute difference image.</p></td> 
       </tr> 
       <tr> 
        <td class="acenter" width="9.36%"><p style="text-align:center">6</p></td> 
        <td class="acenter" width="90.64%"><p style="text-align:center">Close the temporary image.</p></td> 
       </tr> 
       <tr> 
        <td class="custom-bottom-td acenter" width="9.36%"><p style="text-align:center">7</p></td> 
        <td class="custom-bottom-td acenter" width="90.64%"><p style="text-align:center">Return the scaled absolute difference image.</p></td> 
       </tr> 
      </table>
     </table-wrap>
     <p>The flow diagram of the modified algorithm is as follows (<xref ref-type="fig" rid="fig2">
       Figure 2
      </xref>):</p>
     <fig id="fig2" position="float">
      <label>Figure 2</label>
      <caption>
       <title>Figure 2. Flow diagram of modified ELA algorithm.</title>
      </caption>
      <graphic mimetype="image" position="float" xlink:type="simple" xlink:href="https://html.scirp.org/file/1732639-rId14.jpeg?20240627024300" />
     </fig>
     <p>The modified algorithm enhances efficiency and robustness by addressing memory leaks through proper closure of temporary images and eliminating unnecessary loops. Pre-processing with modified Error Level Analysis (ELA) prepares images by emphasizing regions with differing compression levels <xref ref-type="bibr" rid="scirp.134130-19">
       [19]
      </xref>, aiding in the extraction of various image characteristics like texture, edges, and corners. This method enhances the efficiency of tasks such as image classification, segmentation, and denoising.</p>
     <p>The major differences between the original algorithm and the modified algorithm are the modified one prevents memory leaks by closing the temporary image and also avoids unnecessary loops. Moreover, the modified ELA algorithm provides more consistency than the traditional one during image handling, which helps maintain a more accurate reference for comparison. Traditional ELA algorithm performs redundant image conversion, which adds more computation time than that of modified ELA algorithm. Thus, the modified implementation becomes more efficient and robust.</p>
    </sec>
    <sec id="s2_6">
     <title>2.3. Convolutional Neural Network (CNN)</title>
     <p>CNNs, tailored for image and video analysis, mimic human visual processing and excel at identifying complex patterns <xref ref-type="bibr" rid="scirp.134130-12">
       [12]
      </xref> <xref ref-type="bibr" rid="scirp.134130-20">
       [20]
      </xref>. They typically consist of convolutional layers for feature extraction, pooling layers for spatial resolution reduction while retaining vital information, and fully connected layers for merging extracted features to produce final outputs like classification labels or segmentation masks <xref ref-type="bibr" rid="scirp.134130-21">
       [21]
      </xref> <xref ref-type="bibr" rid="scirp.134130-22">
       [22]
      </xref> <xref ref-type="bibr" rid="scirp.134130-23">
       [23]
      </xref> <xref ref-type="bibr" rid="scirp.134130-24">
       [24]
      </xref> <xref ref-type="bibr" rid="scirp.134130-25">
       [25]
      </xref> (illustrated in <xref ref-type="fig" rid="fig3">
       Figure 3
      </xref>). Convolutional layers slide small filters over input images to extract features, generating feature maps <xref ref-type="bibr" rid="scirp.134130-21">
       [21]
      </xref>. Pooling layers reduce computational load and prevent overfitting by decreasing feature map resolution <xref ref-type="bibr" rid="scirp.134130-21">
       [21]
      </xref>. Fully connected layers integrate extracted features to generate final outputs <xref ref-type="bibr" rid="scirp.134130-21">
       [21]
      </xref>.</p>
     <fig id="fig3" position="float">
      <label>Figure 3</label>
      <caption>
       <title>Figure 3. Generic representation of CNN architecture.</title>
      </caption>
      <graphic mimetype="image" position="float" xlink:type="simple" xlink:href="https://html.scirp.org/file/1732639-rId15.jpeg?20240627024300" />
     </fig>
     <p>The training process of a CNN is governed by several crucial hyperparameters. These include:</p>
    </sec>
    <sec id="s2_7">
     <title>2.4. Feedforward Neural Network (FNN)</title>
     <p>FNN, an artificial intelligence model composed of interconnected neurons, consists of input, hidden, and output layers <xref ref-type="bibr" rid="scirp.134130-26">
       [26]
      </xref> <xref ref-type="bibr" rid="scirp.134130-27">
       [27]
      </xref> <xref ref-type="bibr" rid="scirp.134130-28">
       [28]
      </xref>. Neurons within an FNN compute weighted sums of inputs and apply activation functions like sigmoid or ReLU to generate outputs. During training, FNN weights are optimized to minimize the loss function, evaluating prediction performance <xref ref-type="bibr" rid="scirp.134130-26">
       [26]
      </xref>. The FNN model comprises of the Input Layer receives data, while the Hidden Layers process and learn complex relationships, and the Output Layer produces final network output, varying in neuron count based on problem type <xref ref-type="bibr" rid="scirp.134130-29">
       [29]
      </xref>. A simple FNN model architecture is as follows (<xref ref-type="fig" rid="fig4">
       Figure 4
      </xref>):</p>
     <fig id="fig4" position="float">
      <label>Figure 4</label>
      <caption>
       <title>Figure 4. Generic representation of CNN architecture.</title>
      </caption>
      <graphic mimetype="image" position="float" xlink:type="simple" xlink:href="https://html.scirp.org/file/1732639-rId16.jpeg?20240627024301" />
     </fig>
     <p>FNN hyperparameters regulate the training process, crucial for model performance. Key parameters include:</p>
    </sec>
    <sec id="s2_8">
     <title>2.5. Training, Validation, and Evaluation</title>
     <p>Training, validation, and evaluation are crucial stages in CNN or FNN model development. Training optimizes model parameters to minimize loss on training data, while validation assesses performance on a held-out dataset to prevent overfitting. Evaluation gauges model performance on a separate dataset for an unbiased estimate of generalization.</p>
     <p>To train and evaluate the CNN and FNN model, the CASIA 2.0 dataset is partitioned into two subsets: a training set and a validation set. This division guarantees that the model undergoes training on a specific portion of the data and is then assessed on a separate, unseen portion. The conventional ratio for this partition is frequently established at 80% for training and 20% for validation, ensuring an evaluation of the model’s ability to generalize.</p>
     <p>The CNN and FNN models’ training, validation, and evaluation in this study involve several steps. These include Model Definition (outlining the model structure), Model Compilation (configuring training specifics like loss function and optimizer), Model Training (which trains the model on designated data), and Model Evaluation (assessing its performance on validation data). Callbacks used to enhance training include EarlyStopping (monitoring validation accuracy and halting if stagnant), ReduceLROnPlateau (adjusting learning rate with no validation improvement), and LearningRateScheduler (customizing learning rate schedule during training).</p>
    </sec>
    <sec id="s2_9">
     <title>2.6. Explainable Artificial Intelligence (XAI)</title>
     <p>As AI permeates various facets of life, understanding its decision-making processes becomes crucial amid increasing complexity. Explainable AI (XAI), also known as Explainable Machine Learning (XML), addresses this need by making AI models more transparent and comprehensible. XAI offers methods to elucidate how AI models reach decisions, allowing humans to interpret their reasoning. Techniques like Feature Importance, Partial Dependence Plots, Local Interpretable Model-Agnostic Explanations (LIME), and SHapley Additive explanations (SHAP) tailor explanations to different AI models and applications, with SHAP calculating feature impact on predictions, aiding in identifying influential features in the model’s predictions.</p>
    </sec>
   </sec>
   <sec id="s3">
    <title>3. Result and Discussion</title>
    <p>The model in this study was implemented using Python 3.12.0 and TensorFlow 2.12.0. Training was conducted on Kaggle Notebook, a cloud-based Jupyter Notebooks environment offered by Kaggle <xref ref-type="bibr" rid="scirp.134130-30">
      [30]
     </xref>, popular among data scientists and machine learning practitioners for its convenience and ease of use. The research evaluated CNN and FNN models, alongside XAI techniques, for digital image forgery detection, showing the proposed model’s effectiveness in distinguishing between authentic and forged images.</p>
    <p>The proposed CNN and FNN models were evaluated using the CASIA 2.0 Image Tempering Detection Dataset, comprising various forged images subjected to diverse transformations. The dataset was split with 80% for training and 20% for validation and testing. Preprocessing involved modified ELA to emphasize forged regions. The CNN model took about 35 seconds per epoch for training, whereas the FNN model completed each epoch in roughly 4 seconds, demonstrating the suitability of Kaggle notebooks for this research.</p>
    <p>The CNN and FNN models, coupled with Explainable AI (XAI) techniques, are evaluated for image forgery detection primarily using accuracy, a fundamental metric reflecting the models’ ability to classify images as authentic or tampered accurately. High accuracy signifies effective discrimination between the two categories. Alongside accuracy, other performance metrics such as Precision (indicates low false positive rates), Recall (assesses true positive predictions), F1-Score (measures overall model performance), and Confusion Matrix (visualizes classification accuracy).</p>
    <sec id="s3_1">
     <title>3.1. Analysis of Accuracy with Modified ELA Algorithm</title>
     <p>
      <xref ref-type="fig" rid="fig5">
       Figure 5
      </xref> and <xref ref-type="fig" rid="fig6">
       Figure 6
      </xref> illustrates the graphs of accuracy (training and validation), as well as the loss (training and validation), for the CNN and FNN models respectively. The CNN model, when combined with modified ELA algorithm, attains a training accuracy of 99.96% and a validation accuracy of 94.21%. On</p>
     <fig id="fig5" position="float">
      <label>Figure 5</label>
      <caption>
       <title>Figure 5. Training and validation accuracy with Modified ELA Algorithm, as well as training and validation loss, of the CNN model (Batch Size: 64 and Number of Epochs: 30).</title>
      </caption>
      <graphic mimetype="image" position="float" xlink:type="simple" xlink:href="https://html.scirp.org/file/1732639-rId17.jpeg?20240627024303" />
     </fig>
     <fig id="fig6" position="float">
      <label>Figure 6</label>
      <caption>
       <title>Figure 6. Training and validation accuracy with Modified ELA Algorithm, as well as training and validation loss, of the FNN model (Batch Size: 64 and Number of Epochs: 30).</title>
      </caption>
      <graphic mimetype="image" position="float" xlink:type="simple" xlink:href="https://html.scirp.org/file/1732639-rId18.jpeg?20240627024303" />
     </fig>
     <table-wrap id="table2">
      <label>
       <xref ref-type="table" rid="table2">
        Table 2
       </xref></label>
      <caption>
       <title>
        <xref ref-type="bibr" rid="scirp.134130-"></xref>Table 2. Comparison between CNN and FNN Model with Modified ELA algorithm in terms of accuracy and computational time.</title>
      </caption>
      <table class="MsoTableGrid custom-table" border="0" cellspacing="0" cellpadding="0"> 
       <tr> 
        <td class="custom-bottom-td acenter" width="41.73%"><p style="text-align:center">Feature</p></td> 
        <td class="custom-bottom-td acenter" width="29.13%"><p style="text-align:center">CNN Model</p></td> 
        <td class="custom-bottom-td acenter" width="29.14%"><p style="text-align:center">FNN Model</p></td> 
       </tr> 
       <tr> 
        <td class="custom-top-td acenter" width="41.73%"><p style="text-align:center">Training Accuracy</p></td> 
        <td class="custom-top-td acenter" width="29.13%"><p style="text-align:center">99.96%</p></td> 
        <td class="custom-top-td acenter" width="29.14%"><p style="text-align:center">99.06%</p></td> 
       </tr> 
       <tr> 
        <td class="acenter" width="41.73%"><p style="text-align:center">Validation Accuracy</p></td> 
        <td class="acenter" width="29.13%"><p style="text-align:center">94.21%</p></td> 
        <td class="acenter" width="29.14%"><p style="text-align:center">90.65%</p></td> 
       </tr> 
       <tr> 
        <td class="acenter" width="41.73%"><p style="text-align:center">Computational Time (Average)</p></td> 
        <td class="acenter" width="29.13%"><p style="text-align:center">35 seconds</p></td> 
        <td class="acenter" width="29.14%"><p style="text-align:center">04 seconds</p></td> 
       </tr> 
      </table>
     </table-wrap>
     <p>the other hand, the FNN model achieves a training accuracy of 99.06% and a validation accuracy of 90.65%. The CNN model with ELA also achieves a validation loss of 1.5101, while the FNN model achieves a lower validation loss of 1.0654. On contrary, FNN model is computationally faster than CNN model. The summary of the findings in <xref ref-type="fig" rid="fig5">
       Figure 5
      </xref> and <xref ref-type="fig" rid="fig6">
       Figure 6
      </xref> are presented in <xref ref-type="table" rid="table2">
       Table 2
      </xref> for better assimilation of the findings.</p>
    </sec>
    <sec id="s3_2">
     <title>3.2. Analysis of Accuracy with Traditional ELA Algorithm</title>
     <p>
      <xref ref-type="fig" rid="fig7">
       Figure 7
      </xref> and <xref ref-type="fig" rid="fig8">
       Figure 8
      </xref> display training and validation accuracy, along with training and validation loss graphs for the CNN and FNN models, respectively. The</p>
     <fig id="fig7" position="float">
      <label>Figure 7</label>
      <caption>
       <title>Figure 7. Training and validation accuracy with Traditional ELA Algorithm, as well as training and validation loss, of the CNN model (Batch Size: 64 and Number of Epochs: 30).</title>
      </caption>
      <graphic mimetype="image" position="float" xlink:type="simple" xlink:href="https://html.scirp.org/file/1732639-rId19.jpeg?20240627024303" />
     </fig>
     <fig id="fig8" position="float">
      <label>Figure 8</label>
      <caption>
       <title>Figure 8. Training and validation accuracy with Traditional ELA Algorithm, as well as training and validation loss, of the FNN model (Batch Size: 64 and Number of Epochs: 30).</title>
      </caption>
      <graphic mimetype="image" position="float" xlink:type="simple" xlink:href="https://html.scirp.org/file/1732639-rId20.jpeg?20240627024303" />
     </fig>
     <table-wrap id="table3">
      <label>
       <xref ref-type="table" rid="table3">
        Table 3
       </xref></label>
      <caption>
       <title>
        <xref ref-type="bibr" rid="scirp.134130-"></xref>Table 3. Comparison between CNN and FNN Model with Traditional ELA Algorithm in terms of accuracy and computational time.</title>
      </caption>
      <table class="MsoTableGrid custom-table" border="0" cellspacing="0" cellpadding="0"> 
       <tr> 
        <td class="custom-bottom-td acenter" width="45.66%"><p style="text-align:center">Feature</p></td> 
        <td class="custom-bottom-td acenter" width="27.16%"><p style="text-align:center">CNN Model</p></td> 
        <td class="custom-bottom-td acenter" width="27.18%"><p style="text-align:center">FNN Model</p></td> 
       </tr> 
       <tr> 
        <td class="custom-top-td acenter" width="45.66%"><p style="text-align:center">Training Accuracy</p></td> 
        <td class="custom-top-td acenter" width="27.16%"><p style="text-align:center">99.62%</p></td> 
        <td class="custom-top-td acenter" width="27.18%"><p style="text-align:center">98.50%</p></td> 
       </tr> 
       <tr> 
        <td class="acenter" width="45.66%"><p style="text-align:center">Validation Accuracy</p></td> 
        <td class="acenter" width="27.16%"><p style="text-align:center">93.30%</p></td> 
        <td class="acenter" width="27.18%"><p style="text-align:center">89.14%</p></td> 
       </tr> 
       <tr> 
        <td class="acenter" width="45.66%"><p style="text-align:center">Computational Time (Average)</p></td> 
        <td class="acenter" width="27.16%"><p style="text-align:center">55 seconds</p></td> 
        <td class="acenter" width="27.18%"><p style="text-align:center">09 seconds</p></td> 
       </tr> 
      </table>
     </table-wrap>
     <p>summary of the findings in <xref ref-type="fig" rid="fig7">
       Figure 7
      </xref> and <xref ref-type="fig" rid="fig8">
       Figure 8
      </xref> are presented in <xref ref-type="table" rid="table3">
       Table 3
      </xref> for better assimilation of the findings.</p>
     <p>With the traditional ELA algorithm, the CNN model achieves a training accuracy of 99.62% and a validation accuracy of 93.30%, with a validation loss of 0.9231. Conversely, the FNN model achieves a training accuracy of 98.50% and a validation accuracy of 89.14%, with a lower validation loss of 0.4411. Despite this, the FNN model exhibits faster computational performance compared to the CNN model.</p>
    </sec>
    <sec id="s3_3">
     <title>3.3. Analysis of Additional Performance Metrics</title>
     <p>Deep learning models for image forgery detection are evaluated by analyzing performance metrics like precision, recall, and F1-score, illustrated in <xref ref-type="fig" rid="fig9">
       Figure 9
      </xref>.</p>
     <fig id="fig9" position="float">
      <label>Figure 9</label>
      <caption>
       <title>Figure 9. Metrics definition.</title>
      </caption>
      <graphic mimetype="image" position="float" xlink:type="simple" xlink:href="https://html.scirp.org/file/1732639-rId21.jpeg?20240627024304" />
     </fig>
     <p>
      <xref ref-type="table" rid="table4">
       Table 4
      </xref> presents additional performance metrics for both models utilizing the modified ELA algorithm and the traditional ELA algorithm.</p>
     <table-wrap id="table4">
      <label>
       <xref ref-type="table" rid="table4">
        Table 4
       </xref></label>
      <caption>
       <title>
        <xref ref-type="bibr" rid="scirp.134130-"></xref>Table 4. Analysis of additional performance metrics with modified ELA algorithm and traditional ELA algorithm.</title>
      </caption>
      <table class="MsoTableGrid custom-table" border="0" cellspacing="0" cellpadding="0"> 
       <tr> 
        <td class="custom-bottom-td acenter" width="52.40%"><p style="text-align:center">Model</p></td> 
        <td class="custom-bottom-td acenter" width="15.86%"><p style="text-align:center">Precision</p></td> 
        <td class="custom-bottom-td acenter" width="15.87%"><p style="text-align:center">Recall</p></td> 
        <td class="custom-bottom-td acenter" width="15.87%"><p style="text-align:center">F1-Score</p></td> 
       </tr> 
       <tr> 
        <td class="custom-top-td acenter" width="52.40%"><p style="text-align:center">CNN (with Modified ELA Algorithm)</p></td> 
        <td class="custom-top-td acenter" width="15.86%"><p style="text-align:center">0.94</p></td> 
        <td class="custom-top-td acenter" width="15.87%"><p style="text-align:center">0.92</p></td> 
        <td class="custom-top-td acenter" width="15.87%"><p style="text-align:center">0.93</p></td> 
       </tr> 
       <tr> 
        <td class="acenter" width="52.40%"><p style="text-align:center">FNN (with Modified ELA Algorithm)</p></td> 
        <td class="acenter" width="15.86%"><p style="text-align:center">0.91</p></td> 
        <td class="acenter" width="15.87%"><p style="text-align:center">0.89</p></td> 
        <td class="acenter" width="15.87%"><p style="text-align:center">0.90</p></td> 
       </tr> 
       <tr> 
        <td class="acenter" width="52.40%"><p style="text-align:center">CNN (with Traditional ELA Algorithm)</p></td> 
        <td class="acenter" width="15.86%"><p style="text-align:center">0.93</p></td> 
        <td class="acenter" width="15.87%"><p style="text-align:center">0.92</p></td> 
        <td class="acenter" width="15.87%"><p style="text-align:center">0.92</p></td> 
       </tr> 
       <tr> 
        <td class="acenter" width="52.40%"><p style="text-align:center">FNN (with Traditional ELA Algorithm)</p></td> 
        <td class="acenter" width="15.86%"><p style="text-align:center">0.90</p></td> 
        <td class="acenter" width="15.87%"><p style="text-align:center">0.88</p></td> 
        <td class="acenter" width="15.87%"><p style="text-align:center">0.89</p></td> 
       </tr> 
      </table>
     </table-wrap>
    </sec>
    <sec id="s3_4">
     <title>3.4. Confusion Matrix</title>
     <p>The confusion matrix, a 2 × 2 table, features diagonal elements denoting true positives (TP) and true negatives (TN) for accurate predictions by the classifier, while off-diagonal elements represent prediction errors like false positives (FP) and false negatives (FN). <xref ref-type="fig" rid="fig10">
       Figure 10
      </xref> and <xref ref-type="fig" rid="fig11">
       Figure 11
      </xref> depict the confusion matrices for the CNN and FNN models with the modified ELA algorithm, respectively.</p>
     <fig id="fig10" position="float">
      <label>Figure 10</label>
      <caption>
       <title>Figure 10. Illustration of the performance of the CNN model with modified ELA algorithm using confusion matrix.</title>
      </caption>
      <graphic mimetype="image" position="float" xlink:type="simple" xlink:href="https://html.scirp.org/file/1732639-rId22.jpeg?20240627024304" />
     </fig>
     <fig id="fig11" position="float">
      <label>Figure 11</label>
      <caption>
       <title>Figure 11. Illustration of the performance of the FNN model with modified ELA algorithm using confusion matrix.</title>
      </caption>
      <graphic mimetype="image" position="float" xlink:type="simple" xlink:href="https://html.scirp.org/file/1732639-rId23.jpeg?20240627024304" />
     </fig>
     <p>
      <xref ref-type="fig" rid="fig12">
       Figure 12
      </xref> and <xref ref-type="fig" rid="fig13">
       Figure 13
      </xref> display the confusion matrices for the CNN and FNN models with traditional ELA algorithm, respectively.</p>
     <fig id="fig12" position="float">
      <label>Figure 12</label>
      <caption>
       <title>Figure 12. Illustration of the performance of the CNN model with traditional ELA algorithm using confusion matrix.</title>
      </caption>
      <graphic mimetype="image" position="float" xlink:type="simple" xlink:href="https://html.scirp.org/file/1732639-rId24.jpeg?20240627024304" />
     </fig>
     <fig id="fig13" position="float">
      <label>Figure 13</label>
      <caption>
       <title>Figure 13. Illustration of the performance of the FNN model with traditional ELA algorithm using confusion matrix.</title>
      </caption>
      <graphic mimetype="image" position="float" xlink:type="simple" xlink:href="https://html.scirp.org/file/1732639-rId25.jpeg?20240627024304" />
     </fig>
    </sec>
    <sec id="s3_5">
     <title>3.5. Mitigation of the Limitations of Relevant Researches</title>
     <p>The model introduced in this study effectively addressed and surpassed the limitations identified in the previously conducted researches addressed in this paper. The proposed model with modified ELA algorithm and CNN model outperformed other models (FNN model with modified ELA algorithm, CNN model with traditional ELA algorithm, and FNN model with traditional ELA algorithm) across all metrics, including training accuracy, validation accuracy, precision, recall, and F1 score. This suggests its superiority in identifying forged images and minimizing false positives and false negatives.</p>
     <p>The proposed model could detect all forms of image forgeries with enhanced accuracy. More so, this model could efficiently incorporated SHAP explainer with CNN model and modified ELA algorithm, which could interpret the predictions more precisely. Computational expenses also mitigated by using GPU-based Kaggle kernel.</p>
    </sec>
   </sec>
   <sec id="s4">
    <title>4. Conclusions</title>
    <p>This study utilized deep learning techniques and Explainable AI (XAI) to tackle the challenge of differentiating between genuine and forged images, commonly involving individuals. Image forgery involves malicious alterations to images, often turning authentic images from public platforms into entirely different ones, potentially with inappropriate content aimed at spreading negative publicity. The ELA algorithm plays a crucial role in detecting such manipulation, particularly when input image quality aligns with the algorithm’s parameters. The research delved into the efficacy of this combined approach in discerning between authentic and tampered images, yielding several significant findings.</p>
    <p>Overall, the CNN model achieved a test accuracy of 94.21%, which can be comparable to the state-of-the-art methods.</p>
    <p>The proposed image forgery detection approach achieved notable success, yet there remains room for improvement. Future endeavors could focus on exploring avenues such as:</p>
   </sec>
  </sec>
 </body><back>
  <ref-list>
   <title>References</title>
   <ref id="scirp.134130-ref1">
    <label>1</label>
    <mixed-citation publication-type="other" xlink:type="simple">
     Farid, H. (2009) Image Forgery Detection: A Survey. IEEE Signal Processing Magazine, 26, 16-25. &gt;https://doi.org/10.1109/MSP.2008.931079
    </mixed-citation>
   </ref>
   <ref id="scirp.134130-ref2">
    <label>2</label>
    <mixed-citation publication-type="other" xlink:type="simple">
     He, J., Dong, X., Yi, Z. and Wang, H. (2020) Deep Learning for Image Forgery Detection: A Survey. IEEE Transactions on Information Forensics and Security, 15, 3261-3285.
    </mixed-citation>
   </ref>
   <ref id="scirp.134130-ref3">
    <label>3</label>
    <mixed-citation publication-type="other" xlink:type="simple">
     Lundberg, S.M. and Lee, S.-I. (2017) A Unified Approach to Interpreting Model Predictions. Proceedings of the 31st International Conference on Neural Information Processing Systems, Long Beach, 4-9 December 2017, 4766-4777.
    </mixed-citation>
   </ref>
   <ref id="scirp.134130-ref4">
    <label>4</label>
    <mixed-citation publication-type="other" xlink:type="simple">
     Al-Qazzaz, N. and El-Sawi, M. (2022) Digital Image Forgery Detection Using Deep Learning Approaches: A Comprehensive Review. IEEE Access, 10, 46360-46395.
    </mixed-citation>
   </ref>
   <ref id="scirp.134130-ref5">
    <label>5</label>
    <mixed-citation publication-type="other" xlink:type="simple">
     Huang, H., Huang, W., Zhang, X. and Zhang, Y. (2020) Image Forgery Detection Using Integrated Convolution-LSTM (2D) and Convolution (2D). IEEE Signal Processing Letters, 27, 1561-1565. 
    </mixed-citation>
   </ref>
   <ref id="scirp.134130-ref6">
    <label>6</label>
    <mixed-citation publication-type="other" xlink:type="simple">
     Pan, X., Zhang, X., Lyu, S. and Tchoumousset, S. (2010) Image Tampering Detection Using Error Level Analysis and Metadata Analysis. IEEE Transactions on Information Forensics and Security, 5, 492-507.
    </mixed-citation>
   </ref>
   <ref id="scirp.134130-ref7">
    <label>7</label>
    <mixed-citation publication-type="other" xlink:type="simple">
     Chen, J., Luo, W., Li, X., Li, B. and He, J. (2019) ELA-CNN: A Hybrid Model for Digital Image Forgery Detection. IEEE Transactions on Information Forensics and Security, 14, 150-162.
    </mixed-citation>
   </ref>
   <ref id="scirp.134130-ref8">
    <label>8</label>
    <mixed-citation publication-type="other" xlink:type="simple">
     Li, Y., Li, X. and Li, B. (2020) Comprehensive Study on Image Forgery Techniques Using Deep Learning. IEEE Transactions on Information Forensics and Security, 15, 3261-3285.
    </mixed-citation>
   </ref>
   <ref id="scirp.134130-ref9">
    <label>9</label>
    <mixed-citation publication-type="other" xlink:type="simple">
     Ribeiro, M.T., Singh, S. and Guestrin, C. (2016) Why Should I Trust You?: Explaining the Predictions of Any Classifier. Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, San Francisco, 13-17 August 2016, 1135-1144. &gt;https://doi.org/10.1145/2939672.2939778
    </mixed-citation>
   </ref>
   <ref id="scirp.134130-ref10">
    <label>10</label>
    <mixed-citation publication-type="other" xlink:type="simple">
     Huang, H., Huang, W., Tan, T. and Li, J. (2017) A Novel Passive Image Forgery Detection Algorithm Based on Block-Level Error Level Analysis. IEEE Transactions on Information Forensics and Security, 13, 60-74.
    </mixed-citation>
   </ref>
   <ref id="scirp.134130-ref11">
    <label>11</label>
    <mixed-citation publication-type="other" xlink:type="simple">
     He, K., Xiangyu, Z., Shaoqing, R. and Jian, S. (2016) Deep Residual Learning for Im-Age Recognition. Proceedings of 2016 IEEE Conference on Computer Vision and Pattern Recognition, Las Vegas, 27-30 June 2016, 770-778.&gt;https://doi.org/10.1109/CVPR.2016.90
    </mixed-citation>
   </ref>
   <ref id="scirp.134130-ref12">
    <label>12</label>
    <mixed-citation publication-type="other" xlink:type="simple">
     Simonyan, K. and Zisserman, A. (2014) Very Deep Convolutional Networks for Large-Scale Image Recognition. Proceedings of 2014 IEEE International Conference on System Engineering and Technology, Bandung, 24-25 November 2014, 354-355.
    </mixed-citation>
   </ref>
   <ref id="scirp.134130-ref13">
    <label>13</label>
    <mixed-citation publication-type="other" xlink:type="simple">
     Dong, J., Wand, W. and Tan, T. (2013) CASIA Image Tampering Detection Evaluation Database. 2013 IEEE China Summit and International Conference on Signal and Information Processing, Beijing, 6-10 July 2013, 422-426.&gt;https://doi.org/10.1109/ChinaSIP.2013.6625374
    </mixed-citation>
   </ref>
   <ref id="scirp.134130-ref14">
    <label>14</label>
    <mixed-citation publication-type="other" xlink:type="simple">
     Jain, A.K. (2010) Data Clustering: 50 Years beyond K-Means. Pattern Recognition Letters, 31, 651-666. &gt;https://doi.org/10.1016/j.patrec.2009.09.011
    </mixed-citation>
   </ref>
   <ref id="scirp.134130-ref15">
    <label>15</label>
    <mixed-citation publication-type="other" xlink:type="simple">
     Witten, I.H., Frank, E. and Hall, M.A. (2011) Data Mining: Practical Machine Learning Tools and Techniques. Morgan Kaufmann.
    </mixed-citation>
   </ref>
   <ref id="scirp.134130-ref16">
    <label>16</label>
    <mixed-citation publication-type="other" xlink:type="simple">
     Mahalanobis, P.C. (1936) On the Generalised Distance in Statistics. Proceedings of the National Academy of Sciences of India, 2, 49-55.
    </mixed-citation>
   </ref>
   <ref id="scirp.134130-ref17">
    <label>17</label>
    <mixed-citation publication-type="other" xlink:type="simple">
     Krawetz, N. (2016) Error Level Analysis (ELA) for Image Forensics. Digital Forensics Investigation, 19, 16-28.
    </mixed-citation>
   </ref>
   <ref id="scirp.134130-ref18">
    <label>18</label>
    <mixed-citation publication-type="other" xlink:type="simple">
     Li, Y., Li, X. and Li, B. (2021) Explainable Image Forgery Detection Using SHAP. Proceedings of the 2021 IEEE International Conference on Image Processing (ICIP), Anchorage, 19-22 September 2021, 1401-1405.
    </mixed-citation>
   </ref>
   <ref id="scirp.134130-ref19">
    <label>19</label>
    <mixed-citation publication-type="other" xlink:type="simple">
     Gonzalez, R.C. and Woods, R.E. (2018) Digital Image Processing. 4th Edition, Pearson Education.
    </mixed-citation>
   </ref>
   <ref id="scirp.134130-ref20">
    <label>20</label>
    <mixed-citation publication-type="other" xlink:type="simple">
     LeCun, Y., Bottou, L., Bengio, Y. and Haffner, P. (1998) Gradient-Based Learning Applied to Document Recognition. Proceedings of the IEEE, 86, 2278-2324.&gt;https://doi.org/10.1109/5.726791
    </mixed-citation>
   </ref>
   <ref id="scirp.134130-ref21">
    <label>21</label>
    <mixed-citation publication-type="other" xlink:type="simple">
     Guo, Y., Liu, Y., Krizhevsky, A. and Fei-Fei, L. (2019) Understanding Convolutional Neural Networks with a Mathematical Model. IEEE Transactions on Systems, Man, and Cybernetics: Systems, 49, 506-520.
    </mixed-citation>
   </ref>
   <ref id="scirp.134130-ref22">
    <label>22</label>
    <mixed-citation publication-type="other" xlink:type="simple">
     Sharma, P. (2023) Basic Introduction to Convolutional Neural Network in Deep Learning. &gt;https://www.analyticsvidhya.com/blog/2022/03/basic-introduction-to-convolutional-neural-network-in-deep-learning/ 
    </mixed-citation>
   </ref>
   <ref id="scirp.134130-ref23">
    <label>23</label>
    <mixed-citation publication-type="other" xlink:type="simple">
     Rosebrock, A. (2023) Convolutional Neural Networks (CNNs) and Layer Types. &gt;https://pyimagesearch.com/2021/05/14/convolutional-neural-networks-cnns-and-layer-types/ 
    </mixed-citation>
   </ref>
   <ref id="scirp.134130-ref24">
    <label>24</label>
    <mixed-citation publication-type="other" xlink:type="simple">
     GeeksforGeeks (2023) CNN: Introduction to Pooling Layer. &gt;https://www.geeksforgeeks.org/cnn-introduction-to-pooling-layer/
    </mixed-citation>
   </ref>
   <ref id="scirp.134130-ref25">
    <label>25</label>
    <mixed-citation publication-type="other" xlink:type="simple">
     Amidi, A. and Amidi, S. (2023) CS 230-Convolutional Neural Networks Cheat-Sheet.&gt;https://stanford.edu/~shervine/teaching/cs-230/cheatsheet-convolutional-neural-networks
    </mixed-citation>
   </ref>
   <ref id="scirp.134130-ref26">
    <label>26</label>
    <mixed-citation publication-type="other" xlink:type="simple">
     Goodfellow, I., Bengio, Y. and Courville, A. (2016) Deep Learning. MIT Press.
    </mixed-citation>
   </ref>
   <ref id="scirp.134130-ref27">
    <label>27</label>
    <mixed-citation publication-type="other" xlink:type="simple">
     Hagan, M.T. and Menhaj, M.B. (1994) Training Feedforward Networks with the Marquardt Algorithm. IEEE Transactions on Neural Networks, 5, 989-993.&gt;https://doi.org/10.1109/72.329697
    </mixed-citation>
   </ref>
   <ref id="scirp.134130-ref28">
    <label>28</label>
    <mixed-citation publication-type="other" xlink:type="simple">
     Turing (2023) Understanding Feed Forward Neural Networks with Maths and Statistics. &gt;https://www.turing.com/kb/mathematical-formulation-of-feed-forward-neural-network
    </mixed-citation>
   </ref>
   <ref id="scirp.134130-ref29">
    <label>29</label>
    <mixed-citation publication-type="other" xlink:type="simple">
     Shivkumar, D. (2023) Introduction to Feed Forward Neural Network. &gt;https://www.scaler.com/topics/deep-learning/introduction-to-feed-forward-neural-network/ 
    </mixed-citation>
   </ref>
   <ref id="scirp.134130-ref30">
    <label>30</label>
    <mixed-citation publication-type="other" xlink:type="simple">
     Kaggle (2023) Kaggle Notebook. &gt;https://www.kaggle.com/docs/notebooks
    </mixed-citation>
   </ref>
  </ref-list>
 </back>
</article>