﻿<?xml version="1.0" encoding="UTF-8"?><!DOCTYPE article  PUBLIC "-//NLM//DTD Journal Publishing DTD v3.0 20080202//EN" "http://dtd.nlm.nih.gov/publishing/3.0/journalpublishing3.dtd"><article xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink" dtd-version="3.0" xml:lang="en" article-type="research article"><body><sec id="s1"><title>1. Introduction</title><p>Optimization can be defined as one of the branches of knowledge dealing with discovering or arriving at the optimal solutions to a specific issue within a set of alternatives.</p><p>The methods of solving optimization problems divided into two types of algorithms: Deterministic Algorithms and Stochastic Algorithms.</p><p>Most of classical algorithms are specific algorithms. For example, the Simplex method in linear programming is a specific algorithm, and some specific algorithms use tilt information (Gradient), which called slope-based algorithms. For example, Newton-Raphson algorithm) is an algorithm based on slope or derivative [<xref ref-type="bibr" rid="scirp.101268-ref1">1</xref>].</p><p>As for random algorithms, they have two types of algorithms, although the difference between them is small: Heuristic Algorithms and Meta-Heuristic Algorithms [<xref ref-type="bibr" rid="scirp.101268-ref2">2</xref>].</p><p>The Whale Optimization Algorithm (WOA) is an algorithm inspired by the humpback whale search behavior for its food and hunting method and was first proposed by Lewis and Mirjalili (2016) [<xref ref-type="bibr" rid="scirp.101268-ref3">3</xref>].</p><p>In the same year, WOA improved by Trivedi and others by incorporating a new technology called WOA Adaptive Technology (WOA) [<xref ref-type="bibr" rid="scirp.101268-ref4">4</xref>].</p><p>In the same year, Touma studied the economic transmission problem on the IEEE Bus-30 system using a whale optimization algorithm, which gives good results compared to other algorithms [<xref ref-type="bibr" rid="scirp.101268-ref5">5</xref>].</p><p>In 2017, Hu and others proposed an improved algorithm of whale optimization by adding its inertia weights called (WOAs). The new algorithm tested using 27 functions and applied to predict the daily air quality index. The proposed algorithm showed efficiency compared to other algorithms [<xref ref-type="bibr" rid="scirp.101268-ref6">6</xref>].</p><p>This algorithm used in the same year by researchers Prakash and Lakshminarayana in determining the optimal location of the capacitors and determining their size in the radial distribution network, in order to reduce the losses of the distribution network line as the positioning of the capacitors in optimal locations will improve system performance, stability and reliability [<xref ref-type="bibr" rid="scirp.101268-ref7">7</xref>].</p><p>In the same year, the researcher Desuky used a whale optimization algorithm to improve two levels of male fertility classification. Recently, diseases and health problems that were common among the elderly only became common among young people, and some of the causes of these medical problems are behavioral, environmental and lifestyle factors. The whale optimization algorithm then combined with the Pegasos algorithm to enhance the male fertility rating at both levels. This integration improved the results by 90% [<xref ref-type="bibr" rid="scirp.101268-ref8">8</xref>].</p><p>The algorithm of the whale optimization was also used in the same year by Reddy and others to optimize renewable resources to reduce losses in electricity distribution systems [<xref ref-type="bibr" rid="scirp.101268-ref9">9</xref>].</p><p>In the same year, Mafarja and Mirjalili crossed the whale optimization algorithm with Simulated Annealing Algorithm and used in the classification process. The results confirm the efficiency of the hybrid algorithm in improving classification accuracy [<xref ref-type="bibr" rid="scirp.101268-ref10">10</xref>].</p><p>The aim of the research is to propose a new hybrid algorithm consisting of a Whale optimization algorithm (WOA) with Modified traditional Conjugate Gradient Directional Methods (WOA-MCG). <xref ref-type="table" rid="table1">Table 1</xref> represents a definition of the variables used in this study.</p></sec><sec id="s2"><title>2. Conjugate Gradient Method</title><p>In unconstrained optimization, we minimize an objective function depends on real variables with no restrictions on the values of these variables. The unconstrained optimization problem is:</p><p>min f ( x ) : x ∈ R n , (1)</p><p>where f : R n → R is a continuously differentiable function, bounded from below. A nonlinear conjugate gradient method generates a sequence { x k } , k: integer number, k ≥ 0 . Starting from an initial point x 0 , the value of x k calculate by the following equation:</p><p>x k + 1 = x k + λ k d k , (2)</p><p>where the positive step size λ k &gt; 0 is obtained by a line search, and the directions d k are generated as:</p><p>d k + 1 = − g k + 1 + β k d k , (3)</p><p>where d 0 = − g 0 , the value of β k is determined according to the algorithm of Conjugate Gradient (CG), and its known as a conjugate gradient parameter, s k = x k + 1 − x k and g k = ∇ f ( x k ) = f ′ ( x k ) , consider ‖ . ‖ is the Euclidean norm and y k = g k + 1 − g k . The termination conditions for the conjugate gradient line search are often based on some version of the Wolfe conditions. The standard Wolfe conditions:</p><p>f ( x k + λ k d k ) − f ( x k ) ≤ ρ λ k g k T d k , (4)</p><p>g ( x k + λ k d k ) T d k ≥ σ g k T d k , (5)</p><table-wrap id="table1" ><label><xref ref-type="table" rid="table1">Table 1</xref></label><caption><title> Represents a definition of the variables used</title></caption><table><tbody><thead><tr><th align="center" valign="middle" >Variables</th><th align="center" valign="middle" >provide</th></tr></thead><tr><td align="center" valign="middle" >‖ . ‖</td><td align="center" valign="middle" >The standard for any vector</td></tr><tr><td align="center" valign="middle" >ε</td><td align="center" valign="middle" >Small positive value</td></tr><tr><td align="center" valign="middle" >x</td><td align="center" valign="middle" >Local minimum point of function f ( x )</td></tr><tr><td align="center" valign="middle" >λ k</td><td align="center" valign="middle" >Positive parameter to minimize the function f ( x )</td></tr><tr><td align="center" valign="middle" >∇</td><td align="center" valign="middle" >Directional derivative</td></tr><tr><td align="center" valign="middle" >G</td><td align="center" valign="middle" >Gradient vector of pattern n &#215; 1</td></tr><tr><td align="center" valign="middle" >G<sub>k</sub><sub> </sub></td><td align="center" valign="middle" >Hessian matrix n &#215; n</td></tr><tr><td align="center" valign="middle" >d<sub>k</sub><sub> </sub></td><td align="center" valign="middle" >Vector search pattern n &#215; 1</td></tr><tr><td align="center" valign="middle" >f</td><td align="center" valign="middle" >Target function</td></tr><tr><td align="center" valign="middle" >y<sub>k</sub><sub> </sub></td><td align="center" valign="middle" >Vector is the difference between two consecutive gradients of the pattern n &#215; 1</td></tr></tbody></table></table-wrap><p>where d k is a descent search direction and 0 &lt; ρ ≤ σ &lt; 1 , where β k is defined by one of the following formulas:</p><p>β k ( H S ) = y k T g k + 1 y k T d k ;     β k ( F R ) = g k + 1 T g k + 1 g k T g k     β k ( P R P ) = y k T g k + 1 g k T g k (6)</p><p>β k ( C D ) = − g k + 1 T g k + 1 g k T d k ;     β k ( L S ) = − y k T g k + 1 g k T d k ;     β k ( D Y ) = g k + 1 T g k + 1 y k T s k (7)</p><p>Al-Bayati and Al-Assady (1986) proposed three forms for the scalar β k defined by:</p><p>β k A B 1 = ‖ y k ‖ 2 ‖ g k ‖ 2 ;     β k A B 2 = − ‖ y k ‖ 2 d k T g k ;     β k A B 3 = ‖ y k ‖ 2 d k T y k (8) [<xref ref-type="bibr" rid="scirp.101268-ref11">11</xref>]</p></sec><sec id="s3"><title>3. Proposed a New Conjugacy Coefficient</title><p>We have the quasi-Newton condition</p><p>y k = G k s k (9)</p><p>We multiply both sides of Equation (9) by s k and we get</p><p>[ y k = G k s k ] * s k ⇒ y k T s k = G s k T s k</p><p>G = y k T s k ‖ s k ‖ 2 ⋅ I n &#215; n (10)</p><p>Let d k + 1 N = − λ G k − 1 g k + 1 (11)</p><p>d k + 1 N = − λ y k T s k ‖ s k ‖ 2 g k + 1 (12)</p><p>Multiply both sides of Equation (12) by y k and we get</p><p>y k T d k + 1 N = − λ [ y k T s k ‖ s k ‖ 2 ] y k T g k + 1 (13)</p><p>⇒ y k T d k + 1 C G = − y k T g k + 1 + β k d k T y k (14)</p><p>From (13) and (14) we have</p><p>− y k T g k + 1 + β k d k T y k = − λ [ y k T s k ‖ s k ‖ 2 ] y k T g k + 1 (15)</p><p>We assume that β k = β k ( D Y ) = g k + 1 T g k + 1 y k T d k</p><p>Then we have</p><p>− y k T g k + 1 + β k D Y d k T y k = − λ [ y k T s k ‖ s k ‖ 2 ] y k T g k + 1 (16)</p><p>− y k T g k + 1 + ‖ g k + 1 ‖ 2 d k T y k d k T y k = − λ [ y k T s k ‖ s k ‖ 2 ] y k T g k + 1 (17)</p><p>From Equation (17) we get:</p><p>− y k T g k + 1 + β k τ k = − λ [ y k T s k ‖ s k ‖ 2 ] y k T g k + 1 (18)</p><p>Then, we have</p><p>β k = − [ ‖ s k ‖ 2 2 [ f k − f k + 1 + g k + 1 T s k ] ] [ y k T s k ‖ s k ‖ 2 ] y k T g k + 1 + y k T g k + 1 τ k (19)</p><p>β k = − [ y k T s k 2 ( f k − f k + 1 + g k + 1 T s k ) ] y k T g k + 1 + y k T g k + 1 τ k (20)</p><p>β k = [ 1 − y k T s k 2 ( f k − f k + 1 + g k + 1 T s k ) ] y k T g k + 1 τ k (21)</p><p>Since τ k + 1 &gt; 0 then we suppose: τ k = ‖ g k ‖ 2 then:</p><p>β k = [ 1 − y k T s k 2 ( f k − f k + 1 + g k + 1 T s k ) ] y k T g k + 1 ‖ g k ‖ 2 . (22)</p><sec id="s3_1"><title>3.1. Outlines of the Proposed Algorithm</title><p>Step (1): The initial step: We select the starting point x 0 ∈ R n , and we select the accuracy solution ε &gt; 0 is a small positive real number and we find d k = − g k , λ 0 = M i n a r y ( g 0 ) , and we set k = 0 .</p><p>Step (2): The convergence test: If ‖ g k ‖ ≤ ε then stop and set the optimal solution is x k . Else, go to step (3).</p><p>Step (3): The line search: We compute the value of λ k by Cubic method and that satisfy the Wolfe conditions in Equations (4), (5) and go to step (4).</p><p>Step (4): Update the variables: x k + 1 = x k + λ k d k and compute f ( x k + 1 ) , g k + 1 and s k = x k + 1 − x k , y k = g k + 1 − g k .</p><p>Step (5): Check: if ‖ g k + 1 ‖ ≤ ε then stop. Else continue.</p><p>Step (6): The search direction: We compute the scalar β k ( N e w ) by using the Equation (22) and set k = k + 1 , and go to step (4).</p></sec><sec id="s3_2"><title>3.2. Flowchart of Conjugated Gradient Algorithm</title><p><xref ref-type="fig" rid="fig1">Figure 1</xref> shows the flowchart of the standard conjugated gradient method.</p></sec><sec id="s3_3"><title>3.3. Theoretical Properties for the New CG-Method.</title><p>In this section, we focus on the convergence behavior on the β k N e w method with exact line searches. Hence, we make the following basic assumptions on the objective function.</p><p>Assumption (1):</p><p>f is bounded below in the level set L x 0 = { x ∈ R n | f ( x ) ≤ f ( x 0 ) } ; in some neighborhood U of the level set L x 0 , f is continuously differentiable and its gradient ∇ f is Lipschitz continuous in the level set L x 0 , namely, there exists a constant L &gt; 0 such that:</p><p>‖ ∇ f ( x ) − ∇ f ( y ) ‖ ≤ L ‖ x − y ‖ forall x , y ∈ L x 0 . (23)</p><sec id="s3_3_1"><title>3.3.1. Sufficient Descent Property</title><p>We will show that in this section the proposed algorithm defined in the equations (22) and (3) satisfy the sufficient descent property which satisfies the convergence property.</p><p>Theorem (1):</p><p>The search direction d k that generated by the proposed algorithm of modified CG satisfies the descent property for all k, when the step size λ k satisfied the Wolfe conditions (4), (5).</p><p>Proof: we will use the indication to prove the descent property, for k = 0 , d 0 = − g 0 ⇒ d 0 T g 0 = − ‖ g 0 ‖ &lt; 0 , then we proved that the theorem is true for k = 0 , we assume that ‖ s k ‖ ≤ η ; ‖ g k + 1 ‖ ≤ Γ and ‖ g k ‖ ≤ η 2 and assume that the theorem is true for any k i.e. d k T g k &lt; 0 or s k T g k &lt; 0 since s k = λ k d k , now we will prove that the theorem is true for k + 1 then:</p><p>d k + 1 = − g k + 1 + β k ( N e w ) d k (24)</p><p>i.e. d k + 1 = − g k + 1 + [ 1 − y k T s k 2 ( f k − f k + 1 + g k + 1 T s k ) ] y k T g k + 1 ‖ g k ‖ 2 d k (25)</p><p>Multiply both sides of the Equation (25) by g k + 1 we get:</p><p>g k + 1 T d k + 1 = − ‖ g k + 1 ‖ 2 + [ 1 − y k T s k 2 ( f k − f k + 1 + g k + 1 T s k ) ] y k T g k + 1 ‖ g k ‖ 2 g k + 1 T d k (26)</p><p>Divided both side by ‖ g k + 1 ‖ 2 :</p><p>g k + 1 T d k + 1 + ‖ g k + 1 ‖ 2 ‖ g k + 1 ‖ 2 = [ 1 − y k T s k 2 ( f k − f k + 1 + g k + 1 T s k ) ] y k T g k + 1 ‖ g k ‖ 2 g k + 1 T d k ‖ g k + 1 ‖ 2 (27)</p><p>g k + 1 T d k + 1 + ‖ g k + 1 ‖ 2 ‖ g k + 1 ‖ 2 ≤ [ 1 − y k T s k 2 ( f k − f k + 1 + g k + 1 T s k ) ] ‖ y k ‖ ‖ g k + 1 ‖ ‖ g k ‖ 2 ‖ g k + 1 ‖ ‖ d k ‖ ‖ g k + 1 ‖ 2 (28)</p><p>g k + 1 T d k + 1 + ‖ g k + 1 ‖ 2 ‖ g k + 1 ‖ 2 ≤ [ 1 − y k T s k 2 ( f k − f k + 1 + g k + 1 T s k ) ] ‖ y k ‖ ‖ d k ‖ ‖ g k ‖ 2 (29)</p><p>g k + 1 T d k + 1 + ‖ g k + 1 ‖ 2 ‖ g k + 1 ‖ 2 ≤ [ 1 − ‖ y k ‖ ‖ s k ‖ 2 ( f k − f k + 1 + ‖ g k + 1 ‖ ‖ s k ‖ ) ] ‖ y k ‖ ‖ d k ‖ ‖ g k ‖ 2 (30)</p><p>g k + 1 T d k + 1 + ‖ g k + 1 ‖ 2 ‖ g k + 1 ‖ 2 ≤ ‖ y k ‖ ‖ d k ‖ ‖ g k ‖ 2 (31)</p><p>‖ g k + 1 ‖ 2 g k + 1 T d k + 1 + ‖ g k + 1 ‖ 2 ≥ ‖ g k ‖ 2 ‖ y k ‖ ‖ d k ‖ = δ &gt; 1 (32)</p><p>g k + 1 T d k + 1 + ‖ g k + 1 ‖ 2 ‖ g k + 1 ‖ 2 ≤ 1 δ (33)</p><p>g k + 1 T d k + 1 + ‖ g k + 1 ‖ 2 ≤ 1 δ ‖ g k + 1 ‖ 2 (34)</p><p>g k + 1 T d k + 1 ≤ − ( 1 − 1 δ ) ‖ g k + 1 ‖ 2</p><p>Let c = 1 − 1 δ (35)</p><p>Then g k + 1 T d k + 1 ≤ − c ‖ g k + 1 ‖ 2 (36)</p><p>For some positive constant c &gt; 0. This condition often has been used to analyze the global convergence of conjugate gradient methods with inexact line search.</p></sec><sec id="s3_3_2"><title>3.3.2. Global Convergence Property</title><p>The conclusion of the following lemma used to prove the global convergence of nonlinear conjugate gradient methods, under the general Wolfe line search.</p><p>Lemma 1:</p><p>Suppose assumptions (1) (i) and (ii) hold and consider any conjugate gradient method (22) and (3), where d k is a descent direction and λ k is obtained by the strong Wolfe line search. If</p><p>∑ k ≥ 1 α 1 ‖ d k ‖ 2 = α (37)</p><p>Then lim inf k → ∞ ‖ g k ‖ = 0 (38)</p><p>For uniformly convex functions which satisfy the above assumptions, we can prove that the norm of d k + 1 given by (25) is bounded above. Assume that the function f is a uniformly convex function, i.e. there exists a constant μ ≥ 0 such that for all x , y ∈ S ,</p><p>( g ( x ) − g ( y ) ) T ( x − y ) ≥ μ ‖ x − y ‖ 2 , (39)</p><p>Using Lemma 1 the following result can be proved.</p><p>Theorem 2:</p><p>Suppose that the assumptions (i) and (ii) hold. Consider the algorithm (3), (22). If ‖ s k ‖ tends to zero and there exists nonnegative constants η 1 and η 2 such that:</p><p>‖ g k ‖ 2 ≥ η 1 ‖ s k ‖ 2 ,       ‖ g k + 1 ‖ 2 ≥ η 2 ‖ s k ‖ (40)</p><p>and f is a uniformly convex function, then.</p><p>lim inf k → ∞ ‖ g k ‖ = 0 (41)</p><p>Proof: From Equation (22) We have:</p><p>β k n e w = [ 1 − y k T s k 2 ( f k − f k + 1 + g k + 1 T s k ) ] y k T g k + 1 ‖ g k ‖ 2</p><p>From Cuchy-Shwartz we get:</p><p>| β k + 1 N e w | = | [ 1 − y k T s k 2 ( f k − f k + 1 + g k + 1 T s k ) ] y k T g k + 1 ‖ g k ‖ 2 | (42)</p><p>| β k + 1 N e w | ≤ [ 1 − ‖ y k ‖ ‖ s k ‖ 2 ( f k − f k + 1 + g k + 1 T s k ) ] ‖ y k ‖ ‖ g k + 1 ‖ ‖ g k ‖ 2 (43)</p><p>But ‖ y k ‖ ≤ L ‖ s k ‖ . Then</p><p>| β k + 1 N e w | ≤ [ 1 − L ‖ s k ‖ ‖ s k ‖ 2 ( f k − f k + 1 + ‖ g k + 1 ‖ ‖ s k ‖ ) ] L ‖ s k ‖ ‖ g k + 1 ‖ ‖ g k ‖ 2 (44)</p><p>| β k + 1 N e w | ≤ [ 1 − L ‖ s k ‖ ‖ s k ‖ 2 ( f k − f k + 1 + ‖ g k + 1 ‖ ‖ s k ‖ ) ] L ‖ s k ‖ ‖ g k + 1 ‖ ‖ g k ‖ 2 (45)</p><p>From Equation (41)</p><p>| β k + 1 N e w | ≤ [ 1 − L η 2 2 ( | f k − f k + 1 | + η Γ ) ] L η Γ η 1 η ‖ s k ‖ (46)</p><p>Let from theorem (1):</p><p>A = f k − f k + 1 then | β k + 1 N e w | ≤ [ 1 − L η 2 2 ( | A | + η Γ ) ] L η Γ η 1 η ‖ s k ‖ (47)</p><p>| β k + 1 N e w | ≤ L η Γ η 1 η ‖ s k ‖ (48)</p><p>Hence,</p><p>‖ d k + 1 ‖ ≤ ‖ g k + 1 ‖ + | β k N | ‖ s k ‖ (49)</p><p>‖ d k + 1 ‖ ≤ γ + L η Γ η 1 η ‖ s k ‖ ‖ s k ‖ = γ + L η Γ η 1 η (50)</p><p>∑ k ≥ 1 1 ‖ d k + 1 ‖ 2 = ∞ (51)</p><p>1 ( γ + L η Γ η 1 η ) 2 ∑ k ≥ 1 1 = ∞ . (52)</p></sec></sec></sec><sec id="s4"><title>4. Whale Optimization Algorithm (WOA)</title><p>Whales are the largest animals in the world where there are whales with a length of up to 30 meters and weighs 180 tons. There are major species in the world such as killer whales, humpback whales, blue whales. Whales are often predators and whales are sleepless because they breathe from the ocean surface. In fact, only half of the brain sleeps and the interesting thing about whales is that they are very smart animals to add to emotion [<xref ref-type="bibr" rid="scirp.101268-ref3">3</xref>].</p><p>The hunting technique used by these whales is one of the most interesting methods and is called the method of nutrition, the process of searching for food. <xref ref-type="fig" rid="fig2">Figure 2</xref> represents the feeding behavior using the bubble trap in humpback whales.</p><p>The humpback whale dives about (12) meters down and then creates bubbles in the form of circles or spiral encircles the prey and then swim towards the surface and this process consists of three different stages as follows:</p><p>1: Coral loop.</p><p>2: Lob tail.</p><p>3: Capture loop.</p><p>This style of food can be observed in the humpback whale only.</p><sec id="s4_1"><title>4.1. Mathematical Model</title><p>In this section, we will talk about how physically encircle the prey, which divided into maneuvering the spiral and how to get to the prey. We will also discuss Whale Optimization Algorithm (WOA).</p><p>1) Encircling prey</p><p>One of the characteristics of humpback whales is their knowledge of the location of the prey and encircling them either in the research space. The optimal location can not be known in advance. But the whale algorithm assumes that the target prey is the best or near solution, then the rest of the other elements will update their positions according to the best location and is represented by the following equations:</p><p>D = | C ⋅ X ∗ ( t ) − X ( t ) | (53)</p><p>X ( t + 1 ) = X ∗ ( t ) − A ⋅ D (54)</p><p>Since:</p><p>t: represents instantaneous iteration (instantaneous).</p><p>A, C: Indicates the vectors.</p><p>X : means the position vector.</p><p>X ∗ represents the site vector for the best solution obtained and should occur in all iterations if the solution is not preferred</p><p>To calculate the values of vectors A and C, we use the following formulas:</p><p>A = 2 a ⋅ r − a (55)</p><p>C = 2 ⋅ r (56)</p><p>The value of a decreases over the frequency range from 2 to 0 and r represents a vector that takes values in the period [0, 1] at random.</p><p>2) Bubble-net attacking method (Exploitation phase)</p><p>Where the humpback whale style of food Bubble trap was divided mathematically into two parts are:</p><p>a. Shrinking encircling mechanism</p><p>This process carried out by the value of a where its value decreases as in Equation (5) which leads to decreasing A as well.</p><p>The value of a can found from the following formula:</p><p>a = 2 − t 2 M a x l t e r (57)</p><p>where</p><p>t: means the current iteration.</p><p>Maxlter: Maximum number of iterations allowed [<xref ref-type="bibr" rid="scirp.101268-ref10">10</xref>].</p><p>From this, we conclude that the value of A falls between [−a, a] which is a random value and that over all iterations the value of (a) decreases from 2 to 0 by placing values of A in [−1, 1] randomly.</p><p>The new location of the researched element can be considered in any position between the best element currently and the original position of the element. <xref ref-type="fig" rid="fig3">Figure 3</xref> shows the possible position of (X, Y) in the direction of (X*, Y*) where this can be achieved in the space of the two axes by setting 0 ≤ A ≤ 1 as follows It also explains the reduction of the encircling mechanism:</p><p>b. Spiral updating position</p><p>In this method, we will calculate the distance between the whale in (X, Y) and the prey in (X<sup>*</sup>, Y<sup>*</sup>) as shown in <xref ref-type="fig" rid="fig4">Figure 4</xref> and then create an equation that is a spiral equation between the position of the prey and the whale that represents the movement of the snail movement Humpback whales are as follows:</p><p>X ( t + 1 ) = D ′ ⋅ e b l cos ( 2 π l ) + X * ( t ) (58)</p><p>where</p><p>D ′ = | X * ( t ) − X ( t ) | (59)</p><p>Also, D ′ represents the best distance between the whale and its prey obtained to the present moment, (b) is a constant number to determine the shape of the logarithmic spiral, l is a number belonging to the period [−1, 1] randomly.</p><p>Humpback whales run around their prey in a shrinking circle and are in the form of a spiral. To express this technique, we will impose a 50% probability of selection to reduce the cord or spiral pattern to improve the position of the whales. It shall be mathematically as follows:</p><p>X ( t + 1 ) = { X * ( t ) − A ⋅ D                                             P &lt; 0.5 D ′ e b l cos ( 2 π l ) + X * ( t )                     P ≥ 0.5 (60)</p><p>where P: number represents belong to the period [0, 1] at randomly [<xref ref-type="bibr" rid="scirp.101268-ref6">6</xref>].</p><p>3) Search for prey:</p><p>The same method based on the variation in vector A can be used to search for prey. Humpback whales randomly search for their prey depending on the position of each one. Therefore, we will use the vector A with values greater than 1 or less than −1 randomly as this process will force the search element to search away from the reference whale, and in contrast to the exploitation stage. We will improve the position of the search element randomly in the exploration phase rather than better Element obtained so far, this method and 1 &lt; | A | . It emphasizes the exploration process and allows the WOA algorithm to do a full research and the mathematical representation is:</p><p>D = | C ⋅ X r a n d − X | (61)</p><p>X ( t + 1 ) = X r a n d − A ⋅ D (62)</p><p>Since rand : represents the selection of a random whale from the community currently, we have developed some possible placements about any solution with 1 &lt; | A | in <xref ref-type="fig" rid="fig5">Figure 5</xref> [<xref ref-type="bibr" rid="scirp.101268-ref10">10</xref>].</p></sec><sec id="s4_2"><title>4.2. Whale Optimization Algorithm</title><p>The WOA algorithm relies on a set of random solutions that begin with each</p><p>process. The search elements optimize their position based on the randomly selected search element or based on the best solution found to date. To facilitate the properties of exploration and exploitation, where the random element is found when | A | &gt; 1 , when | A | &lt; 1 is the best solution, because the position of the search element is improved [<xref ref-type="bibr" rid="scirp.101268-ref3">3</xref>].</p><p>The WOA algorithm is able to change the movements between the motion of the helix or circular motion based on the value of P and the algorithm will terminate if the stop condition is met.</p><p>If we take the WOA algorithm in theory, we can say that it is an integrated optimization algorithm because it has the ability to explore and exploit. On this basis, the proposed method defines the process of research on the best solutions and allows the rest of the other research elements to take the best obtained so far.</p><p>In the WOA algorithm, the search vector (A) can be allowed to update for the better by the easy passage between exploration and exploitation. For exploitation at ( | A | ≥ 1 ), it should be noted that the WOA algorithm has only two internal key parameters to be modified, A, C. [<xref ref-type="bibr" rid="scirp.101268-ref3">3</xref>].</p></sec><sec id="s4_3"><title>4.3. Whale Optimization Algorithm Features</title><p>1. Algorithms are easy to implement.</p><p>2. This algorithm is highly flexible.</p><p>3. Do not need many parameters.</p><p>4. You can easily navigate through exploration and exploitation based on one parameter.</p><p>5. Due to the simplicity of this algorithm and its lack of many parameters, it is used to solve the logarithmic spiral function, it covers the boundary area in the research space.</p><p>6. The position of the elements (solutions) in the exploration phase is improved based on randomly selected solutions rather than the best solution obtained so far [<xref ref-type="bibr" rid="scirp.101268-ref10">10</xref>].</p></sec><sec id="s4_4"><title>4.4. Proposed Hybrid Algorithm</title><p>In this paragraph, a new hybrid method proposed to solve the optimization issues called WOA-CG, a proposed hybrid algorithm that links the evolutionary ideas of the WOA algorithm with the classical optimization of Conjugate Gradient Algorithm, called WOA-CG. <xref ref-type="fig" rid="fig6">Figure 6</xref> represents the proposed algorithm</p><p>(WOA-CG). In this algorithm, the process in each iteration divided into two phases. In the first stage, the random community and the initial velocity of the WOA are generated, and in the second stage, the HS-CG algorithm is used. The steps of the proposed hybrid algorithm (WOA-CG) can be summarized as follows:</p><p>Step 1: Create a primary community by generating a primary community and configuring parameters A, C.</p><p>Step 2: The random community then entered into the classic conjugate gradient algorithm to improve the community and get the best solution.</p><p>Step 3: Calculate the fitness function of the resulting new community (from the traditional conjugate gradient algorithm as the primary community of the whale optimization algorithm) for each search element that represents the distance between the whale and its prey.</p><p>Step 4: Calculate the best position in the search elements. With this feature can produce a new generation of children.</p><p>Step 5: Update the location of each search element using the algorithm attributes: prey search, prey encirclement, hunting and attacking prey.</p><p>Step 6: Update the new generation position using numbered Equations (6) and (7).</p><p>Step 7: The WOA algorithm performs a number of iterative steps until the stop condition is met.</p></sec></sec><sec id="s5"><title>5. Practical Aspect</title><p>For the purpose of evaluating the performance of the proposed algorithms in solving optimization problems, the proposed WOA-CG algorithm was tested, using (10) standard functions to compare with the algorithm of the whale optimization themselves. The minimum and upper limits of each function used when the function reaches the minimum value and the highest frequency of all programs equals (500) iterations (<xref ref-type="table" rid="table2">Table 2</xref>).</p><p>Tables 3-5 show the results of the WOA-MCG algorithm compared with the results of the WOA algorithm. The proposed WOA-MCG algorithm shown to be successful by improving the results of most high-standard test functions. This confirms the success of the hybridization process.</p><p>The test was carried out by a laptop with the following characteristics: CPU speed is 2.70, RAM is 8 GB, and Matlab R2014a runs on Windows 8.</p></sec><sec id="s6"><title>6. Conclusions</title><p>1. Hybridization of post-intuitive algorithms with one of the classical algorithms has contributed to improving its performance by increasing the speed of convergence.</p><p>2. Hybridization of post-intuitive algorithms with one of the classical algorithms has contributed to an improvement in the quality of the resulting solutions by increasing its exploratory and exploitative capabilities, as numerical results show the ability of hybrid algorithms to solve different optimization problems.</p><table-wrap id="table2" ><label><xref ref-type="table" rid="table2">Table 2</xref></label><caption><title> Details of test functions</title></caption><table><tbody><thead><tr><th align="center" valign="middle" >F<sub>min</sub></th><th align="center" valign="middle" >Range</th><th align="center" valign="middle" >Dim</th><th align="center" valign="middle" >Function</th></tr></thead><tr><td align="center" valign="middle" >0</td><td align="center" valign="middle" >[−100, 100]</td><td align="center" valign="middle" >30</td><td align="center" valign="middle" >F 1 ( x ) = ∑ i = 1 n x i 2</td></tr><tr><td align="center" valign="middle" >0</td><td align="center" valign="middle" >[−10, 10]</td><td align="center" valign="middle" >30</td><td align="center" valign="middle" >F 2 ( x ) = ∑ i = 1 n | x | + ∏ i = 1 n | x i |</td></tr><tr><td align="center" valign="middle" >0</td><td align="center" valign="middle" >[−100, 100]</td><td align="center" valign="middle" >30</td><td align="center" valign="middle" >F 3 ( x ) = ∑ i = 1 n ( ∑ j − 1 n x i ) 2</td></tr><tr><td align="center" valign="middle" >0</td><td align="center" valign="middle" >[−100, 100]</td><td align="center" valign="middle" >30</td><td align="center" valign="middle" >F 4 ( x ) = max i { | x i | , 1 ≤ i ≤ n }</td></tr><tr><td align="center" valign="middle" >0</td><td align="center" valign="middle" >[−30, 30]</td><td align="center" valign="middle" >30</td><td align="center" valign="middle" >F 5 ( x ) = ∑ i = 1 n − 1 [ 100 ( x i + 1 − x i 2 ) 2 + ( x i − 1 ) 2 ]</td></tr><tr><td align="center" valign="middle" ></td><td align="center" valign="middle" >[−5.12, 5.12]</td><td align="center" valign="middle" >30</td><td align="center" valign="middle" >F 6 ( x ) = ∑ i = 1 n [ x i 2 − 10 cos ( 2 π x i ) + 10 ]</td></tr><tr><td align="center" valign="middle" >0</td><td align="center" valign="middle" >[−32, 32]</td><td align="center" valign="middle" >30</td><td align="center" valign="middle" >F 7 ( x ) = − 20 exp ( − 0.2 1 n ∑ i = 1 n x i 2 ) − exp ( 1 n ∑ i = 1 n cos ( 2 π x i ) ) + 20 + e</td></tr><tr><td align="center" valign="middle" >0</td><td align="center" valign="middle" >[−600, 600]</td><td align="center" valign="middle" >30</td><td align="center" valign="middle" >F 8 ( x ) = ∑ i = 1 n x i 2 − ∏ i = 1 n cos ( x i i ) + 1</td></tr><tr><td align="center" valign="middle" >0.00030</td><td align="center" valign="middle" >[−5, 5]</td><td align="center" valign="middle" >4</td><td align="center" valign="middle" >F 9 ( x ) = ∑ i = 1 11 [ a i − x 1 ( b i 2 + b i x 2 ) b i 2 + b i x 3 + x 4 ] 2</td></tr><tr><td align="center" valign="middle" >−1.0316</td><td align="center" valign="middle" >[−5, 5]</td><td align="center" valign="middle" >2</td><td align="center" valign="middle" >F 10 = 4 x 1 2 − 2.1 x 1 4 + 1 3 x 1 6 + x 1 x 2 − 4 x 2 2 + 4 x 2 4</td></tr></tbody></table></table-wrap><table-wrap id="table3" ><label><xref ref-type="table" rid="table3">Table 3</xref></label><caption><title> Comparison of results between WOA and WOA-MCG using the number of elements consisting of 5 elements and the number of iterations 500</title></caption><table><tbody><thead><tr><th align="center" valign="middle" >WOA-MCG</th><th align="center" valign="middle" >WOA</th><th align="center" valign="middle" >Functions</th></tr></thead><tr><td align="center" valign="middle" >1.095564774108044e−219</td><td align="center" valign="middle" >2.564031849964600e−24</td><td align="center" valign="middle" >F<sub>1</sub></td></tr><tr><td align="center" valign="middle" >5.888194531373766e−120</td><td align="center" valign="middle" >2.832824456010799e−21</td><td align="center" valign="middle" >F<sub>2</sub></td></tr><tr><td align="center" valign="middle" >1.152976000000000e−193</td><td align="center" valign="middle" >1.265179717100000e+05</td><td align="center" valign="middle" >F<sub>3</sub></td></tr><tr><td align="center" valign="middle" >7.360625000000001e−98</td><td align="center" valign="middle" >67.423509999999993</td><td align="center" valign="middle" >F<sub>4</sub></td></tr><tr><td align="center" valign="middle" >29</td><td align="center" valign="middle" >28.865160000000003</td><td align="center" valign="middle" >F<sub>5</sub></td></tr><tr><td align="center" valign="middle" >0</td><td align="center" valign="middle" >6.612310000000017</td><td align="center" valign="middle" >F<sub>6</sub></td></tr><tr><td align="center" valign="middle" >8.8818e−16</td><td align="center" valign="middle" >5.149836340000000e−12</td><td align="center" valign="middle" >F<sub>7</sub></td></tr><tr><td align="center" valign="middle" >0</td><td align="center" valign="middle" >1.110200000000000e−17</td><td align="center" valign="middle" >F<sub>8</sub></td></tr><tr><td align="center" valign="middle" >0.14841</td><td align="center" valign="middle" >0.002155848000000</td><td align="center" valign="middle" >F<sub>9</sub></td></tr><tr><td align="center" valign="middle" >4.933645298446245−e−63</td><td align="center" valign="middle" >−1.0316</td><td align="center" valign="middle" >F<sub>1</sub><sub>0</sub></td></tr></tbody></table></table-wrap><table-wrap id="table4" ><label><xref ref-type="table" rid="table4">Table 4</xref></label><caption><title> Comparison of results between WOA and WOA-MCG using the number of elements consisting of 10 elements and the number of iterations 500</title></caption><table><tbody><thead><tr><th align="center" valign="middle" >WOA-MCG</th><th align="center" valign="middle" >WOA</th><th align="center" valign="middle" >Functions</th></tr></thead><tr><td align="center" valign="middle" >5.730144657116025e−238</td><td align="center" valign="middle" >6.064980606729451e−43</td><td align="center" valign="middle" >F<sub>1</sub></td></tr><tr><td align="center" valign="middle" >2.391417877673390e−135</td><td align="center" valign="middle" >1.189940936720370e−35</td><td align="center" valign="middle" >F<sub>2</sub></td></tr><tr><td align="center" valign="middle" >9.460120000000001e−194</td><td align="center" valign="middle" >9.329087286249999e+04</td><td align="center" valign="middle" >F<sub>3</sub></td></tr><tr><td align="center" valign="middle" >6.984070000000001e−98</td><td align="center" valign="middle" >58.731710000000000</td><td align="center" valign="middle" >F<sub>4</sub></td></tr><tr><td align="center" valign="middle" >29</td><td align="center" valign="middle" >28.670350000000003</td><td align="center" valign="middle" >F<sub>5</sub></td></tr><tr><td align="center" valign="middle" >0</td><td align="center" valign="middle" >2.273700000000000e−14</td><td align="center" valign="middle" >F<sub>6</sub></td></tr><tr><td align="center" valign="middle" >8.8818e−16</td><td align="center" valign="middle" >3.019808000000000e−15</td><td align="center" valign="middle" >F<sub>7</sub></td></tr><tr><td align="center" valign="middle" >0</td><td align="center" valign="middle" >0.041301000000000</td><td align="center" valign="middle" >F<sub>8</sub></td></tr><tr><td align="center" valign="middle" >0.14841</td><td align="center" valign="middle" >0.002402970000000</td><td align="center" valign="middle" >F<sub>9</sub></td></tr><tr><td align="center" valign="middle" >0.721217700000000−</td><td align="center" valign="middle" >1.0316−</td><td align="center" valign="middle" >F<sub>1</sub><sub>0</sub></td></tr></tbody></table></table-wrap><table-wrap-group id="5"><label><xref ref-type="table" rid="table5">Table 5</xref></label><caption><title> (a) Comparison of results between AWO and AWO-MCG using the number of elements consisting of 15 elements and the number of iterations 500; (b) Comparison of results between AWO and AWO-MCG using the number of elements consisting of 30 elements and the number of iterations 500</title></caption><table-wrap id="5_1"><caption><title> (b)</title></caption><table><tbody><thead><tr><th align="center" valign="middle" >WOA-MCG</th><th align="center" valign="middle" >WOA</th><th align="center" valign="middle" >Functions</th></tr></thead><tr><td align="center" valign="middle" >4.389922974837402e−245</td><td align="center" valign="middle" >8.652060084310580e−57</td><td align="center" valign="middle" >F<sub>1</sub></td></tr><tr><td align="center" valign="middle" >1.310898716422000e−139</td><td align="center" valign="middle" >8.334965781000000e−44</td><td align="center" valign="middle" >F<sub>2</sub></td></tr><tr><td align="center" valign="middle" >7.116550000000000e−194</td><td align="center" valign="middle" >6.250821902999999e+04</td><td align="center" valign="middle" >F<sub>3</sub></td></tr><tr><td align="center" valign="middle" >6.401950000000001e−98</td><td align="center" valign="middle" >70.443219999999982</td><td align="center" valign="middle" >F<sub>4</sub></td></tr><tr><td align="center" valign="middle" >29</td><td align="center" valign="middle" >28.532130000000002</td><td align="center" valign="middle" >F<sub>5</sub></td></tr><tr><td align="center" valign="middle" >0</td><td align="center" valign="middle" >1.136900000000000e−14</td><td align="center" valign="middle" >F<sub>6</sub></td></tr><tr><td align="center" valign="middle" >8.8818e−16</td><td align="center" valign="middle" >5.861976000000000e−15</td><td align="center" valign="middle" >F<sub>7</sub></td></tr><tr><td align="center" valign="middle" >0</td><td align="center" valign="middle" >0</td><td align="center" valign="middle" >F<sub>8</sub></td></tr><tr><td align="center" valign="middle" >0.14841</td><td align="center" valign="middle" >0.001559451000000</td><td align="center" valign="middle" >F<sub>9</sub></td></tr><tr><td align="center" valign="middle" >−1</td><td align="center" valign="middle" >1.0316−</td><td align="center" valign="middle" >F<sub>1</sub><sub>0</sub></td></tr></tbody></table></table-wrap><table-wrap id="5_2"><caption><title></title></caption><table><tbody><thead><tr><th align="center" valign="middle" >WOA-MCG</th><th align="center" valign="middle" >WOA</th><th align="center" valign="middle" >Functions</th></tr></thead><tr><td align="center" valign="middle" >1.278730856920000e−269</td><td align="center" valign="middle" >6.908449965597019e−73</td><td align="center" valign="middle" >F<sub>1</sub></td></tr><tr><td align="center" valign="middle" >9.284410409233333e−147</td><td align="center" valign="middle" >1.329530134275000e−51</td><td align="center" valign="middle" >F<sub>2</sub></td></tr><tr><td align="center" valign="middle" >4.233633333333334e−194</td><td align="center" valign="middle" >4.278456619000001e+04</td><td align="center" valign="middle" >F<sub>3</sub></td></tr><tr><td align="center" valign="middle" >6.726541000000001e−98</td><td align="center" valign="middle" >52.284220000000005</td><td align="center" valign="middle" >F<sub>4</sub></td></tr><tr><td align="center" valign="middle" >29</td><td align="center" valign="middle" >28.006639999999997</td><td align="center" valign="middle" >F<sub>5</sub></td></tr><tr><td align="center" valign="middle" >0</td><td align="center" valign="middle" >5.684300000000000e−15</td><td align="center" valign="middle" >F<sub>6</sub></td></tr><tr><td align="center" valign="middle" >8.8818e−16</td><td align="center" valign="middle" >4.440896000000000e−15</td><td align="center" valign="middle" >F<sub>7</sub></td></tr><tr><td align="center" valign="middle" >0</td><td align="center" valign="middle" >0</td><td align="center" valign="middle" >F<sub>8</sub></td></tr><tr><td align="center" valign="middle" >0.14841</td><td align="center" valign="middle" >7.288930000000001e−04</td><td align="center" valign="middle" >F<sub>9</sub></td></tr><tr><td align="center" valign="middle" >−1</td><td align="center" valign="middle" >1.0316−</td><td align="center" valign="middle" >F<sub>1</sub><sub>0</sub></td></tr></tbody></table></table-wrap></table-wrap-group><p>The results of the WOA-MCG algorithm compared with the WOA algorithm itself, which led to encouraging results as good solutions were obtained for most test functions.</p></sec><sec id="s7"><title>Conflicts of Interest</title><p>The authors declare no conflicts of interest regarding the publication of this paper.</p></sec><sec id="s8"><title>Cite this paper</title><p>Khaleel, L.R. and Mitras, B.A. (2020) Hybrid Whale Optimization Algorithm with Modified Conjugate Gradient Method to Solve Global Optimization Problems. Open Access Library Journal, 7: e6459. https://doi.org/10.4236/oalib.1106459</p></sec></body><back><ref-list><title>References</title><ref id="scirp.101268-ref1"><label>1</label><mixed-citation publication-type="other" xlink:type="simple">Yang, X.-S. (2010) Engineering Optimization: An Introduction with Metaheuristic Applications. John Wiley &amp; Sons, New Jersey.  
https://doi.org/10.1002/9780470640425</mixed-citation></ref><ref id="scirp.101268-ref2"><label>2</label><mixed-citation publication-type="book" xlink:type="simple">Meng, X., Liu, Y., Gao, X. and Zhang, H. (2014) A New Bio-Inspired Algorithm: Chicken Swarm Optimization. In: Tan, Y., Shi, Y., Coello, C.A.C., Eds., Advances in Swarm Intelligence, ICSI 2014. Lecture Notes in Computer Science, Vol. 8794. Springer, Cham, 86-94. https://doi.org/10.1007/978-3-319-11857-4_10</mixed-citation></ref><ref id="scirp.101268-ref3"><label>3</label><mixed-citation publication-type="other" xlink:type="simple">Mirjalili, S. and Lewis, A. (2016) The Whale Optimization Algorithm. Advances in Engineering Software, 95, 51-67. https://doi.org/10.1016/j.advengsoft.2016.01.008</mixed-citation></ref><ref id="scirp.101268-ref4"><label>4</label><mixed-citation publication-type="other" xlink:type="simple">Trivedi, I.N., Pradeep, J., Narottam, J., Arvind, K. and Dilip, L. (2016) Novel Adaptive Whale Optimization Algorithm for Global Optimization. Indian Journal of Science and Technology, 9, 1-6. https://doi.org/10.17485/ijst/2016/v9i38/101939</mixed-citation></ref><ref id="scirp.101268-ref5"><label>5</label><mixed-citation publication-type="journal" xlink:type="simple"><name name-style="western"><surname>Touma</surname><given-names> H.J. </given-names></name>,<etal>et al</etal>. (<year>2016</year>)<article-title>Study of the Economic Dispatch Problem on IEEE 30-Bus System Using Whale Optimization Algorithm</article-title><source> International Journal of Engineering Technology and Sciences (IJETS)</source><volume> 5</volume>,<fpage> 11</fpage>-<lpage>18</lpage>.<pub-id pub-id-type="doi"></pub-id></mixed-citation></ref><ref id="scirp.101268-ref6"><label>6</label><mixed-citation publication-type="other" xlink:type="simple">Abhiraj, T. and Aravindhababu, P. (2017) Dragonfly Optimization Based Reconfiguration for Voltage Profile Enhancement in Distribution Systems. International Journal of Computer Applications, 158, 1-4. https://doi.org/10.5120/ijca2017912758</mixed-citation></ref><ref id="scirp.101268-ref7"><label>7</label><mixed-citation publication-type="other" xlink:type="simple">Andrea, R., Blesa, M., Blum, C. and Michael, S. (2008) Hybrid Metaheuristics: An Emerging Approach to Optimization, Springer, Berlin.</mixed-citation></ref><ref id="scirp.101268-ref8"><label>8</label><mixed-citation publication-type="other" xlink:type="simple">Manoharan, N., Dash, S.S., Rajesh, K.S. and Panda, S. (2017) Automatic Generation Control by Hybrid Invasive Weed Optimization and Pattern Search Tuned 2-DOF PID Controller. International Journal of Computers, Communications &amp; Control, 12, 533-549. https://doi.org/10.15837/ijccc.2017.4.2751</mixed-citation></ref><ref id="scirp.101268-ref9"><label>9</label><mixed-citation publication-type="other" xlink:type="simple">Mirjalili, S. (2016) Dragonfly Algorithm: A New Meta-Heuristic Optimization Technique for Solving Single-Objective, Discrete, and Multi-Objective Problems. Neural Computing and Applications, 27, 1053-1073.  
https://doi.org/10.1007/s00521-015-1920-1</mixed-citation></ref><ref id="scirp.101268-ref10"><label>10</label><mixed-citation publication-type="other" xlink:type="simple">Mafarja, M.M. and Mirjalili, S. (2017) Hybrid Whale Optimization Algorithm with Simulated Annealing for Feature Selection. Neurocomputing, 260, 302-312.  
https://doi.org/10.1016/j.neucom.2017.04.053</mixed-citation></ref><ref id="scirp.101268-ref11"><label>11</label><mixed-citation publication-type="other" xlink:type="simple">Bayati, A.Y. and Assady, N.H. (1986) Conjugate Gradient Method. Technical Research, School of Computer Studies, Leeds University.</mixed-citation></ref></ref-list></back></article>