<?xml version="1.0" encoding="UTF-8"?><!DOCTYPE article  PUBLIC "-//NLM//DTD Journal Publishing DTD v3.0 20080202//EN" "http://dtd.nlm.nih.gov/publishing/3.0/journalpublishing3.dtd"><article xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink" dtd-version="3.0" xml:lang="en" article-type="research article"><front><journal-meta><journal-id journal-id-type="publisher-id">OJMH</journal-id><journal-title-group><journal-title>Open Journal of Modern Hydrology</journal-title></journal-title-group><issn pub-type="epub">2163-0461</issn><publisher><publisher-name>Scientific Research Publishing</publisher-name></publisher></journal-meta><article-meta><article-id pub-id-type="doi">10.4236/ojmh.2021.111001</article-id><article-id pub-id-type="publisher-id">OJMH-108006</article-id><article-categories><subj-group subj-group-type="heading"><subject>Articles</subject></subj-group><subj-group subj-group-type="Discipline-v2"><subject>Earth&amp;Environmental Sciences</subject></subj-group></article-categories><title-group><article-title>
 
 
  Effects of Model Structural Complexity and Data Pre-Processing on Artificial Neural Network (ANN) Forecast Performance for Hydrological Process Modelling
 
</article-title></title-group><contrib-group><contrib contrib-type="author" xlink:type="simple"><name name-style="western"><surname>Martins</surname><given-names>Yusuf Otache</given-names></name><xref ref-type="aff" rid="aff1"><sup>1</sup></xref><xref ref-type="corresp" rid="cor1"><sup>*</sup></xref></contrib><contrib contrib-type="author" xlink:type="simple"><name name-style="western"><surname>John</surname><given-names>Jiya Musa</given-names></name><xref ref-type="aff" rid="aff1"><sup>1</sup></xref></contrib><contrib contrib-type="author" xlink:type="simple"><name name-style="western"><surname>Ibrahim</surname><given-names>Abayomi Kuti</given-names></name><xref ref-type="aff" rid="aff1"><sup>1</sup></xref></contrib><contrib contrib-type="author" xlink:type="simple"><name name-style="western"><surname>Mustapha</surname><given-names>Mohammed</given-names></name><xref ref-type="aff" rid="aff2"><sup>2</sup></xref></contrib><contrib contrib-type="author" xlink:type="simple"><name name-style="western"><surname>Lydia</surname><given-names>Ezekiel Pam</given-names></name><xref ref-type="aff" rid="aff1"><sup>1</sup></xref></contrib></contrib-group><aff id="aff2"><addr-line>Raw Materials Research and Development Council, Abuja, Nigeria</addr-line></aff><aff id="aff1"><addr-line>Department of Agricultural &amp;amp; Bioresources Engineering, Federal University of Technology, Minna, Nigeria</addr-line></aff><pub-date pub-type="epub"><day>29</day><month>01</month><year>2021</year></pub-date><volume>11</volume><issue>01</issue><fpage>1</fpage><lpage>18</lpage><history><date date-type="received"><day>3,</day>	<month>September</month>	<year>2018</year></date><date date-type="rev-recd"><day>26,</day>	<month>January</month>	<year>2021</year>	</date><date date-type="accepted"><day>29,</day>	<month>January</month>	<year>2021</year></date></history><permissions><copyright-statement>&#169; Copyright  2014 by authors and Scientific Research Publishing Inc. </copyright-statement><copyright-year>2014</copyright-year><license><license-p>This work is licensed under the Creative Commons Attribution International License (CC BY). http://creativecommons.org/licenses/by/4.0/</license-p></license></permissions><abstract><p>
 
 
  The choice of a particular Artificial Neural Network (ANN) structure is a seemingly difficult task; worthy of relevance is that there is no systematic way for establishing a suitable architecture. In view of this, the study looked at the effects of ANN structural complexity and data pre-processing regime on its forecast performance. To address this aim, two ANN structural configurations: 
  <b>1) Single-hidden layer, </b>
  and
  <b> 2) Double-hidden layer</b>
   feed
  -
  forward back
   
  propagation network were employed. Results obtained revealed generally that: a) ANN comprised of double hidden layers tends to be less robust and converges with less accuracy than its single-hidden layer counterpart under identical situations; b) for a univariate time series, phase-space reconstruction using embedding dimension which is based on dynamical systems theory is an effective way for determining the appropriate number of ANN input neurons, and c) data pre-processing via the scaling approach excessively limits the output range of the transfer function. In specific terms considering extreme flow prediction capability on the basis of effective correlation: Percent maximum and minimum correlation coefficient (<b>R<sub>max</sub>%</b> and <b>R<sub>min</sub>%</b>), on the average for one-day ahead forecast during the training and validation phases respectively for the adopted network structures: <b>8 7 5 (i.e., 8 input nodes, 7 nodes in the hidden layer, and 5 output nodes in the output layer)</b>, <b>8 5 2 5 (8 nodes in the input layer, 5 nodes in the first hidden layer, 2 nodes in the second hidden layer, and 5 nodes in the output layer)</b>, and <b>8 4 3 5 (8 nodes in the input layer, 4 nodes in the first hidden layer, 3 nodes in the second hidden layer, and 5 nodes in the output layer)</b> gave: <b>101.2</b>, <b>99.4</b>; <b>100.2</b>, <b>218.3</b>; <b>93.7</b>, <b>95.0</b> in all instances irrespective of the training algorithm (i.e., pooled). On the other hand, in terms of percent of correct event prediction, the respective performances of the models for both low and high flows during the training and validation phases, respectively were: <b>0.78, 0.96: 0.65, 0.87; 0.76, 0.93: 0.61, 0.83; </b>and<b> 0.79, 0.96: 0.65, 0.87</b>. Thus, it suffices to note that on the basis of coherence or regularity of prediction consistency, the ANN model: <b>8 4 3 5</b> performed better. This implies that though the adoption of large hidden layers vis-&#224;-vis corresponding large neuronal signatures could be counter-productive because of network over-fitting, however, it may provide additional representational power. Based on the findings, it is imperative to note that ANN model is by no means a substitute for conceptual watershed 
  modelling, therefore, exogenous variables should be incorporated in streamflow modelling and forecasting exercise because of their hydrologic evolutions.
 
</p></abstract><kwd-group><kwd>Streamflow</kwd><kwd> Neural Network</kwd><kwd> Phase-Space</kwd><kwd> Optimisation</kwd><kwd> Algorithm</kwd></kwd-group></article-meta></front><body><sec id="s1"><title>1. Introduction</title><p>It is imperative to note as reported in Chibanga et al. [<xref ref-type="bibr" rid="scirp.108006-ref1">1</xref>] that the ability to predict events with reasonable accuracy enables one to plan in advance what course of action to take, get the best out of situation and avert probable deleterious ones. But to achieve this, the system analyst might prefer not to waste time and effort required to develop and implement a conceptual model but rather opt for a simpler system-theoretic model (Chibanga et al., [<xref ref-type="bibr" rid="scirp.108006-ref1">1</xref>] ). The system-theoretic models embrace artificial neural networks (ANNs); ANNs entail the application of difference or differential equation to identify a direct mapping between inputs and outputs without detailed consideration of the internal structure of the physical processes (Abrahart and See, [<xref ref-type="bibr" rid="scirp.108006-ref2">2</xref>] ). Thus, in the views of Chibanga et al. [<xref ref-type="bibr" rid="scirp.108006-ref1">1</xref>], ANN model structure, being a flexible mathematical structure capable of identifying complex nonlinear relationships between input and output sets, stands out as one of its principal characteristics of vital importance.</p><p>According to Abrahart [<xref ref-type="bibr" rid="scirp.108006-ref3">3</xref>], system-theoretic/black box or neural network forecasting and prediction offer various benefits ahead of the traditional conceptual modelling; some of the benefits in line with the guiding principles are parsimony, modesty, and testability (Hillel, [<xref ref-type="bibr" rid="scirp.108006-ref4">4</xref>] ). However, though an artificial neural network (ANN) is a flexible mathematical structure that is capable of identifying complex nonlinear relationships between input and output data sets, its overall performance is dependent on a whole lot of associated variables. But since an ANN does not depend solely upon the physical parameters used in the analytical approach, it could be designed with much different architecture to achieve optimal performance. As reported in Balkhair [<xref ref-type="bibr" rid="scirp.108006-ref5">5</xref>], the performance of ANN is sensitive to its physical architecture, such as the number of input nodes, hidden layer nodes, and output nodes; i.e. the appropriate architecture of ANN is highly problem dependent. This implies that as in the identification of other nonlinear types of models (system-theoretic or conceptual), 1) a model structure must be identified, and 2) the model parameters must be calibrated through an iterative procedure that employs an objective function surface in search of an optimum (Hsu et al., [<xref ref-type="bibr" rid="scirp.108006-ref6">6</xref>] ).</p><p>The selection of an appropriate architecture is usually problematic. In the views of Abrahart and See [<xref ref-type="bibr" rid="scirp.108006-ref2">2</xref>], there is no single correct procedure to determine the optimum of units or layers, although one or two “rules of thumb” have been put forward (e.g. Sarle, [<xref ref-type="bibr" rid="scirp.108006-ref7">7</xref>] ) and various automated growing, pruning and network breeding algorithms exist (e.g. Fahlman and Lebiere, [<xref ref-type="bibr" rid="scirp.108006-ref8">8</xref>]; SNN Group, [<xref ref-type="bibr" rid="scirp.108006-ref9">9</xref>] ). In this regard, selection of the optimal number of hidden units is worth mentioning; often, it is considered to be problem dependent. Though the number of hidden units and layers will control the power of the model to perform more complex modelling but as noted by Abrahart and See [<xref ref-type="bibr" rid="scirp.108006-ref2">2</xref>], this is not without its associated trade-off. It has been noted (Abrahart and See, [<xref ref-type="bibr" rid="scirp.108006-ref2">2</xref>] ) that the use of large hidden layers also could be counter-productive because an excessive number of free parameters will encourage over-fitting of the network solution to the training data and thus reduce the generalisation capabilities of the final product. Thus, the general concern is how to find a balance between the hidden units between the layers as well as the number of hidden layers.</p><p>In light of the preceding sections, considering that the ANN model structure is ideally suited for modelling highly nonlinear input-output relationships, the central thrust of this study, therefore, is to assess the implication(s) of some of the latent issues in the application or adoption of neural network modelling paradigm or approach; specifically, in this regard, the emphasis is on model structural complexity and implicitly bring to the fore the correlation between optimisation algorithm as well as data pre-processing regime.</p></sec><sec id="s2"><title>2. Methodology</title><sec id="s2_1"><title>2.1. Data Collection and Management</title><p>For this study, daily streamflow sequence of the River Benue at the Makurdi hydrometric station was obtained from the Benue State Water Works and National Inland Waterways Authority (Makurdi Office); the data sequence spanned through an entire period of thirty (30) years. Consistency test and continuity tests were done; based on these tests, non-continuous data years were removed thus reducing the length to 26 years (i.e., 9490 data elements). The entire time series of length of 9490 daily values was thus partitioned into two-set constituents of 8670 and 730 data points corresponding to training and validation phases, respectively; i.e., split sampling approach. <xref ref-type="fig" rid="fig1">Figure 1</xref> shows the traverse of River Benue and the location of the Makurdi hydrometric station. The River is perennial and exhibits high seasonality with peak flow regimes usually in the months of September and October. It takes its source from the Cameroon high lands; in conjunction with River Niger, they drain the larger part of the country and vastly impart the hydrological evolutions of their respective flood plains, albeit the entire country to a great extent.</p></sec><sec id="s2_2"><title>2.2. Development of ANN Model</title><sec id="s2_2_1"><title>2.2.1. Preliminary Analysis of the Daily Streamflow/Discharge Dynamics</title><p>The mean daily discharges are as shown in <xref ref-type="fig" rid="fig2">Figure 2</xref>; the discernible features are the flood peaks and the seasonal periodicity, with both large and small discharges during the year. Besides these general characteristics, the study of the autocorrelation and the spectral analysis provide the first important indications on the aperiodicity of the signal under examination. <xref ref-type="fig" rid="fig3">Figure 3</xref> shows the autocorrelation for values of the delay time (lag) between 1 day and about 5 years; after a rapid decrease, the autocorrelation function displays a regular behaviour, which represents the effect of the seasonal characteristic of the discharges, due, besides the rainfall regime, to other hydrologic forcing which breathes with the season. Contrary to expectation, there is no brisk fall of the autocorrelation as shown in <xref ref-type="fig" rid="fig4">Figure 4</xref>, which might indicate a complex behaviour, having characteristic timescales of a few days.</p><p>Similarly, the autocorrelation of the first difference signal (<xref ref-type="fig" rid="fig4">Figure 4</xref>) does not show much of a rapid monotonic decrease in autocorrelation. Despite this though, apart from the periodicity, the behaviour of the series appears essentially aperiodic and erratic; for example, once the annual periodic component has been filtered out from the series through least squares methods, the spectral density (<xref ref-type="fig" rid="fig5">Figure 5</xref>) exhibits a typical broadband behaviour. The spectrum does not show any privileged frequencies, but rather a linear decay that links the</p><p>whole range of frequency components. The fact that the spectrum is continuous with a pronounced and wide base underscores the aperiodicity of the series; but the problem however is, how much does the character of this complex aperiodicity and irregularity may translate to complex nonlinearity. This therefore portends the need to investigate if the dynamics of the discharges of a river could have a dominant chaotic signature on which high-dimension linear and nonlinear dynamics may be grafted.</p></sec><sec id="s2_2_2"><title>2.2.2. Reconstruction of Phase-Space (Attractor) by Time Delay Embedding</title><p>The first step in the search for a deterministic behaviour is that of attempting to reconstruct the dynamics in phase space. Having available the time series of only one of the variables present in the phenomenon, that is, the discharge x ( t i ) , the delay time method proposed by Takens [<xref ref-type="bibr" rid="scirp.108006-ref10">10</xref>] and Packard et al. [<xref ref-type="bibr" rid="scirp.108006-ref11">11</xref>] can be used to reconstruct the attractor; this is based on the fact that the interaction between the variables is such that every component contains information on the complex dynamics of the system. Choosing a delay time τ, usually a multiple of sampling period Δ t , the method entails the construction of a series of M = ( m − 1 ) τ / Δ t vectors, of the dimension m, of the form</p><p>x ( t i ) = { x ( t i ) , x ( t i + τ ) , ⋯ , x [ t i + ( m − 1 ) τ ] } (1)</p><p>where, m ( m = 2 , 3 , ⋯ ) is called the embedding dimension.</p><p>To construct a well-behaved phase-space by delay time, a careful choice of τ is critical. The delay time τ is commonly selected by using the autocorrelation function (ACF) method where ACF first attains zeros or drops below a small value, say 1/e<sup>4</sup>, or the mutual information (MI) method according to Fraser and Swinney [<xref ref-type="bibr" rid="scirp.108006-ref12">12</xref>] where the MI attains a minimum. Here, the delay time τ is taken as the lag that first generates a zero autocorrelation, which is when the autocorrelation function crosses the zero line (Mpitsos et al., [<xref ref-type="bibr" rid="scirp.108006-ref13">13</xref>] ). In practice, the estimate of τ is usually application and author dependent; for instance, some authors take the delay time as 1 day (Porporato and Ridolfi, [<xref ref-type="bibr" rid="scirp.108006-ref14">14</xref>] ), 2 days (Jayawardena and Lai, [<xref ref-type="bibr" rid="scirp.108006-ref15">15</xref>], 7 days (Islam and Sivakumar, [<xref ref-type="bibr" rid="scirp.108006-ref16">16</xref>] ), 10 days (Elshorbagy et al., [<xref ref-type="bibr" rid="scirp.108006-ref17">17</xref>] ), 20 days (Wilcox et al., [<xref ref-type="bibr" rid="scirp.108006-ref18">18</xref>] ), 91 days (Wang, [<xref ref-type="bibr" rid="scirp.108006-ref19">19</xref>] ), and 146 days (Pasternack, [<xref ref-type="bibr" rid="scirp.108006-ref20">20</xref>] ). These differences may arise from the nature of the autocorrelation function; to compare the influence of the delay time τ on the construction of state-phase, the state-phase maps can be plotted for differing τ values. The best τ value should make the state-phase plot best unfolded. Towards this end, the state-phase map is constructed for different τ values (τ = 1, 7, 10, 30, and 78), these are as displayed in <xref ref-type="fig" rid="fig6">Figure 6</xref> along with the 3-dimensional state-phase map based on τ equals to 78, i.e., when the autocorrelation function first crossed the zero line (<xref ref-type="fig" rid="fig6">Figure 6</xref>). <xref ref-type="fig" rid="fig6">Figure 6</xref> shows that the best unfolding can be obtained when τ = 78; therefore, τ = 78 is adopted for estimating the correlation dimension of the daily streamflow process in this study.</p></sec><sec id="s2_2_3"><title>2.2.3. Network Topology</title><p>The time delay coordinate method (Packard, et al. [<xref ref-type="bibr" rid="scirp.108006-ref11">11</xref>]; Takens, [<xref ref-type="bibr" rid="scirp.108006-ref10">10</xref>] ) was used to reconstruct the phase-space from the scalar time series; in this case, because of the nature of the data; i.e., a univariate series. This is informed by the fact that to describe the temporal evolution of a dynamical system in a multi-dimensional phase-space with a scalar time series, there is need to employ some techniques to unfold the multi-dimensional structure using the available data. Thus, the approach in the proceeding section is further complimented by applying the method for the determination of minimal sufficient dimension (m) as proposed by Kennel et al. [<xref ref-type="bibr" rid="scirp.108006-ref21">21</xref>], called the “False Nearest Neighbour(FNN)” method. That is, supposing the point X i = [ Y i − p + 1 , ⋯ , Y i ] has a neighbour X j = [ Y j − p + 1 , ⋯ , Y j ] in a p-dimensional space then the distance ‖ X i − X j ‖ is calculated in order to compute:</p><p>R i = | Y i + 1 − Y j + 1 | ‖ X i − X j ‖ (2)</p><p>If R i exceeds a given threshold R T (a suitable value is 10 ≤ R T ≤ 50 ), the point X i is marked as having a False Nearest Neighbour. As a consequence, the embedding dimension p is high enough if the fraction of points that have False Nearest Neighbours is actually zero, or sufficiently small, say, smaller than a criterion R f . In this case, the False Nearest Neighbour threshold R T was set to 10 (as reported in Wang [<xref ref-type="bibr" rid="scirp.108006-ref19">19</xref>]. Based on this, the fraction of False Nearest Neighbours as a function of the embedding dimension was calculated based on phase-space reconstruction using embedding dimension. Here, the minimal embedding dimension was taken as 8; this implies that the state of the streamflow process can be determined by eight lagged observed values as shown in <xref ref-type="fig" rid="fig7">Figure 7</xref>.</p><p>Following from the analysis, eight lagged values of input variables were used when fitting the ANN model to the series; specifically, this implied that based on the phase-space reconstruction, the discharges Q t − 7 , Q t − 6 , ⋯ , Q t of day t-7 to day t. The eight lagged input values were used to forecast the discharge from time t + 1, i.e., the next day, to t + 5; i.e., 5-ahead values, using a multiple-output approach rather than a single-output. The idea here is just to explore the ANN model forecast behaviour over a high lead time (<xref ref-type="fig" rid="fig8">Figure 8</xref>).</p><p>To address the thrust of the study, two model configurations were considered corresponding to two model architectural variants with different nodal configurations. Precisely, single and double hidden layers were thus considered to examine the implications of model structural complexity. The ANN models adopted were 1) 8 7 5 single-hidden layer with 7 nodes; i.e., 8 input nodes in the input layer, 7 nodes in the hidden layer, and 5 output nodes in the output layer 2) 8 5 2 5 double-hidden layers with 5 and 2 nodes, respectively and 3) 8 4 3 5 double-hidden layers with 4 and 3 nodes, respectively; though after several trials in an attempt to choose comparable network structures.</p></sec><sec id="s2_2_4"><title>2.2.4. Network Training</title><p>For the purposes of the stated aim of the study, the multi-layer feedforward back propagation network was used. Specifically, network training was implemented using the trainbr (Bayesian regularisation: Br) function, traingdm (Gradient descent with momentum: gdm) function, trainlm (Levenberg-Marquardt: lm function in MATLAB Neural Network Toolbox. Since in neural network training, the transfer function is of critical relevance and predictability of future behaviour is a direct consequence of the correct identification of it, for the identified network structure, the tansigmoid and purelin transfer functions were used in the hidden and output layers, respectively. The purelin transfer function was considered for the output layer because it allows the network outputs to take on any value, whereas the last layer of a multi-layer network with sigmoid neurons constrains the network outputs to a small range.</p><p>Before applying the ANN, both input and output data were pre-processed and normalised in the range [−1 1]. The scaling strategy was adopted based on the findings of Wang [<xref ref-type="bibr" rid="scirp.108006-ref19">19</xref>] and Otache [<xref ref-type="bibr" rid="scirp.108006-ref22">22</xref>]; rescaling was done to scale the data series to fall within this bound. Scaling of the original data, say x ′ t to the network range was done by</p><p>x t = ( U x − L x ) x ′ t + ( M x L x − m x U x ) M x − m x (3)</p><p>where, x ′ t = the original input data, x t = the input data scaled to the network range, M x and m x are respectively the maximum and the minimum of the original input data, while U x and L x are the upper and the lower network ranges for the network input, respectively. Similarly, the original output, say y ′ t is scaled to the network range by</p><p>y t = ( U y − L y ) y ′ t + ( M y L y − m y U y ) M y − m y (4)</p><p>where, y t the systems’ output is scaled to the network range, M y and m y are respectively the maximum and minimum values of the original output data y ′ t , whereas U y and L y are respectively the upper and the lower network ranges for the network output. After scaling the inputs and outputs, the resulting output, say y ^ t is in the scaled domain. Hence, there is need to rescale the output y ^ t back to its original domain; this is by inverting Equation (3) and using y ^ ′ t as</p><p>y ^ ′ t = ( M y − m y ) y ^ t − ( M y L y − m y U y ) U y − L y (5)</p></sec></sec><sec id="s2_3"><title>2.3. Forecast Analysis</title><p>In order to draw conclusions on the ANN model performance, attention is on the ANN model performance in terms of extreme events, that is, maximum and minimum flows. In this regard, the coefficient of correlation R as in Equation (6) was employed.</p><p>R = 1 v ∑ t = 1 v [ y t − μ y ] [ y ˜ t − μ ˜ y ] [ 1 v ∑ t = 1 v [ y t − μ y ] 2 ] 1 / 2 [ 1 v ∑ t = 1 v [ y ˜ t − μ ˜ y ] 2 ] 1 / 2 (6)</p><p>where, v = the number of output data points, y t = the observed flow, y ˜ t = predicted flow, μ y = mean of observed flow, and μ ˜ y = mean of predicted flows. In terms of the measures of forecast accuracy with respect to extreme values, the ratio of the forecasted maximum to the observed maximum (peak) was determined as</p><p>R max = y ˜ t max { y t } &#215; 100 (7)</p><p>where, max { y t } = max { y 1 , ⋯ , y v } and y ˜ t is the forecast corresponding to such maximum; and R max = 100 % , means that the observed peak is perfectly reproduced by the model. Forecasts with values of R max about 100% are considered to be very accurate, while R max &lt; 100 % indicates that the model underestimates the peak value; and R max &gt; 100 % indicates overestimation. Similarly, the ratio of the forecasted to the observed minimum</p><p>R min = y ˜ t min { y t } &#215; 100 (8)</p><p>where, y ˜ t represents the forecast corresponding to the minimum observed value was used to judge the forecasting capability of the model. In addition, specific-event prediction was also considered by looking at low and high flows.</p></sec></sec><sec id="s3"><title>3. Discussion</title><sec id="s3_1"><title>3.1. Effects of Model Structural Complexity</title><p>Figures 9-12 and <xref ref-type="table" rid="table1">Table 1</xref>, <xref ref-type="table" rid="table2">Table 2</xref> clearly show the performance of the network configurations in terms of correlation, extreme flow and event-specific evaluation for lead times of one and five-day ahead predictions, respectively. It is glaring that the complexity of the network structure may impair the integrity of the network performance as depicted by the contrasting results both in the training and validation phases. The overall performance, looking at Figures 9-12 shows that while the network demonstrated the capacity to predict low flows fairly well as well as elements of high flows, the converse is the case for a range of medium flows. In view of the statistics as in <xref ref-type="table" rid="table1">Table 1</xref> and <xref ref-type="table" rid="table2">Table 2</xref> as well as Figures 9-12, the aggregate performance of ANN Model: 8 4 3 5 is relatively better followed by ANN Model: 8 7 5. The ANN Model: 8 5 2 5 performed abysmally, especially with staggering values of R<sub>max</sub> % (489.5 and 423) and R<sub>min</sub> % (0.0 and 0.0) in the validation phase (See <xref ref-type="table" rid="table1">Table 1</xref>); <xref ref-type="fig" rid="fig1">Figure 1</xref>0 clearly shows this behaviour, especially <xref ref-type="fig" rid="fig1">Figure 1</xref>0 where there is strong evidence of zero flow prediction as well as high spikes probably due to poor data quality leading to outliers; though in all instances, as noted in <xref ref-type="fig" rid="fig9">Figure 9</xref> and <xref ref-type="fig" rid="fig1">Figure 1</xref>1, the models could explain between 60% and 97% (exemplified by R<sup>2</sup> values) of the variability in the streamflow dynamics.</p><p>Based on the results obtained, it suffices to note that the structural complexity is defined here to connote the size of the hidden layers against the traditional one-hidden layer commonly employed. It is thus imperative to state that the selection of the optimal number of hidden units (nodes) for the hidden layer is often considered to be problem dependent. However, intuition suggests that more is better but as reported by Abrahart and See [<xref ref-type="bibr" rid="scirp.108006-ref2">2</xref>], it is not always the case; i.e., the number of hidden units and layers control the power of the network to perform complex modelling but with associated trade-off between training time and network performance. The findings here accord with the submissions of Abrahart and See [<xref ref-type="bibr" rid="scirp.108006-ref2">2</xref>] that the use of large hidden layers could be counter-productive because an excessive number of free parameters will encourage over fitting of the network solution to the training data and invariably reduces the generalisation capabilities of the final product. Hence, worthy of relevance is the effective number of hidden layers and how to establish a balance between the hidden units of these layers as shown by the results in <xref ref-type="table" rid="table1">Table 1</xref> and <xref ref-type="table" rid="table2">Table 2</xref>. Though as pointed by Hornik et al. [<xref ref-type="bibr" rid="scirp.108006-ref23">23</xref>], the performance of a one-hidden layer could be compromised due to data quality; i.e., if the data contain an insufficient deterministic relationship. This really places a searchlight on the viability of a univariate series as employed here; the possibility of compromising any meaningful dependence in terms of casual correlation between input variables is high. However, in line with the findings of Openshaw and Openshaw as reported in Abrahart and See [<xref ref-type="bibr" rid="scirp.108006-ref2">2</xref>], there could be some advantages in the adoption of more than one-hidden layer; as noted here (See <xref ref-type="table" rid="table1">Table 1</xref>, <xref ref-type="table" rid="table2">Table 2</xref>, and <xref ref-type="fig" rid="fig9">Figure 9</xref> and <xref ref-type="fig" rid="fig1">Figure 1</xref>2), the use of two-hidden layers could provide an additional degree of representational power. It is obvious that the selection of too many hidden units or neurons may increase the training time without significant improvement on training results. Generally, in agreement with the findings of Ranjithan and Eheart [<xref ref-type="bibr" rid="scirp.108006-ref24">24</xref>], since too many hidden neurons probably may encourage each hidden neuron to memorise one of the input patterns, the error of the training set decreases gradually with an increasing number of intermediate units but the generalisation of the network may reach an optimum and does not necessarily improve indefinitely with an increasing number of intermediate units or nodes.</p><table-wrap id="table1" ><label><xref ref-type="table" rid="table1">Table 1</xref></label><caption><title> Effective correlation (R) statistics of extreme flow predictions</title></caption><table><tbody><thead><tr><th align="center" valign="middle"  colspan="12"  >Model Architecture: (8 7 5)</th></tr></thead><tr><td align="center" valign="middle" >General</td><td align="center" valign="middle" >Optimisation algorithm</td><td align="center" valign="middle"  colspan="4"  >Training</td><td align="center" valign="middle"  colspan="6"  >Validation</td></tr><tr><td align="center" valign="middle"  colspan="2"   rowspan="2"  ></td><td align="center" valign="middle"  colspan="2"  >R<sub>max</sub> (%)</td><td align="center" valign="middle"  colspan="2"  >R<sub>min</sub> (%)</td><td align="center" valign="middle"  colspan="3"  >R<sub>max</sub> (%)</td><td align="center" valign="middle"  colspan="3"  >R<sub>min</sub> (%)</td></tr><tr><td align="center" valign="middle" >1-day</td><td align="center" valign="middle" >5-day</td><td align="center" valign="middle" >1-day</td><td align="center" valign="middle" >5-day</td><td align="center" valign="middle" >1-day</td><td align="center" valign="middle"  colspan="2"  >5-day</td><td align="center" valign="middle" >1-day</td><td align="center" valign="middle"  colspan="2"  >5-day</td></tr><tr><td align="center" valign="middle" ></td><td align="center" valign="middle" >Br</td><td align="center" valign="middle" >99.8</td><td align="center" valign="middle" >96.8</td><td align="center" valign="middle" >98.5</td><td align="center" valign="middle" >66.0</td><td align="center" valign="middle" >98.5</td><td align="center" valign="middle"  colspan="2"  >97.3</td><td align="center" valign="middle" >82.2</td><td align="center" valign="middle"  colspan="2"  >22.1</td></tr><tr><td align="center" valign="middle" ></td><td align="center" valign="middle" >LM</td><td align="center" valign="middle" >98.9</td><td align="center" valign="middle" >96.4</td><td align="center" valign="middle" >125.8</td><td align="center" valign="middle" >0.0</td><td align="center" valign="middle" >100.6</td><td align="center" valign="middle"  colspan="2"  >100.9</td><td align="center" valign="middle" >84.9</td><td align="center" valign="middle"  colspan="2"  >60.8</td></tr><tr><td align="center" valign="middle" ></td><td align="center" valign="middle" >GDM</td><td align="center" valign="middle" >104.8</td><td align="center" valign="middle" >101.2</td><td align="center" valign="middle" >0.0</td><td align="center" valign="middle" >0.0</td><td align="center" valign="middle" >99.2</td><td align="center" valign="middle"  colspan="2"  >88.6</td><td align="center" valign="middle" >16.4</td><td align="center" valign="middle"  colspan="2"  >0.0</td></tr><tr><td align="center" valign="middle" >Average</td><td align="center" valign="middle" ></td><td align="center" valign="middle" >101.2</td><td align="center" valign="middle" >98.1</td><td align="center" valign="middle" >74.8</td><td align="center" valign="middle" >22.0</td><td align="center" valign="middle" >99.4</td><td align="center" valign="middle"  colspan="2"  >95.6</td><td align="center" valign="middle" >61.2</td><td align="center" valign="middle"  colspan="2"  >27.6</td></tr><tr><td align="center" valign="middle"  colspan="12"  >Model Architecture: (8 5 2 5)</td></tr><tr><td align="center" valign="middle" >General</td><td align="center" valign="middle" >Optimisation algorithm</td><td align="center" valign="middle"  colspan="4"  >Training</td><td align="center" valign="middle"  colspan="6"  >Validation</td></tr><tr><td align="center" valign="middle"  colspan="2"   rowspan="2"  ></td><td align="center" valign="middle"  colspan="2"  >R<sub>max</sub> (%)</td><td align="center" valign="middle"  colspan="2"  >R<sub>min</sub> (%)</td><td align="center" valign="middle"  colspan="3"  >R<sub>max</sub> (%)</td><td align="center" valign="middle"  colspan="3"  >R<sub>min</sub> (%)</td></tr><tr><td align="center" valign="middle" >1-day</td><td align="center" valign="middle" >5-day</td><td align="center" valign="middle" >1-day</td><td align="center" valign="middle" >5-day</td><td align="center" valign="middle" >1-day</td><td align="center" valign="middle"  colspan="2"  >5-day</td><td align="center" valign="middle"  colspan="2"  >1-day</td><td align="center" valign="middle" >5-day</td></tr><tr><td align="center" valign="middle" ></td><td align="center" valign="middle" >Br</td><td align="center" valign="middle" >95.9</td><td align="center" valign="middle" >94.4</td><td align="center" valign="middle" >10.9</td><td align="center" valign="middle" >54.9</td><td align="center" valign="middle" >95.5</td><td align="center" valign="middle"  colspan="2"  >94.6</td><td align="center" valign="middle"  colspan="2"  >104.6</td><td align="center" valign="middle" >34.9</td></tr><tr><td align="center" valign="middle" ></td><td align="center" valign="middle" >LM</td><td align="center" valign="middle" >99.9</td><td align="center" valign="middle" >98.1</td><td align="center" valign="middle" >84.8</td><td align="center" valign="middle" >0.0</td><td align="center" valign="middle" >489.5</td><td align="center" valign="middle"  colspan="2"  >423.0</td><td align="center" valign="middle"  colspan="2"  >0.0</td><td align="center" valign="middle" >0.0</td></tr><tr><td align="center" valign="middle" ></td><td align="center" valign="middle" >GDM</td><td align="center" valign="middle" >104.8</td><td align="center" valign="middle" >101.2</td><td align="center" valign="middle" >0.0</td><td align="center" valign="middle" >0.0</td><td align="center" valign="middle" >69.8</td><td align="center" valign="middle"  colspan="2"  >68.5</td><td align="center" valign="middle"  colspan="2"  >0.0</td><td align="center" valign="middle" >0.0</td></tr><tr><td align="center" valign="middle" >Average</td><td align="center" valign="middle" ></td><td align="center" valign="middle" >100.2</td><td align="center" valign="middle" >97.9</td><td align="center" valign="middle" >31.9</td><td align="center" valign="middle" >18.3</td><td align="center" valign="middle" >218.3</td><td align="center" valign="middle"  colspan="2"  >195.4</td><td align="center" valign="middle"  colspan="2"  >34.9</td><td align="center" valign="middle" >11.6</td></tr><tr><td align="center" valign="middle"  colspan="12"  >Model Architecture: (8 4 3 5)</td></tr><tr><td align="center" valign="middle" >General</td><td align="center" valign="middle" >Optimisation algorithm</td><td align="center" valign="middle"  colspan="4"  >Training</td><td align="center" valign="middle"  colspan="6"  >Validation</td></tr><tr><td align="center" valign="middle"  colspan="2"   rowspan="2"  ></td><td align="center" valign="middle"  colspan="2"  >R<sub>max</sub> (%)</td><td align="center" valign="middle"  colspan="2"  >R<sub>min</sub> (%)</td><td align="center" valign="middle"  colspan="2"  >R<sub>max</sub> (%)</td><td align="center" valign="middle"  colspan="4"  >R<sub>min</sub> (%)</td></tr><tr><td align="center" valign="middle" >1-day</td><td align="center" valign="middle" >5-day</td><td align="center" valign="middle" >1-day</td><td align="center" valign="middle" >5-day</td><td align="center" valign="middle" >1-day</td><td align="center" valign="middle" >5-day</td><td align="center" valign="middle"  colspan="2"  >1-day</td><td align="center" valign="middle"  colspan="2"  >5-day</td></tr><tr><td align="center" valign="middle" ></td><td align="center" valign="middle" >Br</td><td align="center" valign="middle" >98.5</td><td align="center" valign="middle" >95.5</td><td align="center" valign="middle" >110.36</td><td align="center" valign="middle" >66.2</td><td align="center" valign="middle" >97.0</td><td align="center" valign="middle" >96.1</td><td align="center" valign="middle"  colspan="2"  >115.0</td><td align="center" valign="middle"  colspan="2"  >89.7</td></tr><tr><td align="center" valign="middle" ></td><td align="center" valign="middle" >LM</td><td align="center" valign="middle" >101.2</td><td align="center" valign="middle" >101.2</td><td align="center" valign="middle" >107.2</td><td align="center" valign="middle" >0.0</td><td align="center" valign="middle" >94.6</td><td align="center" valign="middle" >94.4</td><td align="center" valign="middle"  colspan="2"  >110.3</td><td align="center" valign="middle"  colspan="2"  >87.1</td></tr><tr><td align="center" valign="middle" ></td><td align="center" valign="middle" >GDM</td><td align="center" valign="middle" >81.5</td><td align="center" valign="middle" >75.8</td><td align="center" valign="middle" >70.9</td><td align="center" valign="middle" >30.7</td><td align="center" valign="middle" >94.6</td><td align="center" valign="middle" >94.4</td><td align="center" valign="middle"  colspan="2"  >110.3</td><td align="center" valign="middle"  colspan="2"  >87.1</td></tr><tr><td align="center" valign="middle" >Average</td><td align="center" valign="middle" ></td><td align="center" valign="middle" >93.7</td><td align="center" valign="middle" >90.8</td><td align="center" valign="middle" >96.1</td><td align="center" valign="middle" >32.3</td><td align="center" valign="middle" >95.4</td><td align="center" valign="middle" >95.0</td><td align="center" valign="middle"  colspan="2"  >111.8</td><td align="center" valign="middle"  colspan="2"  >88.0</td></tr><tr><td align="center" valign="middle" ></td><td align="center" valign="middle" ></td><td align="center" valign="middle" ></td><td align="center" valign="middle" ></td><td align="center" valign="middle" ></td><td align="center" valign="middle" ></td><td align="center" valign="middle" ></td><td align="center" valign="middle" ></td><td align="center" valign="middle" ></td><td align="center" valign="middle" ></td><td align="center" valign="middle" ></td><td align="center" valign="middle" ></td></tr></tbody></table></table-wrap><table-wrap id="table2" ><label><xref ref-type="table" rid="table2">Table 2</xref></label><caption><title> Event-specific evaluation</title></caption><table><tbody><thead><tr><th align="center" valign="middle"  colspan="9"  >Network Topology (8 7 5: Single hidden layer)</th></tr></thead><tr><td align="center" valign="middle" >Optimisation algorithm</td><td align="center" valign="middle"  colspan="4"  >Training</td><td align="center" valign="middle"  colspan="4"  >Validation</td></tr><tr><td align="center" valign="middle"  rowspan="3"  ></td><td align="center" valign="middle"  colspan="4"  >% correct event prediction</td><td align="center" valign="middle"  colspan="4"  >% correct event prediction</td></tr><tr><td align="center" valign="middle"  colspan="2"  >Low flow</td><td align="center" valign="middle"  colspan="2"  >High flow</td><td align="center" valign="middle"  colspan="2"  >Low flow</td><td align="center" valign="middle"  colspan="2"  >High flow</td></tr><tr><td align="center" valign="middle" >1-day</td><td align="center" valign="middle" >5-day</td><td align="center" valign="middle" >1-day</td><td align="center" valign="middle" >5-day</td><td align="center" valign="middle" >1-day</td><td align="center" valign="middle" >5-day</td><td align="center" valign="middle" >1-day</td><td align="center" valign="middle" >5-day</td></tr><tr><td align="center" valign="middle" >Br</td><td align="center" valign="middle" >0.82</td><td align="center" valign="middle" >0.73</td><td align="center" valign="middle" >0.98</td><td align="center" valign="middle" >0.89</td><td align="center" valign="middle" >0.65</td><td align="center" valign="middle" >0.69</td><td align="center" valign="middle" >0.87</td><td align="center" valign="middle" >0.86</td></tr><tr><td align="center" valign="middle" >LM</td><td align="center" valign="middle" >0.81</td><td align="center" valign="middle" >0.72</td><td align="center" valign="middle" >0.98</td><td align="center" valign="middle" >0.88</td><td align="center" valign="middle" >0.65</td><td align="center" valign="middle" >0.72</td><td align="center" valign="middle" >0.87</td><td align="center" valign="middle" >0.87</td></tr><tr><td align="center" valign="middle" >GDM</td><td align="center" valign="middle" >0.72</td><td align="center" valign="middle" >0.68</td><td align="center" valign="middle" >0.91</td><td align="center" valign="middle" >0.83</td><td align="center" valign="middle" >0.65</td><td align="center" valign="middle" >0.72</td><td align="center" valign="middle" >0.87</td><td align="center" valign="middle" >0.87</td></tr><tr><td align="center" valign="middle" >Average</td><td align="center" valign="middle" >0.78</td><td align="center" valign="middle" >0.71</td><td align="center" valign="middle" >0.96</td><td align="center" valign="middle" >0.87</td><td align="center" valign="middle" >0.65</td><td align="center" valign="middle" >0.71</td><td align="center" valign="middle" >0.87</td><td align="center" valign="middle" >0.87</td></tr><tr><td align="center" valign="middle"  colspan="9"  >Network Topology (8 5 2 5: Double hidden layer)</td></tr><tr><td align="center" valign="middle" >Optimisation algorithm</td><td align="center" valign="middle"  colspan="4"  >Training</td><td align="center" valign="middle"  colspan="4"  >Validation</td></tr><tr><td align="center" valign="middle"  rowspan="3"  ></td><td align="center" valign="middle"  colspan="4"  >% correct event prediction</td><td align="center" valign="middle"  colspan="4"  >% correct event prediction</td></tr><tr><td align="center" valign="middle"  colspan="2"  >Low flow</td><td align="center" valign="middle"  colspan="2"  >High flow</td><td align="center" valign="middle"  colspan="2"  >Low flow</td><td align="center" valign="middle"  colspan="2"  >High flow</td></tr><tr><td align="center" valign="middle" >1-day</td><td align="center" valign="middle" >5-day</td><td align="center" valign="middle" >1-day</td><td align="center" valign="middle" >5-day</td><td align="center" valign="middle" >1-day</td><td align="center" valign="middle" >5-day</td><td align="center" valign="middle" >1-day</td><td align="center" valign="middle" >5-day</td></tr><tr><td align="center" valign="middle" >Br</td><td align="center" valign="middle" >0.81</td><td align="center" valign="middle" >0.73</td><td align="center" valign="middle" >0.97</td><td align="center" valign="middle" >0.89</td><td align="center" valign="middle" >0.65</td><td align="center" valign="middle" >0.70</td><td align="center" valign="middle" >0.88</td><td align="center" valign="middle" >0.87</td></tr><tr><td align="center" valign="middle" >LM</td><td align="center" valign="middle" >0.81</td><td align="center" valign="middle" >0.73</td><td align="center" valign="middle" >0.98</td><td align="center" valign="middle" >0.89</td><td align="center" valign="middle" >0.65</td><td align="center" valign="middle" >0.69</td><td align="center" valign="middle" >0.88</td><td align="center" valign="middle" >0.86</td></tr><tr><td align="center" valign="middle" >GDM</td><td align="center" valign="middle" >0.67</td><td align="center" valign="middle" >0.70</td><td align="center" valign="middle" >0.84</td><td align="center" valign="middle" >0.84</td><td align="center" valign="middle" >0.53</td><td align="center" valign="middle" >0.56</td><td align="center" valign="middle" >0.73</td><td align="center" valign="middle" >0.78</td></tr><tr><td align="center" valign="middle" >Average</td><td align="center" valign="middle" >0.76</td><td align="center" valign="middle" >0.72</td><td align="center" valign="middle" >0.93</td><td align="center" valign="middle" >0.87</td><td align="center" valign="middle" >0.61</td><td align="center" valign="middle" >0.65</td><td align="center" valign="middle" >0.83</td><td align="center" valign="middle" >0.84</td></tr><tr><td align="center" valign="middle"  colspan="9"  >Network Topology (8 4 3 5: Double hidden layer)</td></tr><tr><td align="center" valign="middle" >Optimisation algorithm</td><td align="center" valign="middle"  colspan="4"  >Training</td><td align="center" valign="middle"  colspan="4"  >Validation</td></tr><tr><td align="center" valign="middle"  rowspan="3"  ></td><td align="center" valign="middle"  colspan="4"  >% correct event prediction</td><td align="center" valign="middle"  colspan="4"  >% correct event prediction</td></tr><tr><td align="center" valign="middle"  colspan="2"  >Low flow</td><td align="center" valign="middle"  colspan="2"  >High flow</td><td align="center" valign="middle"  colspan="2"  >Low flow</td><td align="center" valign="middle"  colspan="2"  >High flow</td></tr><tr><td align="center" valign="middle" >1-day</td><td align="center" valign="middle" >5-day</td><td align="center" valign="middle" >1-day</td><td align="center" valign="middle" >5-day</td><td align="center" valign="middle" >1-day</td><td align="center" valign="middle" >5-day</td><td align="center" valign="middle" >1-day</td><td align="center" valign="middle" >5-day</td></tr><tr><td align="center" valign="middle" >Br</td><td align="center" valign="middle" >0.82</td><td align="center" valign="middle" >0.73</td><td align="center" valign="middle" >0.98</td><td align="center" valign="middle" >0.89</td><td align="center" valign="middle" >0.65</td><td align="center" valign="middle" >0.70</td><td align="center" valign="middle" >0.88</td><td align="center" valign="middle" >0.87</td></tr><tr><td align="center" valign="middle" >LM</td><td align="center" valign="middle" >0.81</td><td align="center" valign="middle" >0.72</td><td align="center" valign="middle" >0.98</td><td align="center" valign="middle" >0.88</td><td align="center" valign="middle" >0.65</td><td align="center" valign="middle" >0.72</td><td align="center" valign="middle" >0.87</td><td align="center" valign="middle" >0.87</td></tr><tr><td align="center" valign="middle" >GDM</td><td align="center" valign="middle" >0.73</td><td align="center" valign="middle" >0.68</td><td align="center" valign="middle" >0.91</td><td align="center" valign="middle" >0.83</td><td align="center" valign="middle" >0.65</td><td align="center" valign="middle" >0.72</td><td align="center" valign="middle" >0.87</td><td align="center" valign="middle" >0.87</td></tr><tr><td align="center" valign="middle" >Average</td><td align="center" valign="middle" >0.79</td><td align="center" valign="middle" >0.71</td><td align="center" valign="middle" >0.96</td><td align="center" valign="middle" >0.87</td><td align="center" valign="middle" >0.65</td><td align="center" valign="middle" >0.71</td><td align="center" valign="middle" >0.87</td><td align="center" valign="middle" >0.87</td></tr></tbody></table></table-wrap></sec><sec id="s3_2"><title>3.2. Implications of Data Pre-Processing Strategy</title><p>It is paramount not to only evaluate model forecast performance on the basis of statistical parameters, but to also consider the impact data pre-processing may have on ANN model forecasts. It is recognised that data pre-processing can have a significant effect on model performance (e.g. Maier and Dandy, [<xref ref-type="bibr" rid="scirp.108006-ref25">25</xref>] ). It is commonly considered that, because the outputs of some transfer functions are bounded, the outputs of a Multi-Layer Perceptron (MLP) ANN will be in the interval [0, 1] or [−1, 1] depending on the transfer function used in the neurons. Reports in literature (e.g. Otache, [<xref ref-type="bibr" rid="scirp.108006-ref22">22</xref>]; Maier and Dandy, [<xref ref-type="bibr" rid="scirp.108006-ref25">25</xref>]; Wang, [<xref ref-type="bibr" rid="scirp.108006-ref19">19</xref>] ) suggest that using smaller intervals for streamflow modelling, as [0.1, 0.85], and [0.1, 0.9] could allow extreme (low and high) flow events occurring outside the range of the calibration data may be accommodated. However, the advantage of rescaling the data into a small interval is supported to a varying degree; fairly good in some instances and abysmally poor in the others. The prediction capability of extreme flow regimes by the different models is illustrated clearly in both <xref ref-type="table" rid="table1">Table 1</xref> and <xref ref-type="table" rid="table2">Table 2</xref>.</p><p>The behaviour as depicted by <xref ref-type="table" rid="table1">Table 1</xref> and <xref ref-type="table" rid="table2">Table 2</xref> could be explained against the backdrop of the behaviour of transfer functions. For instance, to rescale the input data to [−1, 1] would limit the output range of the tansig ( x ) function approximately to [−0.7616, 0.7616]. Similarly, to rescale the input range to [−0.9, 0.9] would further shrink the output range approximately to [−0.7163, 0.7163]. Both 0.7616 and 0.7163 are still far away from the extreme limits of the tansig ( x ) function; such a small output data range will make the output less sensitive to the change of the weights between the hidden layer and output layer, and will therefore possibly make the training process more difficult. As reported by Wang [<xref ref-type="bibr" rid="scirp.108006-ref19">19</xref>] and affirmed in Otache [<xref ref-type="bibr" rid="scirp.108006-ref22">22</xref>], since the neurons in an ANN structure are combined linearly with a lot of weights, any rescaling of the input vector can be offset the more, as corresponding weights and biases are changed.</p></sec></sec><sec id="s4"><title>4. Conclusion</title><p>Based on the results obtained in all instances, it could be inferred that adoption of large hidden layers could be counter-productive; this is because an excessive number of free parameters will encourage over fitting of the network though it may provide an additional representational power. In the same context, rescaling of the ANN input regime adversely limits the output of the transfer function. Thus resulting from the conclusions drawn, it suffices to note that ANN model is by no means a substitute for conceptual watershed modelling, therefore, exogenous variables should be incorporated in streamflow modelling and forecasting exercise because of their hydrologic evolutions and too, effort should be geared towards using hybrid models like Fuzzy-Neural Network and Wavelet models in a coupling strategy with ANN in the modelling of streamflow; similarly, because of volatility and nonlinear deterministic problems, ARMA-GARCH models should be considered as viable complement in this regard too.</p></sec><sec id="s5"><title>Conflicts of Interest</title><p>The authors declare no conflicts of interest regarding the publication of this paper.</p></sec><sec id="s6"><title>Cite this paper</title><p>Otache, M.Y., Musa, J.J., Kuti, I.A. Mohammed, M. and Pam, L.E. (2021) Effects of Model Structural Complexity and Data Pre-Processing on Artificial Neural Network (ANN) Forecast Performance for Hydrological Process Modelling. Open Journal of Modern Hydrology, 11, 1-18. https://doi.org/10.4236/ojmh.2021.111001</p></sec></body><back><ref-list><title>References</title><ref id="scirp.108006-ref1"><label>1</label><mixed-citation publication-type="other" xlink:type="simple">Maier, H.R. and Dandy, G.C. (2000) Neural Networks for the Prediction and Forecasting of Water Resources Variables: A Review of Modelling Issues and Applications. Environmental Modelling &amp; Software, 15, 101-124. 
https://doi.org/10.1016/S1364-8152(99)00007-9</mixed-citation></ref><ref id="scirp.108006-ref2"><label>2</label><mixed-citation publication-type="other" xlink:type="simple">Ranjithan, S. and Eheart, J.W. (1993) Neural Network-Based Screening for Groundwater Reclamation under Certainty. Water Resources Research, 29, 563-574. 
https://doi.org/10.1029/92WR02129</mixed-citation></ref><ref id="scirp.108006-ref3"><label>3</label><mixed-citation publication-type="other" xlink:type="simple">Hornik, K., Stinchcombe, M. and White, H. (1989) Multi-Layer Feed forward Networks Are Universal Approximator. Neural Networks, 2, 359-366. 
https://doi.org/10.1016/0893-6080(89)90020-8</mixed-citation></ref><ref id="scirp.108006-ref4"><label>4</label><mixed-citation publication-type="other" xlink:type="simple">Otache, Y.M. (2008) Contemporary Analysis of River Benue Flow Dynamics and Modelling. Ph.D. Dissertation, Hohai University, Nanjing, China, 30-35, 60-79, 83-90.</mixed-citation></ref><ref id="scirp.108006-ref5"><label>5</label><mixed-citation publication-type="other" xlink:type="simple">Kennel, M.B., Brown, R. and Abarbanel, H.D. (1992) Determining Embedding Dimension for Phase-Space Reconstruction using Geometrical Construction. Physical Review A, 45, 3403-3411. https://doi.org/10.1103/PhysRevA.45.3403</mixed-citation></ref><ref id="scirp.108006-ref6"><label>6</label><mixed-citation publication-type="other" xlink:type="simple">Pasternack, G.B. (1999) Does the River Run Wild? Assessing Chaos in Hydrological Systems. Advances in Water Resources, 23, 253-260.  
https://doi.org/10.1016/S0309-1708(99)00008-1</mixed-citation></ref><ref id="scirp.108006-ref7"><label>7</label><mixed-citation publication-type="other" xlink:type="simple">Wang, W. (2006) Stochasticity, Nonlinearity and Forecasting of Stream Flow Processes. Deft University Press, Amsterdam, Netherlands, 1-17.</mixed-citation></ref><ref id="scirp.108006-ref8"><label>8</label><mixed-citation publication-type="other" xlink:type="simple">Wilcox, B.P., Rawls, W.J., Brakensiek, D.L. and Wight, J.R. (1990) Predicting Runoff from Rangeland Catchments: A Comparison of Two Models. Water Resources Research, 26, 2401-2410. https://doi.org/10.1029/WR026i010p02401</mixed-citation></ref><ref id="scirp.108006-ref9"><label>9</label><mixed-citation publication-type="other" xlink:type="simple">Elshorbagy, A., Panu, U.S. and Simonovic, S.P. (2001) Analysis of Cross-Correlated Chaotic Streamflows. Hydrological Sciences Journal, 46, 781-793. 
https://doi.org/10.1080/02626660109492870</mixed-citation></ref><ref id="scirp.108006-ref10"><label>10</label><mixed-citation publication-type="other" xlink:type="simple">Islam, M.N. and Sivakumar, B. (2002) Characterisation and Prediction of Runoff Dynamics: A Nonlinear Dynamical View. Advances in Water Resources, 25, 179-190. https://doi.org/10.1016/S0309-1708(01)00053-7</mixed-citation></ref><ref id="scirp.108006-ref11"><label>11</label><mixed-citation publication-type="other" xlink:type="simple">Jayawardena, A.W. and Lai, F. (1994) Analysis and Prediction of Chaos in Rainfall and Stream Flow Time Series. Journal of Hydrology, 153, 23-52. 
https://doi.org/10.1016/0022-1694(94)90185-6</mixed-citation></ref><ref id="scirp.108006-ref12"><label>12</label><mixed-citation publication-type="other" xlink:type="simple">Porporato, A. and Ridolfi, L. (1997) Nonlinear Analysis of River Flow Time Sequences. Water Resources Research, 33, 1353-1367.  
https://doi.org/10.1029/96WR03535</mixed-citation></ref><ref id="scirp.108006-ref13"><label>13</label><mixed-citation publication-type="book" xlink:type="simple">Mpitsos, G.J., Creech, H.C., Cohan, C.S. and Mendelson, M. (1987) Variability and Chaos: Neuron-Integrative Principles in Self-Organization of Motor Patterns. In: Hao, B.L., Ed., Directions in Chaos, World Scientific, Singapore, 162-190.</mixed-citation></ref><ref id="scirp.108006-ref14"><label>14</label><mixed-citation publication-type="other" xlink:type="simple">Fraser, A. and Swinney, H.L. (1986) Independent Coordinates for Strange Attractors from Mutual Information. Physical Review A, 33, 1134-1140,  
https://doi.org/10.1103/PhysRevA.33.1134</mixed-citation></ref><ref id="scirp.108006-ref15"><label>15</label><mixed-citation publication-type="other" xlink:type="simple">Packard, N.H., Crutchfield, J.P., Farmer, J.D. and Shaw, R.S. (1980) Geometry from a Time Series. Physical Review Letters, 45, 712-716.  
https://doi.org/10.1103/PhysRevLett.45.712</mixed-citation></ref><ref id="scirp.108006-ref16"><label>16</label><mixed-citation publication-type="book" xlink:type="simple">Takens, F. (1981) Detecting Strange Attractors in Turbulence. In: Rand, D.A. and Young, L.S., Eds., Lecture Notes in Mathematics, Springer-Verlag, New York, 366-381. https://doi.org/10.1007/BFb0091924</mixed-citation></ref><ref id="scirp.108006-ref17"><label>17</label><mixed-citation publication-type="other" xlink:type="simple">SNNS Group (1990-98) Stuggart Neural Network Simulator—User Manual—Version 4.1. http://www.ra.informatik.uni-tuebingende/SNNS/</mixed-citation></ref><ref id="scirp.108006-ref18"><label>18</label><mixed-citation publication-type="book" xlink:type="simple">Fahlman, S.E. and Lebiere, C. (1990) The Cascade-Correlation Learning Architecture. In: Touretzky, D., Ed., Advances in Neural Information Processing Systems, Morgan Kaufmann Publishers, USA.</mixed-citation></ref><ref id="scirp.108006-ref19"><label>19</label><mixed-citation publication-type="other" xlink:type="simple">Sarle, W.S. (1998) FAQ document for Usenet Newsgroup, comp.ai. neural-nets. 
ftp://ftp.sas.com/pub/neural/FAQ.html.</mixed-citation></ref><ref id="scirp.108006-ref20"><label>20</label><mixed-citation publication-type="other" xlink:type="simple">Hsu, K.L., Gupta, H.V. and Sorooshian, S. (1995) Artificial Neural Network Modelling of the Rainfall-Runoff Process. Water Resources Research, 31, 2517-2530. 
https://doi.org/10.1029/95WR01955</mixed-citation></ref><ref id="scirp.108006-ref21"><label>21</label><mixed-citation publication-type="other" xlink:type="simple">Balkhair, S.K. (2002) Aquifer Parameters Determination for Large Diameter Wells using Neural Network Approach. Journal of Hydrology, 265, 118-128. 
https://doi.org/10.1016/S0022-1694(02)00103-8</mixed-citation></ref><ref id="scirp.108006-ref22"><label>22</label><mixed-citation publication-type="book" xlink:type="simple">Hillel, D. (1986) Modelling in Soil Physics: A critical Review. In: Boersma, L.L., Ed., Future Developments in Soil Science Research, Soil Science Society of America, Madison, WI, 35-42. https://doi.org/10.2136/1987.futuredevelopmentssoil.c5</mixed-citation></ref><ref id="scirp.108006-ref23"><label>23</label><mixed-citation publication-type="other" xlink:type="simple">Abrahart, J.R. (1999) Neuro-Hydrology: Implication Options and a Research Agenda. Area, 31, 141-149. https://doi.org/10.1111/j.1475-4762.1999.tb00179.x</mixed-citation></ref><ref id="scirp.108006-ref24"><label>24</label><mixed-citation publication-type="other" xlink:type="simple">Abrahart, J.R. and See, L. (2000) Comparing Neural Network and Autoregressive Moving Average Techniques for Provision of Continuous River Flow Forecasts in Two Contrasting Catchments. Hydrological Processes, 14, 2157-2172. 
https://doi.org/10.1002/1099-1085(20000815/30)14:11/12&lt;2157::AID-HYP57&gt;3.0.CO;2-S</mixed-citation></ref><ref id="scirp.108006-ref25"><label>25</label><mixed-citation publication-type="other" xlink:type="simple">Chibanga, R., Berlamont, J. and Vandewalle, J. (2003) Modelling and Forecasting of Hydrological Variables Using Artificial Neural Networks: The Kafue River Sub-Basin. Hydrological Sciences, 48, 363-379. https://doi.org/10.1623/hysj.48.3.363.45282</mixed-citation></ref></ref-list></back></article>