<?xml version="1.0" encoding="UTF-8"?><!DOCTYPE article  PUBLIC "-//NLM//DTD Journal Publishing DTD v3.0 20080202//EN" "http://dtd.nlm.nih.gov/publishing/3.0/journalpublishing3.dtd"><article xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink" dtd-version="3.0" xml:lang="en" article-type="research article"><front><journal-meta><journal-id journal-id-type="publisher-id">JSIP</journal-id><journal-title-group><journal-title>Journal of Signal and Information Processing</journal-title></journal-title-group><issn pub-type="epub">2159-4465</issn><publisher><publisher-name>Scientific Research Publishing</publisher-name></publisher></journal-meta><article-meta><article-id pub-id-type="doi">10.4236/jsip.2014.52007</article-id><article-id pub-id-type="publisher-id">JSIP-45990</article-id><article-categories><subj-group subj-group-type="heading"><subject>Articles</subject></subj-group><subj-group subj-group-type="Discipline-v2"><subject>COMPUTER SCIENCE &amp; COMMUNICATIONS</subject></subj-group></article-categories><title-group><article-title>A Nonlinear Autoregressive Approach to Statistical Prediction of Disturbance Storm Time Geomagnetic Fluctuations Using Solar Data</article-title></title-group><contrib-group><contrib contrib-type="author" xlink:type="simple"><name name-style="western"><surname>Joseph</surname><given-names>M. Caswell</given-names></name><xref ref-type="aff" rid="aff1"><sub>1</sub></xref><xref ref-type="corresp" rid="cor1"><sup>*</sup></xref></contrib></contrib-group><aff id="aff1"><label>1</label><addr-line>Neuroscience Research Group, Laurentian University, Sudbury, Canada</addr-line></aff><author-notes><corresp id="cor1">* E-mail:<email>jx_caswell@laurentian.ca</email></corresp></author-notes><pub-date pub-type="epub"><day>02</day><month>05</month><year>2014</year></pub-date><volume>05</volume><issue>02</issue><fpage>42</fpage><lpage>53</lpage><history><date date-type="received"><day>31</day>	<month>January</month>	<year>2014</year></date><date date-type="rev-recd"><day>28</day>	<month>February</month>	<year>2014</year>	</date><date date-type="accepted"><day>18</day>	<month>March</month>	<year>2014</year></date></history><permissions><copyright-statement>&#169; Copyright  2014 by authors and Scientific Research Publishing Inc. </copyright-statement><copyright-year>2014</copyright-year><license><license-p>This work is licensed under the Creative Commons Attribution International License (CC BY). http://creativecommons.org/licenses/by/4.0/</license-p></license></permissions><abstract><p>
	A nonlinear autoregressive approach with exogenous input is used as a
novel method for statistical forecasting of the disturbance storm time index, a
measure of space weather related to the ring current which surrounds the Earth,
and fluctuations in disturbance storm time field strength as a result of
incoming solar particles. This ring current produces a magnetic field which
opposes the planetary geomagnetic field. Given the occurrence of solar activity
hours or days before subsequent geomagnetic fluctuations and the potential
effects that geomagnetic storms have on terrestrial systems, it would be useful
to be able to predict geophysical parameters in advance using both historical
disturbance storm time indices and external input of solar winds and the
interplanetary magnetic field. By assessing various statistical techniques it
is determined that artificial neural networks may be ideal for the prediction
of disturbance storm time index values which may in turn be used to forecast geomagnetic
storms. Furthermore, it is found that a Bayesian regularization neural network
algorithm may be the most accurate model compared to both other forms of
artificial neural network used and the linear models employing regression
analyses. 
</p></abstract><kwd-group><kwd>Space Weather</kwd><kwd> Geomagnetic Storms</kwd><kwd> Artificial Neural Networks</kwd><kwd> Solar Winds</kwd><kwd> NARX</kwd><kwd> Forecasting</kwd><kwd> Interplanetary Magnetic Field</kwd></kwd-group></article-meta></front><body><sec id="s1"><title>1. Introduction</title><p>Many complex system interactions are present throughout the disciplines of geophysics and associated solar dynamics. A number of these processes remain outside the capability of standard statistical procedures, requiring equally complex computational models in order to more accurately reflect physical relationships. Artificial neural networks (ANN) form the basis for a number of computational models based on the mammalian brain. Instead of relying on linear correlative relationships among a particular dataset, ANNs are a form of machine learning in which the system learns to recognize an output variable based on an input variable series [<xref ref-type="bibr" rid="scirp.45990-ref1">1</xref>] . Data is processed through a number of interconnected “neurons” which form “synaptic connections” from the input nodes through a hidden layer before converging on the output neurons (e.g., <xref ref-type="fig" rid="fig1">Figure 1</xref>). Each input and hidden neuron consists of statistical weights which are capable of adaptation [<xref ref-type="bibr" rid="scirp.45990-ref2">2</xref>] , the exact parameters which are modified by an algorithm over the course of network training procedures. These weights essentially form the synaptic connections among neurons which activate during network construction. This form of computation is capable of operating in parallel units, much like the human nervous system. Because neural networks do not rely on linear correlations for learning, ANNs are capable of nonlinear modelling and may therefore provide a useful alternative approach to a number of both theoretical and real world problems. This includes geo and solar physics [<xref ref-type="bibr" rid="scirp.45990-ref3">3</xref>] , medical diagnosis [<xref ref-type="bibr" rid="scirp.45990-ref4">4</xref>] , pattern recognition [<xref ref-type="bibr" rid="scirp.45990-ref5">5</xref>] , and many other areas. The nonlinear approach used in ANN computations is particularly useful in the context of highly complex or “noisy” datasets.</p><p>Backpropagation algorithms constitute a primary basis for the construction of ANNs [<xref ref-type="bibr" rid="scirp.45990-ref6">6</xref>] . In general backpropagation, the delta rule is employed for updating the statistical weights of each neuron in the network using a gradient descent [<xref ref-type="bibr" rid="scirp.45990-ref7">7</xref>] . An activation function is applied to artificial neurons in both the input and hidden layers, which in this case was a sigmoid function (e.g., Equation (1) &amp; <xref ref-type="fig" rid="fig2">Figure 2</xref>).</p><disp-formula id="scirp.45990-formula2032"><label>(1)</label><inline-graphic xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="http://file.scirp.org/Html/htmlimages\3-3400337x\ec1b3351-c95c-4bfb-bea2-2cd3f4107e0c.png"/></disp-formula><fig id="fig1"><label>Figure 1</label><caption><p> Feedforward artificial neural network diagram; input layer neurons, hidden layer neurons, output neuron (s), lines indicate data weights (“synaptic connections”). Image source: Glosser.ca</p></caption><graphic xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="http://file.scirp.org/Html/htmlimages\3-3400337x\24b9196b-f50d-4f75-9a69-5f470c6f2658.png"/></fig><fig id="fig2"><label>Figure 2</label><caption><p> Plotted sigmoid function (logistic curve)</p></caption><graphic xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="http://file.scirp.org/Html/htmlimages\3-3400337x\af045a7d-aee9-4b08-a3f7-f1bd7565c0f7.png"/></fig><p>One of the primary training algorithms employed in ANN modelling is the Levenberg Marquardt Algorithm (LMANN). This particular method is a standard backpropagation curve fitting algorithm typically employed to solve generic problems using a damped least squares process [<xref ref-type="bibr" rid="scirp.45990-ref8">8</xref>] . While the LMANN option is a popular choice, it is capable of obtaining a local minimum only, and is therefore not always ideal for greater generalization [<xref ref-type="bibr" rid="scirp.45990-ref9">9</xref>] . However, a neural network trained using a Bayesian regularization algorithm (BRANN) has been shown to possess greater generalization than other ANNs and has demonstrated more robust results overall compared to standard backpropagation networks [<xref ref-type="bibr" rid="scirp.45990-ref10">10</xref>] . There are a number of other benefits associated with this particular learning algorithm summarized by Burden &amp; Winkler [<xref ref-type="bibr" rid="scirp.45990-ref10">10</xref>] , including reduced probability of network “overtraining” or overfitting, reduced difficulty in cross validation, and more effective stopping procedures. Overfitting refers to a resultant model which describes random noise as opposed to the intended output, which will subsequently have poor overall predictive performance by overemphasizing minute data fluctuations. By integrating Bayesian probabilities, this also allows for greater accuracy in network learning, and probabilities associated with artificial neuron weights are updated according to newly observed data using a likelihood function (Equation (2)) which compares a standard Gaussian function with the updated observations.</p><disp-formula id="scirp.45990-formula2033"><label>(2)</label><inline-graphic xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="http://file.scirp.org/Html/htmlimages\3-3400337x\af5265f5-728b-4fe8-8e6a-55c7cfad55f3.png"/></disp-formula><p>In the following analyses, two training algorithms were employed using a nonlinear autoregressive exogenous network (NARX). This particular form of ANN is used in time series modelling [<xref ref-type="bibr" rid="scirp.45990-ref11">11</xref>] in order to predict an outcome variable [y(t)] based on both d past values of the outcome variable and current and d past values of an external source of influence [x(t)], as illustrated in Equation (3). The fit of predicted output values can be compared to the original target values using simple correlation coefficients [<xref ref-type="bibr" rid="scirp.45990-ref12">12</xref>] , while an error term is also employed in order to further gauge predictive accuracy, typically presented as some forms of mean or summed squared error term (target-output).</p><disp-formula id="scirp.45990-formula2034"><label>(3)</label><inline-graphic xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="http://file.scirp.org/Html/htmlimages\3-3400337x\65a981f3-19e3-44b9-a985-e25cfb5b08da.png"/></disp-formula><p>A number of novel approaches to space weather dynamics have been examined using ANN models. Many of these models possess useful real world applications which enable researchers to predict future values associated with various geo and solar physical systems. The NARX form of network used in this study was previously employed by Oliveira et al. [<xref ref-type="bibr" rid="scirp.45990-ref12">12</xref>] in order to simulate conditions of the interplanetary magnetic field (IMF) using ground observations associated with cosmic rays as the exogenous input. Furthermore, the disturbance storm time (DST) index, which was also the focus of this study, was recently examined using various measures of solar winds and the IMF [<xref ref-type="bibr" rid="scirp.45990-ref3">3</xref>] . The present study focuses on daily averages of simple, untransformed values obtained from a freely available online source (http://omniweb.gsfc.nasa.gov/).</p><p>The Earth’s magnetic field has an average static background intensity of ~50,000 nT [<xref ref-type="bibr" rid="scirp.45990-ref13">13</xref>] . Despite this relatively weak value, variations in geomagnetic activity have been shown to affect terrestrial systems including electronics and power systems [<xref ref-type="bibr" rid="scirp.45990-ref14">14</xref>] , and human health [<xref ref-type="bibr" rid="scirp.45990-ref15">15</xref>] , while even small perturbations of ~20 to 40 nT have been related to alterations in brain activity associated with altered states of consciousness [<xref ref-type="bibr" rid="scirp.45990-ref13">13</xref>] . One of many measures associated with geomagnetic activity, the DST index refers to the varying power of the ring current which surrounds the geosphere. The subsequent DST magnetic field opposes the geomagnetic field so that decreases in DST index accompany increases in geomagnetic activity. This specific measure is particularly useful in studying solar geophysical interactions given that the DST ring current is produced as a result of solar particle streams [<xref ref-type="bibr" rid="scirp.45990-ref16">16</xref>] , and it also has direct correlations with the geomagnetic field. Furthermore, there are a number of complex relationships previously noted between various sources of solar activity and geomagnetic fluctuations [<xref ref-type="bibr" rid="scirp.45990-ref17">17</xref>] . Given the large number of solar factors is found to have potential relationships with geomagnetic activity, it would be beneficial to identify an optimal statistical model for forecasting geomagnetic storms based on a simple subset of input variables. This would allow for potential early warning systems to be placed in effect at relevant institutions regarding future geomagnetic perturbations.</p></sec><sec id="s2"><title>2. Methods</title><sec id="s2_1"><title>2.1. Geomagnetic and Solar Data</title><p>A number of predictive models were constructed using varying statistical methods of both linear and nonlinear processes. In each, the disturbance storm time (DST) index was used as the target variable to be predicted, while a number of solar wind and interplanetary magnetic field (IMF) measures were employed as independent variables (Bx, By, and Bz components of the IMF in nT, solar wind proton density in N&#183;cm<sup>−</sup><sup>3</sup>, solar wind plasma speed in km&#183;s<sup>−</sup><sup>1</sup>, and plasma flow pressure in nPa). A total of N = 1460 daily averages were obtained from January 1, 2009 to December 31, 2012. All data was obtained from the GSFC (Goddard Space Flight Center)/SPDF (Space Physics Data Facility) OMNIWeb interface (http://omniweb.gsfc.nasa.gov/).</p></sec><sec id="s2_2"><title>2.2. Statistical Models</title><p>Five separate models were computed with varying forms of artificial neural network (ANN) and regression analyses using both Matlab 2011a and SPSS 17 software.</p><p>An ANN was constructed using Matlab in order to produce a nonlinear autoregressive network with exogenous input (NARX). DST index was entered as the target variable with 6 feedback delays specified for the autoregressive function, and 6 input delays also specified for the exogenous input. A single hidden layer was deemed adequate for this particular problem with 10 hidden neurons (HN) specified (<xref ref-type="fig" rid="fig3">Figure 3</xref>). Data was segmented into three sets using the divide block function in order to maintain temporal characteristics of the time series. A total of 70% was allocated for training, with 15% of cases used in both validation and testing trials. Neural network learning was limited to a maximum of 1000 epochs a priori. Initial neural weights were randomized. Two training algorithms were employed for comparison between Bayesian regularization (BRANN) and Levenberg Marquardt (LMANN).</p><fig id="fig3"><label>Figure 3</label><caption><p> NARX network architecture; input layer consisting of x (6 variable exogenous input time series) and y (single variable autoregressive time series), 6 exogenous input delays and 6 feedback delays, 10 hidden layer neurons with single bias node and sigmoid activation function, single target (output) time series y</p></caption><graphic xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="http://file.scirp.org/Html/htmlimages\3-3400337x\49c7fab4-cb3c-4c57-a951-577ec29e9982.png"/></fig><p>A third variation of non-autoregressive ANN was constructed using SPSS Multilayer Perceptron (MLPANN) module with sigmoid hidden and output layer activation functions (Equation (1)). Network hidden layer architecture was constructed according to previous specifications obtained in Matlab (single hidden layer, 10 HN), with 70% of cases allocated to training and the remaining 30% used for testing.</p><p>For linear comparison, regression analyses were conducted using both full variable and stepwise variable entry.</p></sec></sec><sec id="s3"><title>3. Results</title><sec id="s3_1"><title>3.1. NARX: Bayesian Regularization</title><p>A NARX neural network constructed with Matlab software using a BRANN algorithm converged upon a solution after the maximum allowed number of iterations (1000). There were no significant error crosscorrelation or autocorrelation issues identified (e.g., <xref ref-type="fig" rid="fig4">Figure 4</xref>). The Bayesian method obtained highly significant (p &lt; 0.001) correlations between output and target data (<xref ref-type="fig" rid="fig5">Figure 5</xref>; r = 0.918, rho = 0.84).</p></sec><sec id="s3_2"><title>3.2. NARX: Levenberg Marquardt</title><p>Matlab was again utilized and a secondary NARX network was constructed by substituting the previous training with a LMANN algorithm. Again, there were no error crosscorrelation or autocorrelation issues identified. This particular network revealed significant (p &lt; 0.001) correlations between target and output data (<xref ref-type="fig" rid="fig6">Figure 6</xref>; r = 0.732, rho = 0.747), although not as strong as that obtained using BRANN.</p><fig id="fig4"><label>Figure 4</label><caption><p> BRANN error (target-output) autocorrelation</p></caption><graphic xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="http://file.scirp.org/Html/htmlimages\3-3400337x\a7baf8b4-ecb6-4ce8-856e-577ff17b5e92.png"/></fig><fig id="fig5"><label>Figure 5</label><caption><p> Correlation between original (target) and predicted (output) DST index values obtained with BRANN</p></caption><graphic xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="http://file.scirp.org/Html/htmlimages\3-3400337x\d82c002c-a660-49be-adc2-5102093e7988.png"/></fig></sec><sec id="s3_3"><title>3.3. Non-Autoregressive: Multilayer Perceptron</title><p>Using a non-autoregressive neural network, MLPANN was used to predict DST index based solely on the input and hidden layers. This particular method revealed a significant correlation (p &lt; 0.001) closer to that found with the LMANN analysis (<xref ref-type="fig" rid="fig7">Figure 7</xref>; r = 0.706, rho = 0.663). Additional independent importance analysis revealed that the Bz component of the IMF and solar wind proton density had the greatest connection to the output layer (<xref ref-type="fig" rid="fig8">Figure 8</xref>).</p></sec><sec id="s3_4"><title>3.4. LR Enter</title><p>A linear regression (LR) was performed for further comparison of statistical predictive power. The first model was obtained by entering all predictor variables. A significant regression was revealed (F<sub>(6,1459)</sub> = 165.295, p &lt; 0.001, adj. R<sup>2</sup> = 0.403). The Durbin Watson statistic (0.935) indicated minute potential autocorrelations in the data (<xref ref-type="fig" rid="fig9">Figure 9</xref>). All variance inflation factors were &lt; 10 suggesting no issues of multicollinearity. Significant correlations (p &lt; 0.001) were obtained between target and predicted values (<xref ref-type="fig" rid="fig10">Figure 10</xref>; r = 0.637, rho = 0.634), but the relationship identified was reduced in power compared to ANN methods.</p></sec><sec id="s3_5"><title>3.5. LR Stepwise</title><p>A secondary LR analysis was conducted using a stepwise method of variable entry for theoretically improved</p><fig id="fig6"><label>Figure 6</label><caption><p> Correlation between original (target) and predicted (output) DST index values obtained with LMANN</p></caption><graphic xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="http://file.scirp.org/Html/htmlimages\3-3400337x\be1e75d0-f934-4d7e-bc3f-76986a177006.png"/></fig><fig id="fig7"><label>Figure 7</label><caption><p> Correlation between original (target) and predicted (output) DST index values obtained with MLPANN</p></caption><graphic xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="http://file.scirp.org/Html/htmlimages\3-3400337x\7b12a291-dda0-431c-81c1-5d84eedb947e.png"/></fig><fig id="fig8"><label>Figure 8</label><caption><p> Independent importance of each input variable as related to the co- nnection with DST index</p></caption><graphic xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="http://file.scirp.org/Html/htmlimages\3-3400337x\b751573a-aeb9-4cef-85db-154fbd779207.png"/></fig><fig id="fig9"><label>Figure 9</label><caption><p> Potential weak autocorrelation in regression model (LR enter)</p></caption><graphic xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="http://file.scirp.org/Html/htmlimages\3-3400337x\aae7696d-2abf-437d-99f4-9cca237a719b.png"/></fig><fig id="fig10"><label>Figure 10</label><caption><p> Correlation between original (target) and predicted (output) DST index values obtained with LR enter</p></caption><graphic xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="http://file.scirp.org/Html/htmlimages\3-3400337x\bd35e5c2-b95e-4c67-b643-d2e05a70cb37.png"/></fig><p>accuracy of results. The only predictor variables to enter the equation were plasma speed and the Bz component of the IMF. A significant regression was identified (F<sub>(2,1459)</sub> = 458.729, p &lt; 0.001, adj. R<sup>2</sup> = 0.386), although the Durbin Watson statistic (0.933) again suggested potential data autocorrelations (<xref ref-type="fig" rid="fig11">Figure 11</xref>). There were no issues of multicollinearity according to the variance inflation factor statistics (all VIF &lt; 10). Again, significant correlations (p &lt; 0.001) were obtained between target and predicted data (<xref ref-type="fig" rid="fig12">Figure 12</xref>; r = 0.622, rho = 0.622), which were also reduced in coefficient strength compared to ANN methods.</p></sec><sec id="s3_6"><title>3.6. Fit Comparisons</title><p>A Fisher r to z transformation (Equation (4)) was applied to pairings of correlation coefficients and compared using a simple z test (Equation (5)) in order to determine significant (Equation (6)) differences in final output of each model.</p><disp-formula id="scirp.45990-formula2035"><label>(4)</label><inline-graphic xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="http://file.scirp.org/Html/htmlimages\3-3400337x\d5b670d5-250c-4a4d-8823-07383a0fbf3f.png"/></disp-formula><disp-formula id="scirp.45990-formula2036"><label>(5)</label><inline-graphic xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="http://file.scirp.org/Html/htmlimages\3-3400337x\c31318c4-f318-4d24-a0f3-3fc8104739df.png"/></disp-formula><disp-formula id="scirp.45990-formula2037"><label>(6)</label><inline-graphic xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="http://file.scirp.org/Html/htmlimages\3-3400337x\8ef9a91e-bf2e-46f1-b924-a9d4a4c3ad99.png"/></disp-formula><p>The BRANN model prediction correlation was significantly greater (p &lt; 0.0001) than LMANN (z = 17.35), MLPANN (z = 18.81), LR enter (z = 22.21), and LR stepwise (z = 22.88). LMANN and MLPANN methods did not differ significantly (z = 1.45, p &gt; 0.05). However, the LMANN algorithm prediction coefficients were significantly greater (p &lt; 0.0001) than both LR enter (z = 4.85) and LR stepwise (z = 5.52). MLPANN method also revealed predictive coefficients which were greater (p &lt; 0.0001) than both LR enter (z = 3.4) and LR stepwise (z = 4.07).</p><fig id="fig11"><label>Figure 11</label><caption><p> Potential autocorrelation in regression model (LR stepwise)</p></caption><graphic xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="http://file.scirp.org/Html/htmlimages\3-3400337x\3abd1f96-90fe-4c0c-8f7b-d0098c6d0b51.png"/></fig><fig id="fig12"><label>Figure 12</label><caption><p> Correlation between original (target) and predicted (output) DST index values obtained with LR stepwise</p></caption><graphic xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="http://file.scirp.org/Html/htmlimages\3-3400337x\b3fadef3-075d-4251-abab-9ee6e9354eb4.png"/></fig></sec><sec id="s3_7"><title>3.7. Average Accuracy</title><p>Overall measures of performance error (target-output) were obtained as the root mean squared error (RMSE) of each model and were similarly reflective of a clear hierarchy in model accuracy, the values of which are summarized in <xref ref-type="table" rid="table1">Table 1</xref>. These results suggest that neural network methods produce a greater predictive capacity for both fit and accuracy in the context of DST index and solar winds compared to more traditional regression methods, while the Bayesian regularization (BRANN) algorithm was superior to other variations of ANN (<xref ref-type="fig" rid="fig13">Figure 13</xref>). This method was far more accurate regarding both the direction and magnitude of target values as demonstrated by the clear distinctive features shown in <xref ref-type="fig" rid="fig14">Figure 14</xref> and <xref ref-type="fig" rid="fig15">Figure 15</xref>.</p><table-wrap id="table1"  position="float"><object-id pub-id-type="pii">Table 1</object-id><label>Table 1</label><caption><p>. Fit (r) and performance error (RMSE) of each statistical model</p></caption><table><thead><tr><th align="center" valign="middle" >Model</th><th align="center" valign="middle" >Pearson r</th><th align="center" valign="middle" >RMSE</th></tr></thead><tbody><tr><td align="center" valign="middle" >BRANN</td><td align="center" valign="middle" >0.918</td><td align="center" valign="middle" >3.784</td></tr><tr><td align="center" valign="middle" >LMANN</td><td align="center" valign="middle" >0.732</td><td align="center" valign="middle" >8.371</td></tr><tr><td align="center" valign="middle" >MLPANN</td><td align="center" valign="middle" >0.706</td><td align="center" valign="middle" >9.482</td></tr><tr><td align="center" valign="middle" >LR enter</td><td align="center" valign="middle" >0.637</td><td align="center" valign="middle" >9.418</td></tr><tr><td align="center" valign="middle" >LR stepwise</td><td align="center" valign="middle" >0.622</td><td align="center" valign="middle" >9.569</td></tr></tbody></table></table-wrap><fig id="fig13"><label>Figure 13</label><caption><p> Correlation coefficients (r) for predictive fit of each model</p></caption><graphic xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="http://file.scirp.org/Html/htmlimages\3-3400337x\bde0c6f4-bc30-4286-937e-ed0d95b0d840.png"/></fig><fig id="fig14"><label>Figure 14</label><caption><p> Target (original) and output (predicted) DST index values for 2012 using the BRANN algorithm</p></caption><graphic xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="http://file.scirp.org/Html/htmlimages\3-3400337x\6ab3a389-bd01-4ef4-bbf8-31d5ce33404d.png"/></fig><fig id="fig15"><label>Figure 15</label><caption><p> Target (original) and output (predicted) DST index values for 2012 using linear regression (enter all variables)</p></caption><graphic xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="http://file.scirp.org/Html/htmlimages\3-3400337x\40c93ae4-969e-4d12-be77-20e3d241e21e.png"/></fig></sec></sec><sec id="s4"><title>4. Conclusions</title><p>The results of this analysis appear to confirm those from a number of previous studies which have suggested that ANN models are more accurate compared to simple regressions for many applications [<xref ref-type="bibr" rid="scirp.45990-ref18">18</xref>] [<xref ref-type="bibr" rid="scirp.45990-ref19">19</xref>] . While the NARX models used relied on past values of the DST index, there was a significantly greater target to output fit apparently for the MLPANN network compared to regression analyses, which did not utilize DST feedback. There was a clear hierarchy of statistical models in the present analyses indicated by both fit (r) and overall accuracy (RMSE), and models from greatest to least relative fit/accuracy were BRANN, LMANN, MLPANN, LR enter, LR stepwise.</p><p>The Bayesian regularization algorithm for neural network training has previously been implicated as a superior model compared to other network algorithms [<xref ref-type="bibr" rid="scirp.45990-ref10">10</xref>] . This appears to be the case in the context of DST autoregressive prediction with solar wind input. It is clear that Bayesian probabilities are well suited to neural network learning for DST forecasting given the adaptive neural weights updated over the course of network construction based on new probabilities. Furthermore, regression models typically require a priori knowledge of variable interactions for accurate forecast implementation, while neural networks are capable of learning from an array of related measures and producing a highly accurate model. Standard regression models also tend to ignore non-linear effects which may be present, particularly in noisy datasets, or time series data with no clear linear relationship. It may also be important to note that the NARX model is capable of both open and closed loop performance and can be used to predict a step beyond an available dataset with associated performance measures. However, there are clear benefits to employ a range of statistical methods when interpreting complex interactions in order to gain a fuller picture of the system in question.</p><p>It is also interesting to note that the Bz component of the IMF was consistently identified as the greatest shared source of variance with geomagnetic disturbances, along with the speed and proton density of solar winds. This assemblage of contributing factors has previously been identified in the context of geomagnetic activity including Bz, particle density, and velocity of solar winds with DST index [<xref ref-type="bibr" rid="scirp.45990-ref20">20</xref>] . Modelling of DST variations was later examined using more complex methods of data transformation and analysis on a wider array of input measures [<xref ref-type="bibr" rid="scirp.45990-ref3">3</xref>] .</p><p>In the present study, the effects of solar wind variations are demonstrated using a range of input measures and statistical methods, which clearly demonstrate the enhanced potential for ANN models compared to more traditional statistical methods. Prior analyses also suggested that network performance improved with the addition of a greater range of IMF variables (e.g., Bx, By, Bz), which was also previously suggested by Boynton et al. [<xref ref-type="bibr" rid="scirp.45990-ref3">3</xref>] . However, network performance was reduced in magnitude with the addition of solar wind temperature in the input layer. The NARX networks still managed to outperform other models using untransformed variables of simple daily averages. Additionally, all data is freely available from an online source (http://omniweb.gsfc.nasa.gov/) open to any researcher interested in constructing models relevant to their own location.</p><p>Similarly, local forecasting with ANNs has proven effects in a number of areas and may be useful for predicting a range of events. Accurate modelling of solar and geomagnetic interactions is a particularly useful endeavor when the increasing reliance on technology civilization has reached. Given the known effects of geomagnetic storms on electrical systems, and even the significant effects of small geomagnetic perturbations on neurophysiology [<xref ref-type="bibr" rid="scirp.45990-ref13">13</xref>] , monitoring and forecasting of this phenomenon are increasingly vital. This is particularly prominent for satellite systems outside of the planetary atmosphere which may be quite sensitive to variations in ring current activity.</p><p>That powerful statistical software which is widely available is also a tremendous boon to statistical modelling and related research endeavors, and the complicated computations required for ANN methods are now easily employed in standard mathematical software, making relatively intimidating methods more accessible to the average researcher. Neural network predictions can be very powerful tools for both local and global predictions and can potentially be used to improve traditional models. ANN methods should be further investigated for potential applicability in better prediction of geomagnetic variations and storm level events, as well as to further elucidate the complex interconnections between solar and geophysical parameters.</p></sec><sec id="s5"><title>Acknowledgements</title><p>The author would like to thank Dr. Michael Persinger, Nicolas Rouleau, Lucas Tessaro, David Vares, Dr. Blake Dotta, and Prof. Kevin Saroka for valuable feedback and support. Additional thanks to Dr. Natalia Papitashyili for maintaining the NASA OMNIWeb database. Funding for this research was provided by Dr. Michael Persinger.</p></sec></body><back><ref-list><title>References</title><ref id="scirp.45990-ref1"><label>1</label><mixed-citation publication-type="other" xlink:type="simple">ERGUO, L. AND JINSHOU, Y. (2002) AN INPUT-TRAINING NEURAL NETWORK BASED NONLINEAR PRINCIPAL COMPONENT ANALYSIS APPROACH FOR FAULT DIAGNOSIS. PROCEEDINGS OF THE 4TH WORLD CONGRESS ON INTELLIGENT CONTROL AND AUTOMATION, SHANGHAI, 10-14 JUNE 2002, 2755-2759.</mixed-citation></ref><ref id="scirp.45990-ref2"><label>2</label><mixed-citation publication-type="other" xlink:type="simple">MEHROTRA, K., MOHAN, C.K. AND RANKA, S. (1997) ELEMENTS OF ARTIFICIAL NEURAL NETWORKS. MIT PRESS, CAMBRIDGE.</mixed-citation></ref><ref id="scirp.45990-ref3"><label>3</label><mixed-citation publication-type="journal" xlink:type="simple"><name name-style="western"><surname>BOYNTON</surname><given-names> R.J.</given-names></name>,<name name-style="western"><surname> BALIKHIN</surname><given-names> M.A.</given-names></name>,<name name-style="western"><surname> BILLINGS</surname><given-names> S.A. </given-names></name>,<name name-style="western"><surname> AMARIUTEI</surname><given-names> O.A. </given-names></name>,<etal>et al</etal>. (<year>2013</year>)<article-title>APPLICATION OF NONLINEAR AUTOREGRESSIVE MOVING AVERAGE EXOGENOUS INPUT MODELS TO GEOSPACE: ADVANCES IN UNDERSTANDING AND SPACE WEATHER FORECASTS</article-title><source>. ANNALES GEOPHYSICAE</source><volume> 31</volume>,<fpage> 1579</fpage>-<lpage>1589</lpage>.<pub-id pub-id-type="doi">HTTP://DX.DOI.ORG/10.5194/ANGEO-31-1579-2013</pub-id></mixed-citation></ref><ref id="scirp.45990-ref4"><label>4</label><mixed-citation publication-type="journal" xlink:type="simple"><name name-style="western"><surname>KHAN</surname><given-names> J.</given-names></name>,<name name-style="western"><surname> WEI</surname><given-names> J.S.</given-names></name>,<name name-style="western"><surname> RINGNER</surname><given-names> M.</given-names></name>,<name name-style="western"><surname> SAAL</surname><given-names> L.H.</given-names></name>,<name name-style="western"><surname> LADANYI</surname><given-names> M.</given-names></name>,<name name-style="western"><surname> WESTERMANN</surname><given-names> F.</given-names></name>,<name name-style="western"><surname> BERTHOLD</surname><given-names> F.</given-names></name>,<name name-style="western"><surname> SCHWAB</surname><given-names> M.</given-names></name>,<name name-style="western"><surname> ANTONESCU</surname><given-names> C.R.</given-names></name>,<name name-style="western"><surname> PETERSON</surname><given-names> C. </given-names></name>,<name name-style="western"><surname> MELTZER</surname><given-names> P.S. </given-names></name>,<etal>et al</etal>. (<year>2001</year>)<article-title>CLASSIFICATION AND DIAGNOSTIC PREDICTION OF CANCERS USING GENE EXPRESSION PROFILING AND ARTIFICIAL NEURAL NETWORKS</article-title><source>. NATURE MEDICINE</source><volume> 7</volume>,<fpage> 673</fpage>-<lpage>679</lpage>.<pub-id pub-id-type="doi">HTTP://DX.DOI.ORG/10.1038/89044</pub-id></mixed-citation></ref><ref id="scirp.45990-ref5"><label>5</label><mixed-citation publication-type="other" xlink:type="simple">LOONEY, C.G. (1997) PATTERN RECOGNITION USING NEURAL NETWORKS: THEORY AND ALGORITHMS FOR ENGINEERS AND SCIENTISTS. OXFORD UNIVERSITY PRESS, OXFORD.</mixed-citation></ref><ref id="scirp.45990-ref6"><label>6</label><mixed-citation publication-type="journal" xlink:type="simple"><name name-style="western"><surname>WIDROW</surname><given-names> B. </given-names></name>,<name name-style="western"><surname> LEHR</surname><given-names> M.A. </given-names></name>,<etal>et al</etal>. (<year>1990</year>)<article-title>30 YEARS OF ADAPTIVE NEURAL NETWORKS: PERCEPTRON, MADALINE, AND BACKPROPAGATION</article-title><source>. PROCEEDINGS OF THE IEEE</source><volume> 78</volume>,<fpage> 1415</fpage>-<lpage>1442</lpage>.<pub-id pub-id-type="doi">HTTP://DX.DOI.ORG/10.1109/5.58323</pub-id></mixed-citation></ref><ref id="scirp.45990-ref7"><label>7</label><mixed-citation publication-type="journal" xlink:type="simple"><name name-style="western"><surname>LEONARD</surname><given-names> J. </given-names></name>,<name name-style="western"><surname> KRAMER</surname><given-names> M.A. </given-names></name>,<etal>et al</etal>. (<year>1990</year>)<article-title>IMPROVEMENT OF THE BACKPROPAGATION ALGORITHM FOR TRAINING NEURAL NETWORKS</article-title><source>. COMPUTERS &amp; CHEMICAL ENGINEERING</source><volume> 14</volume>,<fpage> 337</fpage>-<lpage>341</lpage>.<pub-id pub-id-type="doi">HTTP://DX.DOI.ORG/10.1016/0098-1354(90)87070-6</pub-id></mixed-citation></ref><ref id="scirp.45990-ref8"><label>8</label><mixed-citation publication-type="journal" xlink:type="simple"><name name-style="western"><surname>LEVENBERG</surname><given-names> K. </given-names></name>,<etal>et al</etal>. (1944)<article-title>A METHOD FOR THE SOLUTION OF CERTAIN NON-LINEAR PROBLEMS IN LEAST SQUARES</article-title><source>. QUARTERLY OF APPLIED MATHEMATICS</source><volume> 2</volume>,<fpage> 164</fpage>-<lpage>168</lpage>.<pub-id pub-id-type="doi"></pub-id></mixed-citation></ref><ref id="scirp.45990-ref9"><label>9</label><mixed-citation publication-type="journal" xlink:type="simple"><name name-style="western"><surname>MAHINTHAKUMAR</surname><given-names> G. </given-names></name>,<name name-style="western"><surname> SAYEED</surname><given-names> M. </given-names></name>,<etal>et al</etal>. (<year>2005</year>)<article-title>HYBRID GENETIC ALGORITHM: LOCAL SEARCH METHODS FOR SOLVING GROUNDWATER SOURCE IDENTIFICATION INVERSE PROBLEMS</article-title><source>. JOURNAL OF WATER RESOURCES PLANNING AND MANAGEMENT</source><volume> 131</volume>,<fpage> 45</fpage>-<lpage>57</lpage>.<pub-id pub-id-type="doi">HTTP://DX.DOI.ORG/10.1061/(ASCE)0733-9496(2005)131:1(45)</pub-id></mixed-citation></ref><ref id="scirp.45990-ref10"><label>10</label><mixed-citation publication-type="journal" xlink:type="simple"><name name-style="western"><surname>BURDEN</surname><given-names> F. </given-names></name>,<name name-style="western"><surname> WINKLER</surname><given-names> D. </given-names></name>,<etal>et al</etal>. (2008)<article-title>BURDEN, F. AND WINKLER, D.  AN EMPIRICAL RELATIONSHIP BETWEEN INTERPLANETARY CONDITIONS AND DST</article-title><source>. METHODS IN MOLECULAR BIOLOGY</source><volume> 458</volume>,<fpage> 25</fpage>-<lpage>44</lpage>.<pub-id pub-id-type="doi"></pub-id></mixed-citation></ref><ref id="scirp.45990-ref11"><label>11</label><mixed-citation publication-type="journal" xlink:type="simple"><name name-style="western"><surname>MENEZES JR.</surname><given-names> J.M.P. </given-names></name>,<name name-style="western"><surname> BARRETO</surname><given-names> G.A. </given-names></name>,<etal>et al</etal>. (<year>2008</year>)<article-title>LONG-TERM TIME SERIES PREDICTION WITH THE NARX NETWORK: AN EMPIRICAL EVALUATION</article-title><source>. NEUROCOMPUTING</source><volume> 71</volume>,<fpage> 3335</fpage>-<lpage>3343</lpage>.<pub-id pub-id-type="doi">HTTP://DX.DOI.ORG/10.1016/J.NEUCOM.2008.01.030</pub-id></mixed-citation></ref><ref id="scirp.45990-ref12"><label>12</label><mixed-citation publication-type="other" xlink:type="simple">OLIVEIRA, A.G., SILVA, M.R., ECHER, E., DAL LAGO, A., BRAGA, C.R., MENDONCA, R.R.S., SCHUCH, N.J., MUNAKATA, K. AND KUWABARA, T. (2013) SIMULATIONS OF THE INTERPLANETARY MAGNETIC FIELD CONDITIONS WITH NARX NETWORKS. 33RD INTERNATIONAL COSMIC RAY CONFERENCE, THE ASTROPARTICLE PHYSICS CONFERENCE, RIO DE JANEIRO, 2-9 JULY 2013.</mixed-citation></ref><ref id="scirp.45990-ref13"><label>13</label><mixed-citation publication-type="journal" xlink:type="simple"><name name-style="western"><surname>SAROKA</surname><given-names> K.S.</given-names></name>,<name name-style="western"><surname> CASWELL</surname><given-names> J.M.</given-names></name>,<name name-style="western"><surname> LAPOINTE</surname><given-names> A. </given-names></name>,<name name-style="western"><surname> PERSINGER</surname><given-names> M.A. </given-names></name>,<etal>et al</etal>. (2013)<article-title>SAROKA, K.S., CASWELL, J.M., LAPOINTE, A. AND PERSINGER, M.A.  GREATER ELECTROENCEPHALOGRAPHIC COHERENCE BETWEEN LEFT AND RIGHT TEMPORAL LOBE STRUCTURES DURING INCREASED GEOMAGNETIC ACTIVITY</article-title><source>. NEUROSCIENCE LETTERS</source><volume> 560</volume>,<fpage> 126</fpage>-<lpage>130</lpage>.<pub-id pub-id-type="doi"></pub-id></mixed-citation></ref><ref id="scirp.45990-ref14"><label>14</label><mixed-citation publication-type="journal" xlink:type="simple"><name name-style="western"><surname>BOTELER</surname><given-names> D.H. </given-names></name>,<etal>et al</etal>. (<year>2001</year>)<article-title>ASSESSMENT OF GEOMAGNETIC HAZARD TO POWER SYSTEMS IN CANADA</article-title><source>. NATURAL HAZARDS</source><volume> 23</volume>,<fpage> 101</fpage>-<lpage>120</lpage>.<pub-id pub-id-type="doi">HTTP://DX.DOI.ORG/10.1023/A:1011194414259</pub-id></mixed-citation></ref><ref id="scirp.45990-ref15"><label>15</label><mixed-citation publication-type="journal" xlink:type="simple"><name name-style="western"><surname>MULLIGAN</surname><given-names> B.P.</given-names></name>,<name name-style="western"><surname> HUNTER</surname><given-names> M.D. </given-names></name>,<name name-style="western"><surname> PERSINGER</surname><given-names> M.A. </given-names></name>,<etal>et al</etal>. (<year>2010</year>)<article-title>EFFECTS OF GEOMAGNETIC ACTIVITY AND ATMOSPHERIC POWER VARIATIONS ON QUANTITATIVE MEASURES OF BRAIN ACTIVITY: REPLICATION OF AZERBAIJANI STUDIES</article-title><source>. ADVANCES IN SPACE RESEARCH</source><volume> 45</volume>,<fpage> 940</fpage>-<lpage>948</lpage>.<pub-id pub-id-type="doi">HTTP://DX.DOI.ORG/10.1016/J.ASR.2009.12.008</pub-id></mixed-citation></ref><ref id="scirp.45990-ref16"><label>16</label><mixed-citation publication-type="other" xlink:type="simple">LESKE, R.A., CUMMINGS, J.R., MEWALDT, R.A., STONE, E.C. AND VON ROSENVINGE, T.T. (1995) MEASUREMENTS OF THE IONIC CHARGE STATES OF SOLAR ENERGETIC PARTICLES USING THE GEOMAGNETIC FIELD. THE ASTROPHYSICAL JOURNAL LETTERS, 452, 149.</mixed-citation></ref><ref id="scirp.45990-ref17"><label>17</label><mixed-citation publication-type="other" xlink:type="simple">ZHANG, J., RICHARDSON, I.G., WEBB, D.F., GOPALSWAMY, N., HUTTUNEN, E., KASPER, J.C., NITTA, N.V., POOMVISES, W., THOMPSON, B.J., WU, C.C., YASHIRO, S. AND ZHUKOV, A.N. (2007) SOLAR AND INTERPLANETARY SOURCES OF MAJOR GEOMAGNETIC STORMS (DST ≤ -100 NT) DURING 1996-2005. JOURNAL OF GEOPHYSICAL RESEARCH: SPACE PHYSICS, 112.</mixed-citation></ref><ref id="scirp.45990-ref18"><label>18</label><mixed-citation publication-type="journal" xlink:type="simple"><name name-style="western"><surname>JEFFERSON</surname><given-names> M.F.</given-names></name>,<name name-style="western"><surname> PENDLETON</surname><given-names> N.</given-names></name>,<name name-style="western"><surname> LUCAS</surname><given-names> S.B. </given-names></name>,<name name-style="western"><surname> HORAN</surname><given-names> M.A. </given-names></name>,<etal>et al</etal>. (1997)<article-title>JEFFERSON, M.F., PENDLETON, N., LUCAS, S.B. AND HORAN, M.A.  COMPARISON OF A GENETIC ALGORITHM NEURAL NETWORK WITH LOGISTIC REGRESSION FOR PREDICTING OUTCOME AFTER SURGERY FOR PATIENTS WITH NONSMALL CELL LUNG CARCINOMA</article-title><source>. CANCER</source><volume> 79</volume>,<fpage> 1338</fpage>-<lpage>1342</lpage>.<pub-id pub-id-type="doi"></pub-id></mixed-citation></ref><ref id="scirp.45990-ref19"><label>19</label><mixed-citation publication-type="other" xlink:type="simple">EFTKHAR, B., MOHAMMAD, K., EFTEKHAR ARDEBILI, H., GHODSI, M. AND KETABCHI, E. (2005) COMPARISON OF ARTIFICIAL NEURAL NETWORK AND LOGISTIC REGRESSION MODELS FOR PREDICTION OF MORTALITY IN HEAD TRAUMA BASED ON INITIAL CLINICAL DATA. BMC BIOINFORMATICS AND DECISION MAKING, 5, 3.</mixed-citation></ref><ref id="scirp.45990-ref20"><label>20</label><mixed-citation publication-type="journal" xlink:type="simple"><name name-style="western"><surname>LUNDSTEDT</surname><given-names> H.</given-names></name>,<name name-style="western"><surname> GLEISNER</surname><given-names> H. </given-names></name>,<name name-style="western"><surname> WINTOFT</surname><given-names> P. </given-names></name>,<etal>et al</etal>. (<year>2002</year>)<article-title>OPERATIONAL FORECASTS OF THE GEOMAGNETIC DST INDEX</article-title><source>. GEOPHYSICAL RESEARCH LETTERS</source><volume> 29</volume>,<fpage> 34</fpage>-<lpage>1</lpage>.<pub-id pub-id-type="doi">HTTP://DX.DOI.ORG/10.1029/2002GL016151</pub-id></mixed-citation></ref></ref-list></back></article>