<?xml version="1.0" encoding="UTF-8"?><!DOCTYPE article  PUBLIC "-//NLM//DTD Journal Publishing DTD v3.0 20080202//EN" "http://dtd.nlm.nih.gov/publishing/3.0/journalpublishing3.dtd"><article xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink" dtd-version="3.0" xml:lang="en" article-type="research article"><front><journal-meta><journal-id journal-id-type="publisher-id">ME</journal-id><journal-title-group><journal-title>Modern Economy</journal-title></journal-title-group><issn pub-type="epub">2152-7245</issn><publisher><publisher-name>Scientific Research Publishing</publisher-name></publisher></journal-meta><article-meta><article-id pub-id-type="doi">10.4236/me.2016.78090</article-id><article-id pub-id-type="publisher-id">ME-69188</article-id><article-categories><subj-group subj-group-type="heading"><subject>Articles</subject></subj-group><subj-group subj-group-type="Discipline-v2"><subject>Business&amp;Economics</subject></subj-group></article-categories><title-group><article-title>
 
 
  Shipping Firms’ Efficiency Evaluation through Stochastic Frontier Analysis
 
</article-title></title-group><contrib-group><contrib contrib-type="author" xlink:type="simple"><name name-style="western"><surname>Dimitris</surname><given-names>Gavalas</given-names></name><xref ref-type="aff" rid="aff1"><sub>1</sub></xref></contrib></contrib-group><aff id="aff1"><label>1</label><addr-line>Shipping, Trade &amp;amp; Transport Department, Business School, University of Aegean, Chios, Greece</addr-line></aff><author-notes><corresp id="cor1">* E-mail:</corresp></author-notes><pub-date pub-type="epub"><day>22</day><month>07</month><year>2016</year></pub-date><volume>07</volume><issue>08</issue><fpage>867</fpage><lpage>874</lpage><history><date date-type="received"><day>26</day>	<month>April</month>	<year>2016</year></date><date date-type="rev-recd"><day>accepted</day>	<month>25</month>	<year>July</year>	</date><date date-type="accepted"><day>28</day>	<month>July</month>	<year>2016</year></date></history><permissions><copyright-statement>&#169; Copyright  2014 by authors and Scientific Research Publishing Inc. </copyright-statement><copyright-year>2014</copyright-year><license><license-p>This work is licensed under the Creative Commons Attribution International License (CC BY). http://creativecommons.org/licenses/by/4.0/</license-p></license></permissions><abstract><p>
 
 
  The concept of this study is to note whether financial risk assessment tools impact a ship
  ping firm’s performance, competitiveness and efficiency. Stochastic Frontier Analysis (SFA) is used in the evaluation of such issues. The shipping industry has been classified in three segments, namely dry bulk, tankers (including LPG and LNG) and containers. The influence of the risk assessment indicators on market and operational efficiency is subsequently determined by using a panel regression. This assists to determine whether different asset allocation and risk management techniques improve the performance of shipping firms. Our sample consists of 82 international ship-owning firms drawn from Bloomberg database for the period of 2001-2014. Through estimating efficiency, our model shows that containerized cargo firms have better performance in market and operating efficiency as well.
 
</p></abstract><kwd-group><kwd>Financial Risk</kwd><kwd> Assessment Tools</kwd><kwd> Stochastic Frontier Analysis</kwd><kwd> Shipping Industry</kwd></kwd-group></article-meta></front><body><sec id="s1"><title>1. Introduction</title><p>Since the credit crunch of the last quinquennium, firms across the shipping industry have been seeking for alternative sources of business financing. An increasing stream of firms have entered into the stock market through IPOs or the secondary market to raise the appropriate amount of cash to run their off-shore businesses and operate their vessels. The firm from the one hand needs to raise money to invest, but from the other hand investors need to make sure that the indices of the firm are reliable of its financial situation. One might say that indices have grown more powerful. That might be partly because of the growth of passive index investing, in which funds follow an index, being a positive development since it reduces costs. Costs are the best single predictor of the future performance of an investment that a firm would prefer to follow. If fund managers assume that the firm’s performance compared to the index performance will determine whether investors give their money, then the index will naturally be of high importance for their decisions. To diverge from the benchmark would risk for a possible underperformance and investors taking away their funds.</p><p>Shipping IPOs are different from those of ordinary industrial or service companies. The market value of a shipping company is often closely related to the value of the vessels. This means that shipping IPOs function in a similar way to the respective IPOs of funds and property companies. Furthermore, due to wide intelligence in S &amp; P shipping markets worldwide, shipping IPOs tend to exhibit lower information asymmetry [<xref ref-type="bibr" rid="scirp.69188-ref1">1</xref>] . Shipping has a clear cyclical nature; thus shipping companies tend to prefer equity markets when prospects seem to be auspicious.</p><p>Throughout the review of existing literature one may find that researchers have come up with the concept of efficiency to assess performance. As found in [<xref ref-type="bibr" rid="scirp.69188-ref2">2</xref>] , when one refers to performance of shipping companies, this means either financial performance (ratios used in accounting) or overall efficiency (distributions of inputs). Actually, what characterizes an effective manager is the ability to foresee the risks ahead and establish an early warning signal strategy to mitigate the potential risks concerning financial performance and the overall efficiency of the shipping firm.</p><p>The crucial issue that we try to shed light on in this paper is whether indeed an early warning signal strategy is capable of affecting the firm’s market and operating efficiency. We reckon that the study closer to ours is that of [<xref ref-type="bibr" rid="scirp.69188-ref3">3</xref>] , to which we mainly differ in the sample (82 against 79 firms), the period studied (2001-2014 against 2001- 2010) and the variables used in the model. Our study is divided into two parts: the first one includes the efficiency measurement model driven from [<xref ref-type="bibr" rid="scirp.69188-ref3">3</xref>] and [<xref ref-type="bibr" rid="scirp.69188-ref4">4</xref>] and in the second part we run a panel regression to check the influence of various financial strategies upon the performance of shipping firms. Listed shipping firms have been categorized into three segments that are dry bulk, tankers (including LPG and LNG) and containers. The method to classify each firm to one of the three segments is by discriminating the main activity of the firm. Financial data stem from Bloomberg database, while the firms in our sample do not stop short at ship-owning firms, but also at ship-managers and charterers. Thus we could underpin that our sample expressed the global shipping listed directory. The efficiency evaluation is implementing via the stochastic Frontier Analysis (SFA).</p><p>The remaining part of paper is structured as follows. In Section 2, the literature review on efficiency studies is revealed. We proceed with Section 3 presenting the methodology used in this study. In Section 4, the SFA and panel regression are implement in terms of empirical analysis. We conclude in Section 5.</p></sec><sec id="s2"><title>2. Methodology and Data Analysis</title><p>The work of [<xref ref-type="bibr" rid="scirp.69188-ref5">5</xref>] initiated the deep analysis of frontiers and efficiency measurement. This study provided definitions and a computational framework for both “technical and allocative efficiency”. Based on Farrell’s work, the measurement of efficiency and the way to estimate frontiers have developed enormously over the past decades. In this respect, Data Envelopment Analysis (DEA) and Stochastic Frontier Analysis (SFA) are the two most important alternative approaches; both approaches have been broadly studied as methodologies in their own right and applied to a range of business contexts.</p><p>SFA assumes that a parametric function exists between production inputs and outputs [<xref ref-type="bibr" rid="scirp.69188-ref6">6</xref>] and [<xref ref-type="bibr" rid="scirp.69188-ref7">7</xref>] . As an alternative approach to DEA, the great virtue of SFA is that it not only allows for technical inefficiency, but also acknowledges the fact that random shocks outside the management of producers can affect the output production. For this reason, the essential idea behind SFA is that the error term is composed of two parts; a one-sided component that captures the effects of inefficiency relative to the stochastic frontier, as well as a symmetric component that permits random variation of the frontier across the firms’ sample, and captures the effects of measurement error, other statistical noise, and random shocks outside the firm’s management. In this occasion, the SFA (cross-sectional) has been used and a panel stochastic frontier model as well.</p><sec id="s2_1"><title>2.1. Revealing the SFA</title><p>Production frontier models indicate the maximum production capacity a firm can produce given the available resources. To what extent a firm deviates from the production possibility frontier is actually the measurement tool for inefficiency. This method seems better than the ordinary least squared (OLS) regression because firms may fall short of the production frontier but cannot go beyond it. Additionally, symmetric distribution around the production frontier cannot be assured as in OLS. Apart from [<xref ref-type="bibr" rid="scirp.69188-ref6">6</xref>] and [<xref ref-type="bibr" rid="scirp.69188-ref7">7</xref>] seen before, more recently [<xref ref-type="bibr" rid="scirp.69188-ref8">8</xref>] provided a further detailed explanation.</p><p>In this study, we assume that each firm produces less than its optimal output due to a degree of inefficiency. Specifically, <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/6-7201306x6.png" xlink:type="simple"/></inline-formula>, where <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/6-7201306x7.png" xlink:type="simple"/></inline-formula> and <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/6-7201306x8.png" xlink:type="simple"/></inline-formula> are the appropriate forms of output and the combination of inputs respectively in the production function with i denoting shipping companies and t denoting time. From the other hand, <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/6-7201306x9.png" xlink:type="simple"/></inline-formula>is the level of technical efficiency. Adding the stochastic components to the model, production function is subject to random and factors that may not be controlled. These effects are described by<inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/6-7201306x10.png" xlink:type="simple"/></inline-formula>. Equation (1) shows the above information:</p><disp-formula id="scirp.69188-formula1268"><label>(1)</label><graphic position="anchor" xlink:href="http://html.scirp.org/file/6-7201306x11.png"  xlink:type="simple"/></disp-formula><p>where<inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/6-7201306x12.png" xlink:type="simple"/></inline-formula>,<inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/6-7201306x13.png" xlink:type="simple"/></inline-formula>.</p><p>If equation above is being logged, then Equation (2) is produced:</p><disp-formula id="scirp.69188-formula1269"><label>, (2)</label><graphic position="anchor" xlink:href="http://html.scirp.org/file/6-7201306x14.png"  xlink:type="simple"/></disp-formula><p>where <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/6-7201306x15.png" xlink:type="simple"/></inline-formula></p></sec><sec id="s2_2"><title>2.2. Dataset</title><p>The Bloomberg database has been the feeder for the shipping firm-level financial data used in this study. There have been several occasions where multiple observations have been found to exist within the same year. To front this situation, we proceeded to data cleansing, in order for the data set to be consistent with other similar data sets in the sample. Actually, original filings have been put aside and restated financial data has been ultimately used as inputs. There is no actual way of revealing the actual information and remove the “noise” but this has proved to be our best option. After data cleansing a series of 33 dry bulk, 31 tanker (incl. LPG &amp; LNG) and 18 container shipping companies have been included in the study. The series covers the period from 2000 to 2014.</p><p>The variables that have been used in the efficiency test are denoted in <xref ref-type="table" rid="table1">Table 1</xref>. The enterprise value (ENTV) denotes the market efficiency of the shipping company, while sales (NS) represent the operating efficiency.</p><p>Accordingly, <xref ref-type="table" rid="table2">Table 2</xref> shows the descriptive status of these variables. What may be extracted is that on average, the highest enterprise value and sales appear into the containerized market. As expected the leader of the market (in our case the containers) demand the most of capital expenditure (CAPEX) to face the challenges and the largest amount of full-time employees (FEMP) to manage such operations.</p></sec></sec><sec id="s3"><title>3. Applying the Stochastic Frontier Analysis</title><p>In this section the cross-sectional study is executed. Our sample of 82 shipping companies<sup>1</sup> covers dry bulk, tanker and containers sectors. Afterwards, a panel data analysis is applied from 2000 to 2014 to observe the dynamics of the shipping industry. The period that has been chosen captures a whole shipping cycle.</p><table-wrap id="table1" ><label><xref ref-type="table" rid="table1">Table 1</xref></label><caption><title> Definition of variables</title></caption><table><tbody><thead><tr><th align="center" valign="middle" >Variable</th><th align="center" valign="middle" >Definition</th></tr></thead><tr><td align="center" valign="middle" >TOTA</td><td align="center" valign="middle" >Total assets</td></tr><tr><td align="center" valign="middle" >TOTE</td><td align="center" valign="middle" >Total equity</td></tr><tr><td align="center" valign="middle" >EB</td><td align="center" valign="middle" >EBITDA</td></tr><tr><td align="center" valign="middle" >NS</td><td align="center" valign="middle" >Net sales</td></tr><tr><td align="center" valign="middle" >GRPR</td><td align="center" valign="middle" >Gross profit</td></tr><tr><td align="center" valign="middle" >ENTV</td><td align="center" valign="middle" >Enterprise value</td></tr><tr><td align="center" valign="middle" >CAPEX</td><td align="center" valign="middle" >Capital expenditure</td></tr><tr><td align="center" valign="middle" >FEMP</td><td align="center" valign="middle" >Full-time employees</td></tr></tbody></table></table-wrap><p>Note: <xref ref-type="table" rid="table1">Table 1</xref> describes the variables in our study. NS denotes the dependent variable for operating efficiency and ENTV for market efficiency.</p><table-wrap id="table2" ><label><xref ref-type="table" rid="table2">Table 2</xref></label><caption><title> Descriptive statistics</title></caption><table><tbody><thead><tr><th align="center" valign="middle" >Variable</th><th align="center" valign="middle" >Whole market</th><th align="center" valign="middle" >Containers</th><th align="center" valign="middle" >Dry bulk</th><th align="center" valign="middle" >Tankers</th></tr></thead><tr><td align="center" valign="middle" >TOTA</td><td align="center" valign="middle" >3118.55</td><td align="center" valign="middle" >8323.88</td><td align="center" valign="middle" >912.12</td><td align="center" valign="middle" >1422.09</td></tr><tr><td align="center" valign="middle" ></td><td align="center" valign="middle" >(6772.12)</td><td align="center" valign="middle" >(11,332.11)</td><td align="center" valign="middle" >(1211.42)</td><td align="center" valign="middle" >(1732.21)</td></tr><tr><td align="center" valign="middle" >TOTE</td><td align="center" valign="middle" >1211.93</td><td align="center" valign="middle" >2711.34</td><td align="center" valign="middle" >418.21</td><td align="center" valign="middle" >512.30</td></tr><tr><td align="center" valign="middle" ></td><td align="center" valign="middle" >(2722.17)</td><td align="center" valign="middle" >(4711.41)</td><td align="center" valign="middle" >(426.59)</td><td align="center" valign="middle" >(521.42)</td></tr><tr><td align="center" valign="middle" >EB</td><td align="center" valign="middle" >418.27</td><td align="center" valign="middle" >1052.11</td><td align="center" valign="middle" >131.11</td><td align="center" valign="middle" >162.67</td></tr><tr><td align="center" valign="middle" ></td><td align="center" valign="middle" >(1278.10)</td><td align="center" valign="middle" >(2144.78)</td><td align="center" valign="middle" >(132.78)</td><td align="center" valign="middle" >(211.56)</td></tr><tr><td align="center" valign="middle" >NS</td><td align="center" valign="middle" >2256.12</td><td align="center" valign="middle" >6722.90</td><td align="center" valign="middle" >631.67</td><td align="center" valign="middle" >482.11</td></tr><tr><td align="center" valign="middle" ></td><td align="center" valign="middle" >(6156.89)</td><td align="center" valign="middle" >(10,224.78)</td><td align="center" valign="middle" >(1162.71)</td><td align="center" valign="middle" >(617.52)</td></tr><tr><td align="center" valign="middle" >GRPR</td><td align="center" valign="middle" >832.18</td><td align="center" valign="middle" >2563.16</td><td align="center" valign="middle" >144.12</td><td align="center" valign="middle" >218.96</td></tr><tr><td align="center" valign="middle" ></td><td align="center" valign="middle" >(4622.71)</td><td align="center" valign="middle" >(8772.14)</td><td align="center" valign="middle" >(152.46)</td><td align="center" valign="middle" >(246.78)</td></tr><tr><td align="center" valign="middle" >ENTV</td><td align="center" valign="middle" >226,611.21</td><td align="center" valign="middle" >553,119.73</td><td align="center" valign="middle" >176,221.07</td><td align="center" valign="middle" >12,771.22</td></tr><tr><td align="center" valign="middle" ></td><td align="center" valign="middle" >(864,221.70)</td><td align="center" valign="middle" >(991,662.46)</td><td align="center" valign="middle" >(822,162.26)</td><td align="center" valign="middle" >(32,618.03)</td></tr><tr><td align="center" valign="middle" >CAPEX</td><td align="center" valign="middle" >−281.38</td><td align="center" valign="middle" >−611.72</td><td align="center" valign="middle" >−152.45</td><td align="center" valign="middle" >−172.72</td></tr><tr><td align="center" valign="middle" ></td><td align="center" valign="middle" >(527.19)</td><td align="center" valign="middle" >(962.11)</td><td align="center" valign="middle" >(182.13)</td><td align="center" valign="middle" >(182.19)</td></tr><tr><td align="center" valign="middle" >FEMP</td><td align="center" valign="middle" >3522</td><td align="center" valign="middle" >11,552</td><td align="center" valign="middle" >611</td><td align="center" valign="middle" >1179</td></tr><tr><td align="center" valign="middle" ></td><td align="center" valign="middle" >(12,773)</td><td align="center" valign="middle" >(22,183)</td><td align="center" valign="middle" >(822)</td><td align="center" valign="middle" >(2001)</td></tr></tbody></table></table-wrap><p>Note: <xref ref-type="table" rid="table3">Table 3</xref> shows the descriptive statistics of key variables (in USD mn., apart from FEMP estimated in number of persons). The coefficients denote the means and inside the parentheses one may see the standard deviations.</p><sec id="s3_1"><title>3.1. Cross-Sectional &amp; Panel Frontier Models</title><p>To set our model, we have followed [<xref ref-type="bibr" rid="scirp.69188-ref3">3</xref>] and [<xref ref-type="bibr" rid="scirp.69188-ref4">4</xref>] . In order to evaluate market efficiency of a shipping firm, the stochastic frontier model is formed as:</p><disp-formula id="scirp.69188-formula1270"><label>. (3)</label><graphic position="anchor" xlink:href="http://html.scirp.org/file/6-7201306x17.png"  xlink:type="simple"/></disp-formula><p>We assume that the market value of a firm i at time t (ENTV) is related in a positive way to the profit of the firm (GRPR) and its total equity (TOTE). <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/6-7201306x18.png" xlink:type="simple"/></inline-formula>denotes the random error term, while <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/6-7201306x19.png" xlink:type="simple"/></inline-formula> shows inefficiency. In order to evaluate operating performance efficiency of a shipping firm, the stochastic frontier model is formed as:</p><disp-formula id="scirp.69188-formula1271"><label>. (4)</label><graphic position="anchor" xlink:href="http://html.scirp.org/file/6-7201306x20.png"  xlink:type="simple"/></disp-formula><p>Equation (4) depicts the correlation of the sales of a firm i at time t (NS) with the total assets (TOTA), capital expenditure (CAPEX) and the number of employees (FEMP). <xref ref-type="table" rid="table3">Table 3</xref> presents the results of a cross-sectional study, where the signs are as expected. When a shipping firm has the capacity to raise equity and make profit, then its market value raises. On the other hand, the number of employees and the firm’s assets lead to larger net sales.</p><p>It is possible that several factors affect a shipping firm’s ability to reach the highest production frontier, where the output gap equals zero. As seen in <xref ref-type="table" rid="table4">Table 4</xref>, the results show that whether inefficiency is time-invariant or time-varying, there seems to be a consistency. Specifically, profit and equity are positively related to market efficiency; assets and number of full-time employees are positively related to operating performance efficiency, but negatively related to capital expenditure.</p><p><xref ref-type="table" rid="table5">Table 5</xref> shows the efficiency scores of the three main shipping segments. What seems clear is that high profit margins lead to high scores (on average) in market and operating efficiency for the firms in the containers market.</p><p>After observing the results our conclusions seem consistent with [<xref ref-type="bibr" rid="scirp.69188-ref3">3</xref>] . The scores from market efficiency evaluation are smaller than the ones obtained from the operating performance panel frontier model. In agreement with the previous researchers, in order to predict the enterprise value of a shipping firm, one may need macro</p><table-wrap id="table3" ><label><xref ref-type="table" rid="table3">Table 3</xref></label><caption><title> Frontier model-cross-sectional</title></caption><table><tbody><thead><tr><th align="center" valign="middle" ></th><th align="center" valign="middle"  colspan="2"  >lnENTV</th><th align="center" valign="middle" ></th><th align="center" valign="middle"  colspan="2"  >lnNS</th></tr></thead><tr><td align="center" valign="middle" >(A)</td><td align="center" valign="middle" >Half normal</td><td align="center" valign="middle" >Truncated normal</td><td align="center" valign="middle" >(B)</td><td align="center" valign="middle" >Half normal</td><td align="center" valign="middle" >Truncated normal</td></tr><tr><td align="center" valign="middle" >lnGRPR</td><td align="center" valign="middle" >0.154</td><td align="center" valign="middle" >0.153</td><td align="center" valign="middle" >lnTOTA</td><td align="center" valign="middle" >1.082</td><td align="center" valign="middle" >1.082</td></tr><tr><td align="center" valign="middle" ></td><td align="center" valign="middle" >(0.412)</td><td align="center" valign="middle" >(0.403)</td><td align="center" valign="middle" ></td><td align="center" valign="middle" >(0.136)<sup>***</sup></td><td align="center" valign="middle" >(0.136)<sup>***</sup></td></tr><tr><td align="center" valign="middle" >lnTOTE</td><td align="center" valign="middle" >0.823</td><td align="center" valign="middle" >0.823</td><td align="center" valign="middle" >lnCAPEX</td><td align="center" valign="middle" >−0.019</td><td align="center" valign="middle" >−0.019</td></tr><tr><td align="center" valign="middle" ></td><td align="center" valign="middle" >(0.442)<sup>*</sup></td><td align="center" valign="middle" >(0.442)<sup>*</sup></td><td align="center" valign="middle" ></td><td align="center" valign="middle" >(0.055)</td><td align="center" valign="middle" >(0.055)</td></tr><tr><td align="center" valign="middle" ></td><td align="center" valign="middle" ></td><td align="center" valign="middle" ></td><td align="center" valign="middle" >lnFEMP</td><td align="center" valign="middle" >0.247</td><td align="center" valign="middle" >0.247</td></tr><tr><td align="center" valign="middle" ></td><td align="center" valign="middle" ></td><td align="center" valign="middle" ></td><td align="center" valign="middle" ></td><td align="center" valign="middle" >(0.053)<sup>***</sup></td><td align="center" valign="middle" >(0.053)<sup>***</sup></td></tr><tr><td align="center" valign="middle" >Cons</td><td align="center" valign="middle" >1.877</td><td align="center" valign="middle" >1.863</td><td align="center" valign="middle" >Cons</td><td align="center" valign="middle" >−2.286</td><td align="center" valign="middle" >−2.293</td></tr><tr><td align="center" valign="middle" ></td><td align="center" valign="middle" >(2.519)</td><td align="center" valign="middle" >(1.922)</td><td align="center" valign="middle" ></td><td align="center" valign="middle" >(0.736)<sup>***</sup></td><td align="center" valign="middle" >(0.727)<sup>***</sup></td></tr><tr><td align="center" valign="middle" >Obs</td><td align="center" valign="middle" >78</td><td align="center" valign="middle" >80</td><td align="center" valign="middle" >Obs</td><td align="center" valign="middle" >63</td><td align="center" valign="middle" >63</td></tr><tr><td align="center" valign="middle" >λ</td><td align="center" valign="middle" >0.011</td><td align="center" valign="middle" >0.012</td><td align="center" valign="middle" >λ</td><td align="center" valign="middle" >0.025</td><td align="center" valign="middle" >0.031</td></tr><tr><td align="center" valign="middle" ><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/6-7201306x21.png" xlink:type="simple"/></inline-formula></td><td align="center" valign="middle" >5.318</td><td align="center" valign="middle" >5.318</td><td align="center" valign="middle" ><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/6-7201306x22.png" xlink:type="simple"/></inline-formula></td><td align="center" valign="middle" >0.381</td><td align="center" valign="middle" >0.381</td></tr><tr><td align="center" valign="middle" ><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/6-7201306x23.png" xlink:type="simple"/></inline-formula></td><td align="center" valign="middle" >0.001</td><td align="center" valign="middle" >0.001</td><td align="center" valign="middle" ><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/6-7201306x24.png" xlink:type="simple"/></inline-formula></td><td align="center" valign="middle" >0.000</td><td align="center" valign="middle" >0.000</td></tr></tbody></table></table-wrap><p>Note: Panel (A) present market efficiency and Panel (b) present operating performance efficiency. Standard errors have been put in parentheses. <sup>***</sup>, <sup>**</sup>, <sup>*</sup> are significant at 1%, 5%, 10% level.</p><table-wrap id="table4" ><label><xref ref-type="table" rid="table4">Table 4</xref></label><caption><title> Frontier model-panel</title></caption><table><tbody><thead><tr><th align="center" valign="middle" ></th><th align="center" valign="middle"  colspan="2"  >lnENTV</th><th align="center" valign="middle" ></th><th align="center" valign="middle"  colspan="2"  >lnNS</th></tr></thead><tr><td align="center" valign="middle" ></td><td align="center" valign="middle" >Time-invariant</td><td align="center" valign="middle" >Time-varying</td><td align="center" valign="middle" ></td><td align="center" valign="middle" >Time-invariant</td><td align="center" valign="middle" >Time-varying</td></tr><tr><td align="center" valign="middle" >lnGRPR</td><td align="center" valign="middle" >0.243</td><td align="center" valign="middle" >0.239</td><td align="center" valign="middle" >lnTOTA</td><td align="center" valign="middle" >0.833</td><td align="center" valign="middle" >0.851</td></tr><tr><td align="center" valign="middle" ></td><td align="center" valign="middle" >(0.031)<sup>***</sup></td><td align="center" valign="middle" >(0.031)<sup>***</sup></td><td align="center" valign="middle" ></td><td align="center" valign="middle" >(0.037)<sup>***</sup></td><td align="center" valign="middle" >(0.041)<sup>***</sup></td></tr><tr><td align="center" valign="middle" >lnTOTE</td><td align="center" valign="middle" >0.366</td><td align="center" valign="middle" >0.317</td><td align="center" valign="middle" >lnCAPEX</td><td align="center" valign="middle" >−0.012</td><td align="center" valign="middle" >−0.012</td></tr><tr><td align="center" valign="middle" ></td><td align="center" valign="middle" >(0.046)<sup>***</sup></td><td align="center" valign="middle" >(0.047)<sup>***</sup></td><td align="center" valign="middle" ></td><td align="center" valign="middle" >(0.023)</td><td align="center" valign="middle" >(0.023)</td></tr><tr><td align="center" valign="middle" ></td><td align="center" valign="middle" ></td><td align="center" valign="middle" ></td><td align="center" valign="middle" >lnFEMP</td><td align="center" valign="middle" >0.172</td><td align="center" valign="middle" >0.153</td></tr><tr><td align="center" valign="middle" ></td><td align="center" valign="middle" ></td><td align="center" valign="middle" ></td><td align="center" valign="middle" ></td><td align="center" valign="middle" >(0.016)<sup>***</sup></td><td align="center" valign="middle" >(0.012)<sup>***</sup></td></tr><tr><td align="center" valign="middle" >Cons</td><td align="center" valign="middle" >13.262</td><td align="center" valign="middle" >13.701</td><td align="center" valign="middle" >Cons</td><td align="center" valign="middle" >0.527</td><td align="center" valign="middle" >0.156</td></tr><tr><td align="center" valign="middle" ></td><td align="center" valign="middle" >(1.327)<sup>***</sup></td><td align="center" valign="middle" >(3.427)<sup>***</sup></td><td align="center" valign="middle" ></td><td align="center" valign="middle" >(0.311)<sup>***</sup></td><td align="center" valign="middle" >(0.279)<sup>***</sup></td></tr><tr><td align="center" valign="middle" >Obs</td><td align="center" valign="middle" >632</td><td align="center" valign="middle" >632</td><td align="center" valign="middle" >Obs</td><td align="center" valign="middle" >577</td><td align="center" valign="middle" >577</td></tr><tr><td align="center" valign="middle" >N</td><td align="center" valign="middle" >82</td><td align="center" valign="middle" >82</td><td align="center" valign="middle" >N</td><td align="center" valign="middle" >77</td><td align="center" valign="middle" >77</td></tr><tr><td align="center" valign="middle" >λ</td><td align="center" valign="middle" >5.403</td><td align="center" valign="middle" >5.482</td><td align="center" valign="middle" >λ</td><td align="center" valign="middle" >1.836</td><td align="center" valign="middle" >1.873</td></tr><tr><td align="center" valign="middle" ><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/6-7201306x25.png" xlink:type="simple"/></inline-formula></td><td align="center" valign="middle" >0.155</td><td align="center" valign="middle" >0.147</td><td align="center" valign="middle" ><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/6-7201306x26.png" xlink:type="simple"/></inline-formula></td><td align="center" valign="middle" >0.113</td><td align="center" valign="middle" >0.107</td></tr><tr><td align="center" valign="middle" ><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/6-7201306x27.png" xlink:type="simple"/></inline-formula></td><td align="center" valign="middle" >5.946</td><td align="center" valign="middle" >5.949</td><td align="center" valign="middle" ><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/6-7201306x28.png" xlink:type="simple"/></inline-formula></td><td align="center" valign="middle" >0.413</td><td align="center" valign="middle" >0.418</td></tr></tbody></table></table-wrap><p>Note: Panel (A) present market efficiency and Panel (b) present operating performance efficiency. Standard errors have been put in parentheses. <sup>***</sup>, <sup>**</sup>, <sup>*</sup> are significant at 1%, 5%, 10% level.</p><p>data, shipping cycle data and perhaps credit rating details [<xref ref-type="bibr" rid="scirp.69188-ref9">9</xref>] - [<xref ref-type="bibr" rid="scirp.69188-ref11">11</xref>] .</p></sec><sec id="s3_2"><title>3.2. Risk Exposure &amp; Early Warning System</title><p>In a commonly agreed volatile environment, shipping firms experience business, physical and technical risks. However, in this study we focus on the financial perspective which directly affects the firm’s performance. According to [<xref ref-type="bibr" rid="scirp.69188-ref12">12</xref>] financial risks in the shipping sector could be classified as default, credit, market, financial and liquidity. Each category can be quantified by the indicators defined in <xref ref-type="table" rid="table6">Table 6</xref>. The philosophy behind this structure is the CAMEL rating system.</p><p>In the 1980s, the US supervisory authorities were the first to establish “on-site examinations” ratings for banking institutions. This was done by using the CAMEL rating system and is used by all three US supervisory agencies, i.e. the Federal Reserve System, Office of the Comptroller of the Currency and the Federal Deposit Insurance Corporation [<xref ref-type="bibr" rid="scirp.69188-ref13">13</xref>] . The concept is based on examiner assessment of a banking institution under specific criteria on supervision. Specifically, each credit institution is evaluated on the basis of five critical component factors, relating to its operations and performance. These are Capital, Asset Quality, Management, Earnings and Liquidity [<xref ref-type="bibr" rid="scirp.69188-ref14">14</xref>] .</p><p><xref ref-type="table" rid="table6">Table 6</xref> includes the risk assessment tools that could be the incorporated as efficiency determinants. After having gathered the results (relative efficiency scores) for market and operational efficiency, the risk management perception is being incorporated in the empirical model.</p><p>Moreover, <xref ref-type="table" rid="table7">Table 7</xref> reports the descriptive statistics of above key variables.</p><p>After examining <xref ref-type="table" rid="table7">Table 7</xref>, it is deriver that containerized cargo shipping companies perform the greatest current liabilities ratio, and thus, the lowest current ratio and quick ratio. These firms need to gain access to the capital market instruments, in order to meet the demand for short-term cash flow. Furthermore, shipping firms operating in the tanker segment rely rather on the long-term debt to preserve plane operation, and thus, have the highest debt to asset ratio or perform a high leverage.</p><table-wrap id="table5" ><label><xref ref-type="table" rid="table5">Table 5</xref></label><caption><title> Panel regression-efficiency scores</title></caption><table><tbody><thead><tr><th align="center" valign="middle" ></th><th align="center" valign="middle"  colspan="2"  >Market efficiency</th><th align="center" valign="middle" ></th><th align="center" valign="middle"  colspan="2"  >Operating efficiency</th></tr></thead><tr><td align="center" valign="middle" >(A)</td><td align="center" valign="middle" >Time-invariant</td><td align="center" valign="middle" >Time-varying</td><td align="center" valign="middle" >(B)</td><td align="center" valign="middle" >Time-invariant</td><td align="center" valign="middle" >Time-varying</td></tr><tr><td align="center" valign="middle" >Dry bulk</td><td align="center" valign="middle" >0.037</td><td align="center" valign="middle" >0.012</td><td align="center" valign="middle" >Dry bulk</td><td align="center" valign="middle" >0.481</td><td align="center" valign="middle" >0.362</td></tr><tr><td align="center" valign="middle" ></td><td align="center" valign="middle" >(0.153)</td><td align="center" valign="middle" >(0.062)</td><td align="center" valign="middle" ></td><td align="center" valign="middle" >(0.266)</td><td align="center" valign="middle" >(0.269)</td></tr><tr><td align="center" valign="middle" >Tankers</td><td align="center" valign="middle" >0.002</td><td align="center" valign="middle" >0.001</td><td align="center" valign="middle" >Tankers</td><td align="center" valign="middle" >0.371</td><td align="center" valign="middle" >0.211</td></tr><tr><td align="center" valign="middle" ></td><td align="center" valign="middle" >(0.010)</td><td align="center" valign="middle" >(0.004)</td><td align="center" valign="middle" ></td><td align="center" valign="middle" >(0.217)</td><td align="center" valign="middle" >(0.065)</td></tr><tr><td align="center" valign="middle" >Containers</td><td align="center" valign="middle" >0.074</td><td align="center" valign="middle" >0.012</td><td align="center" valign="middle" >Containers</td><td align="center" valign="middle" >0.721</td><td align="center" valign="middle" >0.524</td></tr><tr><td align="center" valign="middle" ></td><td align="center" valign="middle" >(0.212)</td><td align="center" valign="middle" >(0.037)</td><td align="center" valign="middle" ></td><td align="center" valign="middle" >(0.256)</td><td align="center" valign="middle" >(0.142)</td></tr><tr><td align="center" valign="middle" >All</td><td align="center" valign="middle" >0.034</td><td align="center" valign="middle" >0.012</td><td align="center" valign="middle" >All</td><td align="center" valign="middle" >0.431</td><td align="center" valign="middle" >0.382</td></tr><tr><td align="center" valign="middle" ></td><td align="center" valign="middle" >(0.142)</td><td align="center" valign="middle" >(0.052)</td><td align="center" valign="middle" ></td><td align="center" valign="middle" >(0.253)</td><td align="center" valign="middle" >(0.214)</td></tr></tbody></table></table-wrap><p>Note: Means of efficiency scores. Standard deviations have been put in parentheses.</p><table-wrap id="table6" ><label><xref ref-type="table" rid="table6">Table 6</xref></label><caption><title> Risk assessment tools</title></caption><table><tbody><thead><tr><th align="center" valign="middle" >ART</th><th align="center" valign="middle" >Accounts receivable turnover</th><th align="center" valign="middle" >Net credit sales/average accounts receivable</th></tr></thead><tr><td align="center" valign="middle" >IT</td><td align="center" valign="middle" >Inventory turnover</td><td align="center" valign="middle" >Cost of goods sold/average inventory</td></tr><tr><td align="center" valign="middle" >APT</td><td align="center" valign="middle" >Accounts payable turnover</td><td align="center" valign="middle" >Total supplier purchases/average accounts payable</td></tr><tr><td align="center" valign="middle" >TAT</td><td align="center" valign="middle" >Total assets turnover</td><td align="center" valign="middle" >Sales or revenues/total assets</td></tr><tr><td align="center" valign="middle" >FAT</td><td align="center" valign="middle" >Fixed assets turnover</td><td align="center" valign="middle" >Net sales/Net property, plan &amp; equipment</td></tr><tr><td align="center" valign="middle" >OET</td><td align="center" valign="middle" >Operating expense ratio</td><td align="center" valign="middle" >Property’s operating expense/gross operating income</td></tr><tr><td align="center" valign="middle" >ROI</td><td align="center" valign="middle" >Return on investment</td><td align="center" valign="middle" >(Gain of investment-cost of investment)/cost of investment</td></tr><tr><td align="center" valign="middle" >ACP</td><td align="center" valign="middle" >Average collection period</td><td align="center" valign="middle" >(number of working days * average amount of accounts receivables)/total amount of net credit sales during period</td></tr><tr><td align="center" valign="middle" >APP</td><td align="center" valign="middle" >Average payment period</td><td align="center" valign="middle" >(number of working days * average amount of accounts payable)/total amount of net credit purchases during period</td></tr></tbody></table></table-wrap><p>Note: The variables listed here denote ones that could serve as an early warning system of the shipping industry’s exposure.</p><table-wrap id="table7" ><label><xref ref-type="table" rid="table7">Table 7</xref></label><caption><title> Risk assessment tools-descriptive statistics</title></caption><table><tbody><thead><tr><th align="center" valign="middle" >Variable</th><th align="center" valign="middle" >Dry bulk</th><th align="center" valign="middle" >Tankers</th><th align="center" valign="middle" >Containers</th><th align="center" valign="middle" >All</th></tr></thead><tr><td align="center" valign="middle" >ART</td><td align="center" valign="middle" >1.778</td><td align="center" valign="middle" >1.521</td><td align="center" valign="middle" >0.988</td><td align="center" valign="middle" >1.672</td></tr><tr><td align="center" valign="middle" ></td><td align="center" valign="middle" >(2.672)</td><td align="center" valign="middle" >(1.622)</td><td align="center" valign="middle" >(1.167)</td><td align="center" valign="middle" >(1.722)</td></tr><tr><td align="center" valign="middle" >IT</td><td align="center" valign="middle" >1.256</td><td align="center" valign="middle" >1.278</td><td align="center" valign="middle" >1.289</td><td align="center" valign="middle" >1.267</td></tr><tr><td align="center" valign="middle" ></td><td align="center" valign="middle" >(1.377)</td><td align="center" valign="middle" >(1.325)</td><td align="center" valign="middle" >(1.421)</td><td align="center" valign="middle" >(1.354)</td></tr><tr><td align="center" valign="middle" >APT</td><td align="center" valign="middle" >0.892</td><td align="center" valign="middle" >0.822</td><td align="center" valign="middle" >0.811</td><td align="center" valign="middle" >0.829</td></tr><tr><td align="center" valign="middle" ></td><td align="center" valign="middle" >(1.182)</td><td align="center" valign="middle" >(1.217)</td><td align="center" valign="middle" >(1.267)</td><td align="center" valign="middle" >(1.184)</td></tr><tr><td align="center" valign="middle" >TAT</td><td align="center" valign="middle" >2.143</td><td align="center" valign="middle" >1.866</td><td align="center" valign="middle" >2.142</td><td align="center" valign="middle" >2.054</td></tr><tr><td align="center" valign="middle" ></td><td align="center" valign="middle" >(2.213)</td><td align="center" valign="middle" >(1.874)</td><td align="center" valign="middle" >(2.211)</td><td align="center" valign="middle" >(2.147)</td></tr><tr><td align="center" valign="middle" >FAT</td><td align="center" valign="middle" >2.441</td><td align="center" valign="middle" >2.318</td><td align="center" valign="middle" >2.114</td><td align="center" valign="middle" >2.410</td></tr><tr><td align="center" valign="middle" ></td><td align="center" valign="middle" >(2.499)</td><td align="center" valign="middle" >(2.345)</td><td align="center" valign="middle" >(2.154)</td><td align="center" valign="middle" >(2.412)</td></tr><tr><td align="center" valign="middle" >OET</td><td align="center" valign="middle" >0.084</td><td align="center" valign="middle" >0.081</td><td align="center" valign="middle" >0.086</td><td align="center" valign="middle" >0.082</td></tr><tr><td align="center" valign="middle" ></td><td align="center" valign="middle" >(0.085)</td><td align="center" valign="middle" >(0.084)</td><td align="center" valign="middle" >(0.087)</td><td align="center" valign="middle" >(0.086)</td></tr><tr><td align="center" valign="middle" >ROI</td><td align="center" valign="middle" >13.276</td><td align="center" valign="middle" >6.227</td><td align="center" valign="middle" >9.562</td><td align="center" valign="middle" >9.225</td></tr><tr><td align="center" valign="middle" ></td><td align="center" valign="middle" >(365.172)</td><td align="center" valign="middle" >(101.226)</td><td align="center" valign="middle" >(20.121)</td><td align="center" valign="middle" >(233.901)</td></tr><tr><td align="center" valign="middle" >ACP</td><td align="center" valign="middle" >45</td><td align="center" valign="middle" >43</td><td align="center" valign="middle" >42</td><td align="center" valign="middle" >47</td></tr><tr><td align="center" valign="middle" ></td><td align="center" valign="middle" >(46)</td><td align="center" valign="middle" >(43)</td><td align="center" valign="middle" >(43)</td><td align="center" valign="middle" >(47)</td></tr><tr><td align="center" valign="middle" >APP</td><td align="center" valign="middle" >43</td><td align="center" valign="middle" >41</td><td align="center" valign="middle" >42</td><td align="center" valign="middle" >44</td></tr><tr><td align="center" valign="middle" ></td><td align="center" valign="middle" >(43)</td><td align="center" valign="middle" >(42)</td><td align="center" valign="middle" >(43)</td><td align="center" valign="middle" >(45)</td></tr></tbody></table></table-wrap><p>Note: <xref ref-type="table" rid="table7">Table 7</xref> reports the descriptive statistics of key risk assessment tools for the period 2000-2014. Standard deviations have been put in parentheses.</p></sec></sec><sec id="s4"><title>4. Conclusions</title><p>In this study, we evaluate operating and market efficiencies with financial outputs using SFA. Furthermore, we investigate determinants of the efficiency performance in terms of risk management in relation to financial strategies of international ship-owning firms. The results of panel SFA show that containerized cargo firms perform better than dry bulk and tanker firms in both market and operating efficiency models.</p><p>This study produces mixed results compared to the cross-sectional study by [<xref ref-type="bibr" rid="scirp.69188-ref4">4</xref>] , but similar to the same study and [<xref ref-type="bibr" rid="scirp.69188-ref3">3</xref>] as well, containerized cargo firms seem more efficient in operating performance. From 2001 to 2014 our study’s results showed that containerized cargo firms outperformed dry bulk and tanker firms. Moreover, containers firms require more employees, greater fixed investment, and more capital expenditure than the other sectors.</p><p>The panel results show that container firms perform a little bit to some extent better than tanker firms in the stock markets. When talking about efficiency determinants, it seems that risk management is more effective in explaining operating efficiency than in predicting market efficiency. Furthermore, liquidity is crucial to the industry which operates in a highly volatile market with a high rate of fixed cost.</p></sec><sec id="s5"><title>Cite this paper</title><p>Dimitris Gavalas, (2016) Shipping Firms’ Efficiency Evaluation through Stochastic Frontier Analysis. Modern Economy,07,867-874. doi: 10.4236/me.2016.78090</p></sec><sec id="s6"><title>NOTES</title></sec></body><back><ref-list><title>References</title><ref id="scirp.69188-ref1"><label>1</label><mixed-citation publication-type="book" xlink:type="simple">Syriopoulos, T. (2007) Financing Greek Shipping: Modern Instruments, Methods and Markets. In: Pallis, A., Ed., Maritime Transport: The Greek Paradigm, Research in Transportation Economics, 21, 171-219.  
http://dx.doi.org/10.1016/S0739-8859(07)21006-6</mixed-citation></ref><ref id="scirp.69188-ref2"><label>2</label><mixed-citation publication-type="book" xlink:type="simple">Panayides, P.M., Gong, X.H. and Lambertides, N. (2010) Measuring Business Performance in Shipping. In: Grammenos, C., Ed., Handbook of Maritime Economics and Business, 2nd Edition, LLP, London, 625-655.</mixed-citation></ref><ref id="scirp.69188-ref3"><label>3</label><mixed-citation publication-type="other" xlink:type="simple">Wang, G.W.Y., Woo, S.H. and Mileski, J. (2014) The Relative Efficiency and Financial Risk Assessment of Shipping Companies. Maritime Policy &amp; Management, 41, 651-666.</mixed-citation></ref><ref id="scirp.69188-ref4"><label>4</label><mixed-citation publication-type="other" xlink:type="simple">Panayides, P.M., Lambertides, N. and Savva. C.S. (2011) The Relative Efficiency of Shipping Companies. Transportation Research Part E: Logistics and Transportation Review, 47, 681-694. http://dx.doi.org/10.1016/j.tre.2011.01.001</mixed-citation></ref><ref id="scirp.69188-ref5"><label>5</label><mixed-citation publication-type="other" xlink:type="simple">Farrell, M.J. (1957) The Measurement of Productive Efficiency. Journal of Royal Statistical Society, 120, 253-281.  
http://dx.doi.org/10.2307/2343100</mixed-citation></ref><ref id="scirp.69188-ref6"><label>6</label><mixed-citation publication-type="other" xlink:type="simple">Aigner, D., Lovell, C. and Schmidt, P. (1977) Formulation and Estimation of Stochastic Frontier Production Function Models. Journal of Econometrics, 6, 21-37. http://dx.doi.org/10.1016/0304-4076(77)90052-5</mixed-citation></ref><ref id="scirp.69188-ref7"><label>7</label><mixed-citation publication-type="other" xlink:type="simple">Meeusen, W. and van den Broeck, J. (1977) Efficiency Estimation from Cobb-Douglas Production Functions with Composed Error. International Economic Review, 18, 435-444. http://dx.doi.org/10.2307/2525757</mixed-citation></ref><ref id="scirp.69188-ref8"><label>8</label><mixed-citation publication-type="other" xlink:type="simple">Kumbhakar, S. and Lovell, C.A.K. (2000) Stochastic Frontier Analysis. University Press, Cambridge.  
http://dx.doi.org/10.1017/CBO9781139174411</mixed-citation></ref><ref id="scirp.69188-ref9"><label>9</label><mixed-citation publication-type="journal" xlink:type="simple"><name name-style="western"><surname>Gavalas</surname><given-names> D. and Syriopoulos T. </given-names></name>,<etal>et al</etal>. (<year>2013</year>)<article-title>Bank Loan Quality and Credit Risk Exposure: A Multi-Criteria Decision Approach to Collateral Selection in shipping</article-title><source> Economics World</source><volume> 1</volume>,<fpage> 59</fpage>-<lpage>86</lpage>.<pub-id pub-id-type="doi"></pub-id></mixed-citation></ref><ref id="scirp.69188-ref10"><label>10</label><mixed-citation publication-type="other" xlink:type="simple">Gavalas, D. and Syriopoulos, T. (2014) Bank Credit Risk Management and Rating Migration Analysis on the Business Cycle. International Journal of Financial Studies, 2, 122-143. http://dx.doi.org/10.3390/ijfs2010122</mixed-citation></ref><ref id="scirp.69188-ref11"><label>11</label><mixed-citation publication-type="other" xlink:type="simple">Gavalas, D. and Syriopoulos, T. (2014) Bank Credit Risk Management and Migration Analysis; Conditioning Transition Matrices on the Stage of the Business Cycle. International Advances in Economic Research, 20, 1-16.  
http://dx.doi.org/10.1007/s11294-014-9459-y</mixed-citation></ref><ref id="scirp.69188-ref12"><label>12</label><mixed-citation publication-type="other" xlink:type="simple">Alizadeh, A.H., Kappou, K., Tsouknidis, D. and Visvikis, I. (2015) Liquidity Effects and FFA Returns in the International Shipping Derivatives Market. Transportation Research Part E: Logistics and Transportation Review, 76, 58-75.  
http://dx.doi.org/10.1016/j.tre.2015.02.001</mixed-citation></ref><ref id="scirp.69188-ref13"><label>13</label><mixed-citation publication-type="other" xlink:type="simple">Sahajwala, R. and Van den Bergh, P. (2000) Supervisory Risk Assessment and Early Warning Systems. Basle Committee on Banking Supervision.</mixed-citation></ref><ref id="scirp.69188-ref14"><label>14</label><mixed-citation publication-type="other" xlink:type="simple">Oet, M.V., Ong, S.J. and Gramlich, D. (2013) Policy in Adaptive Financial Markets—The Use of Systemic Risk Early Warning Tools. Federal Reserve Bank of Cleveland, Working Paper No. 1309.</mixed-citation></ref></ref-list></back></article>