<?xml version="1.0" encoding="UTF-8"?><!DOCTYPE article  PUBLIC "-//NLM//DTD Journal Publishing DTD v3.0 20080202//EN" "http://dtd.nlm.nih.gov/publishing/3.0/journalpublishing3.dtd"><article xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink" dtd-version="3.0" xml:lang="en" article-type="research article"><front><journal-meta><journal-id journal-id-type="publisher-id">JMF</journal-id><journal-title-group><journal-title>Journal of Mathematical Finance</journal-title></journal-title-group><issn pub-type="epub">2162-2434</issn><publisher><publisher-name>Scientific Research Publishing</publisher-name></publisher></journal-meta><article-meta><article-id pub-id-type="doi">10.4236/jmf.2015.55039</article-id><article-id pub-id-type="publisher-id">JMF-61565</article-id><article-categories><subj-group subj-group-type="heading"><subject>Articles</subject></subj-group><subj-group subj-group-type="Discipline-v2"><subject>Business&amp;Economics</subject><subject> Physics&amp;Mathematics</subject></subj-group></article-categories><title-group><article-title>
 
 
  Simulation of Leveraged ETF Volatility Using Nonparametric Density Estimation
 
</article-title></title-group><contrib-group><contrib contrib-type="author" xlink:type="simple"><name name-style="western"><surname>atthew</surname><given-names>Ginley</given-names></name><xref ref-type="aff" rid="aff1"><sup>1</sup></xref><xref ref-type="corresp" rid="cor1"><sup>*</sup></xref></contrib><contrib contrib-type="author" xlink:type="simple"><name name-style="western"><surname>David</surname><given-names>W. Scott</given-names></name><xref ref-type="aff" rid="aff1"><sup>1</sup></xref><xref ref-type="corresp" rid="cor1"><sup>*</sup></xref></contrib><contrib contrib-type="author" xlink:type="simple"><name name-style="western"><surname>Katherine</surname><given-names>E. Ensor</given-names></name><xref ref-type="aff" rid="aff1"><sup>1</sup></xref><xref ref-type="corresp" rid="cor1"><sup>*</sup></xref></contrib></contrib-group><aff id="aff1"><addr-line>Department of Statistics, Rice University, Houston TX, USA</addr-line></aff><author-notes><corresp id="cor1">* E-mail:<email>mginley@rice.edu(AG)</email>;<email>scottdw@rice.edu(DWS)</email>;<email>ensor@rice.edu(KEE)</email>;</corresp></author-notes><pub-date pub-type="epub"><day>26</day><month>11</month><year>2015</year></pub-date><volume>05</volume><issue>05</issue><fpage>457</fpage><lpage>479</lpage><history><date date-type="received"><day>30</day>	<month>September</month>	<year>2015</year></date><date date-type="rev-recd"><day>accepted</day>	<month>27</month>	<year>November</year>	</date><date date-type="accepted"><day>30</day>	<month>November</month>	<year>2015</year></date></history><permissions><copyright-statement>&#169; Copyright  2014 by authors and Scientific Research Publishing Inc. </copyright-statement><copyright-year>2014</copyright-year><license><license-p>This work is licensed under the Creative Commons Attribution International License (CC BY). http://creativecommons.org/licenses/by/4.0/</license-p></license></permissions><abstract><p>
 
 
   Leveraged Exchange Traded Funds (LETFs) are constructed to provide the indicated leverage multiple of the daily total return on an underlying index. LETFs may perform as expected on a daily basis; however, fund issuers state that there is no guarantee of achieving the multiple of the index return over longer time horizons. LETF returns are extremely volatile and funds frequently underperform their target for horizons greater than one month. In this paper, we contribute two nonparametric simulation methods for analyzing LETF return volatility and how this is related to the underlying index. First, to overcome the limited history of LETF returns data, we propose a method for simulating implied LETF tracking errors while still accounting for their dependence on underlying index returns. This allows for the incorporation of the complete history of index returns in an LETF returns model. Second, to isolate the effects of daily, leveraged compounding on LETF volatility, we propose an innovative method for simulating daily index returns with a chosen constraint on the multi-day period return. By controlling for the performance of the underlying index, the range of volatilities observed in a simulated sample can be attributed to compounding with leverage and the presence of tracking errors. Our nonparametric methods are flexible-easily incorporating any chosen number of days, leverage ratios, or period return constraints, and can be used in combination or separately to model any quantity of interest derived from daily LETF returns. 
 
</p></abstract><kwd-group><kwd>Nonparametric Density Estimation</kwd><kwd> Exchange Traded Fund</kwd><kwd> Realized Volatility</kwd></kwd-group></article-meta></front><body><sec id="s1"><title>1. Introduction</title><p>The class of securities commonly known as LETFs, or Leveraged Exchange Traded Funds, began trading on the New York Stock Exchange in 2006. LETFs are managed by their issuers with a mandate to provide a multiple of the daily return of the underlying asset, and are developed to provide professional investors a convenient means for the short term hedging of market risk. Since their issuance, their popularity in the investment world has risen steadily and now there are investors promoting buy and hold strategies that feature long term positions in LETFs [<xref ref-type="bibr" rid="scirp.61565-ref1">1</xref>] [<xref ref-type="bibr" rid="scirp.61565-ref2">2</xref>] . The lack of understanding of the risks associated with these strategies and more generally LETF return dynamics was a primary motivation for our work. In this paper, our objective is to offer improved tools for analyzing the risks involved with investing in LETFs.</p><p>The first Exchange Traded Fund (ETF) began trading in 1993. By 2015, there are over 1400 ETFs from over 15 different issuers, with over $1 trillion invested in ETFs globally [<xref ref-type="bibr" rid="scirp.61565-ref3">3</xref>] . The existing universe of ETFs covers all major asset classes such as equities, debt, commodities, and real estate. Many ETFs are referenced as the underlying asset of actively traded options. We will focus on a specific subset of ETFs called Leveraged ETFs (LETFs) which feature a leverage ratio different than 1:1 as part of their fund structure.</p><p>The mandate for LETFs is to provide the daily return of an underlying asset, most often an equity index, at the multiple indicated by the leverage ratio. As of 2015 there are fund offerings featuring leverage ratios of 2:1, −2:1, 3:1, and −3:1. Going forward, we will simply refer to leverage by its multiple (i.e. 2, −2, 3, −3). For example, if the underlying index returned 1% on the day, then LETFs with leverage multiples of 2, −2, 3, and −3 would have a mandate to return 2%, −2%, 3%, and −3% on the day, respectively. Positive values indicate long market exposure, while negative multiples indicate short exposure, or betting that the market will decline. Funds that feature negative leverage multiples are often times referred to as Inverse ETFs, but we will not make this distinction because the returns dynamics are the same except for the obvious negative sign on the leverage term.</p><p>In addition to the included leverage, providing investors with the ability to easily acquire short exposure is an important selling point for LETF issuers. Before these LETFs started trading in 2006, leveraging one’s assets or betting against the market required utilizing expensive margin and collateral accounts or navigating the challenges involved with trading options [<xref ref-type="bibr" rid="scirp.61565-ref4">4</xref>] . Investors have since grown to appreciate the conveniences offered by the LETF structure and as in 2015 there are over 100 funds with a total notional value over $20 billion listed on exchanges worldwide, with Direxion, ProShares, Credit Suisse, and Barclays issuing the majority of them [<xref ref-type="bibr" rid="scirp.61565-ref5">5</xref>] .</p><p>Not long after LETFs started trading, researchers began to examine the leveraged returns they provide and the associated daily compounding. Jarrow [<xref ref-type="bibr" rid="scirp.61565-ref6">6</xref>] and Avellaneda and Zhang [<xref ref-type="bibr" rid="scirp.61565-ref7">7</xref>] were some of the first to do so. The work by both sets of authors is very similar. They clearly prove that the multi-day return on an LETF is not the same as the return on an (unleveraged) ETF with the same underlying index and relate the difference to the ETF’s volatility and borrowing costs. Avellaneda and Zhang also provide a strong collection of empirical results to reinforce their proof. In a similar fashion, Lu, Wang, and Zhang [<xref ref-type="bibr" rid="scirp.61565-ref8">8</xref>] provide empirical results that extensively quantify the underperformance of LETFs with respect to their benchmark over multi-day periods. They claim generally that with a leverage multiple of 2, or we say “2x leverage”, one can expect an LETF to deliver its targeted return for periods up to a month, and then they quantify expected deviations for longer horizons.</p><p>The work by Dobi and Avellaneda [<xref ref-type="bibr" rid="scirp.61565-ref9">9</xref>] takes the discussion of LETFs a step further. They highlight the total return swap exposures that are rebalanced daily by LETF issuers to provide the leveraged return target as a cause of LETF underperformance. We strongly agree with their comment that LETF underperformance “… is especially true for longer holding periods and for periods of high volatility”. Tuzun [<xref ref-type="bibr" rid="scirp.61565-ref10">10</xref>] expands on the ramifications of the swap exposures that are held by the LETF issuers. He notes the similarities between daily rebalancing necessitated by LETFs and portfolio insurance strategies from the 1980s. This work is written from the perspective of market regulators, but we found it helpful because it emphasized the effects of consecutive gains or consecutive losses on LETF performance. With LETFs a period of consecutive gains produces lever- aged gains on leveraged gains, resulting in a compound return that is much greater than would be experienced without leverage. This scenario should not be difficult to understand, but in the case of consecutive losses with leverage, the authors demonstrate that this also results in improved performance (relatively). In other words, relative to the same index exposure without leverage, the magnitude of the cumulative loss experienced with leverage is less. This is because with every consecutive negative return, exposure is decreased before the next loss, and with leverage the decrease of exposure is greater.</p><p>Cooper [<xref ref-type="bibr" rid="scirp.61565-ref11">11</xref>] provides a detailed review of volatility drag and LETF dynamics in an attempt to prove that there exists a leverage ratio greater than one that is optimal for buy and hold investing in any equity index. We are doubtful of his claims because of the assumption of no tracking errors. We show later this would be poor judgment with the LETFs that we analyze. Also, Bouchey and Nemtchinov [<xref ref-type="bibr" rid="scirp.61565-ref12">12</xref>] show that underperformance of high volatility stocks compared to low volatility stocks is mostly the result of volatility drag. There is a parallel that could be considered between their thesis and the performance of LETFs with high volatility underlying indexes compared to LETFs with low volatility underlying indexes, but we do not investigate it here.</p><p>Qualitatively speaking, we agree with the above mentioned authors that LETFs frequently underperform over time horizons greater than one month, underperformance is greater in times of high volatility, and that under- peformance is intrinsically related to volatility drag. But, we view our contributions as an empirical framework that complements their analytical models and we do not attempt to reproduce the results on which their conclusions are based. Instead, our intention is to provide methods that can help LETF investors better account for these dynamics. The remainder of this paper is organized as follows.</p><p>In Section 2 we review the LETF returns dataset used throughout this paper, present a visual motivation for our contributions, and describe two statistics for measuring the realized volatility of LETF returns-sample standard deviation and Shortfall from Maximum Convexity (SMC). SMC is a variant of volatility drag that specifically accounts for the effects of leverage. We defined SMC and documented the advantages of using it to measure realized volatility in a separate publication [<xref ref-type="bibr" rid="scirp.61565-ref13">13</xref>] , which is summarized in Section 2.</p><p>In Section 3 we propose a method for simulating LETF tracking errors. The proposed method allows us to produce simulated LETF returns derived from index returns and LETF tracking errors that are simulated separately. In turn, we can make use of the entirety of their respective datasets, greatly improving the robustness of our density estimates used in simulation.</p><p>In Section 4 we exploit this separation by proposing a method for simulating index returns with a constrained total period return. Constraining the underlying index performance allows for greater nuance with modeling LETF volatility. With this method, a practitioner can formulate more customized LETF volatility summaries by including a specific returns forecast for the underlying index.</p><p>Finally, we demonstrate how to combine the two simulation methods with a brief case study in Section 5.</p></sec><sec id="s2"><title>2. Visualizing LETF Returns and Measuring Realized Volatility</title><p>We have selected a wide ranging set of 10 equity indexes referenced as the underlying asset by 10 pairs of long and short LETFs for demonstrating our work (10 funds with a +3 leverage multiple and 10 with a −3 multiple). All of the included pairs of &#177;3x levered ETFs are issued by Direxion and ProShares. Our set includes established U.S. market indexes (S&amp;P 500, Dow Jones Industrial Average, Russell 2000, NASDAQ 100), sector specific indexes (NYSE ARCA Gold Miners, Dow Jones U.S. Financials, S&amp;P Technology Select), and international equity indexes (MSCI Developed Markets, MSCI Emerging Markets, and Market Vectors Russia). The specific instruments included in the demonstration set are listed in the Appendix in Chart 1 and Chart 2.</p><p>Throughout this paper, we assume that daily LETF returns (for a generic ticker LEFT) and their matching daily index returns (generic ticker Index) are related through the following decomposition:</p><disp-formula id="scirp.61565-formula136"><label>(1)</label><graphic position="anchor" xlink:href="http://html.scirp.org/file/4-1490368x6.png"  xlink:type="simple"/></disp-formula><p>where <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x7.png" xlink:type="simple"/></inline-formula> is the daily return on day t for fund ticker LETF, <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x8.png" xlink:type="simple"/></inline-formula>is the daily return on day t for the underlying ticker Index, <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x9.png" xlink:type="simple"/></inline-formula>is the indicated leverage multiple for LE T F (constant), <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x10.png" xlink:type="simple"/></inline-formula>is the indicated rate of daily management expenses for LETF (constant), and <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x11.png" xlink:type="simple"/></inline-formula> is the tracking error on day t for LETF (random variable).</p><p>The leverage multiple and annualized management expenses are indicated in a given LETF’s fund prospectus. As mentioned, since 2015 there are commercially available LETFs with leverage multiples of 2, −2, 3, and −3. All of the management fees indicated on the LETFs in our demonstration set were listed as 0.95% annually, or a daily rate of approximately 0.375 basis points [<xref ref-type="bibr" rid="scirp.61565-ref14">14</xref>] -[<xref ref-type="bibr" rid="scirp.61565-ref17">17</xref>] . Fees for other LETFs from Direxion and ProShares or other fund issuers are the same or comparable [<xref ref-type="bibr" rid="scirp.61565-ref5">5</xref>] .</p><p>All the daily returns data for the 10 indexes and 20 LETFs in the demonstration set are sourced from Bloomberg and the LETF leverage and fees constants are sourced in their fund prospectuses provided by their respective issuers [<xref ref-type="bibr" rid="scirp.61565-ref16">16</xref>] -[<xref ref-type="bibr" rid="scirp.61565-ref18">18</xref>] . No other sources of data are referenced in this paper.</p><sec id="s2_1"><title>2.1. Visualizing LETF Returns</title><p>Our contributions can best be motivated through visualization, and so we begin with <xref ref-type="fig" rid="fig1">Figure 1</xref>. There are two</p><fig id="fig1"  position="float"><label><xref ref-type="fig" rid="fig1">Figure 1</xref></label><caption><title> Scatter plots of 252 day returns for hypothetical LETF “+3x SPX” and SPXL</title></caption><graphic mimetype="image"   position="float"  xlink:type="simple"  xlink:href="http://html.scirp.org/file/4-1490368x12.png"/></fig><p>scatter plots of 252 day compound LETF returns (y axis) against the matching 252 day compound index returns (x axis) from the same periods. The right plot is for +3x LETF Ticker SPXL, the left plot is for the hypothetical LETF “+3x SPX” created by daily, leveraged compounding of S&amp;P 500 returns, and then for both the underlying index is the S&amp;P 500. The diagonal blue line in each plot corresponds to<inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x13.png" xlink:type="simple"/></inline-formula>, and is provided to indicate what return would be achieved by a leveraged investment in the index without daily compounding. It has been said time and again that “a picture is worth 1000 words,” but in our case we could say 10,000 words, the approximate length of this paper.</p><p>Three extraordinarily important observations need to be made. First, there are many more points representing a much wider range of outcomes in the left plot, which is derived from the entire daily returns series of the S&amp;P 500 (21,591 intervals of 252 days), compared to the right plot that includes only the SPXL returns series (1288 intervals of 252 days). Second, there is an interesting crescent shape with a hard upper bound apparent in the left plot, where the overwhelming majority of points are clustered near the upper bound. Third, again in the left plot, points seem to disperse from the upper bound in a way that maintains some degree of curvature such that the range of dispersion is not constant. These characteristics were readily observable when the same plot was generated using other LETF and index pairs.</p><p><xref ref-type="fig" rid="fig1">Figure 1</xref> illustrates the advantages of having more data. The right plot was limited to the returns data available for SPXL, which extends back to 2008. On the other hand, the left plot used all the data available for the S&amp;P 500, which extends back to the 1920s. Except for the Market Vectors Russia Index (MVRSX) there are at least 16 years of data for every index that we consider in this paper. Given the dependence of an LETF’s daily returns on the matching returns of the underlying index, it follows naturally that we should develop schemes for modeling LETF returns that can incorporate and control for the variation in the complete history of index returns data. Our methods presented in Sections 3 and 4 address these two motivations, respectively.</p><p>The potential enhancements offered by our methods are especially significant given the fact that North American equity indexes have generally been in an upward trend since March 2009. In other words, the majority of available LETF returns were observed when the index returns that they are derived from were positive or compound to a positive value over periods of months or years. This can be seen in <xref ref-type="fig" rid="fig1">Figure 1</xref>, where the right plot has no points with an x value less than 0 (the underlying index return), but there are many points that satisfy this condition in the left plot. Obviously, any quantitative LETF analysis would benefit from the ability to include data from downward trending markets and isolate the resulting effects.</p></sec><sec id="s2_2"><title>2.2. Measuring Realized Volatility</title><p>Modeling the volatility of asset returns as the standard deviation of the returns distribution has been commonly accepted since the publication of Markowitz’ benchmark paper on portfolio theory [<xref ref-type="bibr" rid="scirp.61565-ref19">19</xref>] . Accordingly, sample standard deviation would be the usual measure of realized volatility of a p dimensional vector of daily log LETF returns<inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x14.png" xlink:type="simple"/></inline-formula>. We denote this statistic as PSD, or Periodized Standard Deviation.</p><disp-formula id="scirp.61565-formula137"><label>(2)</label><graphic position="anchor" xlink:href="http://html.scirp.org/file/4-1490368x15.png"  xlink:type="simple"/></disp-formula><disp-formula id="scirp.61565-formula138"><label>(3)</label><graphic position="anchor" xlink:href="http://html.scirp.org/file/4-1490368x16.png"  xlink:type="simple"/></disp-formula><disp-formula id="scirp.61565-formula139"><label>(4)</label><graphic position="anchor" xlink:href="http://html.scirp.org/file/4-1490368x17.png"  xlink:type="simple"/></disp-formula><p>where <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x18.png" xlink:type="simple"/></inline-formula> is the geometric mean of the elements of the geometric returns vector<inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x19.png" xlink:type="simple"/></inline-formula>.</p><p>Alternatively, we will measure realized volatility with Shortfall from Maximum Convexity (SMC), a novel statistic that was designed specifically for application to LETF returns [<xref ref-type="bibr" rid="scirp.61565-ref13">13</xref>] .</p><disp-formula id="scirp.61565-formula140"><label>(5)</label><graphic position="anchor" xlink:href="http://html.scirp.org/file/4-1490368x20.png"  xlink:type="simple"/></disp-formula><disp-formula id="scirp.61565-formula141"><label>(6)</label><graphic position="anchor" xlink:href="http://html.scirp.org/file/4-1490368x21.png"  xlink:type="simple"/></disp-formula><p>where <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x22.png" xlink:type="simple"/></inline-formula> is the indicated leverage multiple for LETF (constant), <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x22.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x23.png" xlink:type="simple"/></inline-formula>is the matching p dimensional vector of daily returns for Index, and <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x22.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x23.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x24.png" xlink:type="simple"/></inline-formula> is the geometric mean of the elements of<inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x22.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x23.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x24.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x25.png" xlink:type="simple"/></inline-formula>. What differentiates SMC from PSD is subtle―a mean return of <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x22.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x23.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x24.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x25.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x26.png" xlink:type="simple"/></inline-formula> is used instead of<inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x22.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x23.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x24.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x25.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x26.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x27.png" xlink:type="simple"/></inline-formula>, and the sum of daily differences is exponentiated instead of taking the square root of the sum of squared, daily differences.</p><p>These changes were inspired by the geometric details of the plotting arrangements used in <xref ref-type="fig" rid="fig1">Figure 1</xref>. SMC is simply the vertical distance between a data point and the point on the convex upper bound that is located at the same x value (calculating the exact form of points on the upper bound is trivial). The interpretation of this measure is the geometric excess return of a hypothetical, maximum return derived from the index return, with respect to the LETF return. We use SMC because the interpretation of PSD becomes problematic with non- normal, dependent data, and when applied to LETF returns SMC provides more information, statistically speaking. These arguments are covered in much greater detail within the original proposal for SMC, and we refer interested readers there for more information.</p></sec></sec><sec id="s3"><title>3. Simulation of Tracking Errors Using Nonparametric Density Estimation</title><p>A naive approach for modeling LETF returns would be to simply assume no tracking errors and approximate daily returns as the underlying daily index return with leverage and net of management fees. These ap- proximated returns, after compounding, could be used in the denominator when calculating SMC in place of a true LETF return. This naive approach is simple and allows for the incorporation of the entire history of index returns data; however, it ignores the impact of LETF tracking errors on returns and realized volatilities.</p><p>This impact becomes significant over time, as demonstrated in <xref ref-type="fig" rid="fig2">Figure 2</xref> and <xref ref-type="fig" rid="fig3">Figure 3</xref> for two LETFs. First, density curves of 252 day returns of LETF Ticker RUSS (top) and LETF Ticker TECL (bottom) are plotted against 252 day returns of their respective underlying indexes, but compounded daily with a leverage multiple of −3. Note the separation between the density curves, which is due to the cumulative effect of tracking errors because the index returns were calculated with daily compounding and leverage. Second, density curves of 252 day SMC are plotted using the same data and plotting arrangements. Again, note the separation between the density curves, and that the separation is much greater when visualizing realized volatility compared to visualizing returns.</p><fig id="fig2"  position="float"><label><xref ref-type="fig" rid="fig2">Figure 2</xref></label><caption><title> Densities of 252 day returns for LETF Tickers RUSS and TECL and their respective indexes compounded daily with −3x leverage</title></caption><graphic mimetype="image"   position="float"  xlink:type="simple"  xlink:href="http://html.scirp.org/file/4-1490368x28.png"/></fig><fig id="fig3"  position="float"><label><xref ref-type="fig" rid="fig3">Figure 3</xref></label><caption><title> Densities of 252 Day SMC for LETF Tickers RUSS and TECL and their respective indexes compounded daily with −3x leverage</title></caption><graphic mimetype="image"   position="float"  xlink:type="simple"  xlink:href="http://html.scirp.org/file/4-1490368x29.png"/></fig><p>In light of this evidence, it is our opinion that approximating LETF returns by assuming no tracking errors would provide for inaccurate analyses, and in response we propose the nonparametric method for simulating LETF tracking errors described in this section. Our method estimates filtering and smoothing densities using only data from the days when LETFs were trading. The proposed method effectively allows for simulating LETF returns derived from index returns and LETF tracking errors that are simulated separately, thus incorporating the entire history of index returns and LETF returns data in an extremely efficient manner.</p><sec id="s3_1"><title>3.1. Framing Tracking Error Simulation as Filtering</title><p>When discussing any statistical analysis of daily LETF returns, over a period of k days, the following length 2k random vector of daily asset returns is observed:</p><disp-formula id="scirp.61565-formula142"><label>(7)</label><graphic position="anchor" xlink:href="http://html.scirp.org/file/4-1490368x30.png"  xlink:type="simple"/></disp-formula><p>where <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x31.png" xlink:type="simple"/></inline-formula> is the daily index return on day t for the underlying index ticker Index, and <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x31.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x32.png" xlink:type="simple"/></inline-formula> is the daily LETF return on day t for the specified LETF ticker LETF. We assume that daily LETF returns and their matching daily index returns are related through the following decomposition:</p><disp-formula id="scirp.61565-formula143"><label>(8)</label><graphic position="anchor" xlink:href="http://html.scirp.org/file/4-1490368x33.png"  xlink:type="simple"/></disp-formula><p>where <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x34.png" xlink:type="simple"/></inline-formula> is the indicated leverage multiple for LETF (constant), <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x34.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x35.png" xlink:type="simple"/></inline-formula>is the indicated rate of daily management expenses for LETF (constant), and <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x34.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x35.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x36.png" xlink:type="simple"/></inline-formula> is the tracking error on day t for LETF (random variable). Implicitly, then, we are assuming that the following random vector captures the same information as the vector that was stated originally:</p><disp-formula id="scirp.61565-formula144"><label>. (9)</label><graphic position="anchor" xlink:href="http://html.scirp.org/file/4-1490368x37.png"  xlink:type="simple"/></disp-formula><p>From this view of the LETF and index returns processes we develop a simulation method that is based on the following factorization of the joint density for these variables:</p><disp-formula id="scirp.61565-formula145"><label>. (10)</label><graphic position="anchor" xlink:href="http://html.scirp.org/file/4-1490368x38.png"  xlink:type="simple"/></disp-formula><p>The density <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x39.png" xlink:type="simple"/></inline-formula> is a filter as used in state space modeling, where (by necessity) the index returns process is designated as the observation process and the LETF returns process is designated as the state process. This runs counter to a more intuitive arrangement of designating LETF returns as functions of the state (index returns) with observation noise (tracking error).</p><p>To handle any dependence that may exist within a sequence of index return variables, we do not factorize the density<inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x40.png" xlink:type="simple"/></inline-formula>. Modeling all of the index return variables jointly captures their complete k day dependence structure. To account for dependence of LETF tracking error data and inter-dependence of tracking errors and index returns, in our filtering density we will additionally include <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x40.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x41.png" xlink:type="simple"/></inline-formula> lagged index returns and <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x40.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x41.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x42.png" xlink:type="simple"/></inline-formula> lagged tracking errors as given, where <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x40.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x41.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x42.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x43.png" xlink:type="simple"/></inline-formula> is an integer valued parameter that will be selected in a later subsection. This arrangement reflects our view that LETF tracking errors have a simpler dependence structure compared to index returns (in practice<inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x40.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x41.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x42.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x43.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x44.png" xlink:type="simple"/></inline-formula>), and that LETF tracking errors are dependent on the underlying index returns. We do not consider index returns to be dependent on the respective LETF returns or tracking errors; therefore, nowhere in our approach do we attempt to model the statistical relationship of<inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x40.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x41.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x42.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x43.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x44.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x45.png" xlink:type="simple"/></inline-formula>.</p><p>To include the additional <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x46.png" xlink:type="simple"/></inline-formula> lagged variables, the joint density factorization is revised as follows:</p><disp-formula id="scirp.61565-formula146"><label>. (11)</label><graphic position="anchor" xlink:href="http://html.scirp.org/file/4-1490368x47.png"  xlink:type="simple"/></disp-formula><p>There are three important changes to highlight. First, the filtering density <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x48.png" xlink:type="simple"/></inline-formula> is now con-</p><p>ditioned on <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x49.png" xlink:type="simple"/></inline-formula> lagged index return variables and <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x49.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x50.png" xlink:type="simple"/></inline-formula> lagged LETF return variables (in addition to<inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x49.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x50.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x51.png" xlink:type="simple"/></inline-formula>). Second, the joint density of index returns and LETF tracking errors (left-hand side), and unconditional joint density of index returns (final term of right-hand side), both include the additional lagged variables such that the random vector being modeled is now of length<inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x49.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x50.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x51.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x52.png" xlink:type="simple"/></inline-formula>. Third, we have introduced a conditional density for</p><p>smoothing the <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x53.png" xlink:type="simple"/></inline-formula> tracking error variables,<inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x53.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x54.png" xlink:type="simple"/></inline-formula>. This additional term</p><p>is necessary to initiate, or “burn-in”, the sequence of tracking error variables, providing the first set of <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x55.png" xlink:type="simple"/></inline-formula> lags that are required by the first iteration of the filtering density.</p><p>Also, the decision to smooth the first <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x56.png" xlink:type="simple"/></inline-formula> variables instead of the first <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x56.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x57.png" xlink:type="simple"/></inline-formula> variables and then starting filtering at <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x56.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x57.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x58.png" xlink:type="simple"/></inline-formula> deserves further comment. Our reasoning is implementation related, so the dataset needs to be transformed only once. As written, the conditional densities differ only by which variables are considered as given. Otherwise both densities model the same <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x56.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x57.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x58.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x59.png" xlink:type="simple"/></inline-formula> variables―a sequence of <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x56.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x57.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x58.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x59.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x60.png" xlink:type="simple"/></inline-formula> index returns and the matching sequence of <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x56.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x57.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x58.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x59.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x60.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x61.png" xlink:type="simple"/></inline-formula> tracking errors. Having both densities model the same variables allows for the same observation matrix being used for both of the resulting kernel density estimates, as shown in the next subsection of derivations. If only the first <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x56.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x57.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x58.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x59.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x60.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x61.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x62.png" xlink:type="simple"/></inline-formula> variables were smoothed, and iterations of the filtering density began with day<inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x56.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x57.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x58.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x59.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x60.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x61.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x62.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x63.png" xlink:type="simple"/></inline-formula>, the dataset would need to be transformed twice. One transform would be required to implement an estimate of the density with <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x56.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x57.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x58.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x59.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x60.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x61.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x62.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x63.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x64.png" xlink:type="simple"/></inline-formula> variables used for smoothing the initial lagged errors and another to implement an estimate of the density with <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x56.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x57.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x58.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x59.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x60.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x61.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x62.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x63.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x64.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x65.png" xlink:type="simple"/></inline-formula> variables used for filtering the remaining errors. There is one exception, when<inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x56.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x57.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x58.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x59.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x60.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x61.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x62.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x63.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x64.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x65.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x66.png" xlink:type="simple"/></inline-formula>, a case which results in smoothing and filtering densities that are identical and the joint density factorization reverts to the initially stated form with only two terms,</p><p><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x67.png" xlink:type="simple"/></inline-formula>.</p><p>However, to avoid the additional bias introduced by smoothing the first <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x68.png" xlink:type="simple"/></inline-formula> tracking errors (conditioning on index returns forward in time relative to the tracking errors constitutes look-ahead bias), we will discard the first <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x68.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x69.png" xlink:type="simple"/></inline-formula> terms when using our simulation method, making any samples generated have an effective length of k. The <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x68.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x69.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x70.png" xlink:type="simple"/></inline-formula>st term is not discarded because the associated look-ahead bias is the same as filtering (relative to this tracking error only index returns at the same time step or backward, but not forward, are given). We ac- knowledge that the filtering density <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x68.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x69.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x70.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x71.png" xlink:type="simple"/></inline-formula> also constitutes the look-ahead bias. In real time we observe the daily closing index price and the daily closing LETF price (which imply daily returns) simultaneously, so the information provided by <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x68.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x69.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x70.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x71.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x72.png" xlink:type="simple"/></inline-formula> should not be available for filtering<inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x68.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x69.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x70.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x71.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x72.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x73.png" xlink:type="simple"/></inline-formula>. But we accept this bias for the increased precision of our estimate of the filtering density that it allows, thus improving our modeling of the realized volatility of LETF returns. Our method is not intended for a live setting and we do not calculate the expectation of any random variables (e.g.<inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x68.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x69.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x70.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x71.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x72.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x73.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x74.png" xlink:type="simple"/></inline-formula>) for the purposes of predicting tracking errors or LETF returns.</p></sec><sec id="s3_2"><title>3.2. Derivation of Kernel Density Estimates</title><p>Given a random process generating daily LETF returns<inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x75.png" xlink:type="simple"/></inline-formula>, a random process generating the daily</p><p>underlying index returns<inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x76.png" xlink:type="simple"/></inline-formula>, the target leverage multiple of the LETF<inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x76.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x77.png" xlink:type="simple"/></inline-formula>, the rate of daily</p><p>management expenses incurred by the LETF<inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x78.png" xlink:type="simple"/></inline-formula>, and a chosen number of lags <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x78.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x79.png" xlink:type="simple"/></inline-formula> indicating the degree of dependence, we construct kernel density estimates of the smoothing density</p><p><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x80.png" xlink:type="simple"/></inline-formula>and filtering density <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x80.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x81.png" xlink:type="simple"/></inline-formula> as follows.</p><p>Note, in this subsection we use slightly different notation so that the implementation details of the kernel density estimates can be documented more clearly. The selection of <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x82.png" xlink:type="simple"/></inline-formula> will be discussed in the following subsection that outlines the tracking error simulation routine.</p><p>1) Calculate the implied tracking errors from the observed data, and transform the data to allow for fitting the desired density estimates.</p><p>Assume the following relationship for decomposing daily LETF returns (as stated previously):</p><disp-formula id="scirp.61565-formula147"><label>. (12)</label><graphic position="anchor" xlink:href="http://html.scirp.org/file/4-1490368x83.png"  xlink:type="simple"/></disp-formula><p>Using the decomposition, observed LETF returns<inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x84.png" xlink:type="simple"/></inline-formula>, and observed index returns<inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x84.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x85.png" xlink:type="simple"/></inline-formula>, calculate the implied tracking error observations<inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x84.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x85.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x86.png" xlink:type="simple"/></inline-formula>. All of the observation vectors are length T.</p><p>Take the log transform of observed index returns <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x87.png" xlink:type="simple"/></inline-formula> and arrange them into a <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x87.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x88.png" xlink:type="simple"/></inline-formula> observation matrix of rolling <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x87.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x88.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x89.png" xlink:type="simple"/></inline-formula> day periods. Denote this matrix as<inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x87.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x88.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x89.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x90.png" xlink:type="simple"/></inline-formula>. In the same way, take the log transform of observed tracking errors <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x87.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x88.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x89.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x90.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x91.png" xlink:type="simple"/></inline-formula> and arrange them into a <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x87.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x88.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x89.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x90.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x91.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x92.png" xlink:type="simple"/></inline-formula> observation matrix of rolling <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x87.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x88.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x89.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x90.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x91.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x92.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x93.png" xlink:type="simple"/></inline-formula> day periods. Denote this matrix as<inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x87.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x88.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x89.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x90.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x91.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x92.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x93.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x94.png" xlink:type="simple"/></inline-formula>.</p><p>To form the final observation matrix used for fitting the kernel density estimate, combine <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x95.png" xlink:type="simple"/></inline-formula> and <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x95.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x96.png" xlink:type="simple"/></inline-formula> in column-wise fashion. Denote this as<inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x95.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x96.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x97.png" xlink:type="simple"/></inline-formula>, a <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x95.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x96.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x97.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x98.png" xlink:type="simple"/></inline-formula> matrix. For notational convenience in the follow- ing steps, let <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x95.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x96.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x97.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x98.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x99.png" xlink:type="simple"/></inline-formula> and<inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x95.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x96.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x97.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x98.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x99.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x100.png" xlink:type="simple"/></inline-formula>, so that observation matrix <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x95.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x96.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x97.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x98.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x99.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x100.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x101.png" xlink:type="simple"/></inline-formula> is<inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x95.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x96.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x97.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x98.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x99.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x100.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x101.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x102.png" xlink:type="simple"/></inline-formula>.</p><disp-formula id="scirp.61565-formula148"><label>(13)</label><graphic position="anchor" xlink:href="http://html.scirp.org/file/4-1490368x103.png"  xlink:type="simple"/></disp-formula><disp-formula id="scirp.61565-formula149"><label>. (14)</label><graphic position="anchor" xlink:href="http://html.scirp.org/file/4-1490368x104.png"  xlink:type="simple"/></disp-formula><p>Using log returns <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x105.png" xlink:type="simple"/></inline-formula> and log tracking errors <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x105.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x106.png" xlink:type="simple"/></inline-formula> is extremely important because of the fact that log values do not suffer from asymmetry or a hard left bound at 0 (now transformed to<inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x105.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x106.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x107.png" xlink:type="simple"/></inline-formula>), making the transformed data less challenging to model.</p><p>2) Fit a kernel density estimate for<inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x108.png" xlink:type="simple"/></inline-formula>, using a jointly independent multivariate normal kernel and ob- servation matrix<inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x108.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x109.png" xlink:type="simple"/></inline-formula>.</p><disp-formula id="scirp.61565-formula150"><label>(15)</label><graphic position="anchor" xlink:href="http://html.scirp.org/file/4-1490368x110.png"  xlink:type="simple"/></disp-formula><p>where <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x111.png" xlink:type="simple"/></inline-formula> is the p dimensional multivariate normal density function evaluated at <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x111.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x112.png" xlink:type="simple"/></inline-formula> using mean vector <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x111.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x112.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x113.png" xlink:type="simple"/></inline-formula> and covariance matrix<inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x111.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x112.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x113.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x114.png" xlink:type="simple"/></inline-formula>, <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x111.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x112.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x113.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x114.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x115.png" xlink:type="simple"/></inline-formula>is the ith row vector of observation matrix<inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x111.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x112.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x113.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x114.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x115.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x116.png" xlink:type="simple"/></inline-formula>, and <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x111.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x112.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x113.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x114.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x115.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x116.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x117.png" xlink:type="simple"/></inline-formula> is the diagonal matrix formed from element-wise squaring of the p dimensional vector of bandwidths. Elements indexed <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x111.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x112.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x113.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x114.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x115.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x116.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x117.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x118.png" xlink:type="simple"/></inline-formula> correspond to bandwidths for index returns, and elements <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x111.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x112.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x113.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x114.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x115.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x116.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x117.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x118.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x119.png" xlink:type="simple"/></inline-formula> correspond to band- widths for tracking errors.</p><p>The selection of <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x120.png" xlink:type="simple"/></inline-formula> is dependent on the LETFs (and underlying indexes) being analyzed. Our selections for the demonstration set of LETFs will be detailed later in this section.</p><p>Note that in using a diagonal matrix based on the vector of <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x121.png" xlink:type="simple"/></inline-formula>s, the selected bandwidths for single dimensions, we are not ignoring the dependence structure that exists between the variables. The dependence structure will be estimated through the addition of the n multivariate kernels centered on the observation data points. This point might be easier to understand algebraically, because although the kernel in the density estimate can be decomposed as the product of univariate kernels, it is not the same as an estimate that is the product of independent univariate density estimates.</p><disp-formula id="scirp.61565-formula151"><label>(16)</label><graphic position="anchor" xlink:href="http://html.scirp.org/file/4-1490368x122.png"  xlink:type="simple"/></disp-formula><p>where <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x123.png" xlink:type="simple"/></inline-formula> is the jth element of observation vector<inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x123.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x124.png" xlink:type="simple"/></inline-formula>.</p><p>By capturing the dependence structure of the data through the addition of multivariate kernels that use a diagonal covariance matrix, we are achieving an effective compromise between modeling power and complexity. Selecting bandwidths for dimensions individually incorporates some information about the respective variable, yet making p separate selections separately is not difficult. The alternative choices of using a single bandwidth for all dimensions or selecting an entire covariance matrix are generally considered too simple or too difficult, respectively [<xref ref-type="bibr" rid="scirp.61565-ref20">20</xref>] .</p><p>3) Factor and rearrange terms of the density estimate for <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x125.png" xlink:type="simple"/></inline-formula> to produce an estimate of the conditional</p><p>density<inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x126.png" xlink:type="simple"/></inline-formula>.</p><disp-formula id="scirp.61565-formula152"><label>(17)</label><graphic position="anchor" xlink:href="http://html.scirp.org/file/4-1490368x127.png"  xlink:type="simple"/></disp-formula><p>where <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x128.png" xlink:type="simple"/></inline-formula> is the subvector of elements indexed <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x128.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x129.png" xlink:type="simple"/></inline-formula> from vector<inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x128.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x129.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x130.png" xlink:type="simple"/></inline-formula>, or the elements that represent index returns whose observations were sourced from the matrix<inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x128.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x129.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x130.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x131.png" xlink:type="simple"/></inline-formula>, and <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x128.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x129.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x130.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x131.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x132.png" xlink:type="simple"/></inline-formula> is the subvector of elements indexed <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x128.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x129.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x130.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x131.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x132.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x133.png" xlink:type="simple"/></inline-formula> from vector<inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x128.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x129.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x130.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x131.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x132.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x133.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x134.png" xlink:type="simple"/></inline-formula>, or the elements that represent tracking errors whose observations were sourced from the matrix<inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x128.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x129.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x130.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x131.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x132.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x133.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x134.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x135.png" xlink:type="simple"/></inline-formula>. Equation (17) could be restated as<inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x128.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x129.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x130.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x131.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x132.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x133.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x134.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x135.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x136.png" xlink:type="simple"/></inline-formula>; however, the following notation will be used for the sake of brevity and consistency with Step 4.</p><disp-formula id="scirp.61565-formula153"><label>(18)</label><graphic position="anchor" xlink:href="http://html.scirp.org/file/4-1490368x137.png"  xlink:type="simple"/></disp-formula><p>In this way, when x and y are written as subscripts, let <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x138.png" xlink:type="simple"/></inline-formula> and<inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x138.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x139.png" xlink:type="simple"/></inline-formula>, and by extension <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x138.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x139.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x140.png" xlink:type="simple"/></inline-formula> and<inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x138.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x139.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x140.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x141.png" xlink:type="simple"/></inline-formula>.</p><p>Continue by inserting the appropriate density estimates.</p><disp-formula id="scirp.61565-formula154"><label>(19)</label><graphic position="anchor" xlink:href="http://html.scirp.org/file/4-1490368x142.png"  xlink:type="simple"/></disp-formula><disp-formula id="scirp.61565-formula155"><label>(20)</label><graphic position="anchor" xlink:href="http://html.scirp.org/file/4-1490368x143.png"  xlink:type="simple"/></disp-formula><p>Because of our choice of a jointly independent multivariate normal kernel, <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x144.png" xlink:type="simple"/></inline-formula>can be factored as follows:</p><disp-formula id="scirp.61565-formula156"><label>. (21)</label><graphic position="anchor" xlink:href="http://html.scirp.org/file/4-1490368x145.png"  xlink:type="simple"/></disp-formula><p>Insert this factorization and rearrange terms to produce the final density estimate.</p><disp-formula id="scirp.61565-formula157"><label>(22)</label><graphic position="anchor" xlink:href="http://html.scirp.org/file/4-1490368x146.png"  xlink:type="simple"/></disp-formula><disp-formula id="scirp.61565-formula158"><label>(23)</label><graphic position="anchor" xlink:href="http://html.scirp.org/file/4-1490368x147.png"  xlink:type="simple"/></disp-formula><disp-formula id="scirp.61565-formula159"><label>. (24)</label><graphic position="anchor" xlink:href="http://html.scirp.org/file/4-1490368x148.png"  xlink:type="simple"/></disp-formula><p><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x149.png" xlink:type="simple"/></inline-formula>is the estimate of the smoothing density that will be used to simulate the first <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x149.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x150.png" xlink:type="simple"/></inline-formula> tracking errors of a new sample.</p><p>4) Factor and rearrange terms of the density estimate for <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x151.png" xlink:type="simple"/></inline-formula> to produce an estimate of the conditional density<inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x151.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x152.png" xlink:type="simple"/></inline-formula>.</p><disp-formula id="scirp.61565-formula160"><label>(25)</label><graphic position="anchor" xlink:href="http://html.scirp.org/file/4-1490368x153.png"  xlink:type="simple"/></disp-formula><p>where <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x154.png" xlink:type="simple"/></inline-formula> is the vector <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x154.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x155.png" xlink:type="simple"/></inline-formula> without the last element. Equation (25) could be restated as</p><p><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x156.png" xlink:type="simple"/></inline-formula>; however, the original notation will be maintained for the sake of</p><p>brevity.</p><p>Continue by inserting the appropriate density estimates.</p><disp-formula id="scirp.61565-formula161"><label>(26)</label><graphic position="anchor" xlink:href="http://html.scirp.org/file/4-1490368x157.png"  xlink:type="simple"/></disp-formula><disp-formula id="scirp.61565-formula162"><label>(27)</label><graphic position="anchor" xlink:href="http://html.scirp.org/file/4-1490368x158.png"  xlink:type="simple"/></disp-formula><p>As in Step 3, factor<inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x159.png" xlink:type="simple"/></inline-formula>, but adjusting for the desired elements of<inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x159.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x160.png" xlink:type="simple"/></inline-formula>.</p><disp-formula id="scirp.61565-formula163"><label>(28)</label><graphic position="anchor" xlink:href="http://html.scirp.org/file/4-1490368x161.png"  xlink:type="simple"/></disp-formula><p>Insert this factorization and rearrange terms to produce the final density estimate.</p><disp-formula id="scirp.61565-formula164"><label>(29)</label><graphic position="anchor" xlink:href="http://html.scirp.org/file/4-1490368x162.png"  xlink:type="simple"/></disp-formula><disp-formula id="scirp.61565-formula165"><label>(30)</label><graphic position="anchor" xlink:href="http://html.scirp.org/file/4-1490368x163.png"  xlink:type="simple"/></disp-formula><disp-formula id="scirp.61565-formula166"><label>(31)</label><graphic position="anchor" xlink:href="http://html.scirp.org/file/4-1490368x164.png"  xlink:type="simple"/></disp-formula><p><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x165.png" xlink:type="simple"/></inline-formula>is the estimate of the filtering density that will be used to simulate tracking errors <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x165.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x166.png" xlink:type="simple"/></inline-formula> through k of a new sample.</p></sec><sec id="s3_3"><title>3.3. Simulation Routine</title><p>With the final density estimates ready, LETF tracking errors can be simulated using the following routine. Given: length <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x167.png" xlink:type="simple"/></inline-formula> input vector of log index returns<inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x167.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x168.png" xlink:type="simple"/></inline-formula>, length p bandwidth vector<inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x167.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x168.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x169.png" xlink:type="simple"/></inline-formula>, number of daily lags<inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x167.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x168.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x169.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x170.png" xlink:type="simple"/></inline-formula>, and</p><p>length p observation vectors <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x171.png" xlink:type="simple"/></inline-formula></p><p>1) Sample an index value <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x172.png" xlink:type="simple"/></inline-formula> from a multinomial distribution with weight vector<inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x172.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x173.png" xlink:type="simple"/></inline-formula>, where</p><p><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x174.png" xlink:type="simple"/></inline-formula>.</p><p>2. Use index value i from step 1 to select the ith observation vector <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x175.png" xlink:type="simple"/></inline-formula> and sample<inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x175.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x176.png" xlink:type="simple"/></inline-formula>, an <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x175.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x176.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x177.png" xlink:type="simple"/></inline-formula></p><p>length vector from the multivariate normal distribution with density<inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x178.png" xlink:type="simple"/></inline-formula>.</p><p>Perform steps 3 and 4 for <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x179.png" xlink:type="simple"/></inline-formula></p><p>3) Sample an index value <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x180.png" xlink:type="simple"/></inline-formula> from a multinomial distribution with weight vector<inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x180.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x181.png" xlink:type="simple"/></inline-formula>, where</p><p><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x182.png" xlink:type="simple"/></inline-formula>, and</p><p><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x183.png" xlink:type="simple"/></inline-formula>is the length <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x183.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x184.png" xlink:type="simple"/></inline-formula> vector formed by concatenating the indicated elements of <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x183.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x184.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x185.png" xlink:type="simple"/></inline-formula> and<inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x183.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x184.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x185.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x186.png" xlink:type="simple"/></inline-formula>.</p><p>4) Use index value i from step 3 to select the ith observation vector <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x187.png" xlink:type="simple"/></inline-formula> and sample <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x187.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x188.png" xlink:type="simple"/></inline-formula> from the multivariate normal distribution with density<inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x187.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x188.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x189.png" xlink:type="simple"/></inline-formula>.</p><p>5) Combine the simulated tracking errors <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x190.png" xlink:type="simple"/></inline-formula> with the input index returns <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x190.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x191.png" xlink:type="simple"/></inline-formula> according to our</p><p>LETF returns decomposition.</p><disp-formula id="scirp.61565-formula167"><label>(32)</label><graphic position="anchor" xlink:href="http://html.scirp.org/file/4-1490368x192.png"  xlink:type="simple"/></disp-formula><p>where <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x193.png" xlink:type="simple"/></inline-formula> is the final, length k output vector of simulated LETF returns. Elements indexed <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x193.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x194.png" xlink:type="simple"/></inline-formula> in vectors<inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x193.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x194.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x195.png" xlink:type="simple"/></inline-formula>, <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x193.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x194.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x195.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x196.png" xlink:type="simple"/></inline-formula>, and <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x193.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x194.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x195.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x196.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x197.png" xlink:type="simple"/></inline-formula> are discarded.</p><p>When simulating data for the intended application, the sampled index returns to be used as inputs are first arranged as a matrix of rolling periods of <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x198.png" xlink:type="simple"/></inline-formula> days (and transformed to log returns). Regular choices of k are 21 or 252. The simulation routine can be executed in parallel because there is no dependence on the input data across rows. Each row of the matrix is input as vector <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x198.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x199.png" xlink:type="simple"/></inline-formula> separately and the density sampling steps can execute on each row simultaneously. Step 5 can obviously execute in parallel with basic matrix algebra. The simulation routine is also put to use for estimating the lag parameter<inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x198.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x199.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x200.png" xlink:type="simple"/></inline-formula>, but the input data is not arranged into rolling periods initially. With lag estimation this step occurs after sampling using the simulated data in order to avoid simulating multiple tracking errors based on the same index returns.</p></sec><sec id="s3_4"><title>3.4. Lag and Bandwidth Selection for Simulation of LETF Tracking Errors</title><p>Estimating the lag parameter <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x201.png" xlink:type="simple"/></inline-formula> proceeds as a brute force sweep of possible selections 0 to N (for some reasonable N), using the simulation routine and a Kolmogorov-Smirnov test for evaluation of fit. For each LETF and index combination and choice of <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x201.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x202.png" xlink:type="simple"/></inline-formula> to be considered, K iterations of tracking error simulation are performed (for some large K). The entire observation vector of daily index returns (log transformed) for the days which LETF returns are available is supplied as the input vector<inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x201.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x202.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x203.png" xlink:type="simple"/></inline-formula>. The routine is executed without the use of rolling periods, but this transformation is made after Step 5 has completed, such that the simulated LETF returns are arranged into a matrix of rolling periods of k returns. The compound return is calculated for each row producing a final simulated sample of k day LETF returns. These two steps are repeated with the actual LETF returns to produce the reference sample of k day LETF returns, and then the samples are compared using a two-tailed Kolmogorov-Smirnov test. Final lag selection is based on the resulting p-values collected from K iterations of the simulation routine and Kolmogorov-Smirnov test.</p><p>The K-S test is comparing a sample of k day LETF returns derived from observed index returns and simulated LETF tracking errors against a sample of k day LETF returns derived from observed index returns and observed LETF tracking errors (i.e. the observed LETF returns). Each iteration uses only the index returns observed on days when the paired LETF was trading to ensure that the two samples are derived from the same sequence of data. The null hypothesis in a K-S test states that the two samples being compared are drawn from the same distribution [<xref ref-type="bibr" rid="scirp.61565-ref21">21</xref>] . Our goal is to simulate tracking errors in a way that the K-S test of the LETF returns samples cannot reject the null hypothesis at sufficiently high confidence levels. Based on the results of the K-S tests, our goal translates to selecting the value of <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x204.png" xlink:type="simple"/></inline-formula> that produces greater p-values compared to other selections. This generic mandate could be interpreted in many different ways, and we settled on selecting the value of <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x204.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x205.png" xlink:type="simple"/></inline-formula> with the greatest proportion of p-values that were<inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x204.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x205.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x206.png" xlink:type="simple"/></inline-formula>. For some LETFs there were multiple possible <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x204.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x205.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x206.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x207.png" xlink:type="simple"/></inline-formula> selec- tions where all resulting p-values were<inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x204.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x205.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x206.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x207.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x208.png" xlink:type="simple"/></inline-formula>. In these cases ties were broken by selecting the least value of <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x204.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x205.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x206.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x207.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x208.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x209.png" xlink:type="simple"/></inline-formula> to avoid any possible overfitting. A p-value that is <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x204.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x205.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x206.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x207.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x208.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x209.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x210.png" xlink:type="simple"/></inline-formula> indicates that iteration of simulation produced a sample that could not be rejected at a confidence level<inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x204.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x205.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x206.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x207.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x208.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x209.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x210.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x211.png" xlink:type="simple"/></inline-formula>, the threshold of confidence we are in effect selecting to delineate as sufficiently high.</p><p>In <xref ref-type="table" rid="table1">Table 1</xref>, we present our final lag selections for the demonstration set of LETFs. Column headers prefixed with “21D” or “252D” refer to results produced when using <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x212.png" xlink:type="simple"/></inline-formula> day or <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x212.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x213.png" xlink:type="simple"/></inline-formula> day periods, respectively, and the notation <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x212.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x213.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x214.png" xlink:type="simple"/></inline-formula> refers to the proportion of p-values that were<inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x212.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x213.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x214.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x215.png" xlink:type="simple"/></inline-formula>. We used 10,000 iterations for testing each LETF. We feel that our selection criteria resulted in satisfactory lag parameter selections for all LETFs when using 21 day periods (except for FINZ), but the results are mixed when using 252 day periods, with 9 of 20 LETFs (FINZ, DUST, TECL, TECS, RUSL, RUSS, DZK, EDC, EDZ) failing to offer values of <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x212.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x213.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x214.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x215.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x216.png" xlink:type="simple"/></inline-formula> greater than 0.9. There were many lag selections for each LETF that performed well when using 21 day periods, so we simplified the estimation task and present only the lag selection that provided the best results with 252 day periods (the values shown in columns with a “21D” prefix may not actually be the best). The minimum and median p-values were not incorporated into any decision making, but are included here for reference.</p><p>Our selections for the kernel bandwidth vector <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x217.png" xlink:type="simple"/></inline-formula> are based on the multivariate “Scott Rule” [<xref ref-type="bibr" rid="scirp.61565-ref20">20</xref>] , defined as:</p><table-wrap id="table1" ><label><xref ref-type="table" rid="table1">Table 1</xref></label><caption><title> Final lag selections for all demonstration LETFs</title></caption><table><tbody><thead><tr><th align="center" valign="middle"  rowspan="2"  >Index</th><th align="center" valign="middle"  rowspan="2"  >Leverage</th><th align="center" valign="middle"  rowspan="2"  >LETF</th><th align="center" valign="middle"  rowspan="2"  >Lags</th><th align="center" valign="middle" >21D</th><th align="center" valign="middle" >21D</th><th align="center" valign="middle" >21D</th><th align="center" valign="middle" >252D</th><th align="center" valign="middle" >252D</th><th align="center" valign="middle" >252D</th></tr></thead><tr><td align="center" valign="middle" >P [p &#179;0.01]</td><td align="center" valign="middle" >Minimum</td><td align="center" valign="middle" >Median</td><td align="center" valign="middle" >P [p &#179;0.01]</td><td align="center" valign="middle" >Minimum</td><td align="center" valign="middle" >Median</td></tr><tr><td align="center" valign="middle" >DJUSFN</td><td align="center" valign="middle" >+3</td><td align="center" valign="middle" >FINU</td><td align="center" valign="middle" >3</td><td align="center" valign="middle" >1.0000</td><td align="center" valign="middle" >0.7125</td><td align="center" valign="middle" >0.9963</td><td align="center" valign="middle" >1.0000</td><td align="center" valign="middle" >0.0354</td><td align="center" valign="middle" >0.6315</td></tr><tr><td align="center" valign="middle" >DJUSFN</td><td align="center" valign="middle" >−3</td><td align="center" valign="middle" >FINZ</td><td align="center" valign="middle" >3</td><td align="center" valign="middle" >0.6034</td><td align="center" valign="middle" >0.0000</td><td align="center" valign="middle" >0.0242</td><td align="center" valign="middle" >0.0511</td><td align="center" valign="middle" >0.0000</td><td align="center" valign="middle" >0.0000</td></tr><tr><td align="center" valign="middle" >GDM</td><td align="center" valign="middle" >+3</td><td align="center" valign="middle" >NUGT</td><td align="center" valign="middle" >5</td><td align="center" valign="middle" >1.0000</td><td align="center" valign="middle" >0.1592</td><td align="center" valign="middle" >0.4248</td><td align="center" valign="middle" >0.9986</td><td align="center" valign="middle" >0.0053</td><td align="center" valign="middle" >0.0644</td></tr><tr><td align="center" valign="middle" >GDM</td><td align="center" valign="middle" >−3</td><td align="center" valign="middle" >DUST</td><td align="center" valign="middle" >3</td><td align="center" valign="middle" >1.0000</td><td align="center" valign="middle" >0.0466</td><td align="center" valign="middle" >0.3639</td><td align="center" valign="middle" >0.5112</td><td align="center" valign="middle" >0.0000</td><td align="center" valign="middle" >0.0107</td></tr><tr><td align="center" valign="middle" >INDU</td><td align="center" valign="middle" >+3</td><td align="center" valign="middle" >UDOW</td><td align="center" valign="middle" >3</td><td align="center" valign="middle" >1.0000</td><td align="center" valign="middle" >0.9962</td><td align="center" valign="middle" >1.0000</td><td align="center" valign="middle" >1.0000</td><td align="center" valign="middle" >0.5142</td><td align="center" valign="middle" >1.0000</td></tr><tr><td align="center" valign="middle" >INDU</td><td align="center" valign="middle" >−3</td><td align="center" valign="middle" >SDOW</td><td align="center" valign="middle" >3</td><td align="center" valign="middle" >1.0000</td><td align="center" valign="middle" >0.9993</td><td align="center" valign="middle" >1.0000</td><td align="center" valign="middle" >1.0000</td><td align="center" valign="middle" >0.4442</td><td align="center" valign="middle" >0.9994</td></tr><tr><td align="center" valign="middle" >IXT</td><td align="center" valign="middle" >+3</td><td align="center" valign="middle" >TECL</td><td align="center" valign="middle" >4</td><td align="center" valign="middle" >0.9996</td><td align="center" valign="middle" >0.0059</td><td align="center" valign="middle" >0.5625</td><td align="center" valign="middle" >0.5942</td><td align="center" valign="middle" >0.0000</td><td align="center" valign="middle" >0.0450</td></tr><tr><td align="center" valign="middle" >IXT</td><td align="center" valign="middle" >−3</td><td align="center" valign="middle" >TECS</td><td align="center" valign="middle" >5</td><td align="center" valign="middle" >0.9953</td><td align="center" valign="middle" >0.0006</td><td align="center" valign="middle" >0.3224</td><td align="center" valign="middle" >0.5057</td><td align="center" valign="middle" >0.0000</td><td align="center" valign="middle" >0.0107</td></tr><tr><td align="center" valign="middle" >MVRSX</td><td align="center" valign="middle" >+3</td><td align="center" valign="middle" >RUSL</td><td align="center" valign="middle" >3</td><td align="center" valign="middle" >0.9997</td><td align="center" valign="middle" >0.0086</td><td align="center" valign="middle" >0.7218</td><td align="center" valign="middle" >0.1339</td><td align="center" valign="middle" >0.0000</td><td align="center" valign="middle" >0.0000</td></tr><tr><td align="center" valign="middle" >MVRSX</td><td align="center" valign="middle" >−3</td><td align="center" valign="middle" >RUSS</td><td align="center" valign="middle" >4</td><td align="center" valign="middle" >1.0000</td><td align="center" valign="middle" >0.0183</td><td align="center" valign="middle" >0.7212</td><td align="center" valign="middle" >0.5420</td><td align="center" valign="middle" >0.0000</td><td align="center" valign="middle" >0.0180</td></tr><tr><td align="center" valign="middle" >MXEA</td><td align="center" valign="middle" >+3</td><td align="center" valign="middle" >DZK</td><td align="center" valign="middle" >3</td><td align="center" valign="middle" >0.9999</td><td align="center" valign="middle" >0.0067</td><td align="center" valign="middle" >0.6241</td><td align="center" valign="middle" >0.0268</td><td align="center" valign="middle" >0.0000</td><td align="center" valign="middle" >0.0000</td></tr><tr><td align="center" valign="middle" >MXEA</td><td align="center" valign="middle" >−3</td><td align="center" valign="middle" >DPK</td><td align="center" valign="middle" >4</td><td align="center" valign="middle" >1.0000</td><td align="center" valign="middle" >0.2803</td><td align="center" valign="middle" >0.9546</td><td align="center" valign="middle" >0.9429</td><td align="center" valign="middle" >0.0000</td><td align="center" valign="middle" >0.1643</td></tr><tr><td align="center" valign="middle" >MXEF</td><td align="center" valign="middle" >+3</td><td align="center" valign="middle" >EDC</td><td align="center" valign="middle" >3</td><td align="center" valign="middle" >1.0000</td><td align="center" valign="middle" >0.0411</td><td align="center" valign="middle" >0.3948</td><td align="center" valign="middle" >0.0455</td><td align="center" valign="middle" >0.0000</td><td align="center" valign="middle" >0.0000</td></tr><tr><td align="center" valign="middle" >MXEF</td><td align="center" valign="middle" >−3</td><td align="center" valign="middle" >EDZ</td><td align="center" valign="middle" >4</td><td align="center" valign="middle" >1.0000</td><td align="center" valign="middle" >0.2243</td><td align="center" valign="middle" >0.9398</td><td align="center" valign="middle" >0.6698</td><td align="center" valign="middle" >0.0000</td><td align="center" valign="middle" >0.0403</td></tr><tr><td align="center" valign="middle" >NDX</td><td align="center" valign="middle" >+3</td><td align="center" valign="middle" >TQQQ</td><td align="center" valign="middle" >3</td><td align="center" valign="middle" >1.0000</td><td align="center" valign="middle" >0.9997</td><td align="center" valign="middle" >1.0000</td><td align="center" valign="middle" >1.0000</td><td align="center" valign="middle" >0.6649</td><td align="center" valign="middle" >1.0000</td></tr><tr><td align="center" valign="middle" >NDX</td><td align="center" valign="middle" >−3</td><td align="center" valign="middle" >SQQQ</td><td align="center" valign="middle" >3</td><td align="center" valign="middle" >1.0000</td><td align="center" valign="middle" >0.9999</td><td align="center" valign="middle" >1.0000</td><td align="center" valign="middle" >1.0000</td><td align="center" valign="middle" >0.5509</td><td align="center" valign="middle" >0.9983</td></tr><tr><td align="center" valign="middle" >RTY</td><td align="center" valign="middle" >+3</td><td align="center" valign="middle" >TNA</td><td align="center" valign="middle" >3</td><td align="center" valign="middle" >1.0000</td><td align="center" valign="middle" >0.9582</td><td align="center" valign="middle" >1.0000</td><td align="center" valign="middle" >1.0000</td><td align="center" valign="middle" >0.0911</td><td align="center" valign="middle" >0.9682</td></tr><tr><td align="center" valign="middle" >RTY</td><td align="center" valign="middle" >−3</td><td align="center" valign="middle" >TZA</td><td align="center" valign="middle" >4</td><td align="center" valign="middle" >1.0000</td><td align="center" valign="middle" >0.9986</td><td align="center" valign="middle" >1.0000</td><td align="center" valign="middle" >1.0000</td><td align="center" valign="middle" >0.0121</td><td align="center" valign="middle" >0.8987</td></tr><tr><td align="center" valign="middle" >SPX</td><td align="center" valign="middle" >+3</td><td align="center" valign="middle" >SPXL</td><td align="center" valign="middle" >5</td><td align="center" valign="middle" >1.0000</td><td align="center" valign="middle" >0.9912</td><td align="center" valign="middle" >1.0000</td><td align="center" valign="middle" >1.0000</td><td align="center" valign="middle" >0.0605</td><td align="center" valign="middle" >1.0000</td></tr><tr><td align="center" valign="middle" >SPX</td><td align="center" valign="middle" >−3</td><td align="center" valign="middle" >SPXS</td><td align="center" valign="middle" >5</td><td align="center" valign="middle" >1.0000</td><td align="center" valign="middle" >0.9912</td><td align="center" valign="middle" >1.0000</td><td align="center" valign="middle" >1.0000</td><td align="center" valign="middle" >0.1100</td><td align="center" valign="middle" >1.0000</td></tr></tbody></table></table-wrap><disp-formula id="scirp.61565-formula168"><label>(33)</label><graphic position="anchor" xlink:href="http://html.scirp.org/file/4-1490368x218.png"  xlink:type="simple"/></disp-formula><p>where <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x219.png" xlink:type="simple"/></inline-formula> is the bandwidth for jth dimension of density estimate, <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x219.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x220.png" xlink:type="simple"/></inline-formula>is the estimated standard deviation of jth dimension, n is the number of p dimensional observations used for fitting density estimate, and p is the number of dimensions of the sample space.</p><p>We use<inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x221.png" xlink:type="simple"/></inline-formula>, the traditional unbiased estimator of<inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x221.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x222.png" xlink:type="simple"/></inline-formula>, and scale down our final selections of<inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x221.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x222.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x223.png" xlink:type="simple"/></inline-formula>. After extensive testing of our tracking error simulation routine with the demonstration set of 20 LETFs, we concluded that the elements of <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x221.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x222.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x223.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x224.png" xlink:type="simple"/></inline-formula> corresponding to index returns (elements<inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x221.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x222.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x223.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x224.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x225.png" xlink:type="simple"/></inline-formula>) needed to be scaled down by a factor of 100, and the elements of <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x221.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x222.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x223.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x224.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x225.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x226.png" xlink:type="simple"/></inline-formula> corresponding to LETF tracking errors (elements<inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x221.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x222.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x223.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x224.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x225.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x226.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x227.png" xlink:type="simple"/></inline-formula>) needed to be scaled down by a factor of 100,000. We provide visual justification for this heuristic in <xref ref-type="fig" rid="fig4">Figure 4</xref>. For the final bandwidth selections, we have:</p><disp-formula id="scirp.61565-formula169"><label>(34)</label><graphic position="anchor" xlink:href="http://html.scirp.org/file/4-1490368x228.png"  xlink:type="simple"/></disp-formula><disp-formula id="scirp.61565-formula170"><label>(35)</label><graphic position="anchor" xlink:href="http://html.scirp.org/file/4-1490368x229.png"  xlink:type="simple"/></disp-formula><disp-formula id="scirp.61565-formula171"><label>(36)</label><graphic position="anchor" xlink:href="http://html.scirp.org/file/4-1490368x230.png"  xlink:type="simple"/></disp-formula><disp-formula id="scirp.61565-formula172"><label>. (37)</label><graphic position="anchor" xlink:href="http://html.scirp.org/file/4-1490368x231.png"  xlink:type="simple"/></disp-formula><p><xref ref-type="fig" rid="fig4">Figure 4</xref> shows the lag testing results from 10,000 iterations of LETF Ticker SPXL using 252 day periods for each lag parameter value 0 through 8. In all simulations, the bandwidths were scaled down as indicated above, producing in our opinion a reasonable increase in K-S p-values (using any of the statistics shown) as the lag value increases from 0 to 8. These results are somewhat representative of the results experienced when testing the other LETFs. Alternatively, when using larger factors to scale the bandwidths, the simulation routine would fail on some iterations because the estimates for the smoothing and filtering densities did not have sufficient support. We experienced this type of result when testing FINZ, TECS, RUSL, and RUSS with the factors indicated above, forcing us to create an exception for these LETFs where we decrease the factor used to scale the tracking error portion of the bandwidth vector to 10,000. When using smaller factors to scale the bandwidths, significant increases in p-values were generally not observed at any lag, or not observed until 8 or more lags were included. In the latter cases, these results appeared to us as overfitting.</p><fig id="fig4"  position="float"><label><xref ref-type="fig" rid="fig4">Figure 4</xref></label><caption><title> Lag testing results summary for LETF ticker SPXL with 252 day periods</title></caption><graphic mimetype="image"   position="float"  xlink:type="simple"  xlink:href="http://html.scirp.org/file/4-1490368x232.png"/></fig></sec></sec><sec id="s4"><title>4. Constrained Simulation Using Nonparametric Density Estimation</title><p>The nonparametric method for constrained simulation we propose in this section was devised as part of the larger body of work on LETF volatility documented throughout this paper, but the method is truly general in nature. It could be helpful in any setting where the practitioner would like to simulate multivariate data with a constrained sample sum (or average). For this reason the second and third subsections are presented in the context of using generic multivariate data, without references to financial data or financial constructs.</p><sec id="s4_1"><title>4.1. Extending the LETF Returns Model with an Index Return Constraint</title><p>In order to constrain the compound underlying index return for the period, the joint density of our LETF returns model from Section 3 must be revised as follows:</p><disp-formula id="scirp.61565-formula173"><label>(38)</label><graphic position="anchor" xlink:href="http://html.scirp.org/file/4-1490368x233.png"  xlink:type="simple"/></disp-formula><p>where<inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x234.png" xlink:type="simple"/></inline-formula>, the total k day compounded return of the underlying index for days <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x234.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x235.png" xlink:type="simple"/></inline-formula></p><p>through<inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x236.png" xlink:type="simple"/></inline-formula>, and the density function <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x236.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x237.png" xlink:type="simple"/></inline-formula> is the joint density of a sequence of <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x236.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x237.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x238.png" xlink:type="simple"/></inline-formula> unconstrained index return variables (the lags) and a sequence of <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x236.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x237.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x238.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x239.png" xlink:type="simple"/></inline-formula> index return variables constrained to compound to<inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x236.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x237.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x238.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x239.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x240.png" xlink:type="simple"/></inline-formula>. This form of the full joint density for index returns and LETF tracking errors (left-hand side) can be used to simulate sequences of LETF returns constrained such that the sampled sequence of index returns compounds to the given total period return<inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x236.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x237.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x238.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x239.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x240.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x241.png" xlink:type="simple"/></inline-formula>.</p><p>It needs to be emphasized that this modification is implemented using the log form of index returns as was the case with all estimators and simulation work featured in Section 3. When index return variables are modeled as</p><p><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x242.png" xlink:type="simple"/></inline-formula>, the density being estimated becomes<inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x242.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x243.png" xlink:type="simple"/></inline-formula>, the joint density of</p><p>a sequence of <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x244.png" xlink:type="simple"/></inline-formula> unconstrained variables (the lags) and a sequence of <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x244.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x245.png" xlink:type="simple"/></inline-formula> variables constrained to sum to<inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x244.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x245.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x246.png" xlink:type="simple"/></inline-formula>. The estimate for this form of the constrained joint density is much easier to derive and more generally useful in applications outside of finance.</p></sec><sec id="s4_2"><title>4.2. Derivation of Kernel Density Estimate</title><p>Given any p dimensional random vector <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x247.png" xlink:type="simple"/></inline-formula> with <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x247.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x248.png" xlink:type="simple"/></inline-formula> unconstrained dimensions (lags) and n observations of <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x247.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x248.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x249.png" xlink:type="simple"/></inline-formula> arranged as an <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x247.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x248.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x249.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x250.png" xlink:type="simple"/></inline-formula> observation matrix<inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x247.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x248.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x249.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x250.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x251.png" xlink:type="simple"/></inline-formula>, our nonparametric density estimate is constructed as follows:</p><p>1) Fit a kernel density estimate for <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x252.png" xlink:type="simple"/></inline-formula> using a jointly independent multivariate normal kernel and observation matrix<inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x252.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x253.png" xlink:type="simple"/></inline-formula>.</p><disp-formula id="scirp.61565-formula174"><label>(39)</label><graphic position="anchor" xlink:href="http://html.scirp.org/file/4-1490368x254.png"  xlink:type="simple"/></disp-formula><p>where <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x255.png" xlink:type="simple"/></inline-formula> is the p dimensional multivariate normal density function evaluated at <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x255.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x256.png" xlink:type="simple"/></inline-formula> using mean vector <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x255.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x256.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x257.png" xlink:type="simple"/></inline-formula> and covariance matrix<inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x255.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x256.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x257.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x258.png" xlink:type="simple"/></inline-formula>, <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x255.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x256.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x257.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x258.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x259.png" xlink:type="simple"/></inline-formula>is the ith row vector of observation matrix<inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x255.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x256.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x257.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x258.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x259.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x260.png" xlink:type="simple"/></inline-formula>, and <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x255.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x256.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x257.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x258.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x259.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x260.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x261.png" xlink:type="simple"/></inline-formula> is the diagonal matrix formed from element-wise squaring of the p dimensional vector of bandwidths.</p><p>Note that the selection of <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x262.png" xlink:type="simple"/></inline-formula> is ultimately application dependent, so we cannot provide advice for any kind of general case other than recommending what has already been published about using the multivariate normal density as a kernel [<xref ref-type="bibr" rid="scirp.61565-ref20">20</xref>] . The selections for our applications will be detailed later in a later subsection.</p><p>2) Perform a change of variables and derive the corresponding kernel density estimate.</p><p>Let<inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x263.png" xlink:type="simple"/></inline-formula>, <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x263.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x264.png" xlink:type="simple"/></inline-formula>, <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x263.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x264.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x265.png" xlink:type="simple"/></inline-formula>, <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x263.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x264.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x265.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x266.png" xlink:type="simple"/></inline-formula>,<inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x263.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x264.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x265.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x266.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x267.png" xlink:type="simple"/></inline-formula>. Or using matrix notation, define random vector <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x263.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x264.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x265.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x266.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x267.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x268.png" xlink:type="simple"/></inline-formula> as</p><p>follows:</p><disp-formula id="scirp.61565-formula175"><label>(40)</label><graphic position="anchor" xlink:href="http://html.scirp.org/file/4-1490368x269.png"  xlink:type="simple"/></disp-formula><disp-formula id="scirp.61565-formula176"><label>(41)</label><graphic position="anchor" xlink:href="http://html.scirp.org/file/4-1490368x270.png"  xlink:type="simple"/></disp-formula><p>where the first <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x271.png" xlink:type="simple"/></inline-formula> elements of the bottom row of <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x271.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x272.png" xlink:type="simple"/></inline-formula> are 0 to allow for the unconstrained dimensions of<inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x271.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x272.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x273.png" xlink:type="simple"/></inline-formula>.</p><p>To derive the kernel density estimate for the transformed variables, invoke the following theorem for trans- forming multivariate normal random vectors [<xref ref-type="bibr" rid="scirp.61565-ref22">22</xref>] :</p><disp-formula id="scirp.61565-formula177"><label>(42)</label><graphic position="anchor" xlink:href="http://html.scirp.org/file/4-1490368x274.png"  xlink:type="simple"/></disp-formula><p>where <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x275.png" xlink:type="simple"/></inline-formula> is a constant matrix, <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x275.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x276.png" xlink:type="simple"/></inline-formula>is the transpose of that matrix, and <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x275.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x276.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x277.png" xlink:type="simple"/></inline-formula> is a constant vector. Apply the theorem to the kernel from the result of Step 1 to produce the estimate of the joint density for<inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x275.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x276.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x277.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x278.png" xlink:type="simple"/></inline-formula>.</p><disp-formula id="scirp.61565-formula178"><label>(43)</label><graphic position="anchor" xlink:href="http://html.scirp.org/file/4-1490368x279.png"  xlink:type="simple"/></disp-formula><p>3) Factor the kernel within <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x280.png" xlink:type="simple"/></inline-formula> into the product of an unconditional univariate kernel for <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x280.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x281.png" xlink:type="simple"/></inline-formula> and a multivariate kernel for <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x280.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x281.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x282.png" xlink:type="simple"/></inline-formula> conditional on<inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x280.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x281.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x282.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x283.png" xlink:type="simple"/></inline-formula>.</p><disp-formula id="scirp.61565-formula179"><label>(44)</label><graphic position="anchor" xlink:href="http://html.scirp.org/file/4-1490368x284.png"  xlink:type="simple"/></disp-formula><p>where <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x285.png" xlink:type="simple"/></inline-formula> is the vector <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x285.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x286.png" xlink:type="simple"/></inline-formula> without the pth element.</p><p>For the kernel factor corresponding to the univariate density for<inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x287.png" xlink:type="simple"/></inline-formula>, re-apply the theorem cited in Step 2 to construct the following univariate density kernel:</p><disp-formula id="scirp.61565-formula180"><label>. (45)</label><graphic position="anchor" xlink:href="http://html.scirp.org/file/4-1490368x288.png"  xlink:type="simple"/></disp-formula><p>To construct <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x289.png" xlink:type="simple"/></inline-formula> invoke another theorem for transforming multivariate normal random vectors</p><p>[<xref ref-type="bibr" rid="scirp.61565-ref22">22</xref>] :</p><disp-formula id="scirp.61565-formula181"><label>(46)</label><graphic position="anchor" xlink:href="http://html.scirp.org/file/4-1490368x290.png"  xlink:type="simple"/></disp-formula><disp-formula id="scirp.61565-formula182"><label>(47)</label><graphic position="anchor" xlink:href="http://html.scirp.org/file/4-1490368x291.png"  xlink:type="simple"/></disp-formula><p>where<inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x292.png" xlink:type="simple"/></inline-formula>, <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x292.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x293.png" xlink:type="simple"/></inline-formula>, <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x292.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x293.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x294.png" xlink:type="simple"/></inline-formula>, and <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x292.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x293.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x294.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x295.png" xlink:type="simple"/></inline-formula> taken together constitute a partition of<inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x292.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x293.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x294.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x295.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x296.png" xlink:type="simple"/></inline-formula>. Apply this theorem to the conditional kernel.</p><disp-formula id="scirp.61565-formula183"><label>(48)</label><graphic position="anchor" xlink:href="http://html.scirp.org/file/4-1490368x297.png"  xlink:type="simple"/></disp-formula><disp-formula id="scirp.61565-formula184"><label>(49)</label><graphic position="anchor" xlink:href="http://html.scirp.org/file/4-1490368x298.png"  xlink:type="simple"/></disp-formula><disp-formula id="scirp.61565-formula185"><label>(50)</label><graphic position="anchor" xlink:href="http://html.scirp.org/file/4-1490368x299.png"  xlink:type="simple"/></disp-formula><p>where <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x300.png" xlink:type="simple"/></inline-formula> is the ith observation vector without the pth element, and <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x300.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x301.png" xlink:type="simple"/></inline-formula> is the bandwidth vector<inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x300.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x301.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x302.png" xlink:type="simple"/></inline-formula>,</p><p>without the pth element, squared element-wise, and transposed.</p><p>4) Factor and rearrange terms of the density estimate for <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x303.png" xlink:type="simple"/></inline-formula> to produce an estimate for the conditional density <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x303.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x304.png" xlink:type="simple"/></inline-formula> Start by factoring the density for <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x303.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x304.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x305.png" xlink:type="simple"/></inline-formula> and inserting the appropriate density estimates.</p><disp-formula id="scirp.61565-formula186"><label>(51)</label><graphic position="anchor" xlink:href="http://html.scirp.org/file/4-1490368x306.png"  xlink:type="simple"/></disp-formula><disp-formula id="scirp.61565-formula187"><label>(52)</label><graphic position="anchor" xlink:href="http://html.scirp.org/file/4-1490368x307.png"  xlink:type="simple"/></disp-formula><disp-formula id="scirp.61565-formula188"><label>. (53)</label><graphic position="anchor" xlink:href="http://html.scirp.org/file/4-1490368x308.png"  xlink:type="simple"/></disp-formula><p>Continue by inserting the factors of <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x309.png" xlink:type="simple"/></inline-formula> that were derived in Step 3 and rearranging terms to produce the final density estimate.</p><disp-formula id="scirp.61565-formula189"><label>(54)</label><graphic position="anchor" xlink:href="http://html.scirp.org/file/4-1490368x310.png"  xlink:type="simple"/></disp-formula><disp-formula id="scirp.61565-formula190"><label>(55)</label><graphic position="anchor" xlink:href="http://html.scirp.org/file/4-1490368x311.png"  xlink:type="simple"/></disp-formula><disp-formula id="scirp.61565-formula191"><label>. (56)</label><graphic position="anchor" xlink:href="http://html.scirp.org/file/4-1490368x312.png"  xlink:type="simple"/></disp-formula><p>Because there was no effective change in the <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x313.png" xlink:type="simple"/></inline-formula> to <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x313.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x314.png" xlink:type="simple"/></inline-formula> transformations, define</p><p><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x315.png" xlink:type="simple"/></inline-formula>to denote the given value for the sum of the random vector and the density estimate can be</p><p>written entirely in terms of<inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x316.png" xlink:type="simple"/></inline-formula>. The final form of the density estimate:</p><disp-formula id="scirp.61565-formula192"><label>(57)</label><graphic position="anchor" xlink:href="http://html.scirp.org/file/4-1490368x317.png"  xlink:type="simple"/></disp-formula><disp-formula id="scirp.61565-formula193"><label>(58)</label><graphic position="anchor" xlink:href="http://html.scirp.org/file/4-1490368x318.png"  xlink:type="simple"/></disp-formula></sec><sec id="s4_3"><title>4.3. Simulation Routine</title><p>With the final density estimates ready, constrained data can be simulated using the following routine.</p><p>Given: length p bandwidth vector<inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x319.png" xlink:type="simple"/></inline-formula>, vector sum <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x319.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x320.png" xlink:type="simple"/></inline-formula> constraint<inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x319.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x320.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x321.png" xlink:type="simple"/></inline-formula>, and length p observation vectors</p><disp-formula id="scirp.61565-formula194"><graphic  xlink:href="http://html.scirp.org/file/4-1490368x322.png"  xlink:type="simple"/></disp-formula><p>1) Sample an index value <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x323.png" xlink:type="simple"/></inline-formula> from a multinomial distribution with weight vector<inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x323.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x324.png" xlink:type="simple"/></inline-formula>, where</p><p><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x325.png" xlink:type="simple"/></inline-formula>.</p><p>2) Use index value i from step 1 to select the ith observation <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x326.png" xlink:type="simple"/></inline-formula> and sample<inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x326.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x327.png" xlink:type="simple"/></inline-formula>, a <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x326.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x327.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x328.png" xlink:type="simple"/></inline-formula> dimensional</p><p>vector, from the multivariate normal distribution with density<inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x329.png" xlink:type="simple"/></inline-formula>, where</p><p><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x330.png" xlink:type="simple"/></inline-formula> , and<inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x330.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x331.png" xlink:type="simple"/></inline-formula>.</p><p>3) Use elements <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x332.png" xlink:type="simple"/></inline-formula> through <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x332.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x333.png" xlink:type="simple"/></inline-formula> of the the sampled <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x332.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x333.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x334.png" xlink:type="simple"/></inline-formula> dimensional vector <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x332.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x333.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x334.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x335.png" xlink:type="simple"/></inline-formula> from Step 2</p><p>to arrive at the pth (implied) sample value<inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x336.png" xlink:type="simple"/></inline-formula>.</p><p>Because Steps 1 and 3 are computationally trivial, the computational complexity of the simulation routine is no worse than that of the chosen implementation for the sampled multivariate normal distribution. Our testing and development was performed using the mvrnorm() implementation available in the R package MASS. Package version 7.3 - 27, R version 3.0.1.</p><p><xref ref-type="table" rid="table2">Table 2</xref> is presented to better illustrate what real time performance a user can expect with the routine (based on our choice of mvrnorm()). The routine was executed 100 times each using various sizes of the observation matrix<inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x337.png" xlink:type="simple"/></inline-formula>, and for the sake of completeness included various values for number of iterations k. For all simulations the returns data for the S&amp;P 500 index were used with a constrained return of 0 and our final bandwidth selection (described in the next subsection). As the iterations of the routine can be executed in parallel, theoretically, the number of iterations k should have no impact on the final runtime. The tests were performed on a Dell server with 2 Intel Xeon 2.5 GHz processors (6 cores each, 64 GB memory total) running a virtualized instance of Red Hat Enterprise Linux Server 6.5 (Kernel 2.6, 64 bit).</p><p>As expected there are significant increases in execution time at the largest selections for n and p, while k does not have much of an impact. With an average execution time near 3 minutes when using a <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x338.png" xlink:type="simple"/></inline-formula></p><table-wrap id="table2" ><label><xref ref-type="table" rid="table2">Table 2</xref></label><caption><title> Execution Times from 100 iterations per parameter set (seconds)</title></caption><table><tbody><thead><tr><th align="center" valign="middle" >n</th><th align="center" valign="middle" >p</th><th align="center" valign="middle" >k</th><th align="center" valign="middle" >mean</th><th align="center" valign="middle" >min</th><th align="center" valign="middle" >max</th></tr></thead><tr><td align="center" valign="middle" >1000</td><td align="center" valign="middle" >10</td><td align="center" valign="middle" >1000</td><td align="center" valign="middle" >0.01</td><td align="center" valign="middle" >0.01</td><td align="center" valign="middle" >0.01</td></tr><tr><td align="center" valign="middle" >1000</td><td align="center" valign="middle" >10</td><td align="center" valign="middle" >10,000</td><td align="center" valign="middle" >0.05</td><td align="center" valign="middle" >0.05</td><td align="center" valign="middle" >0.10</td></tr><tr><td align="center" valign="middle" >1000</td><td align="center" valign="middle" >10</td><td align="center" valign="middle" >100,000</td><td align="center" valign="middle" >0.70</td><td align="center" valign="middle" >0.67</td><td align="center" valign="middle" >0.84</td></tr><tr><td align="center" valign="middle" >1000</td><td align="center" valign="middle" >100</td><td align="center" valign="middle" >1000</td><td align="center" valign="middle" >0.05</td><td align="center" valign="middle" >0.05</td><td align="center" valign="middle" >0.06</td></tr><tr><td align="center" valign="middle" >1000</td><td align="center" valign="middle" >100</td><td align="center" valign="middle" >10,000</td><td align="center" valign="middle" >0.51</td><td align="center" valign="middle" >0.42</td><td align="center" valign="middle" >0.57</td></tr><tr><td align="center" valign="middle" >1000</td><td align="center" valign="middle" >100</td><td align="center" valign="middle" >100,000</td><td align="center" valign="middle" >3.79</td><td align="center" valign="middle" >3.63</td><td align="center" valign="middle" >4.01</td></tr><tr><td align="center" valign="middle" >1000</td><td align="center" valign="middle" >1000</td><td align="center" valign="middle" >1000</td><td align="center" valign="middle" >4.50</td><td align="center" valign="middle" >4.17</td><td align="center" valign="middle" >4.67</td></tr><tr><td align="center" valign="middle" >1000</td><td align="center" valign="middle" >1000</td><td align="center" valign="middle" >10,000</td><td align="center" valign="middle" >13.95</td><td align="center" valign="middle" >13.72</td><td align="center" valign="middle" >14.29</td></tr><tr><td align="center" valign="middle" >1000</td><td align="center" valign="middle" >1000</td><td align="center" valign="middle" >100,000</td><td align="center" valign="middle" >108.81</td><td align="center" valign="middle" >108.24</td><td align="center" valign="middle" >110.41</td></tr><tr><td align="center" valign="middle" >10,000</td><td align="center" valign="middle" >10</td><td align="center" valign="middle" >1000</td><td align="center" valign="middle" >0.05</td><td align="center" valign="middle" >0.04</td><td align="center" valign="middle" >0.05</td></tr><tr><td align="center" valign="middle" >10,000</td><td align="center" valign="middle" >10</td><td align="center" valign="middle" >10,000</td><td align="center" valign="middle" >0.10</td><td align="center" valign="middle" >0.09</td><td align="center" valign="middle" >0.16</td></tr><tr><td align="center" valign="middle" >10,000</td><td align="center" valign="middle" >10</td><td align="center" valign="middle" >100,000</td><td align="center" valign="middle" >0.84</td><td align="center" valign="middle" >0.68</td><td align="center" valign="middle" >0.96</td></tr><tr><td align="center" valign="middle" >10,000</td><td align="center" valign="middle" >100</td><td align="center" valign="middle" >1000</td><td align="center" valign="middle" >0.24</td><td align="center" valign="middle" >0.23</td><td align="center" valign="middle" >0.31</td></tr><tr><td align="center" valign="middle" >10,000</td><td align="center" valign="middle" >100</td><td align="center" valign="middle" >10,000</td><td align="center" valign="middle" >0.71</td><td align="center" valign="middle" >0.68</td><td align="center" valign="middle" >0.77</td></tr><tr><td align="center" valign="middle" >10,000</td><td align="center" valign="middle" >100</td><td align="center" valign="middle" >100,000</td><td align="center" valign="middle" >3.99</td><td align="center" valign="middle" >3.93</td><td align="center" valign="middle" >4.15</td></tr><tr><td align="center" valign="middle" >10,000</td><td align="center" valign="middle" >1000</td><td align="center" valign="middle" >1000</td><td align="center" valign="middle" >11.24</td><td align="center" valign="middle" >11.07</td><td align="center" valign="middle" >12.23</td></tr><tr><td align="center" valign="middle" >10,000</td><td align="center" valign="middle" >1000</td><td align="center" valign="middle" >10,000</td><td align="center" valign="middle" >20.67</td><td align="center" valign="middle" >20.35</td><td align="center" valign="middle" >21.76</td></tr><tr><td align="center" valign="middle" >10,000</td><td align="center" valign="middle" >1000</td><td align="center" valign="middle" >100,000</td><td align="center" valign="middle" >115.92</td><td align="center" valign="middle" >114.91</td><td align="center" valign="middle" >117.25</td></tr><tr><td align="center" valign="middle" >100,000</td><td align="center" valign="middle" >10</td><td align="center" valign="middle" >1000</td><td align="center" valign="middle" >0.46</td><td align="center" valign="middle" >0.40</td><td align="center" valign="middle" >0.53</td></tr><tr><td align="center" valign="middle" >100,000</td><td align="center" valign="middle" >10</td><td align="center" valign="middle" >10,000</td><td align="center" valign="middle" >0.51</td><td align="center" valign="middle" >0.48</td><td align="center" valign="middle" >0.58</td></tr><tr><td align="center" valign="middle" >100,000</td><td align="center" valign="middle" >10</td><td align="center" valign="middle" >100,000</td><td align="center" valign="middle" >1.16</td><td align="center" valign="middle" >1.05</td><td align="center" valign="middle" >1.27</td></tr><tr><td align="center" valign="middle" >100,000</td><td align="center" valign="middle" >100</td><td align="center" valign="middle" >1000</td><td align="center" valign="middle" >2.41</td><td align="center" valign="middle" >2.33</td><td align="center" valign="middle" >2.63</td></tr><tr><td align="center" valign="middle" >100,000</td><td align="center" valign="middle" >100</td><td align="center" valign="middle" >10,000</td><td align="center" valign="middle" >2.77</td><td align="center" valign="middle" >2.73</td><td align="center" valign="middle" >2.91</td></tr><tr><td align="center" valign="middle" >100,000</td><td align="center" valign="middle" >100</td><td align="center" valign="middle" >100,000</td><td align="center" valign="middle" >6.14</td><td align="center" valign="middle" >6.01</td><td align="center" valign="middle" >6.28</td></tr><tr><td align="center" valign="middle" >100,000</td><td align="center" valign="middle" >1000</td><td align="center" valign="middle" >1000</td><td align="center" valign="middle" >80.94</td><td align="center" valign="middle" >79.40</td><td align="center" valign="middle" >91.49</td></tr><tr><td align="center" valign="middle" >100,000</td><td align="center" valign="middle" >1000</td><td align="center" valign="middle" >10,000</td><td align="center" valign="middle" >89.85</td><td align="center" valign="middle" >88.91</td><td align="center" valign="middle" >102.12</td></tr><tr><td align="center" valign="middle" >100,000</td><td align="center" valign="middle" >1000</td><td align="center" valign="middle" >100,000</td><td align="center" valign="middle" >185.86</td><td align="center" valign="middle" >184.00</td><td align="center" valign="middle" >197.93</td></tr></tbody></table></table-wrap><p>observation matrix we hope that interested readers will not consider runtime as a drawback against using our routine in practice.</p></sec><sec id="s4_4"><title>4.4. Bandwidth Selection for Constrained Simulation of Index Returns</title><p>Our selection here is similar to the final rule presented in Section 3. Again we begin with the multivariate “Scott Rule” [<xref ref-type="bibr" rid="scirp.61565-ref20">20</xref>] , defined as it was previously.</p><p>In the case of simulating only index returns, we simplify the initial rule because the p dimensional row vectors of the observation matrix used to fit the density estimate are rolling p day intervals of the same series of daily data. Therefore, a single value from the average of the <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x339.png" xlink:type="simple"/></inline-formula> terms will be used because individually they will be nearly identical. Also, we use<inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x339.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x340.png" xlink:type="simple"/></inline-formula>, the traditional unbiased estimator of<inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x339.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x340.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x341.png" xlink:type="simple"/></inline-formula>.</p><disp-formula id="scirp.61565-formula195"><label>(59)</label><graphic position="anchor" xlink:href="http://html.scirp.org/file/4-1490368x342.png"  xlink:type="simple"/></disp-formula><disp-formula id="scirp.61565-formula196"><label>(60)</label><graphic position="anchor" xlink:href="http://html.scirp.org/file/4-1490368x343.png"  xlink:type="simple"/></disp-formula><disp-formula id="scirp.61565-formula197"><label>(61)</label><graphic position="anchor" xlink:href="http://html.scirp.org/file/4-1490368x344.png"  xlink:type="simple"/></disp-formula><p>where <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x345.png" xlink:type="simple"/></inline-formula> is a p dimensional vector of <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x345.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x346.png" xlink:type="simple"/></inline-formula>s. After extensive testing of our simulation routine with the 10 indexes included in the demonstration set, we concluded that our choice of <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x345.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x346.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x347.png" xlink:type="simple"/></inline-formula> needed to be scaled down by a factor of 10. We provide visual justification for this heuristic in <xref ref-type="fig" rid="fig5">Figure 5</xref> and <xref ref-type="fig" rid="fig6">Figure 6</xref>.</p><p>In the top half of <xref ref-type="fig" rid="fig5">Figure 5</xref>, the density for the sample distribution of SMC (colored blue) is plotted using rolling 21 day intervals from the observed history of the S&amp;P 500 restricted to where the compound return for the period was between 1% and 2%<inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x348.png" xlink:type="simple"/></inline-formula>. In the bottom half, the densities for the sample distribution of SMC are plotted using simulated data with (Adjustment Factor = 10, colored red) and without (Adjustment Factor = 1, colored green) scaling down the bandwidth. For the simulations, the period return constraint was set to 1.5%<inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x348.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x349.png" xlink:type="simple"/></inline-formula>, the midpoint of the data interval used to generate the density</p><fig id="fig5"  position="float"><label><xref ref-type="fig" rid="fig5">Figure 5</xref></label><caption><title> 21 Day SMC densities for SPX</title></caption><graphic mimetype="image"   position="float"  xlink:type="simple"  xlink:href="http://html.scirp.org/file/4-1490368x350.png"/></fig><fig id="fig6"  position="float"><label><xref ref-type="fig" rid="fig6">Figure 6</xref></label><caption><title> 252 day SMC densities for SPX</title></caption><graphic mimetype="image"   position="float"  xlink:type="simple"  xlink:href="http://html.scirp.org/file/4-1490368x351.png"/></fig><p>in the top half of the plot. <xref ref-type="fig" rid="fig6">Figure 6</xref> follows the same layout and color scheme as <xref ref-type="fig" rid="fig5">Figure 5</xref>, but this time using rolling 252 day intervals and different target returns. Only periods where the compound return on the S&amp;P 500 was between 10% and 15% <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x352.png" xlink:type="simple"/></inline-formula> were used in the top half, and the return constraint for simulated data in the lower half was 12.5%<inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x352.png" xlink:type="simple"/></inline-formula><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x353.png" xlink:type="simple"/></inline-formula>. For all SMC calculations (using observed or simulated data), a leverage multiple of +3 is included as if we were approximating LETF Ticker SPXL, where</p><p><inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x354.png" xlink:type="simple"/></inline-formula>is the series of daily returns used for testing. Shortfall from Maximum Con-</p><p>vexity was used as the test statistic to stay consistent with the rest of our work, but an adjustment factor of 10 appeared equally appropriate when standard deviation was used.</p><p>In the figures shown (and including many other cases not shown), it was obvious to us that the bandwidths derived from our simplified Scott Rule were producing simulated data that looked exaggerated when plotted against the comparable subset of observed data. We decided on a final scaling factor of 10 through trial and error, but we think the results shown in <xref ref-type="fig" rid="fig5">Figure 5</xref> and <xref ref-type="fig" rid="fig6">Figure 6</xref> speak for themselves. Our final bandwidth</p><p>selection used in the following application examples is then<inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x355.png" xlink:type="simple"/></inline-formula>.</p></sec></sec><sec id="s5"><title>5. Case Study: Simulating LETF Returns with Underlying Index Return Constraints and Calculating Nonparametric p-values for Volatility Statistics</title><p>We conclude with a demonstration of our three contributions in one example. Our intention is to capture the significance, or rarity, of the volatility experienced during the chosen period as measured by Shortfall from Maximum Convexity. A p-value for the observed SMC value will be calculated with respect to a SMC sample distribution generated by our LETF return model. In the experimental setting described here a p-value of 1 means the lowest possible volatility was observed (if the period in question was repeated, greater volatility would be experienced 100% of the time), and 0 means the highest possible volatility was observed (if the period in question was repeated, greater volatility would be experienced 0% of the time).</p><p>The absolute low point of the U.S. equity markets during the 2008-2009 recession occurred in early March 2009, so we will analyze the realized volatility for that month (22 days) as experienced by LETF Ticker TNA. The underlying index, the Russell 2000, returned 8.92% for the month (the market low point was early in the month, and the rebound was underway by month end). The log form of this value is used as the input total period return of our constrained simulation routine from Section 4 to sample 100,000 sequences of 22 days of Russell 2000 returns. For each of the 100,000 index return samples, our tracking error simulation routine is executed to sample sequences of TNA tracking errors. The data are combined with a +3 leverage multiple (and daily management fee) to produce a final sample of 22 day TNA returns sequences.</p><p>As displayed by the row for Ticker TNA in <xref ref-type="table" rid="table1">Table 1</xref>, the lag parameter <inline-formula><inline-graphic xlink:href="http://html.scirp.org/file/4-1490368x356.png" xlink:type="simple"/></inline-formula> for the simulations was set to 3. The history of daily returns for the Russell 2000 index dating back to 1/2/1979 was arranged into a data matrix of 9151 observations of rolling 25 day intervals (22 days plus 3 lags) to derive the kernel density estimate for constrained simulation. The history of daily returns for the LETF Ticker TNA dating back to 11/11/2008 was combined with the matching Russell 2000 daily returns into a data matrix of 1536 observations of 8 dimensions (4 day sequence of index returns, 4 day sequence of LETF tracking errors) to derive the kernel density estimate for tracking error simulation. All observed values were log transformed before simulation, and our bandwidth selections described in Sections 3 and 4 were applied accordingly.</p><p>Our realized volatility statistic SMC was calculated for each 22 day sample and the density of the final SMC sampling distribution is plotted below in <xref ref-type="fig" rid="fig7">Figure 7</xref>. The red line marks the actual SMC value of 0.1527 that was observed for March 2009. The resulting p-value for this observation with respect to the simulated sample is 0.0053, which indicates that the proportion of simulated SMC values that were less than or equal to the observed value is 0.9947.</p><p>Our constrained simulation routine for index returns guarantees all the 22 day index return samples compound to the observed index return of 8.92%. Given this fact, the range of outcomes represented by the SMC sample is entirely the result of index return volatility and tracking error. Based on the output of our simulation methods we conclude that the realized volatility for TNA in March 2009 was greater than the overwhelming majority of outcomes that may be observed while the Russell 2000 experiences an 8.92% increase over the same period.</p></sec><sec id="s6"><title>6. Conclusions</title><p>Leveraged ETF returns are unique due to the dynamics produced by daily compounding, and we hope to have illuminated some of the challenges involved with modeling these returns over time horizons longer than one day. We have presented a nonparametric framework for modeling daily LETF returns that feature a simulation method for LETF tracking errors and a method for simulating index returns with a constrained period return.</p><fig id="fig7"  position="float"><label><xref ref-type="fig" rid="fig7">Figure 7</xref></label><caption><title> Simulated 22 day SMC density for LETF ticker TNA, with all underlying index returns sequences com- pounding to 8.92%</title></caption><graphic mimetype="image"   position="float"  xlink:type="simple"  xlink:href="http://html.scirp.org/file/4-1490368x357.png"/></fig><p>The two methods allow for incorporating additional index returns data and controlling for index performance, respectively. We feel that these contributions can improve the public understanding of the relationship between LETF return volatility and index returns.</p><p>Our methods can model almost any dependence structure that may exist in LETF returns data and each can be used separately if desired. When used together, the two methods complement each other nicely, enabling powerfully customized risk summaries of LETF investing strategies. Finally, the constrained simulation method is not limited to our particular index returns dataset. It can be used to sample any generic multivariate data with a constraint on the sum of the random vector elements.</p></sec><sec id="s7"><title>Acknowledgements</title><p>We thank Dan Cohen, the Editor, and an anonymous reviewer for their helpful comments.</p></sec><sec id="s8"><title>Cite this paper</title><p>MatthewGinley,David W.Scott,Katherine E.Ensor, (2015) Simulation of Leveraged ETF Volatility Using Nonparametric Density Estimation. Journal of Mathematical Finance,05,457-479. doi: 10.4236/jmf.2015.55039</p></sec><sec id="s9"><title>Appendix</title></sec></body><back><ref-list><title>References</title><ref id="scirp.61565-ref1"><label>1</label><mixed-citation publication-type="other" xlink:type="simple">Fisher, D. (2014) Leverage Your Way to a Richer Retirement. Forbes.</mixed-citation></ref><ref id="scirp.61565-ref2"><label>2</label><mixed-citation publication-type="other" xlink:type="simple">Scott, J.S. and Watson, J.G. (2013) The Floor-Leverage Rule for Retirement. Financial Analysts Journal, 69, 45-60. &lt;/br&gt;http://dx.doi.org/10.2469/faj.v69.n5.2</mixed-citation></ref><ref id="scirp.61565-ref3"><label>3</label><mixed-citation publication-type="other" xlink:type="simple">Simpson, S.D. (2015) A Brief History of Exchange-Traded Funds. Investopedia. &lt;/br&gt;http://www.investopedia.com/articles/exchangetradedfunds/12/brief-history-exchange-traded-funds.asp</mixed-citation></ref><ref id="scirp.61565-ref4"><label>4</label><mixed-citation publication-type="other" xlink:type="simple">Yates, T. (2007) Dissecting Leveraged ETF Returns. Investopedia. &lt;/br&gt;http://www.investopedia.com/articles/exchangetradedfunds/07/leveraged-etf.asp</mixed-citation></ref><ref id="scirp.61565-ref5"><label>5</label><mixed-citation publication-type="other" xlink:type="simple">Jarrow, R.A. (2010) Understanding the Risk of Leveraged ETFs. Finance Research Letters, 7, 135-139. &lt;/br&gt;http://dx.doi.org/10.1016/j.frl.2010.04.001</mixed-citation></ref><ref id="scirp.61565-ref6"><label>6</label><mixed-citation publication-type="other" xlink:type="simple">Avellaneda, M. and Zhang, S. (2010) Path-Dependence of Leveraged ETF Returns. SIAM Journal on Financial Mathematics, 1, 586-603.</mixed-citation></ref><ref id="scirp.61565-ref7"><label>7</label><mixed-citation publication-type="other" xlink:type="simple">Lu, L., Wang, J. and Zhang, G. (2012) Long Term Performance of Leveraged ETFs. Financial Services Review, 21, 63-80.</mixed-citation></ref><ref id="scirp.61565-ref8"><label>8</label><mixed-citation publication-type="other" xlink:type="simple">Dobi, D. and Avellaneda, M. (2012) Structural Slippage of Leveraged ETFs. &lt;/br&gt;http://ssrn.com/abstract=2127738</mixed-citation></ref><ref id="scirp.61565-ref9"><label>9</label><mixed-citation publication-type="other" xlink:type="simple">Tuzun, T. (2012) Are Leveraged and Inverse ETFs the New Portfolio Insurers? Technical Report, Fed. Reserve Board, Div. of Research and Stat. and Monetary Affairs, Washington DC.</mixed-citation></ref><ref id="scirp.61565-ref10"><label>10</label><mixed-citation publication-type="other" xlink:type="simple">Cooper, T. (2010) Alpha Generation and Risk Smoothing Using Managed Volatility. &lt;/br&gt;http://ssrn.com/abstract=1664823 &lt;/br&gt;http://dx.doi.org/10.2139/ssrn.1664823</mixed-citation></ref><ref id="scirp.61565-ref11"><label>11</label><mixed-citation publication-type="other" xlink:type="simple">Bouchey, P. and Nemtchinov, V. (2013) BENDING CAPM: Why Do High Volatility Stocks Underperform? Technical Report, Parametric Portfolio.</mixed-citation></ref><ref id="scirp.61565-ref12"><label>12</label><mixed-citation publication-type="other" xlink:type="simple">Direxion Funds (2015) Direxion Daily S&amp;P 500 Bull and Bear 3x Shares Fact Sheet. &lt;/br&gt;http://www.direxioninvestments.com/wp-content/uploads/2014/02/SPXLSPXS-Fact-Sheet.pdf</mixed-citation></ref><ref id="scirp.61565-ref13"><label>13</label><mixed-citation publication-type="other" xlink:type="simple">Direxion Funds (2014) Direxion Daily S&amp;P 500 Bull 3x Prospectus. &lt;/br&gt;http://direxioninvestments.onlineprospectus.net/DirexionInvestments//SPXL/index.html</mixed-citation></ref><ref id="scirp.61565-ref14"><label>14</label><mixed-citation publication-type="other" xlink:type="simple">ETF Database (2014) Definitive List of Leveraged Equities ETFs. &lt;/br&gt;http://etfdb.com/etfdb-category/leveraged-equities</mixed-citation></ref><ref id="scirp.61565-ref15"><label>15</label><mixed-citation publication-type="other" xlink:type="simple">Direxion Funds (2014) Direxion Daily Bull 3x and Bear 3x ETFs. &lt;/br&gt;http://www.direxioninvestments.com/etfs</mixed-citation></ref><ref id="scirp.61565-ref16"><label>16</label><mixed-citation publication-type="other" xlink:type="simple">ProShares (2014) ProShares Products Leveraged 3x and Inverse 3x ETFs. &lt;/br&gt;http://www.proshares.com/funds</mixed-citation></ref><ref id="scirp.61565-ref17"><label>17</label><mixed-citation publication-type="other" xlink:type="simple">Bloomberg (2014) Bloomberg Professional [Online]. Subscription Service.</mixed-citation></ref><ref id="scirp.61565-ref18"><label>18</label><mixed-citation publication-type="other" xlink:type="simple">Ginley, M. (2015) Shortfall from Maximum Convexity. &lt;/br&gt;http://arxiv.org/abs/1510.00941</mixed-citation></ref><ref id="scirp.61565-ref19"><label>19</label><mixed-citation publication-type="other" xlink:type="simple">Markowitz, H. (1952) Portfolio Selection. The Journal of Finance, 7, 77-91. &lt;/br&gt;http://www.jstor.org/stable/2975974</mixed-citation></ref><ref id="scirp.61565-ref20"><label>20</label><mixed-citation publication-type="other" xlink:type="simple">Conover, W.J. (1971) Practical Nonparametric Statistics. 3rd Edition, Wiley, Hoboken.</mixed-citation></ref><ref id="scirp.61565-ref21"><label>21</label><mixed-citation publication-type="other" xlink:type="simple">Scott, D.W. (1992) Multivariate Density Estimation: Theory, Practice, and Visualization. Wiley, Hoboken. &lt;/br&gt;http://dx.doi.org/10.1002/9780470316849</mixed-citation></ref><ref id="scirp.61565-ref22"><label>22</label><mixed-citation publication-type="other" xlink:type="simple">Mardia, K.V., Kent, J.T. and Bibby, J.M. (1979) Multivariate Analysis. Academic Press, London.</mixed-citation></ref></ref-list></back></article>