<?xml version="1.0" encoding="UTF-8"?>
<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Publishing DTD v1.4 20241031//EN" "JATS-journalpublishing1-4.dtd">
<article xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink" article-type="research-article" dtd-version="1.4" xml:lang="en">
  <front>
    <journal-meta>
      <journal-id journal-id-type="publisher-id">ojs</journal-id>
      <journal-title-group>
        <journal-title>Open Journal of Statistics</journal-title>
      </journal-title-group>
      <issn pub-type="epub">2161-7198</issn>
      <issn pub-type="ppub">2161-718X</issn>
      <publisher>
        <publisher-name>Scientific Research Publishing</publisher-name>
      </publisher>
    </journal-meta>
    <article-meta>
      <article-id pub-id-type="doi">10.4236/ojs.2026.164011</article-id>
      <article-id pub-id-type="publisher-id">ojs-152862</article-id>
      <article-categories>
        <subj-group>
          <subject>Article</subject>
        </subj-group>
        <subj-group>
          <subject>Physics</subject>
          <subject>Mathematics</subject>
        </subj-group>
      </article-categories>
      <title-group>
        <article-title>Robustness of Fitted Behavioural Relationships from Limited Geotechnical Datasets: Application to Sand Castle Test Data</article-title>
      </title-group>
      <contrib-group>
        <contrib contrib-type="author">
          <contrib-id contrib-id-type="orcid">0000-0002-7986-8755</contrib-id>
          <name name-style="western">
            <surname>Rönnqvist</surname>
            <given-names>Hans</given-names>
          </name>
          <xref ref-type="aff" rid="aff1">1</xref>
        </contrib>
      </contrib-group>
      <aff id="aff1"><label>1</label> RQV Teknik AB, Hudiksvall, Sweden </aff>
      <author-notes>
        <fn fn-type="conflict" id="fn-conflict">
          <p>The author declares no conflicts of interest regarding the publication of this paper.</p>
        </fn>
      </author-notes>
      <pub-date pub-type="epub">
        <day>03</day>
        <month>08</month>
        <year>2026</year>
      </pub-date>
      <pub-date pub-type="collection">
        <month>08</month>
        <year>2026</year>
      </pub-date>
      <volume>16</volume>
      <issue>04</issue>
      <fpage>247</fpage>
      <lpage>258</lpage>
      <history>
        <date date-type="received">
          <day>21</day>
          <month>06</month>
          <year>2026</year>
        </date>
        <date date-type="accepted">
          <day>26</day>
          <month>07</month>
          <year>2026</year>
        </date>
        <date date-type="published">
          <day>29</day>
          <month>07</month>
          <year>2026</year>
        </date>
      </history>
      <permissions>
        <copyright-statement>© 2026 by the authors and Scientific Research Publishing Inc.</copyright-statement>
        <copyright-year>2026</copyright-year>
        <license license-type="open-access">
          <license-p> This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license ( <ext-link ext-link-type="uri" xlink:href="https://creativecommons.org/licenses/by/4.0/">https://creativecommons.org/licenses/by/4.0/</ext-link> ). </license-p>
        </license>
      </permissions>
      <self-uri content-type="doi" xlink:href="https://doi.org/10.4236/ojs.2026.164011">https://doi.org/10.4236/ojs.2026.164011</self-uri>
      <abstract>
        <p>Engineering decisions are often based on fitted relationships derived from limited datasets, where individual observations may exert disproportionate influence on interpretation. This paper presents a practical framework for assessing the robustness of such relationships using a simple leave-one-out influence analysis. The approach is demonstrated using Sand Castle Test (SCT) data, in which relative compaction (RC) is related to collapse time (<italic>T</italic>) through a logarithmic relationship governing collapsibility and crack-stopping behaviour. The fitted slope is treated as a sensitivity descriptor, while the compaction window ΔRC (15 → 60) provides a physically meaningful measure of behavioural transition. Two case studies illustrate both robust and point-sensitive datasets. A normalised slope influence index is introduced to quantify dependence on individual observations and to identify data points controlling interpretation. Results show that apparently well-defined relationships may be sensitive to single observations, and that uncertainty in slope propagates directly into uncertainty in the inferred transition between collapsible and crack-holding behaviour. The proposed framework links statistical robustness to engineering interpretation by enabling identification of critical data points and supporting more defensible assessment of behaviour. Although demonstrated for SCT data, the approach is broadly applicable to geotechnical problems where fitted relationships are used to define project-specific criteria from limited datasets.</p>
      </abstract>
      <kwd-group kwd-group-type="author-generated" xml:lang="en">
        <kwd>Sand Castle Tests</kwd>
        <kwd>Compaction-Collapse Behaviour</kwd>
        <kwd>Robustness Analysis</kwd>
        <kwd>Geotechnical Data Interpretation</kwd>
        <kwd>Leave-One-Out Influence Analysis</kwd>
      </kwd-group>
    </article-meta>
  </front>
  <body>
    <sec id="sec1">
      <title>1. Introduction</title>
      <p>In many areas of engineering, behavioural interpretation relies on fitted relationships derived from relatively small experimental datasets. This is particularly common in geotechnical engineering, where laboratory testing is time-consuming and datasets are often sparse. Under such conditions, regression relationships may appear well defined while in reality being strongly influenced by individual observations.</p>
      <p>In embankment dam engineering, filters are required both to retain migrating core material and to remain sufficiently collapsible to close developing cracks rather than maintain an open flow path [<xref ref-type="bibr" rid="B1">1</xref>][<xref ref-type="bibr" rid="B2">2</xref>]. Crack-stopping behaviour and controlled collapsibility are therefore closely linked aspects of performance. The Sand Castle Test (SCT) is commonly used to assess this behaviour. In this test, a compacted sand column is subjected to controlled wetting, and the time to collapse provides a measure of apparent cohesion and stability. In practice, results are interpreted using collapse-time markers (notably <italic>T</italic> = 15 min and <italic>T</italic> = 60 min) as introduced by Soroush <italic>et al.</italic> [<xref ref-type="bibr" rid="B3">3</xref>], together with a logarithmic relation between relative compaction (RC) and collapse time (<italic>T</italic>). The resulting RC-log(<italic>T</italic>) representation forms the basis for interpretation, from which quantities such as RC@15 and ΔRC (15 → 60) are derived.</p>
      <p>From a statistical perspective, inference based on small datasets is inherently sensitive to individual observations, and fitted parameters may vary under resampling or leave-one-out procedures [<xref ref-type="bibr" rid="B4">4</xref>]. While formal influence diagnostics exist (e.g. [<xref ref-type="bibr" rid="B5">5</xref>]), their results are not always directly interpretable in engineering terms. There is therefore a need for simple and transparent methods that allow practitioners to assess the robustness of fitted relationships and their implications for behavioural interpretation.</p>
      <p>This need is consistent with long-recognised uncertainties in embankment dam engineering. As emphasised by Milligan [<xref ref-type="bibr" rid="B6">6</xref>], the ability to perform detailed analytical modelling often exceeds the ability to characterise material behaviour and construction conditions with comparable certainty. Peck [<xref ref-type="bibr" rid="B7">7</xref>] similarly noted that failures of earth dams are seldom attributable to deficiencies in analytical methods, but rather to misjudgement of conditions not readily captured by calculation.</p>
      <p>The present study evaluates the robustness of fitted SCT compaction-collapse relationships using a leave-one-out approach. The analysed datasets are drawn from the SCT framework established by Rönnqvist [<xref ref-type="bibr" rid="B8">8</xref>]. While SCT data provide the case study, the methodology is general and applicable wherever behavioural interpretation relies on fitted relationships derived from limited datasets.</p>
      <p>The central question addressed is therefore: how robust are fitted relationships used to interpret engineering behaviour, and to what extent do inferred thresholds depend on specific data points? To address this, a practical framework for robustness assessment is introduced based on leave-one-out influence analysis. The framework links statistical sensitivity to engineering interpretation by distinguishing four aspects: 1) presence of a behavioural threshold, 2) sensitivity of behaviour to the governing variable, 3) transition interval between behavioural states, and 4) robustness of the fitted relation.</p>
    </sec>
    <sec id="sec2">
      <title>2. Methodology and Conceptual Basis</title>
      <p>The conceptual basis of the fitted relation and its engineering projection is illustrated in <xref ref-type="fig" rid="fig1">Figure 1</xref>, which defines the slope <italic>b</italic> and its projection as the compaction window ΔRC (15 → 60).</p>
      <fig id="fig1">
        <label>Figure 1</label>
        <graphic xlink:href="https://html.scirp.org/file/1242031-rId15.jpeg?20260729111540" />
      </fig>
      <p><bold>Figure 1.</bold> Conceptual illustration of the fitted relationship between relative compaction (RC) and collapse time (<italic>T</italic>). The fitted relation follows the form RC = <italic>a</italic> + <italic>b</italic>log<sub>10</sub>(<italic>T</italic>), where <italic>b</italic> represents the slope of the RC-log10(<italic>T</italic>) relationship. The intersections with <italic>T</italic> = 15 min and <italic>T</italic> = 60 min define RC@15 and RC@60, and the vertical difference between these values defines the compaction window ΔRC (15 → 60).</p>
      <sec id="sec2dot1">
        <title>2.1. Fitted Relationship</title>
        <p>The fitted relation between relative compaction and collapse time is expressed as</p>
        <disp-formula id="FD1">
          <label>(1)</label>
          <mml:math>
            <mml:mrow>
              <mml:mtext>RC</mml:mtext>
              <mml:mo>=</mml:mo>
              <mml:mi>a</mml:mi>
              <mml:mo>+</mml:mo>
              <mml:mi>b</mml:mi>
              <mml:msub>
                <mml:mrow>
                  <mml:mi>log</mml:mi>
                </mml:mrow>
                <mml:mrow>
                  <mml:mn>10</mml:mn>
                </mml:mrow>
              </mml:msub>
              <mml:mrow>
                <mml:mo>(</mml:mo>
                <mml:mi>T</mml:mi>
                <mml:mo>)</mml:mo>
              </mml:mrow>
            </mml:mrow>
          </mml:math>
        </disp-formula>
        <p>where <inline-formula><mml:math><mml:mi> a </mml:mi></mml:math></inline-formula> is the intercept and <italic>b</italic> is the slope of the RC-log<sub>1</sub><sub>0</sub><italic>T</italic> relation. The slope represents the rate of change of RC with respect to logarithmic collapse time.</p>
      </sec>
      <sec id="sec2dot2">
        <title>2.2. General Slope Relation and Engineering Projection</title>
        <p>The slope may be obtained from any two points on the fitted line:</p>
        <disp-formula id="FD2">
          <label>(2)</label>
          <mml:math>
            <mml:mrow>
              <mml:mi>b</mml:mi>
              <mml:mo>=</mml:mo>
              <mml:mfrac>
                <mml:mrow>
                  <mml:mi>Δ</mml:mi>
                  <mml:mtext>RC</mml:mtext>
                </mml:mrow>
                <mml:mrow>
                  <mml:mi>Δ</mml:mi>
                  <mml:msub>
                    <mml:mrow>
                      <mml:mi>log</mml:mi>
                    </mml:mrow>
                    <mml:mrow>
                      <mml:mn>10</mml:mn>
                    </mml:mrow>
                  </mml:msub>
                  <mml:mrow>
                    <mml:mo>(</mml:mo>
                    <mml:mi>T</mml:mi>
                    <mml:mo>)</mml:mo>
                  </mml:mrow>
                </mml:mrow>
              </mml:mfrac>
            </mml:mrow>
          </mml:math>
        </disp-formula>
        <p>An engineering transition interval between two collapse times <italic>T</italic><sub>1</sub> and <italic>T</italic><sub>2</sub> is therefore:</p>
        <disp-formula id="FD3">
          <label>(3)</label>
          <mml:math>
            <mml:mrow>
              <mml:mi>Δ</mml:mi>
              <mml:mtext>RC</mml:mtext>
              <mml:mrow>
                <mml:mo>(</mml:mo>
                <mml:mrow>
                  <mml:msub>
                    <mml:mi>T</mml:mi>
                    <mml:mn>1</mml:mn>
                  </mml:msub>
                  <mml:mo>→</mml:mo>
                  <mml:msub>
                    <mml:mi>T</mml:mi>
                    <mml:mn>2</mml:mn>
                  </mml:msub>
                </mml:mrow>
                <mml:mo>)</mml:mo>
              </mml:mrow>
              <mml:mo>=</mml:mo>
              <mml:mi>b</mml:mi>
              <mml:msub>
                <mml:mrow>
                  <mml:mi>log</mml:mi>
                </mml:mrow>
                <mml:mrow>
                  <mml:mn>10</mml:mn>
                </mml:mrow>
              </mml:msub>
              <mml:mrow>
                <mml:mo>(</mml:mo>
                <mml:mrow>
                  <mml:mfrac>
                    <mml:mrow>
                      <mml:msub>
                        <mml:mi>T</mml:mi>
                        <mml:mn>2</mml:mn>
                      </mml:msub>
                    </mml:mrow>
                    <mml:mrow>
                      <mml:msub>
                        <mml:mi>T</mml:mi>
                        <mml:mn>1</mml:mn>
                      </mml:msub>
                    </mml:mrow>
                  </mml:mfrac>
                </mml:mrow>
                <mml:mo>)</mml:mo>
              </mml:mrow>
            </mml:mrow>
          </mml:math>
        </disp-formula>
        <p>For the practical SCT anchors <italic>T</italic> = 15 min and <italic>T</italic> = 60 min:</p>
        <disp-formula id="FD4">
          <label>(4)</label>
          <mml:math>
            <mml:mrow>
              <mml:mi>Δ</mml:mi>
              <mml:mtext>RC</mml:mtext>
              <mml:mrow>
                <mml:mo>(</mml:mo>
                <mml:mrow>
                  <mml:mn>15</mml:mn>
                  <mml:mo>→</mml:mo>
                  <mml:mn>60</mml:mn>
                </mml:mrow>
                <mml:mo>)</mml:mo>
              </mml:mrow>
              <mml:mo>=</mml:mo>
              <mml:mi>b</mml:mi>
              <mml:msub>
                <mml:mrow>
                  <mml:mi>log</mml:mi>
                </mml:mrow>
                <mml:mrow>
                  <mml:mn>10</mml:mn>
                </mml:mrow>
              </mml:msub>
              <mml:mrow>
                <mml:mo>(</mml:mo>
                <mml:mrow>
                  <mml:mfrac>
                    <mml:mrow>
                      <mml:mn>60</mml:mn>
                    </mml:mrow>
                    <mml:mrow>
                      <mml:mn>15</mml:mn>
                    </mml:mrow>
                  </mml:mfrac>
                </mml:mrow>
                <mml:mo>)</mml:mo>
              </mml:mrow>
              <mml:mo>≈</mml:mo>
              <mml:mn>0.60206</mml:mn>
              <mml:mtext>
                 
              </mml:mtext>
              <mml:mi>b</mml:mi>
            </mml:mrow>
          </mml:math>
        </disp-formula>
        <p>Thus, ΔRC (15 → 60), as defined in Equation (4), is a projection of the fitted slope over a specified interval rather than an independent descriptor. Logarithms are expressed in base 10 throughout. The choice of logarithmic base affects only the numerical scaling of the fitted slope and does not influence interpretation.</p>
      </sec>
      <sec id="sec2dot3">
        <title>2.3. Interpretation Variables</title>
        <p>The fitted relation provides three complementary descriptors:</p>
        <p>RC@15: indicator of a behavioural threshold.<italic>b</italic>: sensitivity of RC to logarithmic time.ΔRC (15 → 60): projected transition interval.</p>
      </sec>
      <sec id="sec2dot4">
        <title>2.4. Robustness Assessment</title>
        <p>Robustness is evaluated using leave-one-out regression. Slopes <italic>b</italic><sub>−</sub><italic><sub>i</sub></italic> are computed after removing each observation in turn.</p>
        <disp-formula id="FD5">
          <label>(5)</label>
          <mml:math>
            <mml:mrow>
              <mml:mi>Δ</mml:mi>
              <mml:msub>
                <mml:mi>b</mml:mi>
                <mml:mrow>
                  <mml:mtext>spread</mml:mtext>
                </mml:mrow>
              </mml:msub>
              <mml:mo>=</mml:mo>
              <mml:mi>max</mml:mi>
              <mml:mrow>
                <mml:mo>(</mml:mo>
                <mml:mrow>
                  <mml:msub>
                    <mml:mi>b</mml:mi>
                    <mml:mrow>
                      <mml:mo>−</mml:mo>
                      <mml:mi>i</mml:mi>
                    </mml:mrow>
                  </mml:msub>
                </mml:mrow>
                <mml:mo>)</mml:mo>
              </mml:mrow>
              <mml:mo>−</mml:mo>
              <mml:mi>min</mml:mi>
              <mml:mrow>
                <mml:mo>(</mml:mo>
                <mml:mrow>
                  <mml:msub>
                    <mml:mi>b</mml:mi>
                    <mml:mrow>
                      <mml:mo>−</mml:mo>
                      <mml:mi>i</mml:mi>
                    </mml:mrow>
                  </mml:msub>
                </mml:mrow>
                <mml:mo>)</mml:mo>
              </mml:mrow>
            </mml:mrow>
          </mml:math>
        </disp-formula>
        <disp-formula id="FD6">
          <label>(6)</label>
          <mml:math>
            <mml:mrow>
              <mml:msub>
                <mml:mi>I</mml:mi>
                <mml:mi>b</mml:mi>
              </mml:msub>
              <mml:mo>=</mml:mo>
              <mml:mfrac>
                <mml:mrow>
                  <mml:mi>Δ</mml:mi>
                  <mml:msub>
                    <mml:mi>b</mml:mi>
                    <mml:mrow>
                      <mml:mtext>spread</mml:mtext>
                    </mml:mrow>
                  </mml:msub>
                </mml:mrow>
                <mml:mrow>
                  <mml:mrow>
                    <mml:mo>|</mml:mo>
                    <mml:mi>b</mml:mi>
                    <mml:mo>|</mml:mo>
                  </mml:mrow>
                </mml:mrow>
              </mml:mfrac>
            </mml:mrow>
          </mml:math>
        </disp-formula>
        <p>The index <italic>I</italic><italic><sub>b</sub></italic> defined in Equation (6) quantifies overall sensitivity to individual observations, while Δ<italic>b</italic><italic><sub>i</sub></italic> (Equation (7)) identifies specific influential points: </p>
        <disp-formula id="FD7">
          <label>(7)</label>
          <mml:math>
            <mml:mrow>
              <mml:mi>Δ</mml:mi>
              <mml:msub>
                <mml:mi>b</mml:mi>
                <mml:mi>i</mml:mi>
              </mml:msub>
              <mml:mo>=</mml:mo>
              <mml:mfrac>
                <mml:mrow>
                  <mml:msub>
                    <mml:mi>b</mml:mi>
                    <mml:mrow>
                      <mml:mo>−</mml:mo>
                      <mml:mi>i</mml:mi>
                    </mml:mrow>
                  </mml:msub>
                  <mml:mo>−</mml:mo>
                  <mml:mi>b</mml:mi>
                </mml:mrow>
                <mml:mi>b</mml:mi>
              </mml:mfrac>
            </mml:mrow>
          </mml:math>
        </disp-formula>
        <p>The index <italic>I</italic><italic><sub>b</sub></italic> quantifies overall sensitivity of the fitted slope to individual observations, while Δ<italic>b</italic><italic><sub>i</sub></italic> identifies specific influential points. Low values of <italic>I</italic><italic><sub>b</sub></italic> indicate a stable fitted relationship, whereas higher values indicate increasing dependence on individual observations. In the present examples, values of <italic>I</italic><italic><sub>b</sub></italic> on the order of 0.2 distinguish relatively stable from point-sensitive datasets and are therefore proposed as an indicative threshold for interpretation. <italic>I</italic><italic><sub>b</sub></italic> = 0.2 corresponds approximately to a situation where the total leave-one-out slope spread approaches 20% of the fitted slope magnitude. Further validation across broader datasets is required before general application.</p>
        <p>Beyond this level, changes in the interpreted compaction window become sufficiently large that engineering interpretation may begin to depend noticeably on individual observations rather than the overall material response. The threshold should therefore be viewed as practical engineering guidance rather than a strict statistical limit. For elevated point sensitivity, the practitioner should examine the individual influence values Δ<italic>b</italic><italic><sub>i</sub></italic> to identify which observations control the fitted slope. If a single point strongly steepens the regression, it may be appropriate to assess the alternative, flatter relation obtained when that point is removed and to consider whether this represents a more conservative interpretation for engineering purposes.</p>
      </sec>
      <sec id="sec2dot5">
        <title>2.5. Preferred Basis of Interpretation</title>
        <p>The slope <italic>b</italic> should be determined from the fitted regression rather than from individual point pairs. This approach uses the full dataset, reduces the effect of local scatter and provides a consistent basis for comparison between materials. It also allows interpretation even when <italic>T</italic> = 60 min is not strongly constrained by the achieved data.</p>
      </sec>
      <sec id="sec2dot6">
        <title>2.6. Reference Dependence and Invariance</title>
        <p>Relative compaction RC depends on the chosen compaction reference (for example Modified Proctor or Standard Proctor). Changing reference shifts absolute RC values, and therefore RC@15, but does not affect <italic>b</italic> or ΔRC (15 → 60), which depend only on differences along the fitted relation. This distinction is important when comparing datasets obtained using different compaction standards.</p>
      </sec>
    </sec>
    <sec id="sec3">
      <title>3. Case Study Dataset</title>
      <p>The data analysed in this study originate from the SCT database presented by Rönnqvist [<xref ref-type="bibr" rid="B8">8</xref>], comprising natural and crushed filter materials tested over a range of relative compaction levels. For each specimen, collapse time is measured under controlled wetting and fitted logarithmic compaction-collapse relationships are derived. Method A defines compaction through density, expressed as relative compaction (RC), and measures the time required for collapse of a constructed sand column under controlled wetting.</p>
      <p>In this note, RC is referenced to the maximum dry density obtained from Modified Proctor compaction [<xref ref-type="bibr" rid="B9">9</xref>]. If Standard Proctor compaction [<xref ref-type="bibr" rid="B10">10</xref>] were used instead, the absolute RC values would shift, but the slope b and the derived ΔRC (15 → 60) would remain unchanged because they depend only on differences in RC along the fitted relation. Consequently, quantities such as RC@15 shift with the compaction reference, whereas <italic>b</italic> and ΔRC (15 → 60) do not.</p>
    </sec>
    <sec id="sec4">
      <title>4. Results</title>
      <p>The fitted relationships for the two representative materials are shown in <xref ref-type="fig" rid="fig2">Figure 2</xref>, which illustrates contrasting slopes and compaction windows for Materials A and D, while <xref ref-type="fig" rid="fig3">Figure 3</xref> shows the corresponding leave-one-out influence analysis and variation in slope under omission of individual observations. A quantitative comparison is summarised in <bold>Table 1</bold>, which presents slope, compaction window and robustness metrics for the two materials.</p>
      <fig id="fig2">
        <label>Figure 2</label>
        <graphic xlink:href="https://html.scirp.org/file/1242031-rId32.jpeg?20260729111541" />
      </fig>
      <p><bold>Figure 2.</bold> Fitted compaction-collapse relationships showing relative compaction (RC) as a function of collapse time (<italic>T</italic>, log scale) for Materials A and D. Material A exhibits a stable fitted slope and broad compaction window, whereas Material D shows a flatter slope and narrower transition interval. For Material D, the red dashed line shows the fitted relationship obtained after removal of the most influential observation (Point 5), resulting in a reduction of slope from <italic>b</italic> ≈ 2.76 to <italic>b</italic> ≈ 2.44. This illustrates how individual observations may influence the fitted relationship and the derived compaction window ΔRC (15 → 60).</p>
      <fig id="fig3">
        <label>Figure 3</label>
        <graphic xlink:href="https://html.scirp.org/file/1242031-rId33.jpeg?20260729111541" />
      </fig>
      <p><bold>Figure 3.</bold> Leave-one-out slope analysis showing variation in fitted slope b under omission of individual observations based on sensitive case D. The resulting spread defines the robustness of the fitted relationship and forms the basis for the slope influence index <italic>I</italic><italic><sub>b</sub></italic>.</p>
      <p><bold>Table 1</bold><bold>.</bold> Comparison of fitted relationship parameters for Materials A and D.</p>
      <table-wrap id="tbl1">
        <label>Table 1</label>
        <table>
          <tbody>
            <tr>
              <td>Material</td>
              <td>
                <italic>b</italic>
              </td>
              <td>ΔRC(15 → 60)(%)</td>
              <td>
                R
                <sup>2</sup>
              </td>
              <td>
                <italic>I</italic>
                <italic>
                  <sub>b</sub>
                </italic>
              </td>
              <td>Interpretation</td>
            </tr>
            <tr>
              <td>A</td>
              <td>7.97</td>
              <td>4.7</td>
              <td>0.95</td>
              <td>0.11</td>
              <td>Strong trend, high robustness</td>
            </tr>
            <tr>
              <td>D</td>
              <td>2.76</td>
              <td>1.7</td>
              <td>0.61</td>
              <td>0.20</td>
              <td>Lower correlation, elevated sensitivity</td>
            </tr>
          </tbody>
        </table>
      </table-wrap>
      <p>The fitted relations describe how achieved compaction governs collapse behaviour in the SCT. The slope <italic>b</italic> (Equation (2)) and the derived compaction window ΔRC (15 → 60) (Equation (4)) therefore directly control the interpretation of whether a material remains collapsible or transitions towards crack-holding behaviour. Errors in the fitted slope translate directly into errors in the inferred transition interval and may therefore affect engineering judgement regarding filter performance.</p>
      <sec id="sec4dot1">
        <title>4.1. Example A: Robust Case</title>
        <p>Material A represents a high-correlation case (R<sup>2</sup> ≈ 0.95) with slope <italic>b</italic> ≈ 7.97 and a comparatively wide compaction window ΔRC (15 → 60) ≈ 4.7%. This indicates relatively low sensitivity to densification across the tested range, and a stable interpretation of collapse behaviour with respect to compaction. Leave-one-out analysis yields a low influence index (<italic>I</italic><italic><sub>b</sub></italic> ≈ 0.11), with the largest absolute point influence of about 5.8%, confirming that the fitted slope is highly stable with respect to removal of individual observations. The variation in slope is limited, indicating that the fitted relation is representative of the dataset rather than controlled by specific points.</p>
      </sec>
      <sec id="sec4dot2">
        <title>4.2. Example D: Sensitive Case</title>
        <p>Material D represents a contrasting case with lower correlation (R<sup>2</sup> ≈ 0.61), slope <italic>b</italic> ≈ 2.76, and a narrower compaction window ΔRC (15 → 60) ≈ 1.7%. This indicates higher sensitivity to densification. Leave-one-out analysis yields <italic>I</italic><italic><sub>b</sub></italic> ≈ 0.20, indicating elevated point sensitivity. Removal of individual observations produces noticeable changes in slope, with the largest absolute point influence of about 11.7%, reflecting the greater dependence of the fitted relation on individual observations, and implying that the inferred transition between collapsible and crack-holding behaviour may shift depending on the dataset.</p>
        <p>This effect is illustrated in <xref ref-type="fig" rid="fig2">Figure 2</xref>, where removal of the most influential observation (Point 5) results in a reduction of the fitted slope from <italic>b</italic> ≈ 2.76 to <italic>b</italic> ≈ 2.44. The corresponding flattening of the fitted relationship leads to a reduced compaction window ΔRC (15 → 60), demonstrating how interpretation of collapse behaviour may shift depending on individual observations. This highlights the practical importance of identifying influential data points when interpreting SCT results.</p>
      </sec>
      <sec id="sec4dot3">
        <title>4.3. Comparison</title>
        <p>The comparison shows that regression quality and robustness are related but not identical. The present examples show that moderate R<sup>2</sup> does not necessarily invalidate a fitted trend, while robustness must be evaluated independently, as high correlation alone does not guarantee low point sensitivity. Material A combines high correlation with low sensitivity, whereas Material D exhibits both weaker correlation and greater dependence on individual observations. This highlights the need to evaluate robustness explicitly rather than relying solely on regression metrics.</p>
        <p>The quantitative comparison of slope, compaction window and influence index is provided in <bold>Table 1</bold>, while detailed variation in leave-one-out slopes is summarised in <bold>Table 2</bold>.</p>
        <p><bold>Table 2</bold><bold>.</bold> Summary of leave-one-out slope variation for representative datasets.</p>
        <table-wrap id="tbl2">
          <label>Table 2</label>
          <table>
            <tbody>
              <tr>
                <td>Material</td>
                <td>
                  <italic>b</italic>
                </td>
                <td>
                  max(
                  <italic>b</italic>
                  <sub>−</sub>
                  <italic>
                    <sub>i</sub>
                  </italic>
                  )
                </td>
                <td>
                  min(
                  <italic>b</italic>
                  <sub>−</sub>
                  <italic>
                    <sub>i</sub>
                  </italic>
                  )
                </td>
                <td>
                  <italic>I</italic>
                  <italic>
                    <sub>b</sub>
                  </italic>
                </td>
                <td>
                  Largest Δ
                  <italic>b</italic>
                  <italic>
                    <sub>i</sub>
                  </italic>
                  (%)
                </td>
              </tr>
              <tr>
                <td>A</td>
                <td>7.97</td>
                <td>8.38</td>
                <td>7.51</td>
                <td>0.11</td>
                <td>5.8</td>
              </tr>
              <tr>
                <td>D</td>
                <td>2.76</td>
                <td>2.99</td>
                <td>2.44</td>
                <td>0.20</td>
                <td>11.7</td>
              </tr>
            </tbody>
          </table>
        </table-wrap>
      </sec>
    </sec>
    <sec id="sec5">
      <title>5. Discussion</title>
      <sec id="sec5dot1">
        <title>5.1. Engineering Interpretation of Fitted Relationships</title>
        <p>The interpretation of fitted relationships should be supported by both graphical representation (<xref ref-type="fig" rid="fig1">Figures 1-3</xref>) and quantitative measures (<bold>Tables 1-3</bold>). <xref ref-type="fig" rid="fig1">Figure 1</xref> defines the compaction window concept, <xref ref-type="fig" rid="fig2">Figure 2</xref> presents fitted behaviour, and <xref ref-type="fig" rid="fig3">Figure 3</xref> quantifies robustness, while the tables provide corresponding numerical measures.</p>
        <p><bold>Table 3</bold><bold>.</bold> Most influential observations for Materials A and D based on leave-one-out analysis.</p>
        <table-wrap id="tbl3">
          <label>Table 3</label>
          <table>
            <tbody>
              <tr>
                <td>Material</td>
                <td>Omitted point</td>
                <td>RC (%)</td>
                <td>
                  <italic>T</italic>
                  (min)
                </td>
                <td>
                  <italic>b</italic>
                  <sub>−</sub>
                  <italic>
                    <sub>i</sub>
                  </italic>
                </td>
                <td>
                  Δ
                  <italic>b</italic>
                  <italic>
                    <sub>i</sub>
                  </italic>
                </td>
              </tr>
              <tr>
                <td>D</td>
                <td>5</td>
                <td>79.9</td>
                <td>0.10</td>
                <td>2.44</td>
                <td>−0.117</td>
              </tr>
              <tr>
                <td>D</td>
                <td>13</td>
                <td>79.6</td>
                <td>0.05</td>
                <td>2.44</td>
                <td>−0.117</td>
              </tr>
              <tr>
                <td>D</td>
                <td>15</td>
                <td>87.3</td>
                <td>58.48</td>
                <td>2.99</td>
                <td>0.083</td>
              </tr>
              <tr>
                <td>A</td>
                <td>3</td>
                <td>74.3</td>
                <td>0.55</td>
                <td>7.51</td>
                <td>−0.058</td>
              </tr>
              <tr>
                <td>A</td>
                <td>4</td>
                <td>84.0</td>
                <td>2.90</td>
                <td>8.38</td>
                <td>0.052</td>
              </tr>
              <tr>
                <td>A</td>
                <td>5</td>
                <td>78.0</td>
                <td>2.17</td>
                <td>7.64</td>
                <td>−0.040</td>
              </tr>
            </tbody>
          </table>
        </table-wrap>
        <p>From an engineering perspective, the fitted relationship describes how achieved compaction governs collapse behaviour and therefore crack-stopping ability. The slope <italic>b</italic> (Equation (2)) defines sensitivity, while the compaction window ΔRC (15 → 60) (Equation (4)) expresses the rate of transition between practical collapse-time anchors. A narrow window implies that small variations in achieved density may shift a material from collapsible to crack-holding behaviour, whereas a broader window indicates a more gradual transition. The reliability of this interpretation therefore depends directly on the stability of the fitted slope.</p>
      </sec>
      <sec id="sec5dot2">
        <title>5.2. Statistical Robustness and Point Sensitivity</title>
        <p>Established statistical influence measures, such as Cook’s distance and DFFITS, as well as robust regression techniques, provide formal tools for identifying influential observations in fitted relationships. However, these approaches are not always directly interpretable in terms of engineering quantities. The present framework complements such methods by expressing sensitivity directly in terms of slope variation and the resulting change in interpreted behavioural thresholds, providing a transparent and practically applicable measure of robustness. From a statistical perspective, fitted relationships derived from limited datasets may appear stable while being influenced by individual observations. This sensitivity is quantified using leave-one-out analysis, where the robustness index <italic>I</italic><italic><sub>b</sub></italic> measures overall slope stability and Δ<italic>b</italic><italic><sub>i</sub></italic> identifies specific influential points. It identifies vulnerable data points, quantifies how ΔRC (15 → 60) may shift due to those points, and supports conservative interpretation through alternative, flatter fits when sensitivity is elevated. In the case studies, Material A shows low Δ<italic>b</italic><italic><sub>i</sub></italic> and stable ΔRC, indicating a reliable fit, whereas Material D exhibits influential points that materially alter the slope, requiring targeted scrutiny and cautious interpretation. The practical impact of point sensitivity is illustrated in <xref ref-type="fig" rid="fig2">Figure 2</xref>, where removal of a single influential observation produces a measurable change in slope and corresponding compaction window, demonstrating how statistical sensitivity translates directly into engineering interpretation. Influential observations should not be interpreted solely as statistical anomalies. In geotechnical testing, such points may reflect genuine transitions in material behaviour, for example associated with changes in moisture conditions or structural collapse mechanisms. The present framework therefore identifies sensitivity in the fitted relationship but does not prescribe removal of observations; rather, it highlights cases where interpretation should be supported by experimental judgement.</p>
      </sec>
      <sec id="sec5dot3">
        <title>5.3. Implications for Threshold-Based Interpretation</title>
        <p>This distinction is critical when fitted relationships are used to define behavioural thresholds. High correlation does not guarantee robustness, and moderate correlation does not invalidate a trend. For point-sensitive datasets, interpretation should therefore consider plausible alternative fits derived from removal of influential observations.</p>
        <p>For datasets exhibiting both moderate regression quality and elevated point sensitivity, interpretation should be undertaken conservatively. A practical approach is to consider the most negative Δ<italic>b</italic><italic><sub>i</sub></italic>, corresponding to a flatter fitted relation, as a lower-bound estimate of behaviour. Reductions in fitted slope on the order of 10% - 15% may produce comparable reductions in the derived compaction window ΔRC (15 → 60).</p>
        <p>In practical terms, this may correspond to density differences on the order of tens of kg/m<sup>3</sup>, which are within the range of normal construction variability. Consequently, materials exhibiting narrow compaction windows and elevated sensitivity may transition from collapsible to crack-holding behaviour under routine variations in achieved density. In such cases, apparent collapsibility may be overestimated if robustness is not explicitly considered.</p>
      </sec>
      <sec id="sec5dot4">
        <title>5.4. Link to Proposed Framework</title>
        <p>The combined use of graphical representation, fitted relationships, and robustness metrics provides a consistent framework for interpretation. Engineering behaviour (ΔRC), statistical stability (<italic>I</italic><italic><sub>b</sub></italic> and Δ<italic>b</italic><italic><sub>i</sub></italic>), and practical consequence (density variation) are directly linked, allowing informed and transparent assessment of collapse behaviour from limited datasets.</p>
      </sec>
      <sec id="sec5dot5">
        <title>5.5. Proposed Practical Framework for Robustness Assessment</title>
        <p>The proposed framework is intentionally simple. Its novelty lies not in the statistical method itself, but in its direct application to engineering interpretation. By linking slope sensitivity to a physically meaningful descriptor (ΔRC) and to practical decision-making, the method provides a transparent tool for assessing confidence in fitted relationships derived from limited datasets.</p>
        <p><bold>Proposed</bold><bold>procedure:</bold></p>
        <p><bold>1) Evaluate</bold><bold>robustness</bold></p>
        <p>Fit the RC-log(<italic>T</italic>) relationship and compute <italic>I</italic><italic><sub>b</sub></italic> and Δ<italic>b</italic><italic><sub>i</sub></italic> using leave-one-out analysis. Classify the dataset as robust (low <italic>I</italic><italic><sub>b</sub></italic>) or point-sensitive (elevated <italic>I</italic><italic><sub>b</sub></italic>). In practical implementation, regression fitting in common software environments may use either base-10 or natural logarithms. The choice of logarithmic base does not affect interpretation, provided consistency is maintained. Where natural logarithms are used, the fitted slope should be converted to the equivalent base-10 slope to ensure consistency with the definition of ΔRC (15 → 60). This is achieved by dividing the slope obtained from ln(<italic>T</italic>) by ln(10), <italic>i.e.</italic><italic>b</italic> = <italic>b</italic><italic><sub>ln</sub></italic>/ln(10), where <italic>b</italic><italic><sub>ln</sub></italic> is the slope obtained from the RC-ln(<italic>T</italic>) relation. This conversion ensures that derived quantities remain directly comparable and physically interpretable within the SCT framework.</p>
        <p><bold>2</bold><bold>) Identify</bold><bold>and</bold><bold>verify</bold><bold>influential</bold><bold>observations</bold></p>
        <p>For point-sensitive datasets, examine Δ<italic>b</italic><italic><sub>i</sub></italic> to identify controlling observations. Check data quality, test conditions, and representativeness. Where warranted, repeat laboratory tests or review field data to confirm or refute the influence of these points.</p>
        <p><bold>3</bold><bold>) Adopt</bold><bold>a</bold><bold>defensible</bold><bold>interpretation</bold></p>
        <p>If influential points cannot be conclusively resolved, adopt a conservative interpretation by considering alternative fits (e.g. a flatter slope corresponding to the most negative Δ<italic>b</italic><italic><sub>i</sub></italic>). Translate the resulting change in slope into ΔRC (15 → 60) using Equation (4) and reassess the implied transition between collapsible and crack-holding behaviour.</p>
        <p><bold>4</bold><bold>) Update</bold><bold>engineering</bold><bold>decisions</bold></p>
        <p>Where reduced ΔRC indicates a narrow compaction window, adjust specifications and procedures accordingly (e.g. tighter compaction control, revised acceptance criteria, or additional verification testing) to account for construction variability and reduce the risk of unintended transition to crack-holding behaviour.</p>
        <p>A similar procedure may be applied in other geotechnical contexts where fitted relationships are used to define project-specific criteria, allowing robustness assessment to be linked directly to governing parameters and acceptance thresholds relevant to the problem at hand.</p>
      </sec>
    </sec>
    <sec id="sec6">
      <title>6. Conclusions</title>
      <p>Fitted relationships derived from limited datasets may appear reliable but can be sensitive to individual observations; uncertainty in the fitted slope therefore propagates directly into uncertainty in the compaction window ΔRC (15 → 60) and the inferred transition between collapsible and crack-holding behaviour.Leave-one-out analysis provides a simple and effective diagnostic that quantifies slope stability and identifies influential data points controlling interpretation.The framework enables practical engineering actions, including verification of critical data points and adoption of conservative interpretations based on alternative, flatter fits when sensitivity is elevated.Application to the case studies demonstrates how the method distinguishes between robust and point-sensitive datasets, identifies influential observations, and supports more defensible interpretation of compaction-collapse behaviour.List of Notations </p>
    </sec>
  </body>
  <back>
    <ref-list>
      <title>References</title>
      <ref id="B1">
        <label>1.</label>
        <citation-alternatives>
          <mixed-citation publication-type="journal">Vaughan, P.H. and Soares, H.F. (1982) Design of Filters for Clay Cores of Dams. <italic>Journal</italic><italic>of</italic><italic>the</italic><italic>Geotechnical</italic><italic>Engineering</italic><italic>Division</italic>, 108, 17-31. https://doi.org/10.1061/ajgeb6.0001233 <pub-id pub-id-type="doi">10.1061/ajgeb6.0001233</pub-id><ext-link ext-link-type="uri" xlink:href="https://doi.org/10.1061/ajgeb6.0001233">https://doi.org/10.1061/ajgeb6.0001233</ext-link></mixed-citation>
          <element-citation publication-type="journal">
            <person-group person-group-type="author">
              <string-name>Vaughan, P.H.</string-name>
              <string-name>Soares, H.F.</string-name>
            </person-group>
            <year>1982</year>
            <article-title>Design of Filters for Clay Cores of Dams</article-title>
            <source>Journal of the Geotechnical Engineering Division</source>
            <volume>108</volume>
            <pub-id pub-id-type="doi">10.1061/ajgeb6.0001233</pub-id>
          </element-citation>
        </citation-alternatives>
      </ref>
      <ref id="B2">
        <label>2.</label>
        <citation-alternatives>
          <mixed-citation publication-type="other">FEMA (2011) Filters for Embankment Dams: Best Practices for Design and Construction. Federal Emergency Management Agency, Denver, CO, USA.</mixed-citation>
          <element-citation publication-type="other">
            <person-group person-group-type="author">
              <string-name>Agency, D</string-name>
              <string-name>CO, U</string-name>
            </person-group>
            <year>2011</year>
            <article-title>Filters for Embankment Dams: Best Practices for Design and Construction</article-title>
            <source>Federal Emergency Management Agency</source>
          </element-citation>
        </citation-alternatives>
      </ref>
      <ref id="B3">
        <label>3.</label>
        <citation-alternatives>
          <mixed-citation publication-type="journal">Soroush, A., Tabatabaie Shourijeh, P., Aghajani, H.F., Mohammadinia, A. and Aminzadeh, A. (2012) A Review of the Sand Castle Test for Assessing Collapsibility of Filters in Dams. <italic>Geotechnical</italic><italic>Testing</italic><italic>Journal</italic>, 35, 503-516. https://doi.org/10.1520/gtj103051 <pub-id pub-id-type="doi">10.1520/gtj103051</pub-id><ext-link ext-link-type="uri" xlink:href="https://doi.org/10.1520/gtj103051">https://doi.org/10.1520/gtj103051</ext-link></mixed-citation>
          <element-citation publication-type="journal">
            <person-group person-group-type="author">
              <string-name>Soroush, A.</string-name>
              <string-name>Shourijeh, P.</string-name>
              <string-name>Aghajani, H.F.</string-name>
              <string-name>Mohammadinia, A.</string-name>
              <string-name>Aminzadeh, A.</string-name>
            </person-group>
            <year>2012</year>
            <article-title>A Review of the Sand Castle Test for Assessing Collapsibility of Filters in Dams</article-title>
            <source>Geotechnical Testing Journal</source>
            <volume>35</volume>
            <pub-id pub-id-type="doi">10.1520/gtj103051</pub-id>
          </element-citation>
        </citation-alternatives>
      </ref>
      <ref id="B4">
        <label>4.</label>
        <citation-alternatives>
          <mixed-citation publication-type="other">Efron, B. and Tibshirani, R.J. (1993) An Introduction to the Bootstrap. Chapman &amp; Hall.</mixed-citation>
          <element-citation publication-type="other">
            <person-group person-group-type="author">
              <string-name>Efron, B.</string-name>
              <string-name>Tibshirani, R.J.</string-name>
            </person-group>
            <year>1993</year>
            <article-title>An Introduction to the Bootstrap</article-title>
          </element-citation>
        </citation-alternatives>
      </ref>
      <ref id="B5">
        <label>5.</label>
        <citation-alternatives>
          <mixed-citation publication-type="other">Cook, R.D. (1977) Detection of Influential Observation in Linear Regression. <italic>Technometrics</italic>, 19, 15-18. https://doi.org/10.1080/00401706.1977.10489493 <pub-id pub-id-type="doi">10.1080/00401706.1977.10489493</pub-id><ext-link ext-link-type="uri" xlink:href="https://doi.org/10.1080/00401706.1977.10489493">https://doi.org/10.1080/00401706.1977.10489493</ext-link></mixed-citation>
          <element-citation publication-type="other">
            <person-group person-group-type="author">
              <string-name>Cook, R.D.</string-name>
            </person-group>
            <year>1977</year>
            <article-title>Detection of Influential Observation in Linear Regression</article-title>
            <source>Technometrics</source>
            <volume>19</volume>
            <pub-id pub-id-type="doi">10.1080/00401706.1977.10489493</pub-id>
          </element-citation>
        </citation-alternatives>
      </ref>
      <ref id="B6">
        <label>6.</label>
        <citation-alternatives>
          <mixed-citation publication-type="journal">Milligan, V. (2003) Some Uncertainties in Embankment Dam Engineering. <italic>Journal of Geotechnical and Geoenvironmental Engineering</italic>, 129, 785-797. https://doi.org/10.1061/(asce)1090-0241(2003)129:9(785) <pub-id pub-id-type="doi">10.1061/(asce)1090-0241(2003)129:9(785)</pub-id><ext-link ext-link-type="uri" xlink:href="https://doi.org/10.1061/(asce)1090-0241(2003)129:9(785)">https://doi.org/10.1061/(asce)1090-0241(2003)129:9(785)</ext-link></mixed-citation>
          <element-citation publication-type="journal">
            <person-group person-group-type="author">
              <string-name>Milligan, V.</string-name>
            </person-group>
            <year>2003</year>
            <article-title>Some Uncertainties in Embankment Dam Engineering</article-title>
            <source>Journal of Geotechnical and Geoenvironmental Engineering</source>
            <volume>0241</volume>
            <issue>2003</issue>
            <fpage>9</fpage>
            <pub-id pub-id-type="doi">10.1061/(asce)1090-0241(2003)129:9(785)</pub-id>
          </element-citation>
        </citation-alternatives>
      </ref>
      <ref id="B7">
        <label>7.</label>
        <citation-alternatives>
          <mixed-citation publication-type="journal">Peck, R.B. (1980) “Where Has All the Judgment Gone?” The Fifth Laurits Bjerrum Memorial Lecture. <italic>Canadian Geotechnical Journal</italic>, 17, 584-590. https://doi.org/10.1139/t80-065 <pub-id pub-id-type="doi">10.1139/t80-065</pub-id><ext-link ext-link-type="uri" xlink:href="https://doi.org/10.1139/t80-065">https://doi.org/10.1139/t80-065</ext-link></mixed-citation>
          <element-citation publication-type="journal">
            <person-group person-group-type="author">
              <string-name>Peck, R.B.</string-name>
            </person-group>
            <year>1980</year>
            <article-title>“Where Has All the Judgment Gone?” The Fifth Laurits Bjerrum Memorial Lecture</article-title>
            <source>Canadian Geotechnical Journal</source>
            <volume>17</volume>
            <pub-id pub-id-type="doi">10.1139/t80-065</pub-id>
          </element-citation>
        </citation-alternatives>
      </ref>
      <ref id="B8">
        <label>8.</label>
        <citation-alternatives>
          <mixed-citation publication-type="other">Rönnqvist, H. (2026) Crack-Stopping in Natural and Crushed Filter Materials Assessed Using the Sand Castle Test. <italic>Geotechnique</italic><italic>Letters</italic>. https://doi.org/10.1680/jgele.26.00030 <pub-id pub-id-type="doi">10.1680/jgele.26.00030</pub-id><ext-link ext-link-type="uri" xlink:href="https://doi.org/10.1680/jgele.26.00030">https://doi.org/10.1680/jgele.26.00030</ext-link></mixed-citation>
          <element-citation publication-type="other">
            <year>2026</year>
            <article-title>Crack-Stopping in Natural and Crushed Filter Materials Assessed Using the Sand Castle Test</article-title>
            <pub-id pub-id-type="doi">10.1680/jgele.26.00030</pub-id>
          </element-citation>
        </citation-alternatives>
      </ref>
      <ref id="B9">
        <label>9.</label>
        <citation-alternatives>
          <mixed-citation publication-type="other">ASTM D1557 (2014) Standard Test Methods for Laboratory Compaction Characteristics of Soil Using Modified Effort. ASTM International.</mixed-citation>
          <element-citation publication-type="other">
            <year>2014</year>
            <article-title>Standard Test Methods for Laboratory Compaction Characteristics of Soil Using Modified Effort</article-title>
          </element-citation>
        </citation-alternatives>
      </ref>
      <ref id="B10">
        <label>10.</label>
        <citation-alternatives>
          <mixed-citation publication-type="other">ASTM D698 (2021) Standard Test Methods for Laboratory Compaction Characteristics of Soil Using Standard Effort. ASTM International.</mixed-citation>
          <element-citation publication-type="other">
            <year>2021</year>
            <article-title>Standard Test Methods for Laboratory Compaction Characteristics of Soil Using Standard Effort</article-title>
          </element-citation>
        </citation-alternatives>
      </ref>
    </ref-list>
  </back>
</article>