<?xml version="1.0" encoding="UTF-8"?><!DOCTYPE article  PUBLIC "-//NLM//DTD Journal Publishing DTD v3.0 20080202//EN" "http://dtd.nlm.nih.gov/publishing/3.0/journalpublishing3.dtd"><article xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink" dtd-version="3.0" xml:lang="en" article-type="research article"><front><journal-meta><journal-id journal-id-type="publisher-id">AJPS</journal-id><journal-title-group><journal-title>American Journal of Plant Sciences</journal-title></journal-title-group><issn pub-type="epub">2158-2742</issn><publisher><publisher-name>Scientific Research Publishing</publisher-name></publisher></journal-meta><article-meta><article-id pub-id-type="doi">10.4236/ajps.2018.92018</article-id><article-id pub-id-type="publisher-id">AJPS-81989</article-id><article-categories><subj-group subj-group-type="heading"><subject>Articles</subject></subj-group><subj-group subj-group-type="Discipline-v2"><subject>Biomedical&amp;Life Sciences</subject></subj-group></article-categories><title-group><article-title>
 
 
  Decision Trees as a Tool to Select Sugarcane Families
 
</article-title></title-group><contrib-group><contrib contrib-type="author" xlink:type="simple"><name name-style="western"><surname>Luiz</surname><given-names>A. Peternelli</given-names></name><xref ref-type="aff" rid="aff1"><sup>1</sup></xref><xref ref-type="corresp" rid="cor1"><sup>*</sup></xref></contrib><contrib contrib-type="author" xlink:type="simple"><name name-style="western"><surname>Diego</surname><given-names>P. Bernardes</given-names></name><xref ref-type="aff" rid="aff1"><sup>1</sup></xref></contrib><contrib contrib-type="author" xlink:type="simple"><name name-style="western"><surname>Bruno</surname><given-names>P. Brasileiro</given-names></name><xref ref-type="aff" rid="aff2"><sup>2</sup></xref></contrib><contrib contrib-type="author" xlink:type="simple"><name name-style="western"><surname>Marcio</surname><given-names>H.P. Barbosa</given-names></name><xref ref-type="aff" rid="aff3"><sup>3</sup></xref></contrib><contrib contrib-type="author" xlink:type="simple"><name name-style="western"><surname>Raphael</surname><given-names>H. T. Silva</given-names></name><xref ref-type="aff" rid="aff1"><sup>1</sup></xref></contrib></contrib-group><aff id="aff2"><addr-line>Department of Crop Science and Phytosanitary, Universidade Federal do Paraná, Curitiba, Brazil</addr-line></aff><aff id="aff3"><addr-line>Department of Crop Science, Universidade Federal de Vicosa, Vicosa, Brazil</addr-line></aff><aff id="aff1"><addr-line>Department of Statistics, Universidade Federal de Vicosa, Vicosa, Brazil</addr-line></aff><author-notes><corresp id="cor1">* E-mail:<email>peternelli@ufv.br(LAP)</email>;</corresp></author-notes><pub-date pub-type="epub"><day>18</day><month>01</month><year>2018</year></pub-date><volume>09</volume><issue>02</issue><fpage>216</fpage><lpage>230</lpage><history><date date-type="received"><day>1,</day>	<month>October</month>	<year>2017</year></date><date date-type="rev-recd"><day>22,</day>	<month>January</month>	<year>2018</year>	</date><date date-type="accepted"><day>25,</day>	<month>January</month>	<year>2018</year></date></history><permissions><copyright-statement>&#169; Copyright  2014 by authors and Scientific Research Publishing Inc. </copyright-statement><copyright-year>2014</copyright-year><license><license-p>This work is licensed under the Creative Commons Attribution International License (CC BY). http://creativecommons.org/licenses/by/4.0/</license-p></license></permissions><abstract><p>
 
 
  New strategies are required in the sugarcane selection process to optimize the genetic gains in breeding programs. Conventional selection strategies have the disadvantage of requiring the weighing of all the plants in a plot or a sample of stalks and the counting of the number of stalks in all the experimental plots, which cannot always be performed because more than 200,000 genotypes routinely comprise the first test phase (T1) of most sugarcane breeding programs. One way to circumvent this problem is to use decision trees to rank the yield components (the stalk height, the stalk diameter and the number of stalks) and to subsequently use this categorization to select the best families for a specific trait. The objective of this study was to evaluate the categorization of yield components using the classification and regression tree (CART) algorithm as a family selection strategy by comparing the performance of CART with those of conventional methods that require the weighing of stalks, such as the best linear unbiased prediction (BLUP) with sequential (BLUPS) or individual simulated (BLUPIS) procedures. Data from five experiments performed in May 2007 in a randomized block design were analyzed. Each experiment consisted of five blocks, 22 families and two controls (commercial varieties). CART effectively defined the classes of the yield components and selected the best families with an accuracy of 74% compared to BLUPS and BLUPIS. Families with at least 11 stalks per linear meter of furrow resulted in productivities that were above the average productivity of the commercial varieties used in this study and are, therefore, recommended for selection.
 
</p></abstract><kwd-group><kwd>Statistical Learning</kwd><kwd> Plant Breeding</kwd><kwd> Saccharum Spp.</kwd><kwd> Synthetic Data</kwd><kwd> Supervised Learning</kwd></kwd-group></article-meta></front><body><sec id="s1"><title>1. Introduction</title><p>Genetic breeding programs are central to the sugarcane agribusiness. The use of novel cultivars can increase the average productivity of the Brazilian sugar and alcohol sector and improve the quality of the raw materials used in the production of sugar and ethanol [<xref ref-type="bibr" rid="scirp.81989-ref1">1</xref>] .</p><p>Sugarcane genetic breeding programs usually consist of three test phases (T1, T2 and T3), an experimental phase (EP) and a multiplication phase [<xref ref-type="bibr" rid="scirp.81989-ref2">2</xref>] . Briefly, the first plant selections are performed in the T1 phase. A clone is selected in this phase that is cultivated in the subsequent phases through vegetative propagation. The clones are planted in experimental designs with replicates to identify potentially superior clones. After 8 to 10 years of evaluation, the best clones are used in final evaluation experiments (EP) in different locations, wherein the clones are evaluated for 3 to 5 harvests.</p><p>Although individual visual selection is routinely applied in the early phases of breeding programs [<xref ref-type="bibr" rid="scirp.81989-ref1">1</xref>] [<xref ref-type="bibr" rid="scirp.81989-ref3">3</xref>] , this type of selection has been criticized for its inefficiency in terms of the absence of replicates, plant competition and confounding environmental effects [<xref ref-type="bibr" rid="scirp.81989-ref4">4</xref>] . The aforementioned authors have advocated the use of family selection followed by individual selection to produce greater gains than that obtained via mass selection, especially for low-heritability traits.</p><p>Along this line of thought, some breeding programs have prioritized family selection followed by individual selection to find superior clones [<xref ref-type="bibr" rid="scirp.81989-ref3">3</xref>] [<xref ref-type="bibr" rid="scirp.81989-ref4">4</xref>] [<xref ref-type="bibr" rid="scirp.81989-ref5">5</xref>] . This strategy is motivated by the higher likelihood of finding individuals with favorable traits in families with high genotypic values [<xref ref-type="bibr" rid="scirp.81989-ref5">5</xref>] .</p><p>Reference [<xref ref-type="bibr" rid="scirp.81989-ref6">6</xref>] has shown that predicting genotypic values using the best linear unbiased predictor (BLUP) at individual level (BLUPI) procedure is the optimal sugarcane selection strategy. This procedure simultaneously uses information from families and individuals within families for selection. However, this procedure is seldom used in breeding programs because of the difficulty of collecting data on an individual level.</p><p>Some strategies to overcome this practical problem have been reported in the literature. Reference [<xref ref-type="bibr" rid="scirp.81989-ref3">3</xref>] developed what we shall call sequential BLUP (BLUPS). Families are ranked according to the trait being evaluated (usually tons of stalks per hectare―TSH), and the selection is performed for 40% of the families. The families comprising the 40% with the highest mean TSH are split into four groups. In the group of families with the highest means, 40% of the individuals from each family are selected, and in the other three groups, 30%, 20% and 10% of individuals are selected from each family. Reference [<xref ref-type="bibr" rid="scirp.81989-ref7">7</xref>] proposed the selection of families with genotypic values greater than the overall mean, followed by the simulation of the number of individuals to be selected in each family according to the ratio between the genotypic values of the families and the number of individuals to be selected in the best family. The latter procedure is termed BLUP individual simulated (BLUPIS).</p><p>The difficulties encountered in using BLUPS [<xref ref-type="bibr" rid="scirp.81989-ref3">3</xref>] and BLUPIS [<xref ref-type="bibr" rid="scirp.81989-ref7">7</xref>] in inter-family and intra-family selection are related to the large volume of data that must be collected and the logistics that are required for timely data collection and processing to perform the selection because the data are collected at the end of the crop cycle. At least one representative sample of stalks from each experimental plot must be weighed to use these methods. The difficulties in finding skilled labor and operating costs often restrict the number of families that can be evaluated in the field.</p><p>Alternative data collection methods have been sought to streamline the family selection process by circumventing having to weigh plants from all the plots. Thus, a definition of classes (categorization) for the variables that incorporates crop yield components (the number of stalks, the stalk diameter and the stalk height) could significantly reduce the time expended on data collection, if such a definition were properly defined and experimentally validated. Decision trees can be used to categorize the yield components, specifically by using the classification and regression trees (CART) algorithm [<xref ref-type="bibr" rid="scirp.81989-ref4">4</xref>] , which is a statistical method potentially useful for identifying families with the highest yield potential by combining classes of variables.</p><p>CART involves non-parametric statistical methods that are used in data partitioning through specific rules performed by binary divisions [<xref ref-type="bibr" rid="scirp.81989-ref8">8</xref>] . The objective of this technique is to describe the variability in the dependent variable as a function of the independent variables through binary divisions [<xref ref-type="bibr" rid="scirp.81989-ref9">9</xref>] . Reference [<xref ref-type="bibr" rid="scirp.81989-ref10">10</xref>] has argued that the advantage offered by this technique is that the algorithm evaluates all the possible predictors and divisions. Furthermore, the algorithm may be applied to other data sets that include the same variables used in designing the decision tree.</p><p>The objective of this study was to examine the efficiency of categorizing sugarcane yield components using the CART algorithm for sugarcane family selection to further the development of alternative data collection methods and reduce costs in the initial phase (T1) of sugarcane breeding programs. The efficiency of the algorithm was measured by comparison with the selection performed using conventionally used procedures i.e., BLUPS and BLUPIS.</p></sec><sec id="s2"><title>2. Material and Methods</title><sec id="s2_1"><title>2.1. Plant Material</title><p>In 2006, 110 full-sib families were assessed from biparental crosses performed at the Serra do Ouro Experimental Station of the Federal University of Alagoas, located in the municipality of Murici, Alagoas, Brazil.</p><p>Following acclimatization, the seedlings resulting from the crosses were used in experiments on families in the experimental field of the Sugarcane Research and Breeding Center at the Federal University of Vi&#231;osa, located in the municipality of Orat&#243;rios, Minas Gerais, Brazil at a latitude of 20˚25'S, a longitude of 42˚48'W and a 494-m altitude in a LVe soil. Orat&#243;rios has a climate classified as Aw according to K&#246;ppen and Geiger. The annual average temperature and rainfall are respectively 21.6˚C and 1162 mm.</p><p>Five experiments were performed in May 2007 using a randomized complete block design. Each experiment consisted of five blocks, 22 families and two controls (commercial varieties). The same controls were used in all the experiments. Each plot consisted of 20 plants, which were distributed in two 5-m-long furrows, 1.40 m apart, totaling 12,000 plants. Each family was thus represented by 100 genotypes, which is considered to be a sufficient number for selection within the best families [<xref ref-type="bibr" rid="scirp.81989-ref11">11</xref>] . Agronomic practices including weed control and soil fertilization were the usual for this crop at the experimental station. Field was not irrigated.</p></sec><sec id="s2_2"><title>2.2. Data Collection</title><p>In 2009, the mean stalk height (SH) and stalk diameter (SD) of all plots of the five experiments were assessed. Stalk height (SH) was measured in meters for one stalk from each clump in the plot from the base to the first visible dewlap. Stalk diameter (SD) was measured in centimeters using a digital caliper in the third internode from the stalk base to the apex of one stalk per clump in the plot. In addition to the stalk height and diameter, the total number of stalks per plot (NS) was also counted.</p><p>The total plot mass (TPM), in kg, was determined by weighing all the stalks using a dynamometer. The stalk productivity, in tons of sugarcane per hectare (TSH), was estimated using the equation T S H = T P M &#215; 10 / P A , where TPM is the total mass of the plot in kg, and PA is the plot area in m<sup>2</sup>. In the present study, PA = 14 m<sup>2</sup>.</p></sec><sec id="s2_3"><title>2.3. Selection Using CART</title><p>In this study, regression trees were used to create classes for the three yield component variables. Only the SH, SD, NS and TSH data of the controls that were tested in the experiments, totaling 50 observations, were used in designing the regression trees. However, since regression trees may be incorrectly generated or, in an extreme case, even not generated, if the number of observations is too small, we decided to also simulate control data prior to using the CART algorithm, resulting in a procedure known as “data synthesis”. The use of synthetic data to improve the amount of data for comparing statistical methods or techniques has been previously used in other research works [<xref ref-type="bibr" rid="scirp.81989-ref12">12</xref>] [<xref ref-type="bibr" rid="scirp.81989-ref13">13</xref>] [<xref ref-type="bibr" rid="scirp.81989-ref14">14</xref>] .</p><p>The simulation was performed based on the covariance matrix ∑(4 &#215; 4, positive definite) of the variables TSH, NS, SH and SD of two of the controls that were used in all five experiments. In the simulation algorithm, the Cholesky decomposition of the covariance matrix ∑ was used to generate Σ = C C ′ , where C is a lower triangular matrix m &#215; m known as the Cholesky factor. A normal multivariate vector X = μ + C Z was simulated, where μ is the mean vector of the controls, C is the Cholesky factor derived from the covariance matrix ∑, and Z is a vector of random independent and identically distributed (IID) variables with a standard normal distribution. This procedure was used to generate 1000 row vectors of the type [ X i 1 , X i 2 , X i 3 , X i 4 ] , wherein X<sub>ij</sub> (i = 1 to 1000, and j = 1 to 4) represents the simulated value of the variable j (TSH, NS, SD or SH) for individual i. The algorithm presented ensured that these four variables had a covariance matrix ∑ and a mean vector μ [<xref ref-type="bibr" rid="scirp.81989-ref15">15</xref>] [<xref ref-type="bibr" rid="scirp.81989-ref16">16</xref>] [<xref ref-type="bibr" rid="scirp.81989-ref17">17</xref>] .</p><p>The generated data were subsequently subjected to the standard CART algorithm procedure. The NS distribution is discrete (Poisson) and is characterized by a parameter λ = mean number of stalks per plot; however, this distribution can be approximated by a normal distribution [<xref ref-type="bibr" rid="scirp.81989-ref18">18</xref>] because λ is relatively large (mean = 111.74). Thus, the simulated value was approximated to the nearest integer. Tree pruning was performed according to the 1-SE rule [<xref ref-type="bibr" rid="scirp.81989-ref8">8</xref>] and 10-fold cross-validation [<xref ref-type="bibr" rid="scirp.81989-ref19">19</xref>] methods to generate more accurate estimates, to reduce over fitting and to facilitate the interpretation of results. In summary, regression trees were obtained using simulated data based on the control observations (1000 observation vectors), and pruned (according to the 10-fold cross-validation and the 1-SE rule methods) and unpruned regression trees were obtained using non-simulated data (50 observation vectors).</p><p>Combinations of variables that could produce TSH levels higher than the mean productivity of both controls were located in the generated trees to obtain a clone selection cutoff point. The intra-family selection procedure was subsequently defined as follows: the selected families were split into three classes to define the number of individuals to be selected in each family, as indicated by the CART algorithm. The classes were defined based on the number of replicates (plots) in which the family was selected by the algorithm. The family was selected in each plot (replicate) when the combination of variables used in the classifier met the selection criterion defined by the designed regression tree. The first class consisted of the families selected by CART in all five plots (or replicates) of the family. The second class consisted of the families selected in four replicates. Finally, the third class consisted of the families selected in three replicates. Thus, for the intra-family selection, 30% of the individuals from each family were selected in the best class, followed by 20% and 10% of the individuals from each family in the second and third classes, respectively. Note that other ratios could have been chosen, which could modify the results presented here. The choice reported herein was based on the aforementioned BLUPS procedure. In future studies, we will analyze the best selection ratio within our proposed use of CART.</p></sec><sec id="s2_4"><title>2.4. Selection Using BLUPS and BLUPIS</title><p>The TSH data were analyzed using restricted maximum likelihood (REML)/ BLUP mixed models and a statistical model associated with genotype assessment in an incomplete block design at plot means level by considering the matrix equation [<xref ref-type="bibr" rid="scirp.81989-ref6">6</xref>] y = X r + Z g + W b + e . In this equation y represents the data vector ( y ∼ N ( X r , V ) ) ; r is the presumed fixed effects vector; g is the genotypic effects vector (presumed to be random), where g ∼ N ( 0 , G ) and G = the genetic covariance matrix of genotypes ( G = I σ g 2 ) ; b is the environmental effects vector of the incomplete blocks (presumed to be random), where b ∼ N ( 0 , I σ b 2 ) ; and e is the vector of errors or residuals (random), where e ∼ N ( 0 , R ) , R = residual covariance matrix ( R = I σ e 2 ) . X, Z and W are the incidence matrices for the said effect. The variance components σ g 2 , σ b 2 and σ e 2 correspond to the genotypic variance, the block variance and the residual variance, respectively.</p><p>The selection in the BLUPS procedure was performed following the strategy used by the Australian breeding program [<xref ref-type="bibr" rid="scirp.81989-ref3">3</xref>] to select 40% of the families tested. The selected families were split into four classes based on the TSH means. Each class consisted of 11 families, and 40% of the individuals within each family of the first class and 30%, 20% and 10% of individuals in each family in classes 2, 3 and 4 were selected, respectively.</p><p>In the BLUPIS procedure, the families with TSH means higher than the overall mean were selected [<xref ref-type="bibr" rid="scirp.81989-ref7">7</xref>] . The number of individuals selected from each family k (k = 1 to 52) was calculated using n = ( g ^ k / g ^ j ) n j , wherein g ^ k refers to the estimated genotypic value of family k, g ^ j refers to the estimated genotypic value of the best family, and n<sub>j</sub> is the number of individuals selected from the best family. In the present study, n<sub>j</sub> = 27 individuals were selected from the best family. A mixed models analysis was performed using the SELEGEN-REML/BLUP software [<xref ref-type="bibr" rid="scirp.81989-ref20">20</xref>] .</p></sec><sec id="s2_5"><title>2.5. Comparison between BLUPS, BLUPIS and CART</title><p>Confusion matrices were generated for each tree to facilitate the visualization of the similarities and differences among the selection methods BLUPS and BLUPIS (which were considered as conventional methods and, therefore, considered correct and were subsequently used for comparison purposes) and CART (the method being tested) (<xref ref-type="fig" rid="fig1">Figure 1</xref>).</p><p>This confusion matrix was used to calculate four useful statistical parameters to assess the applicability of the selection method: 1) the choice accuracy (CAc), where CAc = (A + D)/T<sub>ABCD</sub>; 2) the apparent error rate (AER), where AER = 1 − CAc; 3) the selection precision (SeP), where SeP = A/T<sub>AC</sub>; and 4) the error of omission (EOm), where EOm = 1 − SeP.</p><p>The selection obtained using BLUPIS or BLUPS was considered to be the correct selection in the comparisons because these procedures are routinely used in breeding programs.</p><p>The CAc refers to the number of families selected or not selected by CART and BLUPS or BLUPIS relative to the total number of experimental families. The AER corresponds to the selection error. The SeP is the number of families simultaneously selected by CART, BLUPIS or BLUPS divided by the total number of families selected by BLUPS or BLUPIS. Finally, EOm is the error relative to the failure to select some families, as indicated by BLUPS or BLUPIS.</p><p>All the analyses and graphs of the CART algorithm were generated in the free software R [<xref ref-type="bibr" rid="scirp.81989-ref21">21</xref>] using the package rpart() [<xref ref-type="bibr" rid="scirp.81989-ref22">22</xref>] .</p></sec></sec><sec id="s3"><title>3. Results and Discussion</title><p><xref ref-type="table" rid="table1">Table 1</xref> outlines the number of individuals selected from the families with the highest TSH means according to the BLUPS, BLUPIS and CART strategies using the original data (without simulation) and via CART after increasing the volume of control data through simulation. Whereas the families were ranked based on the TSH genotypic means obtained using the BLUPS and BLUPIS procedures, the families selected using CART were ranked based on the number of replicates in which each family was indicated for selection. A total of 52 families were selected using the BLUPIS procedure, corresponding to families that had genotypic means higher than the overall mean of the original population (102 t∙ha<sup>−1</sup>). A total of 44 families were selected using the BLUPS procedure, corresponding to 40% of the 110 families considered in this study. CART selected 52 families when simulation was not used and 49 families following simulation (<xref ref-type="table" rid="table1">Table 1</xref> and <xref ref-type="table" rid="table2">Table 2</xref>).</p><p>Although all the yield components (NS, SD and SH) were used to generate the regression trees, CART discarded the components SH and SD when predicting the TSH values. This result indicates that, according to the data analysis, the number of stalks was the variable that most strongly affected the productivity. Various studies on sugarcane path analysis and logistic regression have shown that NS is more important than other yield components [<xref ref-type="bibr" rid="scirp.81989-ref23">23</xref>] [<xref ref-type="bibr" rid="scirp.81989-ref24">24</xref>] [<xref ref-type="bibr" rid="scirp.81989-ref25">25</xref>] . The aforementioned authors have reported that families and clones with high TSH values can be successfully selected using NS only because NS is the main determinant of variation in TSH.</p><p>For the selection intensity used, BLUPS indicated 40 individuals in the best family for selection, whereas BLUPIS indicated 27 individuals, and CART indicated 30 individuals. Considering the intra-family selection criteria defined in this study, a total of 1100 individuals were indicated for selection by BLUPS, 1077 by BLUPIS, 1022 by CART using non-simulated data, and 890 by CART using simulated data (<xref ref-type="table" rid="table1">Table 1</xref>).</p><p><xref ref-type="table" rid="table2">Table 2</xref> shows the confusion matrices among CART, BLUPS and BLUPIS and the respective measures used to assess the CART efficiency. In the specific</p><table-wrap-group id="1"><label><xref ref-type="table" rid="table1">Table 1</xref></label><caption><title> Genotypic TSH means (u + g) of families selected using BLUPS, BLUPIS and CART using data with and without simulation, number of replicates (plots) wherein each family was selected using CART (Rep) and number of individuals selected within each family (n<sub>k</sub>)</title></caption><table-wrap id="1_1"><table><tbody><thead><tr><th align="center" valign="middle"  rowspan="3"  >Order</th><th align="center" valign="middle"  colspan="6"  >Without simulation</th><th align="center" valign="middle"  colspan="3"  >With simulation</th></tr></thead><tr><td align="center" valign="middle"  rowspan="2"  >Family</td><td align="center" valign="middle"  rowspan="2"  >u + g</td><td align="center" valign="middle"  rowspan="2"  >Rep</td><td align="center" valign="middle"  colspan="3"  >n<sub>k</sub></td><td align="center" valign="middle"  rowspan="2"  >Family</td><td align="center" valign="middle"  rowspan="2"  >Rep</td><td align="center" valign="middle" >n<sub>k</sub></td></tr><tr><td align="center" valign="middle" >BLUPS</td><td align="center" valign="middle" >BLUPIS</td><td align="center" valign="middle" >CART</td><td align="center" valign="middle" >CART</td></tr><tr><td align="center" valign="middle" >1</td><td align="center" valign="middle" >28</td><td align="center" valign="middle" >157.0236</td><td align="center" valign="middle" >5</td><td align="center" valign="middle" >40</td><td align="center" valign="middle" >27</td><td align="center" valign="middle" >30</td><td align="center" valign="middle" >28</td><td align="center" valign="middle" >5</td><td align="center" valign="middle" >30</td></tr><tr><td align="center" valign="middle" >2</td><td align="center" valign="middle" >90</td><td align="center" valign="middle" >156.0278</td><td align="center" valign="middle" >5</td><td align="center" valign="middle" >40</td><td align="center" valign="middle" >27</td><td align="center" valign="middle" >30</td><td align="center" valign="middle" >90</td><td align="center" valign="middle" >4</td><td align="center" valign="middle" >20</td></tr><tr><td align="center" valign="middle" >3</td><td align="center" valign="middle" >42</td><td align="center" valign="middle" >151.0156</td><td align="center" valign="middle" >4</td><td align="center" valign="middle" >40</td><td align="center" valign="middle" >26</td><td align="center" valign="middle" >20</td><td align="center" valign="middle" >42</td><td align="center" valign="middle" >2</td><td align="center" valign="middle" >0</td></tr><tr><td align="center" valign="middle" >4</td><td align="center" valign="middle" >75</td><td align="center" valign="middle" >150.6422</td><td align="center" valign="middle" >3</td><td align="center" valign="middle" >40</td><td align="center" valign="middle" >26</td><td align="center" valign="middle" >10</td><td align="center" valign="middle" >75</td><td align="center" valign="middle" >3</td><td align="center" valign="middle" >10</td></tr><tr><td align="center" valign="middle" >5</td><td align="center" valign="middle" >69</td><td align="center" valign="middle" >150.0833</td><td align="center" valign="middle" >4</td><td align="center" valign="middle" >40</td><td align="center" valign="middle" >26</td><td align="center" valign="middle" >20</td><td align="center" valign="middle" >69</td><td align="center" valign="middle" >5</td><td align="center" valign="middle" >30</td></tr><tr><td align="center" valign="middle" >6</td><td align="center" valign="middle" >39</td><td align="center" valign="middle" >140.8769</td><td align="center" valign="middle" >5</td><td align="center" valign="middle" >40</td><td align="center" valign="middle" >24</td><td align="center" valign="middle" >30</td><td align="center" valign="middle" >39</td><td align="center" valign="middle" >5</td><td align="center" valign="middle" >30</td></tr><tr><td align="center" valign="middle" >7</td><td align="center" valign="middle" >113</td><td align="center" valign="middle" >139.3131</td><td align="center" valign="middle" >5</td><td align="center" valign="middle" >40</td><td align="center" valign="middle" >24</td><td align="center" valign="middle" >30</td><td align="center" valign="middle" >113</td><td align="center" valign="middle" >4</td><td align="center" valign="middle" >20</td></tr><tr><td align="center" valign="middle" >8</td><td align="center" valign="middle" >117</td><td align="center" valign="middle" >137.7323</td><td align="center" valign="middle" >5</td><td align="center" valign="middle" >40</td><td align="center" valign="middle" >24</td><td align="center" valign="middle" >30</td><td align="center" valign="middle" >117</td><td align="center" valign="middle" >5</td><td align="center" valign="middle" >30</td></tr><tr><td align="center" valign="middle" >9</td><td align="center" valign="middle" >106</td><td align="center" valign="middle" >137.2079</td><td align="center" valign="middle" >5</td><td align="center" valign="middle" >40</td><td align="center" valign="middle" >24</td><td align="center" valign="middle" >30</td><td align="center" valign="middle" >106</td><td align="center" valign="middle" >5</td><td align="center" valign="middle" >30</td></tr><tr><td align="center" valign="middle" >10</td><td align="center" valign="middle" >70*</td><td align="center" valign="middle" >136.7379</td><td align="center" valign="middle" >1</td><td align="center" valign="middle" >40</td><td align="center" valign="middle" >24</td><td align="center" valign="middle" >0</td><td align="center" valign="middle" >70</td><td align="center" valign="middle" >1</td><td align="center" valign="middle" >0</td></tr><tr><td align="center" valign="middle" >11</td><td align="center" valign="middle" >38</td><td align="center" valign="middle" >133.924</td><td align="center" valign="middle" >5</td><td align="center" valign="middle" >40</td><td align="center" valign="middle" >23</td><td align="center" valign="middle" >30</td><td align="center" valign="middle" >38</td><td align="center" valign="middle" >5</td><td align="center" valign="middle" >30</td></tr><tr><td align="center" valign="middle" >12</td><td align="center" valign="middle" >26</td><td align="center" valign="middle" >130.6799</td><td align="center" valign="middle" >3</td><td align="center" valign="middle" >30</td><td align="center" valign="middle" >22</td><td align="center" valign="middle" >10</td><td align="center" valign="middle" >26</td><td align="center" valign="middle" >3</td><td align="center" valign="middle" >10</td></tr><tr><td align="center" valign="middle" >13</td><td align="center" valign="middle" >2</td><td align="center" valign="middle" >127.906</td><td align="center" valign="middle" >5</td><td align="center" valign="middle" >30</td><td align="center" valign="middle" >22</td><td align="center" valign="middle" >30</td><td align="center" valign="middle" >2</td><td align="center" valign="middle" >5</td><td align="center" valign="middle" >30</td></tr><tr><td align="center" valign="middle" >14</td><td align="center" valign="middle" >61</td><td align="center" valign="middle" >127.8761</td><td align="center" valign="middle" >5</td><td align="center" valign="middle" >30</td><td align="center" valign="middle" >22</td><td align="center" valign="middle" >30</td><td align="center" valign="middle" >61</td><td align="center" valign="middle" >5</td><td align="center" valign="middle" >30</td></tr><tr><td align="center" valign="middle" >15</td><td align="center" valign="middle" >78</td><td align="center" valign="middle" >127.8528</td><td align="center" valign="middle" >4</td><td align="center" valign="middle" >30</td><td align="center" valign="middle" >22</td><td align="center" valign="middle" >20</td><td align="center" valign="middle" >78</td><td align="center" valign="middle" >4</td><td align="center" valign="middle" >20</td></tr><tr><td align="center" valign="middle" >16</td><td align="center" valign="middle" >27</td><td align="center" valign="middle" >125.4197</td><td align="center" valign="middle" >5</td><td align="center" valign="middle" >30</td><td align="center" valign="middle" >22</td><td align="center" valign="middle" >.30</td><td align="center" valign="middle" >27</td><td align="center" valign="middle" >5</td><td align="center" valign="middle" >30</td></tr><tr><td align="center" valign="middle" >17</td><td align="center" valign="middle" >34</td><td align="center" valign="middle" >124.4823</td><td align="center" valign="middle" >4</td><td align="center" valign="middle" >30</td><td align="center" valign="middle" >21</td><td align="center" valign="middle" >20</td><td align="center" valign="middle" >34</td><td align="center" valign="middle" >4</td><td align="center" valign="middle" >20</td></tr><tr><td align="center" valign="middle" >18</td><td align="center" valign="middle" >66</td><td align="center" valign="middle" >124.1805</td><td align="center" valign="middle" >5</td><td align="center" valign="middle" >30</td><td align="center" valign="middle" >21</td><td align="center" valign="middle" >30</td><td align="center" valign="middle" >66</td><td align="center" valign="middle" >5</td><td align="center" valign="middle" >30</td></tr><tr><td align="center" valign="middle" >19</td><td align="center" valign="middle" >100</td><td align="center" valign="middle" >123.5837</td><td align="center" valign="middle" >3</td><td align="center" valign="middle" >30</td><td align="center" valign="middle" >21</td><td align="center" valign="middle" >10</td><td align="center" valign="middle" >100</td><td align="center" valign="middle" >3</td><td align="center" valign="middle" >10</td></tr><tr><td align="center" valign="middle" >20</td><td align="center" valign="middle" >89</td><td align="center" valign="middle" >121.6171</td><td align="center" valign="middle" >1</td><td align="center" valign="middle" >30</td><td align="center" valign="middle" >21</td><td align="center" valign="middle" >0</td><td align="center" valign="middle" >89</td><td align="center" valign="middle" >1</td><td align="center" valign="middle" >0</td></tr><tr><td align="center" valign="middle" >21</td><td align="center" valign="middle" >81</td><td align="center" valign="middle" >121.2884</td><td align="center" valign="middle" >3</td><td align="center" valign="middle" >30</td><td align="center" valign="middle" >21</td><td align="center" valign="middle" >10</td><td align="center" valign="middle" >81</td><td align="center" valign="middle" >3</td><td align="center" valign="middle" >10</td></tr><tr><td align="center" valign="middle" >22</td><td align="center" valign="middle" >12</td><td align="center" valign="middle" >120.4981</td><td align="center" valign="middle" >4</td><td align="center" valign="middle" >30</td><td align="center" valign="middle" >21</td><td align="center" valign="middle" >20</td><td align="center" valign="middle" >12</td><td align="center" valign="middle" >4</td><td align="center" valign="middle" >20</td></tr><tr><td align="center" valign="middle" >23</td><td align="center" valign="middle" >29</td><td align="center" valign="middle" >119.5196</td><td align="center" valign="middle" >1</td><td align="center" valign="middle" >20</td><td align="center" valign="middle" >21</td><td align="center" valign="middle" >0</td><td align="center" valign="middle" >29</td><td align="center" valign="middle" >1</td><td align="center" valign="middle" >0</td></tr><tr><td align="center" valign="middle" >24</td><td align="center" valign="middle" >43</td><td align="center" valign="middle" >118.4544</td><td align="center" valign="middle" >2</td><td align="center" valign="middle" >20</td><td align="center" valign="middle" >20</td><td align="center" valign="middle" >0</td><td align="center" valign="middle" >43</td><td align="center" valign="middle" >2</td><td align="center" valign="middle" >0</td></tr><tr><td align="center" valign="middle" >25</td><td align="center" valign="middle" >65</td><td align="center" valign="middle" >117.1188</td><td align="center" valign="middle" >4</td><td align="center" valign="middle" >20</td><td align="center" valign="middle" >20</td><td align="center" valign="middle" >20</td><td align="center" valign="middle" >65</td><td align="center" valign="middle" >4</td><td align="center" valign="middle" >20</td></tr><tr><td align="center" valign="middle" >26</td><td align="center" valign="middle" >67</td><td align="center" valign="middle" >116.4488</td><td align="center" valign="middle" >4</td><td align="center" valign="middle" >20</td><td align="center" valign="middle" >20</td><td align="center" valign="middle" >20</td><td align="center" valign="middle" >67</td><td align="center" valign="middle" >3</td><td align="center" valign="middle" >10</td></tr><tr><td align="center" valign="middle" >27</td><td align="center" valign="middle" >7</td><td align="center" valign="middle" >115.7334</td><td align="center" valign="middle" >3</td><td align="center" valign="middle" >20</td><td align="center" valign="middle" >20</td><td align="center" valign="middle" >10</td><td align="center" valign="middle" >7</td><td align="center" valign="middle" >3</td><td align="center" valign="middle" >10</td></tr><tr><td align="center" valign="middle" >28</td><td align="center" valign="middle" >80</td><td align="center" valign="middle" >115.419</td><td align="center" valign="middle" >1</td><td align="center" valign="middle" >20</td><td align="center" valign="middle" >20</td><td align="center" valign="middle" >0</td><td align="center" valign="middle" >80</td><td align="center" valign="middle" >1</td><td align="center" valign="middle" >0</td></tr><tr><td align="center" valign="middle" >29</td><td align="center" valign="middle" >71</td><td align="center" valign="middle" >114.8461</td><td align="center" valign="middle" >4</td><td align="center" valign="middle" >20</td><td align="center" valign="middle" >20</td><td align="center" valign="middle" >20</td><td align="center" valign="middle" >71</td><td align="center" valign="middle" >4</td><td align="center" valign="middle" >20</td></tr><tr><td align="center" valign="middle" >30</td><td align="center" valign="middle" >50</td><td align="center" valign="middle" >114.7471</td><td align="center" valign="middle" >5</td><td align="center" valign="middle" >20</td><td align="center" valign="middle" >20</td><td align="center" valign="middle" >30</td><td align="center" valign="middle" >50</td><td align="center" valign="middle" >5</td><td align="center" valign="middle" >30</td></tr><tr><td align="center" valign="middle" >31</td><td align="center" valign="middle" >25</td><td align="center" valign="middle" >114.2707</td><td align="center" valign="middle" >4</td><td align="center" valign="middle" >20</td><td align="center" valign="middle" >20</td><td align="center" valign="middle" >20</td><td align="center" valign="middle" >25</td><td align="center" valign="middle" >3</td><td align="center" valign="middle" >10</td></tr><tr><td align="center" valign="middle" >32</td><td align="center" valign="middle" >23</td><td align="center" valign="middle" >114.2551</td><td align="center" valign="middle" >2</td><td align="center" valign="middle" >20</td><td align="center" valign="middle" >20</td><td align="center" valign="middle" >0</td><td align="center" valign="middle" >23</td><td align="center" valign="middle" >2</td><td align="center" valign="middle" >0</td></tr></tbody></table></table-wrap><table-wrap id="1_2"><table><tbody><thead><tr><th align="center" valign="middle" >33</th><th align="center" valign="middle" >54</th><th align="center" valign="middle" >114.1181</th><th align="center" valign="middle" >3</th><th align="center" valign="middle" >20</th><th align="center" valign="middle" >20</th><th align="center" valign="middle" >10</th><th align="center" valign="middle" >54</th><th align="center" valign="middle" >3</th><th align="center" valign="middle" >10</th></tr></thead><tr><td align="center" valign="middle" >34</td><td align="center" valign="middle" >84</td><td align="center" valign="middle" >114.0369</td><td align="center" valign="middle" >1</td><td align="center" valign="middle" >10</td><td align="center" valign="middle" >20</td><td align="center" valign="middle" >0</td><td align="center" valign="middle" >84</td><td align="center" valign="middle" >2</td><td align="center" valign="middle" >0</td></tr><tr><td align="center" valign="middle" >35</td><td align="center" valign="middle" >88</td><td align="center" valign="middle" >113.5553</td><td align="center" valign="middle" >3</td><td align="center" valign="middle" >10</td><td align="center" valign="middle" >20</td><td align="center" valign="middle" >10</td><td align="center" valign="middle" >88</td><td align="center" valign="middle" >3</td><td align="center" valign="middle" >10</td></tr><tr><td align="center" valign="middle" >36</td><td align="center" valign="middle" >47</td><td align="center" valign="middle" >111.458</td><td align="center" valign="middle" >0</td><td align="center" valign="middle" >10</td><td align="center" valign="middle" >19</td><td align="center" valign="middle" >0</td><td align="center" valign="middle" >47</td><td align="center" valign="middle" >0</td><td align="center" valign="middle" >0</td></tr><tr><td align="center" valign="middle" >37</td><td align="center" valign="middle" >9</td><td align="center" valign="middle" >108.5093</td><td align="center" valign="middle" >4</td><td align="center" valign="middle" >10</td><td align="center" valign="middle" >19</td><td align="center" valign="middle" >20</td><td align="center" valign="middle" >9</td><td align="center" valign="middle" >3</td><td align="center" valign="middle" >10</td></tr><tr><td align="center" valign="middle" >38</td><td align="center" valign="middle" >111</td><td align="center" valign="middle" >108.037</td><td align="center" valign="middle" >3</td><td align="center" valign="middle" >10</td><td align="center" valign="middle" >19</td><td align="center" valign="middle" >10</td><td align="center" valign="middle" >111</td><td align="center" valign="middle" >3</td><td align="center" valign="middle" >10</td></tr><tr><td align="center" valign="middle" >39</td><td align="center" valign="middle" >76</td><td align="center" valign="middle" >107.3001</td><td align="center" valign="middle" >4</td><td align="center" valign="middle" >10</td><td align="center" valign="middle" >18</td><td align="center" valign="middle" >20</td><td align="center" valign="middle" >76</td><td align="center" valign="middle" >4</td><td align="center" valign="middle" >20</td></tr><tr><td align="center" valign="middle" >40</td><td align="center" valign="middle" >94</td><td align="center" valign="middle" >106.6959</td><td align="center" valign="middle" >2</td><td align="center" valign="middle" >10</td><td align="center" valign="middle" >18</td><td align="center" valign="middle" >0</td><td align="center" valign="middle" >94</td><td align="center" valign="middle" >2</td><td align="center" valign="middle" >0</td></tr><tr><td align="center" valign="middle" >41</td><td align="center" valign="middle" >35</td><td align="center" valign="middle" >105.795</td><td align="center" valign="middle" >3</td><td align="center" valign="middle" >10</td><td align="center" valign="middle" >18</td><td align="center" valign="middle" >10</td><td align="center" valign="middle" >35</td><td align="center" valign="middle" >1</td><td align="center" valign="middle" >0</td></tr><tr><td align="center" valign="middle" >42</td><td align="center" valign="middle" >96</td><td align="center" valign="middle" >105.5061</td><td align="center" valign="middle" >4</td><td align="center" valign="middle" >10</td><td align="center" valign="middle" >18</td><td align="center" valign="middle" >20</td><td align="center" valign="middle" >96</td><td align="center" valign="middle" >4</td><td align="center" valign="middle" >20</td></tr><tr><td align="center" valign="middle" >43</td><td align="center" valign="middle" >63</td><td align="center" valign="middle" >105.3483</td><td align="center" valign="middle" >2</td><td align="center" valign="middle" >10</td><td align="center" valign="middle" >18</td><td align="center" valign="middle" >0</td><td align="center" valign="middle" >63</td><td align="center" valign="middle" >0</td><td align="center" valign="middle" >0</td></tr><tr><td align="center" valign="middle" >44</td><td align="center" valign="middle" >53</td><td align="center" valign="middle" >105.1904</td><td align="center" valign="middle" >4</td><td align="center" valign="middle" >10</td><td align="center" valign="middle" >18</td><td align="center" valign="middle" >20</td><td align="center" valign="middle" >53</td><td align="center" valign="middle" >4</td><td align="center" valign="middle" >20</td></tr><tr><td align="center" valign="middle" >45</td><td align="center" valign="middle" >6</td><td align="center" valign="middle" >104.6934</td><td align="center" valign="middle" >3</td><td align="center" valign="middle" >0</td><td align="center" valign="middle" >18</td><td align="center" valign="middle" >10</td><td align="center" valign="middle" >6</td><td align="center" valign="middle" >3</td><td align="center" valign="middle" >10</td></tr><tr><td align="center" valign="middle" >46</td><td align="center" valign="middle" >72</td><td align="center" valign="middle" >104.3787</td><td align="center" valign="middle" >1</td><td align="center" valign="middle" >0</td><td align="center" valign="middle" >18</td><td align="center" valign="middle" >0</td><td align="center" valign="middle" >72</td><td align="center" valign="middle" >1</td><td align="center" valign="middle" >0</td></tr><tr><td align="center" valign="middle" >47</td><td align="center" valign="middle" >68</td><td align="center" valign="middle" >104.1732</td><td align="center" valign="middle" >2</td><td align="center" valign="middle" >0</td><td align="center" valign="middle" >18</td><td align="center" valign="middle" >0</td><td align="center" valign="middle" >68</td><td align="center" valign="middle" >2</td><td align="center" valign="middle" >0</td></tr><tr><td align="center" valign="middle" >48</td><td align="center" valign="middle" >14</td><td align="center" valign="middle" >104.0509</td><td align="center" valign="middle" >4</td><td align="center" valign="middle" >0</td><td align="center" valign="middle" >18</td><td align="center" valign="middle" >20</td><td align="center" valign="middle" >14</td><td align="center" valign="middle" >4</td><td align="center" valign="middle" >20</td></tr><tr><td align="center" valign="middle" >49</td><td align="center" valign="middle" >24</td><td align="center" valign="middle" >103.9342</td><td align="center" valign="middle" >3</td><td align="center" valign="middle" >0</td><td align="center" valign="middle" >18</td><td align="center" valign="middle" >10</td><td align="center" valign="middle" >24</td><td align="center" valign="middle" >3</td><td align="center" valign="middle" >10</td></tr><tr><td align="center" valign="middle" >50</td><td align="center" valign="middle" >118</td><td align="center" valign="middle" >103.8421</td><td align="center" valign="middle" >1</td><td align="center" valign="middle" >0</td><td align="center" valign="middle" >18</td><td align="center" valign="middle" >0</td><td align="center" valign="middle" >118</td><td align="center" valign="middle" >1</td><td align="center" valign="middle" >0</td></tr><tr><td align="center" valign="middle" >51</td><td align="center" valign="middle" >95</td><td align="center" valign="middle" >103.7601</td><td align="center" valign="middle" >4</td><td align="center" valign="middle" >0</td><td align="center" valign="middle" >18</td><td align="center" valign="middle" >20</td><td align="center" valign="middle" >95</td><td align="center" valign="middle" >4</td><td align="center" valign="middle" >20</td></tr><tr><td align="center" valign="middle" >52</td><td align="center" valign="middle" >101</td><td align="center" valign="middle" >103.5018</td><td align="center" valign="middle" >0</td><td align="center" valign="middle" >0</td><td align="center" valign="middle" >18</td><td align="center" valign="middle" >0</td><td align="center" valign="middle" >101</td><td align="center" valign="middle" >2</td><td align="center" valign="middle" >0</td></tr><tr><td align="center" valign="middle" >53</td><td align="center" valign="middle" >22</td><td align="center" valign="middle" >101.9428</td><td align="center" valign="middle" >5</td><td align="center" valign="middle" >0</td><td align="center" valign="middle" >0</td><td align="center" valign="middle" >30</td><td align="center" valign="middle" >22</td><td align="center" valign="middle" >4</td><td align="center" valign="middle" >20</td></tr><tr><td align="center" valign="middle" >55</td><td align="center" valign="middle" >1</td><td align="center" valign="middle" >101.2394</td><td align="center" valign="middle" >5</td><td align="center" valign="middle" >0</td><td align="center" valign="middle" >0</td><td align="center" valign="middle" >30</td><td align="center" valign="middle" >1</td><td align="center" valign="middle" >4</td><td align="center" valign="middle" >20</td></tr><tr><td align="center" valign="middle" >56</td><td align="center" valign="middle" >55</td><td align="center" valign="middle" >101.1084</td><td align="center" valign="middle" >4</td><td align="center" valign="middle" >0</td><td align="center" valign="middle" >0</td><td align="center" valign="middle" >20</td><td align="center" valign="middle" >55</td><td align="center" valign="middle" >3</td><td align="center" valign="middle" >10</td></tr><tr><td align="center" valign="middle" >60</td><td align="center" valign="middle" >56</td><td align="center" valign="middle" >99.605</td><td align="center" valign="middle" >4</td><td align="center" valign="middle" >0</td><td align="center" valign="middle" >0</td><td align="center" valign="middle" >20</td><td align="center" valign="middle" >56</td><td align="center" valign="middle" >3</td><td align="center" valign="middle" >10</td></tr><tr><td align="center" valign="middle" >61</td><td align="center" valign="middle" >20</td><td align="center" valign="middle" >99.4583</td><td align="center" valign="middle" >3</td><td align="center" valign="middle" >0</td><td align="center" valign="middle" >0</td><td align="center" valign="middle" >10</td><td align="center" valign="middle" >20</td><td align="center" valign="middle" >3</td><td align="center" valign="middle" >10</td></tr><tr><td align="center" valign="middle" >63</td><td align="center" valign="middle" >45</td><td align="center" valign="middle" >98.8018</td><td align="center" valign="middle" >4</td><td align="center" valign="middle" >0</td><td align="center" valign="middle" >0</td><td align="center" valign="middle" >20</td><td align="center" valign="middle" >45</td><td align="center" valign="middle" >4</td><td align="center" valign="middle" >20</td></tr><tr><td align="center" valign="middle" >65</td><td align="center" valign="middle" >103</td><td align="center" valign="middle" >97.8211</td><td align="center" valign="middle" >4</td><td align="center" valign="middle" >0</td><td align="center" valign="middle" >0</td><td align="center" valign="middle" >20</td><td align="center" valign="middle" >103</td><td align="center" valign="middle" >4</td><td align="center" valign="middle" >20</td></tr><tr><td align="center" valign="middle" >66</td><td align="center" valign="middle" >109</td><td align="center" valign="middle" >97.158</td><td align="center" valign="middle" >3</td><td align="center" valign="middle" >0</td><td align="center" valign="middle" >0</td><td align="center" valign="middle" >10</td><td align="center" valign="middle" >109</td><td align="center" valign="middle" >3</td><td align="center" valign="middle" >10</td></tr><tr><td align="center" valign="middle" >69</td><td align="center" valign="middle" >17</td><td align="center" valign="middle" >96.0743</td><td align="center" valign="middle" >4</td><td align="center" valign="middle" >0</td><td align="center" valign="middle" >0</td><td align="center" valign="middle" >20</td><td align="center" valign="middle" >17</td><td align="center" valign="middle" >3</td><td align="center" valign="middle" >10</td></tr><tr><td align="center" valign="middle" >71</td><td align="center" valign="middle" >64</td><td align="center" valign="middle" >95.8345</td><td align="center" valign="middle" >3</td><td align="center" valign="middle" >0</td><td align="center" valign="middle" >0</td><td align="center" valign="middle" >10</td><td align="center" valign="middle" >64</td><td align="center" valign="middle" >3</td><td align="center" valign="middle" >10</td></tr><tr><td align="center" valign="middle" >82</td><td align="center" valign="middle" >49</td><td align="center" valign="middle" >87.8862</td><td align="center" valign="middle" >4</td><td align="center" valign="middle" >0</td><td align="center" valign="middle" >0</td><td align="center" valign="middle" >20</td><td align="center" valign="middle" >49</td><td align="center" valign="middle" >4</td><td align="center" valign="middle" >20</td></tr><tr><td align="center" valign="middle" >83</td><td align="center" valign="middle" >4</td><td align="center" valign="middle" >85.0302</td><td align="center" valign="middle" >3</td><td align="center" valign="middle" >0</td><td align="center" valign="middle" >0</td><td align="center" valign="middle" >10</td><td align="center" valign="middle" >4</td><td align="center" valign="middle" >3</td><td align="center" valign="middle" >10</td></tr><tr><td align="center" valign="middle" >84</td><td align="center" valign="middle" >3</td><td align="center" valign="middle" >84.9651</td><td align="center" valign="middle" >4</td><td align="center" valign="middle" >0</td><td align="center" valign="middle" >0</td><td align="center" valign="middle" >20</td><td align="center" valign="middle" >3</td><td align="center" valign="middle" >4</td><td align="center" valign="middle" >20</td></tr><tr><td align="center" valign="middle" >93</td><td align="center" valign="middle" >11</td><td align="center" valign="middle" >75.5039</td><td align="center" valign="middle" >3</td><td align="center" valign="middle" >0</td><td align="center" valign="middle" >0</td><td align="center" valign="middle" >10</td><td align="center" valign="middle" >11</td><td align="center" valign="middle" >0</td><td align="center" valign="middle" >0</td></tr><tr><td align="center" valign="middle"  colspan="4"  >Total</td><td align="center" valign="middle" >1100</td><td align="center" valign="middle" >1077</td><td align="center" valign="middle" >1020</td><td align="center" valign="middle" ></td><td align="center" valign="middle" >Total</td><td align="center" valign="middle" >890</td></tr></tbody></table></table-wrap></table-wrap-group><p>*Families not selected using CART because they failed to exhibit satisfactory results (≥11 stalks/m) in at least 50% of plots are shown in bold.</p><table-wrap id="table2" ><label><xref ref-type="table" rid="table2">Table 2</xref></label><caption><title> Confusion matrices between the family selection strategies using CART, BLUPIS and BLUPS, together with measures of choice accuracy (CAc), apparent error rate (AER), selection precision (SeP) and error of omission (EOm) for the original data (without simulation) and following simulation (with simulation)</title></caption><table><tbody><thead><tr><th align="center" valign="middle"  colspan="7"  >Without simulation</th></tr></thead><tr><td align="center" valign="middle"  rowspan="2"  >CART</td><td align="center" valign="middle"  colspan="2"  >BLUPIS</td><td align="center" valign="middle"  rowspan="2"  >Total</td><td align="center" valign="middle"  colspan="2"  >BLUPS</td><td align="center" valign="middle"  rowspan="2"  >Total</td></tr><tr><td align="center" valign="middle" >S</td><td align="center" valign="middle" >N</td><td align="center" valign="middle" >S</td><td align="center" valign="middle" >N</td></tr><tr><td align="center" valign="middle" >S*</td><td align="center" valign="middle" >38</td><td align="center" valign="middle" >14</td><td align="center" valign="middle" >52</td><td align="center" valign="middle" >34</td><td align="center" valign="middle" >18</td><td align="center" valign="middle" >52</td></tr><tr><td align="center" valign="middle" >N</td><td align="center" valign="middle" >14</td><td align="center" valign="middle" >44</td><td align="center" valign="middle" >58</td><td align="center" valign="middle" >10</td><td align="center" valign="middle" >48</td><td align="center" valign="middle" >58</td></tr><tr><td align="center" valign="middle" >Total</td><td align="center" valign="middle" >52</td><td align="center" valign="middle" >58</td><td align="center" valign="middle" >110</td><td align="center" valign="middle" >44</td><td align="center" valign="middle" >66</td><td align="center" valign="middle" >110</td></tr><tr><td align="center" valign="middle" >CAc (AER)</td><td align="center" valign="middle"  colspan="3"  >0.745 (0.255)</td><td align="center" valign="middle"  colspan="3"  >0.745 (0.255)</td></tr><tr><td align="center" valign="middle" >SeP (EOm)</td><td align="center" valign="middle"  colspan="3"  >0.731 (0.269)</td><td align="center" valign="middle"  colspan="3"  >0.773 (0.227)</td></tr><tr><td align="center" valign="middle"  colspan="7"  >With simulation</td></tr><tr><td align="center" valign="middle"  rowspan="2"  >CART</td><td align="center" valign="middle"  colspan="2"  >BLUPIS</td><td align="center" valign="middle"  rowspan="2"  >Total</td><td align="center" valign="middle"  colspan="2"  >BLUPS</td><td align="center" valign="middle"  rowspan="2"  >Total</td></tr><tr><td align="center" valign="middle" >S</td><td align="center" valign="middle" >N</td><td align="center" valign="middle" >S</td><td align="center" valign="middle" >N</td></tr><tr><td align="center" valign="middle" >S</td><td align="center" valign="middle" >36</td><td align="center" valign="middle" >13</td><td align="center" valign="middle" >49</td><td align="center" valign="middle" >32</td><td align="center" valign="middle" >17</td><td align="center" valign="middle" >49</td></tr><tr><td align="center" valign="middle" >N</td><td align="center" valign="middle" >16</td><td align="center" valign="middle" >45</td><td align="center" valign="middle" >61</td><td align="center" valign="middle" >12</td><td align="center" valign="middle" >49</td><td align="center" valign="middle" >61</td></tr><tr><td align="center" valign="middle" >Total</td><td align="center" valign="middle" >52</td><td align="center" valign="middle" >58</td><td align="center" valign="middle" >110</td><td align="center" valign="middle" >44</td><td align="center" valign="middle" >66</td><td align="center" valign="middle" >110</td></tr><tr><td align="center" valign="middle" >CAc (AER)</td><td align="center" valign="middle"  colspan="3"  >0.736 (0.264)</td><td align="center" valign="middle"  colspan="3"  >0.736 (0.264)</td></tr><tr><td align="center" valign="middle" >SeP (EOm)</td><td align="center" valign="middle"  colspan="3"  >0.692 (0.308)</td><td align="center" valign="middle"  colspan="3"  >0.727 (0.273)</td></tr></tbody></table></table-wrap><p>*S = selected families, N = non-selected families.</p><p>context of sugarcane family selection, the higher the choice accuracy (CAc) and the smaller the error of omission (EOm) are, the better is the CART performance. In a breeding program, the error of omission (EOm) is more compromising than the error of selecting more families improperly, that is, the error corresponding to B/TAB. The genotypes that pass to the next phase, coming from the families improperly selected by CART, would be subjected to new selection cycles within the breeding program, where these genotypes could then be excluded, if necessary. That is, the performance of CART improves for a higher number of correct predictions of selected and non-selected families (higher CAc), as indicated by the other procedures (BLUPS or BLUPIS), and a smaller number of families selected using BLUPS and BLUPIS and discarded by CART (smaller EOm).</p><p>Using non-simulated data, CART identified 38 of 52 families selected by BLUPIS (SeP = 0.731), that is, 73% of families with high TSH values (<xref ref-type="table" rid="table2">Table 2</xref>). CART failed to select 14 families selected by BLUPIS, resulting in an EOm = 0.269. Coincidentally, 14 other families not selected by BLUPIS were selected by CART. This error corresponds to another type of selection error, which is less compromising than the EOm because the genotypes selected in the respective families are assessed in the subsequent stages of the breeding program, where these genotypes may be eventually excluded from the breeding population, as previously mentioned. Similar reasoning applies when comparing the apparent error from CART selection relative to BLUPS selection (EOm = 0.227, <xref ref-type="table" rid="table2">Table 2</xref>).</p><p>The CART choice accuracy values were similar to those obtained using BLUPIS and BLUPS (CAc = 0.745). In practical terms, this result indicates that CART successfully predicted 74.5% of the families selected or non-selected by BLUPS or BLUPIS, even when only using the number of stalks in the plot. This accuracy ratio is greater than 0.5 (p-value = 1.26e−07), a value that would be expected by chance if selection using CART had no relationship whatsoever with the other methods.</p><p>CART, based only on NS, indicated the selection of 52 families, 14 (26.9%) of which would not have been selected by BLUPIS and 18 of which would not have been selected by BLUPS (<xref ref-type="table" rid="table2">Table 2</xref>). When considering only potentially superior families, that is, those families that should be selected, CART exhibited significant selection precision compared to BLUPIS (SeP = 0.731, p-value = 0.0005976, H<sub>0</sub>:π = 0.5) or BLUPS (SeP = 0.727, p-value = 0.0001941, H<sub>0</sub>:π = 0.5). These percentages were relatively low but ensured that there was a reasonable amount of potential families in the subsequent stages of the breeding program at a rather reduced operation cost because only NS data were required.</p><p>According to [<xref ref-type="bibr" rid="scirp.81989-ref26">26</xref>] , approximately 60% of the best genotypes are concentrated in 10% of the best families, and little can be gained by selecting more than 20% of the families. Therefore, the use of the CART algorithm and the selection rate from the BLUPIS and BLUPS methods should ensure the selection of 10% to 20% of the best families, and the best individuals would consequently be assessed in the second test phase (T2).</p><p>When considering only simulated data, the CART choice accuracy values were also similar to those obtained using BLUPIS or BLUPS, with CAc = 0.736. The results obtained using simulated data (synthetic data) were actually very similar to those obtained using non-simulated data, most likely because of the relatively large number of control data (a total of 25 plots per control, which contributed data for the CART algorithm). Using simulation data prior to the CART procedure has the potential advantage of enabling the means for ideotypes (ideal families) to be simulated at the researcher’s discretion, which can be used to define which families to select from those present in a specific experiment. The results in <xref ref-type="table" rid="table2">Table 2</xref> show the relevancy of the simulation procedure because the measures of the choice accuracy and the selection precision of the simulated and non-simulated data were rather similar, indicating sustained algorithm performance. Furthermore, the simulation can enable offsetting limited control data in a specific experiment. In the extreme case of the absence of controls, data could be simulated if the researcher is able to define a mean vector and a covariance matrix for the variables of interest according to the study population and considering the environment in which the selection is performed. This information could be retrieved from historical records from other experiments that have been conducted at the same location, for example, or from other studies reporting the information.</p><p>The use of tree pruning (1-SE rule or 10-fold cross-validation methods) to generate more accurate estimates resulted in no changes in the trees obtained, both for the simulated and non-simulated data. There was no change in the trees for which the pruning procedure was used because the algorithm could reach the optimal tree without using a fit to the model, which may have resulted from the good volume and quality of the data that were used in the analyses.</p><p><xref ref-type="fig" rid="fig2">Figure 2</xref> shows the regression tree with the non-simulated data generated by CART. The mean productivity of the controls was 145.81 TSH. Productivities higher than this value were generated by families with NS values higher than 110.5. That is, the NS was ranked into two classes, of which the first consisted of families with total NS values per plot below 110.5, and the second consisted of families with corresponding values above 110.5. This cutoff point between the classes corresponded to at least 11 stalks per linear meter of furrow because the plots consisted of two five-meter furrows.</p><p><xref ref-type="fig" rid="fig3">Figure 3</xref> shows the regression tree with the simulated data. The productivities generated for this tree were higher than 145.81 TSH when the total NS per plot was higher than 113.4, that is, at least 11 stalks per linear meter, which corroborated the result found using only the original data. However, the increase in the volume of data via simulation enabled additional classes of predicted values for TSH to be defined according to the total NS per plot of the family, which may be advantageous within the family selection process. Thus, it would be sufficient to select families with 13 to 15 stalks per linear meter if the breeder aims to select families with predicted TSH values ranging from 157 to 180 t∙ha<sup>−1</sup>. A NS per linear meter above 15 and below 18 would indicate families with predicted TSH values ranging from approximately 180 to 200 t∙ha<sup>−1</sup>. Families with more than 18 stalks per linear meter would be associated with predicted TSH values above 230 t∙ha<sup>−1</sup>. Although the yield components SD and SH are not included in the regression tree generated by CART, the breeder should assess these traits and others, including the disease resistance, the lateral bud outgrowth, the internode length, the growth habits and other agronomic aspects of plants, for selection in families with higher productivity potential.</p><table-wrap id="table3" ><label><xref ref-type="table" rid="table3">Table 3</xref></label><caption><title> Mean of the selected population (Ms), in tons of stalks per hectare (TSH), and number of families (nf) selected using the BLUPS, BLUPIS and CART selection strategies</title></caption><table><tbody><thead><tr><th align="center" valign="middle"  rowspan="2"  ></th><th align="center" valign="middle"  rowspan="2"  >BLUPS</th><th align="center" valign="middle"  rowspan="2"  >BLUPIS</th><th align="center" valign="middle"  colspan="2"  >CART</th></tr></thead><tr><td align="center" valign="middle" >NSim*</td><td align="center" valign="middle" >SimD</td></tr><tr><td align="center" valign="middle" >Ms</td><td align="center" valign="middle" >123.4621</td><td align="center" valign="middle" >120.4744</td><td align="center" valign="middle" >115.5319</td><td align="center" valign="middle" >115.8233</td></tr><tr><td align="center" valign="middle" >nf</td><td align="center" valign="middle" >44</td><td align="center" valign="middle" >52</td><td align="center" valign="middle" >52</td><td align="center" valign="middle" >49</td></tr></tbody></table></table-wrap><p>*NSim = non-simulated data; SimD = simulated data.</p><p>The mean of the population selected by CART was lower than that selected by BLUP and BLUPIS for both the simulated and non-simulated data (<xref ref-type="table" rid="table3">Table 3</xref>). This result was obtained because CART selected families with TSH genotypic means below the overall mean of the original population (<xref ref-type="table" rid="table1">Table 1</xref>). However, the considerable advantage offered by CART is that the entire plot does not need to be weighed, which is necessary in the application of BLUPS or BLUPIS. Counting the number of stalks alone can be used to obtain a highly accurate selection of the best families when using CART.</p><p>The CART selection strategy may reduce operational costs because a smaller amount of manpower and a shorter execution time are required both to establish the experiments and to evaluate the families, which may result in a more efficient process of individual selection in the initial phases of sugarcane genetic breeding programs.</p></sec><sec id="s4"><title>4. Conclusions</title><p>The CART algorithm effectively defined the classes of yield components followed by family selection with a mean accuracy of 74% compared to the BLUPIS and BLUPS selection procedures, which are usually applied in most sugarcane breeding programs.</p><p>A regression tree based only on the number of stalks per plot was sufficient to predict the sugarcane productivity classes. This study shows that families with more than 11 stalks per linear meter of furrow are potentially more productive and should be selected and inspected for other agronomic characteristics.</p><p>Data simulation based on the covariance matrix between variables collected in controls had no effect on the results assessed in the present study because the NS showed a high correlation with the TSH.</p></sec><sec id="s5"><title>Acknowledgements</title><p>We thank CNPq, FAPEMIG, and CAPES for financial support and RIDESA (Inter-University Network for the Development of Sugarcane Industry) and PMGCA-UFV, for providing the dataset.</p></sec><sec id="s6"><title>Cite this paper</title><p>Peternelli, L.A., Bernardes, D.P., Brasileiro, B.P., Barbosa, M.H.P. and Silva, R.H.T. (2018) Decision Trees as a Tool to Select Sugarcane Families. American Journal of Plant Sciences, 9, 216-230. https://doi.org/10.4236/ajps.2018.92018</p></sec></body><back><ref-list><title>References</title><ref id="scirp.81989-ref1"><label>1</label><mixed-citation publication-type="other" xlink:type="simple">Barbosa, M.H.P., Resende, M.D.V., Dias, L.A.S., Barbosa, G.V.S., Oliveira, R.A., Peternelli, L.A. and Daros, E. (2012) Genetic Improvement of Sugar Cane for Bioenergy: The Brazilian Experience in Network Research with RIDESA. Crop Breeding and Applied Biotechnology, 12, 87-98.  
https://doi.org/10.1590/S1984-70332012000500010</mixed-citation></ref><ref id="scirp.81989-ref2"><label>2</label><mixed-citation publication-type="book" xlink:type="simple">Barbosa, M.H.P., Silveira, L.C.I. (2012) Breeding and Cultivar Recommendations. In: Santos, F., Borém, A. and Caldas, C. Eds., Sugarcane: Bioenergy, Sugar and Ethanol—Technology and Prospects. Suprema, Vicosa, MG, 568 p.</mixed-citation></ref><ref id="scirp.81989-ref3"><label>3</label><mixed-citation publication-type="other" xlink:type="simple">Stringer, J.K., Cox, M.C., Atkin, F.C., Wei, X. and Hogarth, D.M. (2011) Family Selection Improves the Efficiency and Effectiveness of Selecting Original Seedlings and Parents. Sugar Tech, 13, 36-41. https://doi.org/10.1007/s12355-011-0073-5</mixed-citation></ref><ref id="scirp.81989-ref4"><label>4</label><mixed-citation publication-type="other" xlink:type="simple">Kimbeng, C.A. and Cox, M.C. (2003) Early Generation Selection of Sugarcane Families and Clones in Australia: A Review. Journal American Society of Sugarcane Technologists, 23, 20-39.</mixed-citation></ref><ref id="scirp.81989-ref5"><label>5</label><mixed-citation publication-type="other" xlink:type="simple">Resende, M.D.V. and Barbosa, M.H.P. (2005) Melhoramento genético de plantas de propagacao assexuada. [Genetic Breeding of Plants with Asexual Propagation.] Embrapa, Colombo, Paraná.</mixed-citation></ref><ref id="scirp.81989-ref6"><label>6</label><mixed-citation publication-type="other" xlink:type="simple">Resende, M.D.V. (2002) Genética biométrica e estatística no melhoramento de plantas perenes. [Biometric and Statistical Genetics in the Improvement of Perennial Plants.] Embrapa, Brasília.</mixed-citation></ref><ref id="scirp.81989-ref7"><label>7</label><mixed-citation publication-type="other" xlink:type="simple">Resende, M.D.V. and Barbosa, M.H.P. (2006) Selection via Simulated Blup Based on Family Genotypic Effects in Sugarcane. Pesquisa Agropecuária Brasileira, 41, 421-429. https://doi.org/10.1590/S0100-204X2006000300008</mixed-citation></ref><ref id="scirp.81989-ref8"><label>8</label><mixed-citation publication-type="other" xlink:type="simple">Breiman, L., Friedman, J., Stone, C.J. and Olshen, S.A. (1984) Classification and Regression Trees. Chapman &amp; Hall/CRC, Belmont, CA.</mixed-citation></ref><ref id="scirp.81989-ref9"><label>9</label><mixed-citation publication-type="other" xlink:type="simple">Finch, H. and Schneider, M.K. (2007) Classification Accuracy of Neural Networks vs. Discriminant Analysis Logistic Regression, and Classification and Regression Trees. Methodology, 3, 47-57. https://doi.org/10.1027/1614-2241.3.2.47</mixed-citation></ref><ref id="scirp.81989-ref10"><label>10</label><mixed-citation publication-type="other" xlink:type="simple">Scholes D., Yu, O., Raebel, M.A., Trabert, B. and Holt, V.L. (2011) Improving Automated Case Finding for Ectopic Pregnancy Using a Classification Algorithm. Human Reproduction, 26, 3163-3168. https://doi.org/10.1093/humrep/der299</mixed-citation></ref><ref id="scirp.81989-ref11"><label>11</label><mixed-citation publication-type="other" xlink:type="simple">Leite, M.S.O., Peternelli, L.A., Barbosa, M.H.P., Cecon, P.R. and Cruz, C.D. (2009) Sample Size for Full-Sib Family Evaluation in Sugarcane. Pesquisa Agropecuária Brasileira, 44, 1562-1574. https://doi.org/10.1590/S0100-204X2009001200002</mixed-citation></ref><ref id="scirp.81989-ref12"><label>12</label><mixed-citation publication-type="other" xlink:type="simple">Moreira, E.F.A. and Peternelli, L.A. (2015) Sugarcane Families Selection in Early Stages Based on Classification by Discriminant Linear Analysis. Revista Brasileira de Biometria, 33, 484-493. https://doi.org/10.1590/S1984-70332013000200008</mixed-citation></ref><ref id="scirp.81989-ref13"><label>13</label><mixed-citation publication-type="other" xlink:type="simple">Peternelli, L.A., Moreira, E.F.A., Nascimento, M. and Cruz, C.D. (2017) Artificial Neural Networks and Linear Discriminant Analysis in Early Selection among Sugarcane Families. Crop Breeding and Applied Biotechnology, 17, 299-305.  
https://doi.org/10.1590/1984-70332017v17n4a46</mixed-citation></ref><ref id="scirp.81989-ref14"><label>14</label><mixed-citation publication-type="other" xlink:type="simple">Nascimento, M., Peternelli, L.A., Cruz, C.D., Nascimento, A.C.C., Ferreira, R.P., Bhering, L.L., Salgado, C.C. (2013) Artificial Neural Network for Adaptability and Stability Evaluation in Alfalfa Genotypes. Crop Breeding and Applied Biotechnology, 13, 152-156. https://doi.org/10.1590/S1984-70332013000200008</mixed-citation></ref><ref id="scirp.81989-ref15"><label>15</label><mixed-citation publication-type="other" xlink:type="simple">Cressie, N.A.C. (2015) Statistics for Spatial Data. Revised Edition, John Wiley &amp; Sons, Inc., New York. https://doi.org/10.1002/9781119115151</mixed-citation></ref><ref id="scirp.81989-ref16"><label>16</label><mixed-citation publication-type="other" xlink:type="simple">Haining, R. (2005) Spatial Data Analysis—Theory and Practice. Cambridge University Press, Cambridge.</mixed-citation></ref><ref id="scirp.81989-ref17"><label>17</label><mixed-citation publication-type="other" xlink:type="simple">Santos, A.C. and Ferreira, D.F. (2003) Sample Size Definition using Monte Carlo Simulation for the Normality Test Based on Skewness and Kurtosis. II. Multivariate Approach. Ciência Agrotécnica, 27, 62-69.  
https://doi.org/10.1590/S1413-70542003000100007</mixed-citation></ref><ref id="scirp.81989-ref18"><label>18</label><mixed-citation publication-type="other" xlink:type="simple">Casella, G. and Berger, R.L. (2002) Statistical Inference. 2nd Edition, Duxbury Press, Pacific Grove.</mixed-citation></ref><ref id="scirp.81989-ref19"><label>19</label><mixed-citation publication-type="other" xlink:type="simple">Faraway, J.J. (2006) Extending the Linear Model with R. Generalized Linear, Mixed Effects and Nonparametric Regression. Chapman &amp; Hall/CRC, New York.</mixed-citation></ref><ref id="scirp.81989-ref20"><label>20</label><mixed-citation publication-type="other" xlink:type="simple">Resende, M.D.V. (2016) Selegen-REML/BLUP: A Useful Tool for Plant Breeding. Crop Breeding and Applied Biotechnology, 16, 330-339.  
https://doi.org/10.1590/1984-70332016v16n4a49</mixed-citation></ref><ref id="scirp.81989-ref21"><label>21</label><mixed-citation publication-type="other" xlink:type="simple">R Core Team (2015) R: A Language and Environment for Statistical Computing. R Foundation for Statistical Computing, Vienna. http://www.R-project.org/</mixed-citation></ref><ref id="scirp.81989-ref22"><label>22</label><mixed-citation publication-type="other" xlink:type="simple">Therneau, T., Atkinson, B. and Ripley, B. (2014) Rpart: Recursive Partitioning and Regression Trees. R Package Version 4.1-8.  
http://CRAN.R-project.org/package=rpart</mixed-citation></ref><ref id="scirp.81989-ref23"><label>23</label><mixed-citation publication-type="other" xlink:type="simple">Brasileiro, B.P., Peternelli, L.A. and Barbosa, M.H.P. (2013) Consistency of the Results of Path Analysis among Sugarcane Experiments. Crop Breeding and Applied Biotechnology, 13, 113-119. https://doi.org/10.1590/S1984-70332013000200003</mixed-citation></ref><ref id="scirp.81989-ref24"><label>24</label><mixed-citation publication-type="other" xlink:type="simple">Espósito, D.P., Peternelli, L.A., Paula, T.O.M. and Barbosa, M.H.P. (2012) Path Analysis using Phenotypic and Genotypic Values for Yield Components in the Selection of Sugarcane Families. Ciência Rural, 42, 38-44.  
https://doi.org/10.1590/S0103-84782011005000152</mixed-citation></ref><ref id="scirp.81989-ref25"><label>25</label><mixed-citation publication-type="other" xlink:type="simple">Zhou, M.M., Kimbeng, C.A., Tew, T.L., Gravois, K.A., Pontif, M. and Bischoff, K.P. (2014) Logistic Regression Models to Aid Selection in Early Stages of Sugarcane Breeding. Sugar Tech, 16, 150-156. https://doi.org/10.1007/s12355-013-0266-1</mixed-citation></ref><ref id="scirp.81989-ref26"><label>26</label><mixed-citation publication-type="other" xlink:type="simple">Simmonds, N.W. (1996) Family Selection in Plant Breeding. Euphytica, 90, 201-208.  
https://doi.org/10.1007/BF00023859</mixed-citation></ref></ref-list></back></article>