<?xml version="1.0" encoding="UTF-8"?><!DOCTYPE article  PUBLIC "-//NLM//DTD Journal Publishing DTD v3.0 20080202//EN" "http://dtd.nlm.nih.gov/publishing/3.0/journalpublishing3.dtd"><article xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink" dtd-version="3.0" xml:lang="en" article-type="research article"><front><journal-meta><journal-id journal-id-type="publisher-id">JBiSE</journal-id><journal-title-group><journal-title>Journal of Biomedical Science and Engineering</journal-title></journal-title-group><issn pub-type="epub">1937-6871</issn><publisher><publisher-name>Scientific Research Publishing</publisher-name></publisher></journal-meta><article-meta><article-id pub-id-type="doi">10.4236/jbise.2019.124017</article-id><article-id pub-id-type="publisher-id">JBiSE-92102</article-id><article-categories><subj-group subj-group-type="heading"><subject>Articles</subject></subj-group><subj-group subj-group-type="Discipline-v2"><subject>Biomedical&amp;Life Sciences</subject></subj-group></article-categories><title-group><article-title>
 
 
  Correlation of Combined Characters of Amino Acid and Whole Protein with Success Rate of Crystallization of &lt;i&gt;Lactobacillus&lt;/i&gt; Proteins
 
</article-title></title-group><contrib-group><contrib contrib-type="author" xlink:type="simple"><name name-style="western"><surname>Shaomin</surname><given-names>Yan</given-names></name><xref ref-type="aff" rid="aff1"><sup>1</sup></xref><xref ref-type="corresp" rid="cor1"><sup>*</sup></xref></contrib><contrib contrib-type="author" xlink:type="simple"><name name-style="western"><surname>Guang</surname><given-names>Wu</given-names></name><xref ref-type="aff" rid="aff1"><sup>1</sup></xref><xref ref-type="corresp" rid="cor1"><sup>*</sup></xref></contrib></contrib-group><aff id="aff1"><addr-line>State Key Laboratory of Non-food Biomass Enzyme Technology, National Engineering Research Center for Non-Food Biorefinery, Guangxi Key Laboratory of Biorefinery, Guangxi Academy of Sciences, Nanning, China</addr-line></aff><pub-date pub-type="epub"><day>22</day><month>04</month><year>2019</year></pub-date><volume>12</volume><issue>04</issue><fpage>245</fpage><lpage>256</lpage><history><date date-type="received"><day>18,</day>	<month>February</month>	<year>2019</year></date><date date-type="rev-recd"><day>25,</day>	<month>April</month>	<year>2019</year>	</date><date date-type="accepted"><day>28,</day>	<month>April</month>	<year>2019</year></date></history><permissions><copyright-statement>&#169; Copyright  2014 by authors and Scientific Research Publishing Inc. </copyright-statement><copyright-year>2014</copyright-year><license><license-p>This work is licensed under the Creative Commons Attribution International License (CC BY). http://creativecommons.org/licenses/by/4.0/</license-p></license></permissions><abstract><p>
 
 
  Crystallization of proteins is a very delicate process, which is influenced by many known and unknown factors. Of tested factors, many factors are exclusively related to individual amino-acid characters such as molecular weight or protein characters such as protein length. It is considered necessary to test factors that combine both individual amino-acid characters and protein characters with respect to success rate of crystallization. In this study, two combined characters characterizing individual amino-acid character and protein character, amino acid distribution probability and future composition, were used to correlate the success rate of crystallization of proteins from
  <em> Lactobacillus</em> via modeling. The results obtained from logistic regression and neural network were compared against the results obtained from each of 533 individual amino-acid characters. This study demonstrated that the combined characters are involved in crystallization process and should be taken into account for predicting the success rate of crystallization process.
 
</p></abstract><kwd-group><kwd>Amino Acid Character</kwd><kwd> Distribution Probability</kwd><kwd> Future Composition</kwd><kwd> &lt;i&gt;Lactobacillus&lt;/i&gt;</kwd><kwd> Protein Crystallization</kwd></kwd-group></article-meta></front><body><sec id="s1"><title>1. Introduction</title><p>Crystallization of proteins is a very delicate process and costs time, because many known and unknown factors influence the process of crystallization. Therefore, it is hoped that a law between affecting factors and crystallization can be found to facilitate this process, i.e. to predict whether its protein is likely to be crystallized. Over last years, intensive efforts are made to search various factors, and then correlate these factors with the success rate of crystallization of proteins [1-8]. Technically, these factors should be numeric in order to correlate with success rate of crystallization. Efforts have become less impressed recently because almost all known factors have been tested without much improvement on predictions. Of tested factors, many factors are exclusively related to individual amino-acid characters, for example, molecular weight of amino acid, whereas a small number of tested factors are related to the whole protein characters, for example, the length of a protein.</p><p>Really, it is necessary to correlate the factors that combine both individual amino-acid characters and whole protein characters with the rate of protein crystallization. This is because 1) an individual amino-acid character is a fixed numerically number, for example, molecular weight, no matter whether an amino acid is in a protein or exists individually, and 2) protein characters appear simple in the previous studies. In fact, there is a combined character, i.e. the amino acid composition that represents very basic character of proteins and has been widely used in various analyses. However, new combined characters are needed in order to understand the nature of protein from different angles.</p><p>Over the last decade, we have developed three combined characters characterizing individual amino acid and protein together, and we have applied them to many different studies, for example, protein evolution, drug target designing, determination of mutation patterns, analysis of genetic disorder, protein structure and function, and prediction of mutation of influenza A viruses [9-12]. The results demonstrate the applicability and advantage of the combined characters, thus it is our desire to correlate these combined characters with the success rate of crystallization of proteins.</p><p>Technically, the relationship between various factors and success rate of crystallization of proteins was established via modeling, because it is impossible to run a control experiment without individual amino-acid characters and protein characters. So far, logistic regression was a major tool to model the relationship, because whether a protein can be crystallized is a yes-no event while protein sequences were encoded using individual amino-acid characters [4-6]. In this study, an attempt was made to test the role of combined characters in crystallization of Lactobacillus proteins via logistic regression and neural network model, whose results were compared with the results obtained from each of 531 individual amino-acid characters.</p><p>We chose Lactobacillus, not only because it is important for human health with food industrial perspective [13-15], but also because big efforts were made to crystallize its proteins. The sample of data is relatively larger than proteins from other species of interests [<xref ref-type="bibr" rid="scirp.92102-ref16">16</xref>].</p></sec><sec id="s2"><title>2. Materials and Methods</title><sec id="s2_1"><title>2.1. Data</title><p>314 proteins from Lactobacillus were found in TargetDB [<xref ref-type="bibr" rid="scirp.92102-ref16">16</xref>] under the criterion of purified proteins before 2011, of which 141 were found under the criterion of crystallized protein. Those two criteria were used in previous studies [17-22].</p></sec><sec id="s2_2"><title>2.2. Combined Characters</title><p>The combined characters means that a character that combines a character of an individual amino acid and a character of a protein in terms of numerical value. For example, the molecular weight of an amino acid is a character of an individual amino acid and is unchangeable no matter where the given amino acid is located at any position in a protein. Although it is true that the molecular weight is unchangeable, the amino acid should affect the crystallization of a protein differently when it is located at different position. Similarly, the length of protein is a character associated with a whole protein, however it losses the individuality of composed amino acids, because the proteins with same length do not grantee the same crystallization propensity because they can have different amino acid compositions. So it is important to have a combined character forming from both the character of an individual amino and the character of a whole protein.</p><p>The first combined character is the amino acid distribution probability, which is based on the occupancy of subpopulations and partitions [<xref ref-type="bibr" rid="scirp.92102-ref23">23</xref>] with its online computation [<xref ref-type="bibr" rid="scirp.92102-ref24">24</xref>]. Two worked examples were listed in columns 8 and 9 of <xref ref-type="table" rid="table1">Table 1</xref> to show how this combined character is different from protein to protein.</p><table-wrap id="table1" ><label><xref ref-type="table" rid="table1">Table 1</xref></label><caption><title> Comparison of characters of individual amino acid and combined character of individual amino acid and of a whole protein</title></caption><table><tbody><thead><tr><th align="center" valign="middle"  rowspan="2"  >Amino Acid</th><th align="center" valign="middle"  colspan="2"  >Number</th><th align="center" valign="middle"  colspan="2"  >OOBM850101</th><th align="center" valign="middle"  colspan="2"  >OOBM850101 &#215; Number</th><th align="center" valign="middle"  colspan="2"  >Distribution probability</th><th align="center" valign="middle"  colspan="2"  >Future composition, %</th></tr></thead><tr><td align="center" valign="middle" >Protein 1</td><td align="center" valign="middle" >Protein 2</td><td align="center" valign="middle" >Protein 1</td><td align="center" valign="middle" >Protein 2</td><td align="center" valign="middle" >Protein 1</td><td align="center" valign="middle" >Protein 2</td><td align="center" valign="middle" >Protein 1</td><td align="center" valign="middle" >Protein 2</td><td align="center" valign="middle" >Protein 1</td><td align="center" valign="middle" >Protein 2</td></tr><tr><td align="center" valign="middle" >A</td><td align="center" valign="middle" >29</td><td align="center" valign="middle" >23</td><td align="center" valign="middle" >2.01</td><td align="center" valign="middle" >2.01</td><td align="center" valign="middle" >58.29</td><td align="center" valign="middle" >46.23</td><td align="center" valign="middle" >0.0069</td><td align="center" valign="middle" >0.0153</td><td align="center" valign="middle" >9.00</td><td align="center" valign="middle" >8.12</td></tr><tr><td align="center" valign="middle" >R</td><td align="center" valign="middle" >10</td><td align="center" valign="middle" >8</td><td align="center" valign="middle" >0.84</td><td align="center" valign="middle" >0.84</td><td align="center" valign="middle" >8.4</td><td align="center" valign="middle" >6.72</td><td align="center" valign="middle" >0.0008</td><td align="center" valign="middle" >0.2243</td><td align="center" valign="middle" >7.10</td><td align="center" valign="middle" >6.82</td></tr><tr><td align="center" valign="middle" >N</td><td align="center" valign="middle" >9</td><td align="center" valign="middle" >7</td><td align="center" valign="middle" >0.03</td><td align="center" valign="middle" >0.03</td><td align="center" valign="middle" >0.27</td><td align="center" valign="middle" >0.21</td><td align="center" valign="middle" >0.1475</td><td align="center" valign="middle" >0.3213</td><td align="center" valign="middle" >3.60</td><td align="center" valign="middle" >3.78</td></tr><tr><td align="center" valign="middle" >D</td><td align="center" valign="middle" >6</td><td align="center" valign="middle" >21</td><td align="center" valign="middle" >−2.05</td><td align="center" valign="middle" >−2.05</td><td align="center" valign="middle" >−12.3</td><td align="center" valign="middle" >−43.05</td><td align="center" valign="middle" >0.1543</td><td align="center" valign="middle" >0.0270</td><td align="center" valign="middle" >4.64</td><td align="center" valign="middle" >4.06</td></tr><tr><td align="center" valign="middle" >C</td><td align="center" valign="middle" >1</td><td align="center" valign="middle" >0</td><td align="center" valign="middle" >1.98</td><td align="center" valign="middle" >1.98</td><td align="center" valign="middle" >1.98</td><td align="center" valign="middle" >0</td><td align="center" valign="middle" >1.0000</td><td align="center" valign="middle" >0.0000</td><td align="center" valign="middle" >1.71</td><td align="center" valign="middle" >2.04</td></tr><tr><td align="center" valign="middle" >E</td><td align="center" valign="middle" >15</td><td align="center" valign="middle" >6</td><td align="center" valign="middle" >1.02</td><td align="center" valign="middle" >1.02</td><td align="center" valign="middle" >15.3</td><td align="center" valign="middle" >6.12</td><td align="center" valign="middle" >0.0196</td><td align="center" valign="middle" >0.3472</td><td align="center" valign="middle" >4.44</td><td align="center" valign="middle" >4.92</td></tr><tr><td align="center" valign="middle" >Q</td><td align="center" valign="middle" >13</td><td align="center" valign="middle" >12</td><td align="center" valign="middle" >0.93</td><td align="center" valign="middle" >0.93</td><td align="center" valign="middle" >12.09</td><td align="center" valign="middle" >11.16</td><td align="center" valign="middle" >0.0221</td><td align="center" valign="middle" >0.1241</td><td align="center" valign="middle" >3.09</td><td align="center" valign="middle" >2.76</td></tr><tr><td align="center" valign="middle" >G</td><td align="center" valign="middle" >22</td><td align="center" valign="middle" >15</td><td align="center" valign="middle" >0.12</td><td align="center" valign="middle" >0.12</td><td align="center" valign="middle" >2.64</td><td align="center" valign="middle" >1.8</td><td align="center" valign="middle" >0.0878</td><td align="center" valign="middle" >0.0981</td><td align="center" valign="middle" >7.69</td><td align="center" valign="middle" >6.49</td></tr><tr><td align="center" valign="middle" >H</td><td align="center" valign="middle" >5</td><td align="center" valign="middle" >5</td><td align="center" valign="middle" >−0.14</td><td align="center" valign="middle" >−0.14</td><td align="center" valign="middle" >−0.7</td><td align="center" valign="middle" >−0.7</td><td align="center" valign="middle" >0.1920</td><td align="center" valign="middle" >0.3840</td><td align="center" valign="middle" >3.20</td><td align="center" valign="middle" >4.13</td></tr><tr><td align="center" valign="middle" >I</td><td align="center" valign="middle" >14</td><td align="center" valign="middle" >12</td><td align="center" valign="middle" >3.7</td><td align="center" valign="middle" >3.7</td><td align="center" valign="middle" >51.8</td><td align="center" valign="middle" >44.4</td><td align="center" valign="middle" >0.0550</td><td align="center" valign="middle" >0.1241</td><td align="center" valign="middle" >5.28</td><td align="center" valign="middle" >5.27</td></tr><tr><td align="center" valign="middle" >L</td><td align="center" valign="middle" >17</td><td align="center" valign="middle" >23</td><td align="center" valign="middle" >2.73</td><td align="center" valign="middle" >2.73</td><td align="center" valign="middle" >46.41</td><td align="center" valign="middle" >62.79</td><td align="center" valign="middle" >0.0183</td><td align="center" valign="middle" >0.0791</td><td align="center" valign="middle" >7.71</td><td align="center" valign="middle" >9.86</td></tr><tr><td align="center" valign="middle" >K</td><td align="center" valign="middle" >12</td><td align="center" valign="middle" >9</td><td align="center" valign="middle" >2.55</td><td align="center" valign="middle" >2.55</td><td align="center" valign="middle" >30.6</td><td align="center" valign="middle" >22.95</td><td align="center" valign="middle" >0.0621</td><td align="center" valign="middle" >0.1475</td><td align="center" valign="middle" >3.96</td><td align="center" valign="middle" >3.00</td></tr><tr><td align="center" valign="middle" >M</td><td align="center" valign="middle" >5</td><td align="center" valign="middle" >6</td><td align="center" valign="middle" >1.75</td><td align="center" valign="middle" >1.75</td><td align="center" valign="middle" >8.75</td><td align="center" valign="middle" >10.5</td><td align="center" valign="middle" >0.1920</td><td align="center" valign="middle" >0.2315</td><td align="center" valign="middle" >1.82</td><td align="center" valign="middle" >1.66</td></tr><tr><td align="center" valign="middle" >F</td><td align="center" valign="middle" >3</td><td align="center" valign="middle" >9</td><td align="center" valign="middle" >2.68</td><td align="center" valign="middle" >2.68</td><td align="center" valign="middle" >8.04</td><td align="center" valign="middle" >24.12</td><td align="center" valign="middle" >0.6667</td><td align="center" valign="middle" >0.1770</td><td align="center" valign="middle" >2.59</td><td align="center" valign="middle" >2.99</td></tr><tr><td align="center" valign="middle" >P</td><td align="center" valign="middle" >4</td><td align="center" valign="middle" >14</td><td align="center" valign="middle" >0.41</td><td align="center" valign="middle" >0.41</td><td align="center" valign="middle" >1.64</td><td align="center" valign="middle" >5.74</td><td align="center" valign="middle" >0.0938</td><td align="center" valign="middle" >0.0550</td><td align="center" valign="middle" >5.09</td><td align="center" valign="middle" >6.07</td></tr><tr><td align="center" valign="middle" >S</td><td align="center" valign="middle" >14</td><td align="center" valign="middle" >9</td><td align="center" valign="middle" >1.47</td><td align="center" valign="middle" >1.47</td><td align="center" valign="middle" >20.58</td><td align="center" valign="middle" >13.23</td><td align="center" valign="middle" >0.0550</td><td align="center" valign="middle" >0.0492</td><td align="center" valign="middle" >7.24</td><td align="center" valign="middle" >6.73</td></tr><tr><td align="center" valign="middle" >T</td><td align="center" valign="middle" >14</td><td align="center" valign="middle" >11</td><td align="center" valign="middle" >2.39</td><td align="center" valign="middle" >2.39</td><td align="center" valign="middle" >33.46</td><td align="center" valign="middle" >26.29</td><td align="center" valign="middle" >0.1649</td><td align="center" valign="middle" >0.1616</td><td align="center" valign="middle" >6.71</td><td align="center" valign="middle" >5.87</td></tr><tr><td align="center" valign="middle" >W</td><td align="center" valign="middle" >0</td><td align="center" valign="middle" >4</td><td align="center" valign="middle" >2.49</td><td align="center" valign="middle" >2.49</td><td align="center" valign="middle" >0</td><td align="center" valign="middle" >9.96</td><td align="center" valign="middle" >0.0000</td><td align="center" valign="middle" >0.5625</td><td align="center" valign="middle" >0.76</td><td align="center" valign="middle" >0.60</td></tr><tr><td align="center" valign="middle" >Y</td><td align="center" valign="middle" >6</td><td align="center" valign="middle" >7</td><td align="center" valign="middle" >2.23</td><td align="center" valign="middle" >2.23</td><td align="center" valign="middle" >13.38</td><td align="center" valign="middle" >15.61</td><td align="center" valign="middle" >0.3472</td><td align="center" valign="middle" >0.2142</td><td align="center" valign="middle" >1.76</td><td align="center" valign="middle" >2.64</td></tr><tr><td align="center" valign="middle" >V</td><td align="center" valign="middle" >20</td><td align="center" valign="middle" >18</td><td align="center" valign="middle" >3.5</td><td align="center" valign="middle" >3.5</td><td align="center" valign="middle" >70</td><td align="center" valign="middle" >63</td><td align="center" valign="middle" >0.0338</td><td align="center" valign="middle" >0.0831</td><td align="center" valign="middle" >8.68</td><td align="center" valign="middle" >8.57</td></tr></tbody></table></table-wrap><p>OOBM850101 is a character of individual amino acid that describes the optimized beta-structure-coil equilibrium constant. P1 and P2 are two proteins with accession number LdR34 and LpR114. The amino acid distribution probability was computed according to the equation, r ! / ( q 0 ! &#215; q 1 ! &#215; ⋯ &#215; q n ! ) &#215; r ! / ( r 1 ! &#215; r 2 ! &#215; ⋯ &#215; r n ! ) &#215; n − r , where ! is the factorial, r is the number of a type of amino acid, q is the number of partitions with the same number of amino acids and n is the number of partitions in the protein for a type of amino acid.</p><p>The second combined character is the amino acid future composition, which is based on the relationship between RNA codons and their translated amino acids [25-27] with its online computation [<xref ref-type="bibr" rid="scirp.92102-ref28">28</xref>]. Two worked examples were listed in columns 10 and 11 of <xref ref-type="table" rid="table1">Table 1</xref> to show how this combined character is different from protein to protein.</p></sec><sec id="s2_3"><title>2.3. Characters for Comparison</title><p>A database, called AAIndex, contains more than 530 different individual amino-acid characters [<xref ref-type="bibr" rid="scirp.92102-ref29">29</xref>]. Some are quite familiar to us, for examples, physicochemical properties, spatial properties [<xref ref-type="bibr" rid="scirp.92102-ref29">29</xref>], electronic properties [<xref ref-type="bibr" rid="scirp.92102-ref30">30</xref>], hydrophobic properties [<xref ref-type="bibr" rid="scirp.92102-ref31">31</xref>], predictors for secondary structures [<xref ref-type="bibr" rid="scirp.92102-ref32">32</xref>], and so on. These individual amino-acid characters are constants, i.e., each character generally has an unchangeable value for an amino acid, for example, molecular weight for alanine is 89.09. Each individual amino-acid character is put into model to predict the success rate of crystallization of Lactobacillus proteins each time for comparison with the results obtained from combined characters.</p></sec><sec id="s2_4"><title>2.4. Models</title><p>Logistic regression and 18-1 neural network were used, because the success rate of protein crystallization was a yes-no event while any character is a number for a type of amino acid, i.e. the model outcome is defined as unity when a protein can be crystallized and the model outcome is defined as zero when a protein cannot be crystallized.</p></sec><sec id="s2_5"><title>2.5. Statistics</title><p>MatLab was used to perform both logistic regression and neural network [33 , 34]. The results obtained from each predictor were classified as true positive (TP), true negative (TN), false positive (FP) and false negative (FN). The accuracy, sensitivity and specificity were calculated as follows: Accuracy = (TP + TN)/(TP + FP + TN + FN) &#215; 100, Sensitivity = (TP)/(TP + FN) &#215; 100, and Specificity = (TN)/(TN + FP) &#215; 100. The McNemar’s test was used to compare the classified results. Sensitivity and specificity were compared using receiver operating characteristic (ROC) analysis [35-37].</p></sec></sec><sec id="s3"><title>3. Results and Discussion</title><p><xref ref-type="table" rid="table1">Table 1</xref> compares the difference between an individual amino-acid character, OOBM850101, and combined characters. No matter what an amino-acid character describes, its value for each type of amino acid is unchangeable (columns 4 and 5). This appears counter-intuitive when we use it to describe an amino acid in a protein because intuitively an amino acid should have different values in terms of different position, different neighboring amino acid and different composition. On the other hand, we can weigh an individual amino-acid character with amino acid composition (columns 6 and 7). As a result, the combined characters do have different values for the same type of amino acids when they are located at different positions, when their neighboring amino acids are different and when their number in a protein is different (last four columns). Therefore, the combined characters are more meaningful but their values have to be computed for each type of amino acid in each protein.</p><p><xref ref-type="fig" rid="fig1">Figure 1</xref> showed the results of accuracy, sensitivity and specificity obtained using logistic regression to correlate the success rate of protein crystallization with each of two combined characters and each of 533 individual amino-acid characters. In this figure: each bar represented how many characters used in predictions resulted in a similar accuracy, sensitivity and specificity. For example, the most right bars in upper, middle and lower indicated that the predictions using each of 483 individual amino-acid characters produced a similar accuracy of 0.6, the predictions using each of 488 individual amino-acid characters produced a similar sensitivity of 0.6, and the prediction using an individual amino-acid character produces the highest specificity. For another example, VENT840101 and FAUJ880112 had the accuracy of 0.53 and 0.55 in the first and second bars from left-hand in the upper panel, while the third bar indicated that three individual amino-acid characters, FAUJ880111, CHAM830107 and NOZY710101, had similar accuracies (0.58 &#177; 0.01). <xref ref-type="fig" rid="fig1">Figure 1</xref> clearly showed that two combined characters, distribution probability and future composition, had a relative good relationship with the success rate of crystallization of Lactobacillus proteins.</p><p>A frequent question in modeling is whether predictors result in a random prediction, which especially is the case for yes-no event prediction because yes-no event can easily connect with random tossing a coin. As good performance includes high true positive rate and low false positive rate, these render the ROC (receiver operating characteristic) analysis, where x-axis represented the false positive rate and y-axis represented the true positive rate. <xref ref-type="fig" rid="fig2">Figure 2</xref> demonstrated the comparison of sensitivity versus 1-specificity obtained from logistic regression, where x-axis represented 1-specificity and y-axis represented the sensitivity. As can be seen, the ratios of sensitivity versus 1-specificity appear on upper-left area above the diagonal, indicating these characters give a good prediction. The McNemar’s test shows that such classified results are significantly different from those of random guess (P &lt; 0.05). However, only one circle is located near the lower left corner, which resulted from an individual amino-acid character, FAUJ880112, reflecting negative charge. Thus, this individual amino-acid character, FAUJ880112, is not suitable to predict the success rate of crystallization of Lactobacillus proteins.</p><p><xref ref-type="fig" rid="fig3">Figure 3</xref> showed the results of accuracy, sensitivity and specificity obtained using 18-1 feedforward backpropagation neural network to correlate the success rate of protein crystallization with each of two combined characters and each of 533 individual amino-acid characters. <xref ref-type="fig" rid="fig3">Figure 3</xref> had similar explanations and implications as those in <xref ref-type="fig" rid="fig1">Figure 1</xref>. Clearly, the neural network can furthermore distinguish the difference between characters for prediction of the success rate of protein crystallization. Compared against individual amino-acid characters, Figures 1-3 suggested that the two combined characters are sensitive to the crystallization process of Lactobacillus proteins. Not surprisingly, many individual amino-acid characters generated similar results, being consistent with the study showing the abundance in individual amino-acid characters [<xref ref-type="bibr" rid="scirp.92102-ref38">38</xref>].</p><p>For the results in Figures 1-3, the database was not divided, i.e., the model parameters obtained from the 314 Lactobacillus proteins were used for predictions. This was generally considered as the first stage in modeling, and then the database should be divided as two groups, one for the generation of model parameters while the other for the validation [<xref ref-type="bibr" rid="scirp.92102-ref39">39</xref>]. <xref ref-type="fig" rid="fig4">Figure 4</xref> displayed the accuracy, sensitivity and specificity obtained using delet-1 jackknife validation, which further demonstrated that the predictions using combined characters were not worse than those using individual amino-acid characters.</p><p><xref ref-type="fig" rid="fig5">Figure 5</xref> displayed the results of ROC analysis with respect to fitting and delete-1 jackknife validation using 18-1 feed forward back propagation neural network. Although the McNemar’s test shows that such classified results are significantly different from those of random guess (P &lt; 0.05), a cluster of circles appear at the lower left corner and near the diagonal indicating that 152 individual amino-acid characters result in the sensitivity smaller than 0.5 in the fitting (upper panel of <xref ref-type="fig" rid="fig5">Figure 5</xref>) therefore these characters cannot be used as predictors. On the contrary, the two combined characters and other individual amino-acid characters can be used to predict the success rate of crystallization of Lactobacillus proteins.</p><p>Actually, the workload in this study is not small at all because the proposed combined characters has been checked against each of 532 individual amino-acid characters in order to get a solid conclusion.</p><p>The current practice on prediction of success rate of crystallization employs as many characters as possible, such as hybrid crystal growth predictive model [<xref ref-type="bibr" rid="scirp.92102-ref7">7</xref>], “sticky patch” model [<xref ref-type="bibr" rid="scirp.92102-ref40">40</xref>], theoretical underpinning using a solubility phase diagram [<xref ref-type="bibr" rid="scirp.92102-ref41">41</xref>]. Therefore, we would expect that our proposed combined characters would be included in the factors, which influence the success rate of crystallization of Lactobacillus proteins.</p><p>At present, to build a predictable relationship between individual protein and its crystallization propensity is still difficult when using either logistical model or neural network model. This suggests that the more sophisticated model could be more suitable for such studies in future, for example, deep learning model. On the other hand, the introduction of cryo-electron microscopy to determine the protein 3-demensional structure reduces the demand for crystallization of proteins for X-ray crystallography [<xref ref-type="bibr" rid="scirp.92102-ref42">42</xref>], however the relationship between individual protein and its crystallization propensity is still important.</p></sec><sec id="s4"><title>Fund</title><p>This study was supported by National Natural Science Foundation of China (31460296 and 31560315), Key Project of Guangxi Scientific Research and Technology Development Plan (AB17190534) and Special Funds for Building of Guangxi Talent Highland.</p></sec><sec id="s5"><title>CONFLICTS OF INTEREST</title><p>The authors declare no conflicts of interest regarding the publication of this paper.</p></sec></body><back><ref-list><title>References</title><ref id="scirp.92102-ref1"><label>1</label><mixed-citation publication-type="other" xlink:type="simple">Smialowski, P., Schmidt, T., Cox, J., Kirschner, A. and Frishman, D. (2006) Will My Protein Crystallize? A Sequence-Based Predictor. Proteins, 62, 343-355. https://doi.org/10.1002/prot.20789</mixed-citation></ref><ref id="scirp.92102-ref2"><label>2</label><mixed-citation publication-type="other" xlink:type="simple">Slabinski, L., Jaroszewski, L., Rychlewski, L., Wilson, I.A., Lesley, S.A. and Godzik, A. (2007) XtalPred: A Web Server for Prediction of Protein Crystallizability. Bioinformatics, 23, 3403-3405.  
https://doi.org/10.1093/bioinformatics/btm477</mixed-citation></ref><ref id="scirp.92102-ref3"><label>3</label><mixed-citation publication-type="other" xlink:type="simple">Chen, K., Kurgan, L. and Rahbari, M. (2007) Prediction of Protein Crystallization Using Collocation of Amino Acid Pairs. Biochemical and Biophysical Research Communications, 355, 764-759.  
https://doi.org/10.1016/j.bbrc.2007.02.040</mixed-citation></ref><ref id="scirp.92102-ref4"><label>4</label><mixed-citation publication-type="other" xlink:type="simple">Overton, I.M., Padovani, G., Girolami, M.A. and Barton, G.J. (2008) ParCrys: A Parzen Window Density Estimation Approach to Protein Crystallization Propensity Prediction. Bioinformatics, 24, 901-907.  
https://doi.org/10.1093/bioinformatics/btn055</mixed-citation></ref><ref id="scirp.92102-ref5"><label>5</label><mixed-citation publication-type="other" xlink:type="simple">Kurgan, L. and Mizianty, M.J. (2009) Sequence-Based Protein Crystallization Propensity Prediction for Structural Genomics: Review and Comparative Analysis. Natural Science, 1, 93-106.  
https://doi.org/10.4236/ns.2009.12012</mixed-citation></ref><ref id="scirp.92102-ref6"><label>6</label><mixed-citation publication-type="other" xlink:type="simple">Kurgan, L., Razib, A.A., Aghakhani, S., Dick, S., Mizianty, M.J. and Jahandideh, S. (2009) CRYSTALP2: Sequence-Based Protein Crystallization Propensity Prediction. BMC Structural Biology, 9, 50.  
https://doi.org/10.1186/1472-6807-9-50</mixed-citation></ref><ref id="scirp.92102-ref7"><label>7</label><mixed-citation publication-type="other" xlink:type="simple">Zucker, F.H., Stewart, C., dela Rosa, J., Kim, J., Zhang, L., Xiao, L., Ross, J., Napuli, A.J., Mueller, N., Castaneda, L.J., Nakazawa Hewitt, S.R., Arakaki, T.L., Larson, E.T., Subramanian, E., Verlinde, C.L., Fan, E., Buckner, F.S., Van Voorhis, W.C., Merritt, E.A. and Hol, W.G. (2010) Prediction of Protein Crystallization Outcome Using a Hybrid Method. Journal of Structural Biology, 171, 64-73. https://doi.org/10.1186/1472-6807-9-50</mixed-citation></ref><ref id="scirp.92102-ref8"><label>8</label><mixed-citation publication-type="other" xlink:type="simple">Wang, H., Feng, L., Webb, G.I., Kurgan, L., Song, J. and Lin, D. (2018) Critical Evaluation of Bioinformatics Tools for the Prediction of Protein Crystallization Propensity. Briefings in Bioinformatics, 19, 838-852.  
https://doi.org/10.1093/bib/bbx018</mixed-citation></ref><ref id="scirp.92102-ref9"><label>9</label><mixed-citation publication-type="other" xlink:type="simple">Wu, G. and Yan, S.M. (2002) Randomness in the Primary Structure of Protein: Methods and Implications. Molecular Biology Today, 3, 55-69.</mixed-citation></ref><ref id="scirp.92102-ref10"><label>10</label><mixed-citation publication-type="other" xlink:type="simple">Wu, G. and Yan, S. (2006) Mutation Trend of Hemagglutinin of Influenza A Virus: A Review from Computational Mutation Viewpoint. Acta Pharmacologica Sinica, 27, 513-526.  
https://doi.org/10.1111/j.1745-7254.2006.00329.x</mixed-citation></ref><ref id="scirp.92102-ref11"><label>11</label><mixed-citation publication-type="other" xlink:type="simple">Wu, G. and Yan, S. (2008) Lecture Notes on Computational Mutation. Nova Science Publishers, New York.</mixed-citation></ref><ref id="scirp.92102-ref12"><label>12</label><mixed-citation publication-type="other" xlink:type="simple">Wu, G. and Yan, S. (2010) Creation and Application of Computational Mutation. Journal of Guangxi Academy of Sciences, 17, 145-150.</mixed-citation></ref><ref id="scirp.92102-ref13"><label>13</label><mixed-citation publication-type="other" xlink:type="simple">Seddik, H.A., Bendali, F., Gancel, F., Fliss, I., Spano, G. and Drider, D. (2019) Lactobacillus plantarum and Its Probiotic and Food Potentialities. Probiotics and Antimicrobial Proteins, 9, 111-122.  
https://doi.org/10.1007/s12602-017-9264-z</mixed-citation></ref><ref id="scirp.92102-ref14"><label>14</label><mixed-citation publication-type="other" xlink:type="simple">Salas-Jara, M.J., Ilabaca, A., Vega, M. and García, A. (2016) Biofilm Forming Lactobacillus: New Challenges for the Development of Probiotics. Microorganisms, 4, pii: E35. https://doi.org/10.3390/microorganisms4030035</mixed-citation></ref><ref id="scirp.92102-ref15"><label>15</label><mixed-citation publication-type="other" xlink:type="simple">Martín, R., Miquel, S., Ulmer, J., Kechaou, N., Langella, P. and Bermúdez-Humarán, L.G. (2013) Role of Commensal and Probiotic Bacteria in Human Health: A Focus on Inflammatory Bowel Disease. Microbial Cell Factories, 12, 71. https://doi.org/10.1186/1475-2859-12-71</mixed-citation></ref><ref id="scirp.92102-ref16"><label>16</label><mixed-citation publication-type="other" xlink:type="simple">Chen, L., Oughtred, R., Berman, H.M. and Westbrook, J. (2004) TargetDB: A Target Registration Database for Structural Genomics Projects. Bioinformatics, 20, 2860-2862. https://doi.org/10.1093/bioinformatics/bth300</mixed-citation></ref><ref id="scirp.92102-ref17"><label>17</label><mixed-citation publication-type="other" xlink:type="simple">Yan, S. and Wu, G. (2011) Possible Random Mechanism in Crystallization Evidenced in Proteins from Plasmodium falciparum. Crystal Growth &amp; Design, 11, 4198-4204. https://doi.org/10.1021/cg200814k</mixed-citation></ref><ref id="scirp.92102-ref18"><label>18</label><mixed-citation publication-type="other" xlink:type="simple">Yan, S. and Wu, G. (2012) Correlating Dynamic Amino Acid Properties with Success Rate of Crystallization of Proteins from Bacteroides vulgatus. Crystal Research and Technology, 47, 511-516.  
https://doi.org/10.1002/crat.201200007</mixed-citation></ref><ref id="scirp.92102-ref19"><label>19</label><mixed-citation publication-type="other" xlink:type="simple">Yan, S. and Wu, G. (2012) Randomness in Crystallization of Proteins from Staphylococcus aureus. Protein &amp; Peptide Letters, 19, 784-789. https://doi.org/10.2174/092986612800793190</mixed-citation></ref><ref id="scirp.92102-ref20"><label>20</label><mixed-citation publication-type="other" xlink:type="simple">Yan, S. and Wu, G. (2013) Association of Combined Features of Amino Acid and Protein with Crystallization Propensity of Proteins from Cytophaga hutchinsonii. Zeitschrift fur Kristallographie, 228, 250-254.  
https://doi.org/10.1524/zkri.2013.1570</mixed-citation></ref><ref id="scirp.92102-ref21"><label>21</label><mixed-citation publication-type="other" xlink:type="simple">Yan, S., Wang, H. and Wu, G. (2013) Correlation of Combined Features of Amino Acid and Protein with Crystallization Propensity of Proteins from Caenorhabditis elegans. Guangxi Sciences, 20, 234-238.</mixed-citation></ref><ref id="scirp.92102-ref22"><label>22</label><mixed-citation publication-type="other" xlink:type="simple">Yan, S. and Wu, G. (2015) Predicting Crystallization Propensity of Proteins from Arabidopsis thaliana. Biological Procedures Online, 17, 16. https://doi.org/10.1186/s12575-015-0029-3</mixed-citation></ref><ref id="scirp.92102-ref23"><label>23</label><mixed-citation publication-type="other" xlink:type="simple">Feller, W. (1968) An Introduction to Probability Theory and Its Applications. Third Edition, Wiley, New York, Vol. 1.</mixed-citation></ref><ref id="scirp.92102-ref24"><label>24</label><mixed-citation publication-type="other" xlink:type="simple">http://www.gxas.cn/dp.htm</mixed-citation></ref><ref id="scirp.92102-ref25"><label>25</label><mixed-citation publication-type="other" xlink:type="simple">Wu, G. and Yan, S. (2005) Determination of Mutation Trend in Proteins by Means of Translation Probability between RNA Codes and Mutated Amino Acids. Biochemical and Biophysical Research Communications, 337, 692-700. https://doi.org/10.1016/j.bbrc.2005.09.106</mixed-citation></ref><ref id="scirp.92102-ref26"><label>26</label><mixed-citation publication-type="other" xlink:type="simple">Wu, G. and Yan, S. (2006) Determination of Mutation Trend in Hemagglutinins by Means of Translation Probability between RNA Codons and Mutated Amino Acids. Protein &amp; Peptide Letters, 13, 601-609.  
https://doi.org/10.2174/092986606777145779</mixed-citation></ref><ref id="scirp.92102-ref27"><label>27</label><mixed-citation publication-type="book" xlink:type="simple">Wu, G. and Yan, S. (2007) Translation Probability between RNA Codons and Translated Amino Acids, and Its Applications to Protein Mutations. In: Ostrovskiy M.H., Ed., Leading-Edge Messenger RNA Research Communications, Nova Science Publishers, New York, Chapter 3, 47-65.</mixed-citation></ref><ref id="scirp.92102-ref28"><label>28</label><mixed-citation publication-type="other" xlink:type="simple">http://www.gxas.cn/fc.htm</mixed-citation></ref><ref id="scirp.92102-ref29"><label>29</label><mixed-citation publication-type="other" xlink:type="simple">Kawashima, S., Pokarowski, P., Pokarowska, M., Kolinski, A., Katayama, T. and Kanehisa, M. (2008) AAindex: Amino Acid Index Database, Progress Report 2008. Nucleic Acids Research, 36, D202-D205.  
https://doi.org/10.1093/nar/gkm998</mixed-citation></ref><ref id="scirp.92102-ref30"><label>30</label><mixed-citation publication-type="other" xlink:type="simple">Darby, N.J. and Creighton, T.E. (1993) Dissecting the Disulphide-Coupled Folding Pathway of Bovine Pancreatic Trypsin Inhibitor. Forming the First Disulphide Bonds in Analogues of the Reduced Protein. Journal of Molecular Biology, 232, 873-896. https://doi.org/10.1006/jmbi.1993.1437</mixed-citation></ref><ref id="scirp.92102-ref31"><label>31</label><mixed-citation publication-type="other" xlink:type="simple">Dwyer, D.S. (2005) Electronic Properties of Amino Acid Side Chains: Quantum Mechanics Calculation of Substituent Effects. BMC Chemical Biology, 5, 2. https://doi.org/10.1186/1472-6769-5-2</mixed-citation></ref><ref id="scirp.92102-ref32"><label>32</label><mixed-citation publication-type="other" xlink:type="simple">Chou, P.Y. and Fasman, G.D. (1978) Prediction of Secondary Structure of Proteins from Amino Acid Sequence. Advances in Enzymology and Related Subjects of Biochemistry, 47, 45-48.</mixed-citation></ref><ref id="scirp.92102-ref33"><label>33</label><mixed-citation publication-type="other" xlink:type="simple">Demuth, H. and Beale, M. (2001) Neural Network Toolbox for Use with MatLab. User’s Guide, Version 4.</mixed-citation></ref><ref id="scirp.92102-ref34"><label>34</label><mixed-citation publication-type="other" xlink:type="simple">MathWorks Inc. (1984-2001) MatLab—The Language of Technical Computing. Version 6.1.0.450, Release 12.1.</mixed-citation></ref><ref id="scirp.92102-ref35"><label>35</label><mixed-citation publication-type="other" xlink:type="simple">Alonzo, T. and Pepe, M.S. (2002) Distribution-Free ROC Analysis Using Binary Regression Techniques. Biostatistics, 3, 421-432. https://doi.org/10.1093/biostatistics/3.3.421</mixed-citation></ref><ref id="scirp.92102-ref36"><label>36</label><mixed-citation publication-type="other" xlink:type="simple">Cai, T.X., Pepe, M.S., Zheng, Y.Y., Lumley, T. and Jenny, N.S. (2006) The Sensitivity and Specificity of Markers for Event Times. Biostatistics, 7, 182-197. https://doi.org/10.1093/biostatistics/kxi047</mixed-citation></ref><ref id="scirp.92102-ref37"><label>37</label><mixed-citation publication-type="other" xlink:type="simple">Pepe, M., Longton, G. and Janes, H. (2009) Estimation and Comparison of Receiver Operating Characteristic Curves. Stata Journal, 9, 1. https://doi.org/10.1177/1536867X0900900101</mixed-citation></ref><ref id="scirp.92102-ref38"><label>38</label><mixed-citation publication-type="other" xlink:type="simple">Atchley, W.R., Zhao, J., Fernandes, A.D. and Druke, T. (2005) Solving the Protein Sequence Metric Problem. Proceedings of the National Academy of Sciences of the United States of America, 102, 6395-6400.  
https://doi.org/10.1073/pnas.0408677102</mixed-citation></ref><ref id="scirp.92102-ref39"><label>39</label><mixed-citation publication-type="other" xlink:type="simple">Chou, K.C. (2011) Some Remarks on Protein Attribute Prediction and Pseudo Amino Acid Composition (50th Anniversary Year Review). Journal of Theoretical Biology, 273, 236-247.  
https://doi.org/10.1016/j.jtbi.2010.12.024</mixed-citation></ref><ref id="scirp.92102-ref40"><label>40</label><mixed-citation publication-type="other" xlink:type="simple">Derewenda, Z.S. and Godzik, A. (2017) The “Sticky Patch” Model of Crystallization and Modification of Proteins for Enhanced Crystallizability. Methods in Molecular Biology, 1607, 77-115.  
https://doi.org/10.1007/978-1-4939-7000-1_4</mixed-citation></ref><ref id="scirp.92102-ref41"><label>41</label><mixed-citation publication-type="other" xlink:type="simple">Altan, I., Charbonneau, P. and Snell, E.H. (2016) Computational Crystallization. Archives of Biochemistry and Biophysics, 602, 12-20. https://doi.org/10.1016/j.abb.2016.01.004</mixed-citation></ref><ref id="scirp.92102-ref42"><label>42</label><mixed-citation publication-type="other" xlink:type="simple">Cressey, D. and Callaway, E. (2017) Cryo-Electron Microscopy Wins Chemistry Nobel. Nature, 550, 167.  
https://doi.org/10.1038/nature.2017.22738</mixed-citation></ref></ref-list></back></article>