<?xml version="1.0" encoding="UTF-8"?><!DOCTYPE article  PUBLIC "-//NLM//DTD Journal Publishing DTD v3.0 20080202//EN" "http://dtd.nlm.nih.gov/publishing/3.0/journalpublishing3.dtd"><article xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink" dtd-version="3.0" xml:lang="en" article-type="research article"><front><journal-meta><journal-id journal-id-type="publisher-id">JAMP</journal-id><journal-title-group><journal-title>Journal of Applied Mathematics and Physics</journal-title></journal-title-group><issn pub-type="epub">2327-4352</issn><publisher><publisher-name>Scientific Research Publishing</publisher-name></publisher></journal-meta><article-meta><article-id pub-id-type="doi">10.4236/jamp.2017.511183</article-id><article-id pub-id-type="publisher-id">JAMP-80537</article-id><article-categories><subj-group subj-group-type="heading"><subject>Articles</subject></subj-group><subj-group subj-group-type="Discipline-v2"><subject>Physics&amp;Mathematics</subject></subj-group></article-categories><title-group><article-title>
 
 
  Topological Modelling of Deep Ulcerations in Patients with Ulcerative Colitis
 
</article-title></title-group><contrib-group><contrib contrib-type="author" xlink:type="simple"><name name-style="western"><surname>Ian</surname><given-names>Morilla</given-names></name><xref ref-type="aff" rid="aff1"><sup>1</sup></xref></contrib><contrib contrib-type="author" xlink:type="simple"><name name-style="western"><surname>Mathieu</surname><given-names>Uzzan</given-names></name><xref ref-type="aff" rid="aff2"><sup>2</sup></xref></contrib><contrib contrib-type="author" xlink:type="simple"><name name-style="western"><surname>Dominique</surname><given-names>Cazals-Hatem</given-names></name><xref ref-type="aff" rid="aff2"><sup>2</sup></xref></contrib><contrib contrib-type="author" xlink:type="simple"><name name-style="western"><surname>Hatem</surname><given-names>Zaag</given-names></name><xref ref-type="aff" rid="aff1"><sup>1</sup></xref></contrib><contrib contrib-type="author" xlink:type="simple"><name name-style="western"><surname>Eric</surname><given-names>Ogier-Denis</given-names></name><xref ref-type="aff" rid="aff2"><sup>2</sup></xref></contrib><contrib contrib-type="author" xlink:type="simple"><name name-style="western"><surname>Gilles</surname><given-names>Wainrib</given-names></name><xref ref-type="aff" rid="aff3"><sup>3</sup></xref></contrib><contrib contrib-type="author" xlink:type="simple"><name name-style="western"><surname>Xavier</surname><given-names>Tréton</given-names></name><xref ref-type="aff" rid="aff2"><sup>2</sup></xref></contrib></contrib-group><aff id="aff2"><addr-line>INSERM, UMRS1149, Team “Inflammation Intestinale”, Research Centre of Inflammation, Paris, France</addr-line></aff><aff id="aff1"><addr-line>Université Paris 13, Sorbonne Paris Cité, LAGA, CNRS (UMR 7539), Laboratoire d’excellence Inflamex, F-93430, Villetaneuse, France</addr-line></aff><aff id="aff3"><addr-line>Département d’Informatique, Equipe DATA, Ecole Normale Supérieure, Paris, France</addr-line></aff><pub-date pub-type="epub"><day>02</day><month>11</month><year>2017</year></pub-date><volume>05</volume><issue>11</issue><fpage>2244</fpage><lpage>2261</lpage><history><date date-type="received"><day>7,</day>	<month>September</month>	<year>2017</year></date><date date-type="rev-recd"><day>21,</day>	<month>November</month>	<year>2017</year>	</date><date date-type="accepted"><day>24,</day>	<month>November</month>	<year>2017</year></date></history><permissions><copyright-statement>&#169; Copyright  2014 by authors and Scientific Research Publishing Inc. </copyright-statement><copyright-year>2014</copyright-year><license><license-p>This work is licensed under the Creative Commons Attribution International License (CC BY). http://creativecommons.org/licenses/by/4.0/</license-p></license></permissions><abstract><p>
 
 
  Aims
  : Steadily the clinicians of our team in inflammatory bowel disease encounter ulcerative colitis patients that develop deep ulcers during their treatment. Currently, these practitioners are only equipped with their grade of expertise in inflammatory domains to decide what new therapy maybe use in such cases. Encouraged by the limited knowledge of this frequent pathology, we seek to determine the molecular conditions underlying the recurrent formation of deep ulcerations in certain group of patients. 
  Method
  : The goal of this strategy is to expose differences between groups of patients based on similarities computed by 
  random walk graph kernels and performing 
  functional inference on those differences. 
  Results
  : We apply the methodology to a cohort of eleven miRNA microarrays of ulcerative colitis patients. Our results showed how the group of ulcerative colitis patients with presence of deep ulcers is topologically more similar (0.35) than ulcerative colitis patients (0.18) to control. Such topological constraint drove functional inference to complete the information that clinicians need. 
  Conclusions
  : Our analyses reveal highly interpretable in the guidance of practitioners to eventually correct initial therapies of ulcerative colitis patients that develop deep ulcers. The methodology can provide them with useful molecular hypotheses necessaries prior to make any decision on the newest course of the treatment.
 
</p></abstract><kwd-group><kwd>Ulcerative Colitis</kwd><kwd> Deep Ulcers</kwd><kwd> Fast Random Walk Graph Kernels</kwd><kwd> Conjugate Gradient Methods</kwd><kwd> Spectral Graph Theory</kwd></kwd-group></article-meta></front><body><sec id="s1"><title>1. Introduction</title><p>Acute severe ulcerative colitis (ASC) is a multifaceted complication affecting about 25% of ulcerative colitis (UC) patients nowadays. Such a complication is a chronic threatening state often requiring emergent colectomy in case of intensive medical treatment failure. Additionally, the presence of deep ulcers expose patients to serious episodes such as sepsis, toxic mega-colon, perforation or death [<xref ref-type="bibr" rid="scirp.80537-ref1">1</xref>] [<xref ref-type="bibr" rid="scirp.80537-ref2">2</xref>] [<xref ref-type="bibr" rid="scirp.80537-ref3">3</xref>] . Despite many efforts, the molecular conditions leading to ulcers formation are still not clear. As showed in following sections, our graph kernel analysis provides practitioners with an excellent medical tool to approach this serious episode of inflammatory disorder. In this sense, we infer plausible hypothesis that sheds light into such a pressing medical problem and fits previous experiments reported in the literature.</p><p>Graphs naturally model many types of structured data by means of nodes and edges. While nodes are representing general entities edges describe type of relations between such entities. On the other hand, machine learning methods applied to biomedical contexts [<xref ref-type="bibr" rid="scirp.80537-ref4">4</xref>] [<xref ref-type="bibr" rid="scirp.80537-ref5">5</xref>] concern about capturing relationships between structured entities. This tight coupling is of major interest in domains like medicine, where the seek of similarity between structures, here patients, is essential in preventing and fighting diseases. Kernel algorithms [<xref ref-type="bibr" rid="scirp.80537-ref6">6</xref>] provide an excellent framework to measure similarity ( κ ( o , o ′ ) ) between objects o and o ′ . Notwithstanding, some few mathematical properties must be ensured first, i.e., symmetry ( κ ( o , o ′ ) = κ ( o ′ , o ) ) and positive semi-definite (p.s.d.). Kernel methods may be used both to compare nodes within the same graph [<xref ref-type="bibr" rid="scirp.80537-ref7">7</xref>] and in inter-graph [<xref ref-type="bibr" rid="scirp.80537-ref8">8</xref>] [<xref ref-type="bibr" rid="scirp.80537-ref9">9</xref>] comparisons. The only constraint is its interpretability since we need to capture the pith of data encapsulated by the construction of a graph while we find ways suitable for the kernel evaluation. In this paper we evaluate in a novel scenario, inflammatory bowel disease, an extension of kernel methods [<xref ref-type="bibr" rid="scirp.80537-ref10">10</xref>] looking for topological similarity and combine functional context with the idea of performing medical inference in ulcerative colitis (UC). The paper maybe dissected in sections, namely: Section 2 portrays the inflammatory medical issue underlying this work; Section 3 gives us a reasonable landscape of the methods: spectral graph analysis, Conjugate Gradient Methods (CGs) to calibrate random walk graph kernel, and functional inference on our topological model; section 4 confirms our approach is valid when it is used in a real cohort of 11 patients having been diagnosed with acute severe ulcerative colitis; we provide our concluding remarks in Section 5.</p></sec><sec id="s2"><title>2. Motivation: The Deep Ulcer Problem in ASC</title><p>Practitioners and scientists based at the “Centre de Recherche sur l’Inflammation” (INSERM, UMRS1149); Universit&#233; Paris-Diderot Sorbonne have recently, conducted a primary pilot study targeted to determine why some patients having been diagnosed with ulcerative colitis, an idiotypic inflammatory bowel disease, develop a haemorrhagic mucosa with deep ulceration. Indeed, ulcerative colitis is characterised by superficial inflammatory damages in the colonic mucosa. Currently, there are no pathogenic factors identified to explain the occurrence of deep ulcers in severe form of UC, such as ASC. This newest complication of the disease is an indicator of a poor response to medical therapy. Upon multiple medical assays as well as statistical approaches (i.e., supervised hierarchical clustering, etc.) aiming at establishing predictive signatures to be used as dia- gnostic and prognostic; such phenomenon, apparently, seems to be “stochastic” within the treatment of ASC patients.</p></sec><sec id="s3"><title>3. Material and Methods</title><p>This section provides the reader with a summary description of the three constituent methods, i.e., spectral graph theory, CGs in the efficiently computation of the graph kernel, and functional inference on topological models needed to understand the results showed in section 4.</p><sec id="s3_1"><title>3.1. Human Samples</title><p>All the biopsies analysed in the study were extracted from non-inflamed mucosa of the sigmoid colon. Paraffinised samples of colectomy were selected among three groups of patients: a first group consisting of four patients operated on UC in presence of deep ulcerations (ASC), what is a constituent marker of severity; a second sample made of three healthy subject with normal colonic mucosa and a last sample of four patients with refractory UC, i.e., superficial inflammation without deep ulcers (<xref ref-type="fig" rid="fig1"><xref ref-type="fig" rid="fig">Figure </xref>1</xref>(a)). The extracted RNA derives from low inflammatory areas of the colon. MicroRNA (small non-coding RNA containing between 22 - 25 nucleotides) expression was measured by specific chip of microarray Affymetrix.</p></sec><sec id="s3_2"><title>3.2. Differential miRNA Expression</title><p>Differential miRNA expression was performed using limma [<xref ref-type="bibr" rid="scirp.80537-ref11">11</xref>] by fitting a log-normal (LN) generalized linear model (GLM) that accounts for expression (mucosal) as well as group (UC/ASC).</p></sec><sec id="s3_3"><title>3.3. Multi-Omic Graphs Integration</title><p>In this stage a cohort of eleven miRNA microarrays was used with the aim of co-integrating the differential miRNA expression profiles not present in the intersection in pairwise of UC patients (i.e., UC, ASC and Control) and known human Protein-Protein Interaction (PPI, defined as miRNA-gene target product) from Genemania database [<xref ref-type="bibr" rid="scirp.80537-ref12">12</xref>] . Our approach is based on the assumption that genes with similar gene expression levels are translated into proteins that are more likely to interact. Recent works on gene expression and protein interaction data at genome-wide level expose such a conjecture: “Protein pairs encoded by co-expressed genes are much more likely to interact mutually than with any other type of proteins [<xref ref-type="bibr" rid="scirp.80537-ref13">13</xref>] [<xref ref-type="bibr" rid="scirp.80537-ref14">14</xref>] . Specifically, the rationale to transform the miRNA expression of a patient into a network is like this: We may want to represent a node in the graph for every protein encoded by a miRNA target gene provided its expression level was measured on this patient’s microarray. We create an edge between two given proteins of this type if these proteins are reported as interacting by Genemania, and genes are up or down-regulated at the same time with respect to a provided measure tag (see previous subsection). Herein, no distinction is made between coding gene and protein.</p></sec><sec id="s3_4"><title>3.4. Spectral Graph Properties</title><p>Briefly, we initially explore the geometric and algebraic behaviour of each co-integrated omic graph (UC, ASC and Control) by means of some few key spectral properties, namely: their spectra; i.e., the eigenvalue for a given factor measures the variance in all the variables which is accounted for by that factor. Their algebraic connectivity calculated in the Laplacian matrix as its second smallest eigenvalue. Eigencentrality; i.e., to weight the relative importance of a given i<sup>th</sup> node in linking motifs within the graphs and defined as the i<sup>th</sup> com- ponent of the eigenvector corresponding to the greatest eigenvalue; and their modularity by calculating the Fiedler’s vector; i.e., the vector corresponding to its algebraic connectivity [<xref ref-type="bibr" rid="scirp.80537-ref15">15</xref>] [<xref ref-type="bibr" rid="scirp.80537-ref16">16</xref>] . All the calculations were performed using MATLAB R2011a (maci64 architecture on a machine with a single 2.8 GHz processor and 8GB RAM distributed in two cores).</p></sec><sec id="s3_5"><title>3.5. Fixing the Context: Reproducing Kernel Hilbert Space</title><p>Definition 1 Lets M ∈ ℝ r &#215; c and M ′ ∈ ℝ p &#215; q be two real matrices, the Kronecker product M ⊗ M ′ ∈ ℝ r p &#215; c q and column-stacking operator v e c ( M ) ∈ ℝ r c are defined as</p><p>M ⊗ M ′ : = [ M 11 M ′ M 12 M ′ ⋯ M 1 c M ′ M 21 M ′ M 22 M ′ ⋯ M 2 c M ′ ⋮ ⋮ ⋮ M r 1 B M r 2 M ′ ⋯ M r c M ′ ] ,</p><p>v e c ( M ) : = [ M * 1 ⋮ M * c ] ,</p><p>where M * k amounts the k<sup>th</sup> column of M .</p><p>The Kronecker product and v e c operator meet the following relationship (e.g., [<xref ref-type="bibr" rid="scirp.80537-ref17">17</xref>] , Proposition 7.1.9):</p><p>v e c ( M N P ) = ( P T ⊗ M ) v e c ( N ) . (1)</p><p>Another standard condition of the Kronecker product exploited in this work is ( [<xref ref-type="bibr" rid="scirp.80537-ref17">17</xref>] , Proposition 7.1.6):</p><p>( M ⊗ M ′ ) ( N ⊗ N ′ ) = M N ⊗ M ′ N ′ . (2)</p><p>All these ideas are extendable to Reproducing Kernel Hilbert Spaces (RKHS). Let H be such a space, hence it is defined by a p.s.d. kernel κ : Y &#215; Y → ℝ , where Y is a set of labels including the singular label ξ . H generates a feature map Φ : Y → H satisfying κ ( y , y ′ ) = 〈 Φ ( y ) , Φ ( y ′ ) 〉 H and mapping in H ξ to its zero element. We finally denote by Φ ( Y ) the matrix of a graph G associated to the feature map that enables lifting tensor algebra from Y to H [<xref ref-type="bibr" rid="scirp.80537-ref18">18</xref>] .</p></sec><sec id="s3_6"><title>3.6. General Setup of UC Graphs</title><p><sup>1</sup>In some others context this matrix might be differently defined, e.g., spectral graph theory.</p><p>Graphs G s were constructed for each group of UC patients individually. These networks consisted of a set of n vertices V = { v 1 , v 2 , ⋯ , v n } endowed with order and edges E ⊂ V &#215; V . The nature of the measured microRNA expression leads us to work on undirected graphs, i.e., if ( v p , v q ) ∈ E ⇔ ( v q , v p ) ∈ E . Aditionally, ( v p , v p ) ∉ E for any p. Now, we define paths on those UC graphs as a sequence of indices p 0 , ⋯ , p l ( l amounts path length) such that v p s − 1 ~ v p s , for all 1 ≤ s ≤ l . Our graphs are robustly connected since a path can be traced in each direction between each pair of vertices of the graph. We also associate a weight w p q &gt; 0 to each edge ( v p , v q ) to capture the “strength” of an edge ( v p , v q ) . Then ( v p ≁ v q ) implies w p q = 0 whereas for undirected weighted graphs we have w p q = w q p . Now, let A : = w q p D − 1 be the adjacency matrix<sup>1</sup> of our weighted graphs with D a diagonal matrix measuring the node degrees, that is,</p><p>D p p = ∑ q   w q p . Thus it may be used as transition matrix in a stochastic process</p><p>since the sum of each of its columns is one. We transform a path on G s into random by applying P ( p s + 1 | p 1 , ⋯ , p s ) = A p s + 1 , p s what generates sequences of vertices v p 1 , v p 2 , v p 3 , ⋯ proportionally linked to their weights in pairwise following the above probability. Hence, the probability of transition between any pair of vertex v q and v p through a path of length p can be induced by the expression ( A p ) p q . Finally, we say that two graphs G = ( V , E ) and G ′ = ( V ′ , E ′ ) are isomorphic ( G ≅ G ′ ) if ( v p , v q ) ∈ E iff ( g ( v p ) , g ( v q ) ) ∈ E ′ , where g : V → V ′ is a bijection.</p></sec><sec id="s3_7"><title>3.7. Random Walk Graph Kernel</title><p>Henceforth, we note that all the definitions are generalised to the normalised case, whereas the edges are taken on a set with finite number of labels { 1,2, ⋯ , d } . In particular, we can take the induced RKHS H = ℝ d endowed with the usual inner product.</p><p>Intuitive definition: Random walk graph kernel has been extensively reported in literature to classify and measure similarities of graphs [<xref ref-type="bibr" rid="scirp.80537-ref18">18</xref>] [<xref ref-type="bibr" rid="scirp.80537-ref19">19</xref>] . The rationale of this algorithm is as follows: The random walk kernel on graph counts the number of walks shared by a couple of graphs. Two walks are said to be shared if their lengths and label sequences are the same. Subsequently, the calculated number of shared walks enables to measure the similarity of the two graphs. To infer a formal definition of random walk graph kernel, we might want to present some basic concepts in direct product of graphs. The direct product of two graphs G = { V , E } and G ′ = { V ′ , E ′ } is other graph, denoted by G &#215; = { V &#215; , E &#215; } , where the node set</p><p>V &#215; = { ( v p , v ′ s ) | v p ∈ V , v ′ s ∈ V ′ } , andthe edge set E &#215; = { ( ( v p , v ′ s ) , ( v q , v ′ t ) ) | ( v p , v q ) ∈ E , ( v ′ s , v ′ t ) ∈ E ′ } . In particular, G &#215; can be</p><p>associated to a weight matrix W &#215; = A ⊗ A ′ (Definition 1) with non-zero entries provided the analogous edge is defined in the graph produced by the direct product. A random walk on the direct product graph G &#215; amounts the trace of random walks on G and G ′ at once. Let c ( d ) and c ′ ( d ′ ) be the starting (stopping) probabilities of the random walks on G and G ′ , respectively. Then, the number of shared walks of length l on the direct product graph G &#215; is calculated by ( d ⊗ d ′ ) ( A T ⊗ A ′ T ) l ( c ⊗ c ′ ) , where A and A ′ are the normalised adjacency matrices of G and G ′ , respectively [<xref ref-type="bibr" rid="scirp.80537-ref20">20</xref>] . This definition enables the review of all the shared walks per each unique lengths. However, this sum might not be convergent. Thus, we introduce a non-negative coefficient of decay μ ( l ) to get rid of the longer walks.</p><p>Kernel definition Formally, the expression for the random walk kernel on graph is as follows:</p><p>k ( G , G ′ ) : = ∑ l = 0 ∞     μ ( l ) d &#215; T W &#215; l c &#215; . (3)</p><p>Hence, c &#215; : = c ⊗ c ′ ( d &#215; : = d ⊗ d ′ ) is the starting (stopping) probability distribution associated to the graph produced by the direct product. Therefore, if the coefficients μ ( l ) assure the convergence of (3), then (3) is a valid p.s.d. kernel ( [<xref ref-type="bibr" rid="scirp.80537-ref18">18</xref>] , Theorem 3).</p></sec><sec id="s3_8"><title>3.8. Conjugate Gradient Methods</title><p>We selected the conjugate gradient method for calculating the random walk kernel on our graphs since other methods such as the Sylvester or the spectral decomposition are not applicable for kernels on graphs in general [<xref ref-type="bibr" rid="scirp.80537-ref20">20</xref>] .</p><p>The computation of a random walk kernel on graph with μ ( l ) = λ l stands for inverting ( I − λ W &#215; ) , an n 2 &#215; n 2 matrix if each graph G and G ′ have n vertices. Lets M and v be a matrix and a vector respectively, conjugate gradient (CG) method is used to solve systems as M x = v efficiently [<xref ref-type="bibr" rid="scirp.80537-ref20">20</xref>] . More general, since these methods are thought of symmetric p.s.d. matrices, CGs solve as well other linear systems efficiently. CG solvers improve their performances as the matrix has a small number of different eigenvalues, or is rank deficient. Remarkably, in cases where the matrix M is sparse the computation speed of matrix-vector products can be increased significantly [<xref ref-type="bibr" rid="scirp.80537-ref21">21</xref>] .</p><p>The computation of the graph kernel (3) using CG maybe firstly described as the solution of the following linear system:</p><p>( I − λ W &#215; ) x = c &#215; , (4)</p><p>for x, then we compute d &#215; T x . Next, it ought to contemplate proficient ways to solve (4) with the CG solver. We already know that W is a square matrix of size n 2 &#215; n 2 . The application of the CG method to a direct approach needs O ( n 4 ) iterations to multiply W by a vector y. However, if we exploit the above extended vec-MNP formula (1) into RKHS ( [<xref ref-type="bibr" rid="scirp.80537-ref18">18</xref>] , Lemma 12) with some new matrix Y ∈ ℝ n &#215; n with y = v e c ( Y ) and taking into account that in particular W &#215; = A ⊗ A ′ (A and A ′ the normalised adjacency matrix for the graphs G and G ′ respectively), by ( [<xref ref-type="bibr" rid="scirp.80537-ref18">18</xref>] , Lemma 12) we can write</p><p>W &#215; y = ( A ⊗ A ′ ) v e c ( Y ) = v e c ( A ′ Y A T ) . (5)</p><p>If A ~ Φ ( ⋅ ) ∈ ℝ d then we can compute the above multiplication of a matrix by a vector in time order of O ( d n 3 ) . Furthermore, even more efficient computation of A ′ Y A T is feasible provided that the matrices A and A ′ are sparse: Assuming that A and A ′ have O ( n ) non-x entries, then computing (5) takes only O ( n 2 ) time.</p><p>Finally, note that the nearest Kronecker product [<xref ref-type="bibr" rid="scirp.80537-ref22">22</xref>] is not appropriate to approximate W &#215; since the number d of distinct labels in our labeled graph is not large enough.</p></sec><sec id="s3_9"><title>3.9. Weisfeiler-Lehman Graph Kernels Cross-Validation</title><p>As validation of our results, we also propose to compare the random walk kernel on graph and the family of Weisfeiler-Lehman kernels. The later consists of proficient kernels to be used on graphs presenting discrete node labels. Such family is built on the Weisfeiler-Lehman test of isomorphism between graphs [<xref ref-type="bibr" rid="scirp.80537-ref23">23</xref>] and its valid 1-dimensional variant [<xref ref-type="bibr" rid="scirp.80537-ref24">24</xref>] . It captures topological and label information iteratively mapping the graph of reference onto a sequence of graphs with nodes displaying characteristic attributes. This catenation of graphs originating from the Weisfeiler-Lehman test can establish a family of kernels, including an adequate kernel to compare patterns taking subtree shape. Notice how the edges and length of such a sequence produce a final complexity in linear terms.</p><p>Definition 2 Given the Weisfeiler-Lehman (WL) graph G a = ( V , E , l a ) of height a , its sequence is denoted by:</p><p>V = { G 0 , G 1 , ⋯ , G h } = { ( V , E , l 0 ) , ( V , E , l 1 ) , ⋯ , ( V , E , l h ) } , (6)</p><p>where h counts iterations, and { G 0 , ⋯ , G h } and { G ′ 0 , ⋯ , G ′ h } are respectively the sequences of G and G ′ associated to WL graphs.</p><p>Definition 3 Provided the so-called base kernel κ is fixed, then the definition of Weisfeiler-Lehman kernel for κ is</p><p>κ W L ( h ) ( G , G ′ ) = κ ( G 0 , G ′ 0 ) + κ ( G 1 , G ′ 1 ) + ⋯ + κ ( G h , G ′ h ) , (7)</p><p>where G 0 = G and l 0 = l , the WL sequence up to height a of G.</p><p>Finally, κ ( h ) is positive semidefinite if the base kernel κ is positive semidefinite [<xref ref-type="bibr" rid="scirp.80537-ref25">25</xref>] , Theorem 3.</p><p>Definition 4 Let Γ k ⊆ Γ be the set of node labels matching at least once in graphs G or G ′ at the end of the k-th iteration of the WL algorithm. We also fix Γ 0 as the set of original node labels of G and G ′ while Γ k are pairwise disjoint. Then, we presume every Γ k = { σ k 1 , ⋯ , σ k | Γ k | } is ordered. Define a map p k : { G , G ′ } &#215; Γ k → ℕ such that p k ( G , σ k l ) amounts the count of the letter σ k l in a graph G . The Weisfeiler-Lehman subtree kernel on two graphs G and G ′ is as follows:</p><p>κ W L s u b t r e e ( h ) ( G , G ′ ) = 〈 ϕ W L s u b t r e e ( h ) ( G ) , ϕ W L s u b t r e e ( h ) ( G ′ ) 〉 , (8)</p><p>where for G (resp. G ′ )</p><p>ϕ W L s u b t r e e ( h ) ( G ) = ( p 0 ( G , σ 01 ) , ⋯ , p 0 ( G , σ 0 | Γ 0 | ) , ⋯ , p h ( G , σ h 1 ) , ⋯ , p h ( G , σ h | Γ h | ) ) .</p><p>This algorithm basically seeks matching of vertex identifiers assuming that the corresponding subgraphs match.</p><p>Definition 5 Provided a function w weighting the edges exits, we can described the corresponding base kernel κ E by ∑ e ∈ E ∑ e ′ ∈ E ′     δ ( α , α ′ ) δ ( β , β ′ ) κ w ( w ( e ) , w ( e ′ ) ) , where δ amounts Dirac kernel and κ w is the similarity captured by a kernel between weights. Hence by 6, the Weisfeiler-Lehman edge kernel turns into</p><p>κ W L e d g e ( h ) = κ E ( G 0 , G ′ 0 ) + κ E ( G 1 , G ′ 1 ) + ⋯ + κ E ( G h , G ′ h ) ,</p><p>where κ E = 〈 ϕ E ( G ) , ϕ E ( G ′ ) 〉 and ϕ E ( G ) is a vector of matching pairs ( α , β ) , α , β ∈ ∑ , which amounts sorted final vertices of an edge in G .</p><p>Definition 6 We also calculate the shortest path version of the Weisfeiler- Lehman kernel. Similarly, it is defined as</p><p>κ W L s h o r t e s t p a t h ( h ) = κ S P ( G 0 , G ′ 0 ) + κ S P ( G 1 , G ′ 1 ) + ⋯ + κ S P ( G h , G ′ h ) ,</p><p>where κ S P ( G , G ′ ) = 〈 ϕ S P ( G ) , ϕ S P ( G ′ ) 〉 and ϕ S P ( G ) denotes a vector composed by the counts of matches for triplets ( α , β , s p l ) in G / G ′ , where α , β ∈ ∑ are sorted final vertices of a shortest path and s p l ∈ ℕ 0 is the shortest path length.</p></sec><sec id="s3_10"><title>3.10. Inference on Random Walk Graph Kernels by Enrichment of Functional Annotations</title><p>So far, we described how to compare UC/ASC graphs, enabling the trace of the underlying similarity between them and their corresponding control samples by gene targets expression profiles from data. Now, we are interesting in performing inference on our topological model to characterise the genetic mechanisms of miRNA perturbations of gene graph in detail. In section 4, we discuss how inference schemes can be used on our estimated model to learn about downstream effects of miRNAs perturbations. We note that all of these inference schemes are based on enrichment analysis in functional annotations (calculation of Fisher’s test [<xref ref-type="bibr" rid="scirp.80537-ref26">26</xref>] is performed to quantitatively capture the functional enrichment of genes according to their annotation terms) using the gene ontology database (GO) [<xref ref-type="bibr" rid="scirp.80537-ref27">27</xref>] .</p></sec></sec><sec id="s4"><title>4. Results and discussion</title><sec id="s4_1"><title>4.1. Data Integration and Spectral Behaviour between the UC Graphs</title><p>We analyse our sequence of graphs individually by comparing some algebraic characteristics.</p><p>As describe in section 3.3, we found that 2390 proteins (<xref ref-type="fig" rid="fig">Figure </xref>S1) from Genemania [<xref ref-type="bibr" rid="scirp.80537-ref12">12</xref>] were reported by the gene expression levels of our miRNA microarrays (<xref ref-type="fig" rid="fig1"><xref ref-type="fig" rid="fig">Figure </xref>1</xref>(b)). The largest amount of those proteins (1071 for 330 miRNAs differentially expressed (see section 3.2) was identified in the ASC sample, whereas the UC patients sample matched in 804 (in 237 miRNAs differentially expressed); the remaining 515 (in 92 miRNAs differentially expressed) corresponded to the sample of control. These amounts seem to be consistent with the medical expectation of discovering, at a larger-scale, perturbed expression profiles involved in the pathways leading to deep ulcerations (ASC). Strikingly, the comparison of their spectra showed dissimilar conclusions; while the eigenvectors of ASC and Control patients exhibit similar patterns regarding UC patients (<xref ref-type="fig" rid="fig">Figure </xref>2(a)), the eigenvalue distributions of the three group of patients display the same Gaussian mixture models (<xref ref-type="fig" rid="fig">Figure </xref>2(b)). However, the algebraic connectivity in ASC and UC resembled each other with associated values of 21 and 18 what means almost twofold greater than the control group with a value of 10. No significant difference was detected among the remaining spectral parameters, i.e., eigencentrality or simple modularity <xref ref-type="fig" rid="fig">Figure </xref>S1. Although we enhance important algebraic and geometric characteristics of our graphs, it seems that no conclusions might be made regarding their similarities per group.</p></sec><sec id="s4_2"><title>4.2. Topological Similarity between Pairs of UC Graphs by Random Walk Kernel</title><p>To measure topological similarity among our three groups of graphs, i.e., UC, ASC and Control with a biological significant, we established a comparison</p><p>between interacting and co-regulated groups of target genes per sample of patient. To this task a random walk kernel on graph is the appropriate selection, as for this graph a random walk amounts a set of target genes in which continuous genes by the walk side are co-expressed and interact. To efficiently compute the random walk, we made use of the CG methods using the parameter λ = 0.001 with convergence threshold set to 10<sup>−6</sup>. In <xref ref-type="fig" rid="fig">Figure </xref>3(a) we contrast the scores of similarity measured by graph kernel computation of the conjugate gradient algorithm referred to UC patients modelled as labeled graphs with that of the direct sparse method. Our approach demonstrates how the group of ASC</p><p>patients is topologically more similar to control patients (0.35 as normalised score ∈ [ 0,1 ] ) than UC are (0.18). Here, closer to 1 means more similar graphs. We recall that the random walk kernel on graph measures the amount of walks shared by the couple of graphs involved in G &#215; (section 3.7). This topological relationship between ASC patients and their group of control is, although relatively unexpected, entirely plausible from a biological and thus medical point of view. Validation of similarities using the Weisfeiler-Lehman Graph Kernels The reliability of our results is also validated by comparing the performances of the random walk and Weisfeiler-Lehman graph kernels. The latter consists of a triplet of robust methods (see methods) in capturing topological and label information on graphs. These algorithms confirmed the same scheme described in our results, i.e., ASC group is closer than UC patients to control group. Whereas a graphical visualisation of these data may be displayed in <xref ref-type="fig" rid="fig">Figure </xref>3(b), the specific normalised (by all the possible paths on the graph) values of the pairwise comparison between patients’ graphs are shown in the following <xref ref-type="table" rid="table1"><xref ref-type="table" rid="table">Table </xref>1</xref>.</p></sec><sec id="s4_3"><title>4.3. Inference on the Topological Model: Malfunction of Lymphoid Structures Induces Deep Ulcers in UC Patients</title><p>We can perform inference on our topological model combining the similarity scores and functional enrichment analysis. Since ASC patients are topologically more similar than UC to Control (<xref ref-type="fig" rid="fig">Figure </xref>3 and <xref ref-type="fig" rid="fig">Figure </xref>5(a)), one natural idea is to explore the lack of or alternatively the low expression levels of miRNA-gene targets involved in enriched pathways from both ASC and control data with respect to UC patients. In the view of the enrichment analysis using GO (<xref ref-type="table" rid="table">Table </xref>SI, <xref ref-type="table" rid="table">Table </xref>SII and <xref ref-type="table" rid="table">Table </xref>SIII) and the above inference constraint, the only enriched functional module fitting our topological model in the colon was that linked to lymphoid nodules (GO:0048541 with p-value = 2.45 e − 4 and q-value = 5.45 e − 2 associated to the Fisher Exact test). Such structures are the equivalent</p><table-wrap id="table1" ><label><xref ref-type="table" rid="table1"><xref ref-type="table" rid="table">Table </xref>1</xref></label><caption><title> Weisfeiler-Lehman graph kernels’ Validation</title></caption><table><tbody><thead><tr><th align="center" valign="middle" >Method/Graph Comparison</th><th align="center" valign="middle" >UC&#196;ASC</th><th align="center" valign="middle" >UC&#196;Control</th><th align="center" valign="middle" >ASC&#196;Control</th></tr></thead><tr><td align="center" valign="middle" >WL subtree</td><td align="center" valign="middle" >0.17</td><td align="center" valign="middle" >0.10</td><td align="center" valign="middle" >0.14</td></tr><tr><td align="center" valign="middle" >WL edge</td><td align="center" valign="middle" >0.05</td><td align="center" valign="middle" >0.01</td><td align="center" valign="middle" >0.02</td></tr><tr><td align="center" valign="middle" >WL shortest path</td><td align="center" valign="middle" >0.004</td><td align="center" valign="middle" >0.002</td><td align="center" valign="middle" >0.003</td></tr></tbody></table></table-wrap><p>to the Peyer’s patches (PPs) in the Ileum. This fact derives from the no detection of such enrichment in the production of immunoglobulins, i.e., sIgA and slgE, in ASC patients as compared to UC patients (<xref ref-type="fig" rid="fig">Figure </xref>4). Such a lack of production in sIgA is a consequence of the relative poorly enriched scores associated to the coding genes ID2 and STAT5, which control the intestinal immune network for sIgA production via negative regulation of class IgA/E class switching [<xref ref-type="bibr" rid="scirp.80537-ref28">28</xref>] and“on-off” recombination of immunoglobulin gene in developing pro-B cells [<xref ref-type="bibr" rid="scirp.80537-ref29">29</xref>] (<xref ref-type="fig" rid="fig">Figure </xref>5(d)―starts highlighted in red). Now, we are equipped with enough information to infer the following hypothesis: There exists a very low production of immune globulin A (sIgA) within ASC patients occasioned by malfunction of lymphoid nodules. Indeed, there is no immune system’s activation, whereas in UC patients we have over-expression of lymphoid nodules related pathways (<xref ref-type="fig" rid="fig">Figure </xref>5(d)).</p><p>The sIgA is an antibody―Y-shaped protein―that plays a critical role in immune function in the mucous membranes. This scenario matches the topological constraint yielded by our model between control and ASC patients. Furthermore, it is been already described how sIgA likely contains other propitious outcomes in overall immunity by means of a diminished inflammation in the digestive tract [<xref ref-type="bibr" rid="scirp.80537-ref30">30</xref>] . There is also evidence that sIgA (low/coding genes under-expression) secretion into body cavities in combination with malfunction of immune cells in PPs [<xref ref-type="bibr" rid="scirp.80537-ref31">31</xref>] [<xref ref-type="bibr" rid="scirp.80537-ref32">32</xref>] [<xref ref-type="bibr" rid="scirp.80537-ref33">33</xref>] is involved in allergic diseases (type 1 diabetes, Ulcerative Colitis/Crohn disease, hay fever or asthma). Thus, the formation of deep ulcers in some UC patients may be caused by the low production of sIgA as a consequence of lymphoid structures malfunction.</p></sec></sec><sec id="s5"><title>5. Conclusion</title><p>This paper first presented the urgent medical problem derived from the occurrence of deep ulcers during the therapy of patients with a severe chronic inflammation in the colon mucosa and how the efficiently computation of a Random walk graph kernel captures similarity between groups of these patients, namely: UC, ASC and Control. We adopt the extended linear algebra in an RKHS to overcome some issues of efficiency in kernels computations taking advantage of the shared structure intrinsic to these questions. The groups of patients were modelled as undirected labeled graphs based on the co-integration of target gene expression profiles and interaction. Thus, the nature of our data and the flexibility of conjugate gradient algorithm made of this method the most appropriate to compute geometrical random walks among other options such as spectral decomposition. We made use of models of sparsity, low effective rank, and Kronecker product to reduce the computational cost in the calculations and exploited specific forms of W &#215; . While other methods of direct comparison to measure similarity like spectral properties are not conclusive; this approach reveals as much more interpretable. Indeed, our results demonstrate how the group of ASC patients topologically resembles Control better than UC patients do. In addition, we stress the reliability of our results by means of a robust triple validation. Albeit, an important caveat of our kernel approach concerns the possible values taken by the parameter λ in (3) which entirely relies on the range of W &#215; as weight matrix. We also show how the topological constraint imposed by the ASC and Control groups drives the analysis of enrichment in functional annotations enabling inference on our topological model. As a consequence, we are able to guide clinicians with a likely hypothesis regarding the low production of slgA and slgE in the ASC group to be conducted during patient’s treatment. Moreover, these results are being further validated by the clinicians and scientists of our team in the “Centre de Recherche sur l’Inflammation” as part of the future work based on this study. Specifically, we plan to performance immunofluorescence experiments, which would experimentally validate our results. we will also extend our analysis to a new cohort of patients applying improved versions of neighbour matching using deep learning models to capture similarities between graph of individual patients. Overall, this work provides practitioners with a useful and biologically meaningful tool to find similarities among patients profiles in a timely manner. Our approach allows them to avoid spending a large amount of time and effort on sweeping lots of experimental results to test eventual therapeutic hypotheses done by hand; therefore, the diagnosis efficiency and accuracy can be enhanced.</p></sec><sec id="s6"><title>Acknowledgements</title><p>We acknowledge the financial support by Institut National de la Sant&#233; et de la Recherche M&#233;dicale (INSERM), Inserm-Transfert, Association Franois Aupetit (AFA), Universit&#233; Diderot Paris 7, and the Investissements d’Avenir programme ANR-11-IDEX-0005-02 and 10-LABX-0017, Sorbonne Paris Cit&#233;, Laboratoire d’excellence INFLAMEX. IM would like to extend his thanks to Dr. Ver&#243;nica G. Doblas for her invaluable discussions and ideas.</p></sec><sec id="s7"><title>Cite this paper</title><p>Morilla, I., Uzzan, M., Cazals-Hatem, D., Zaag, H., Ogier-Denis, E., Wainrib, G. and Tr&#233;ton, X. (2017) Topological Modelling of Deep Ulcerations in Patients with Ulcerative Colitis. Journal of Applied Mathematics and Physics, 5, 2244-2261. https://doi.org/10.4236/jamp.2017.511183</p></sec><sec id="s8"><title>Nomenclature</title><p>miRNA: micro-RNAs ASC: Acute Severe Ulcertative Colitis UC: Ulcerative Colitis κ : kernel application on graphs PSD: Positive Semi-definite Kernel CGs: Conjugate Gradient Methos LN: Log-Normal GLM: Generalized Linear Model PPI: Protein-Protein Interaction ⊗ : Kronecker product of two matrices v e c : column-stacking operator of a matrix RKHS: Reproducing Kernel Hilbert Spaces G: a set of ordered points generating a graph V: an ordered set of vertices E: set of edges of a graph G Φ ( Y ) : matrix of a graph G w x x : weight of an edge ( x , x ) W &#215; : weight matrix associated to the Kronceker product of two matrices D: node degrees matrix A: adjacency matrix of a graph G μ ( l ) : non-negative coefficient of decay for walks of length l W L : Weisfeiler-Lehman kernels κ W L : Weisfeiler-Lehman kernel for κ Σ κ : set of node labels matching at least once in a graph at the end of the k-ith Weisfeiler-Lehman iteration p k : a map counting a specific node label in a graph κ W L s u b t r e e : Weisfeiler-Lehman subtree kernel on two graphs δ : Dirac kernel κ W L e d g e : Weisfeiler-Lehman edge kernel for κ κ W L s h o r t e s t p a t h : Weisfeiler-Lehman shortest path kernel for κ GO: Gene Ontology database PPs: Peyer’s Patches sIgA/E: immunoglobulins A/E ID2: Inhibitor Of DNA Binding 2 STAT5: Signal Transducer And Activator Of Transcription 5.</p><p><xref ref-type="fig" rid="fig">Figure </xref>S1</p><disp-formula id="scirp.80537-formula1"><graphic  xlink:href="//html.scirp.org/file/13-1720987x187.png"  xlink:type="simple"/></disp-formula><disp-formula id="scirp.80537-formula2"><graphic  xlink:href="//html.scirp.org/file/13-1720987x188.png"  xlink:type="simple"/></disp-formula><p>Tables. https://figshare.com/s/795ae25c8bf76ffb2489</p></sec></body><back><ref-list><title>References</title><ref id="scirp.80537-ref1"><label>1</label><mixed-citation publication-type="other" xlink:type="simple">Grainge, M.J., West, J. and Card, T.R. (2010) Role of Drug Transporters and Drug Accumulation in the Temporal Acquisition of Drug Resistance. Lancet, 375, 657-663.</mixed-citation></ref><ref id="scirp.80537-ref2"><label>2</label><mixed-citation publication-type="other" xlink:type="simple">McClements, D. and Probert, C. (2015) Managing Acute Severe Ulcerative Colitis in the Hosptialised Setting. Frontline Gastroenterology, 6, 241-245.</mixed-citation></ref><ref id="scirp.80537-ref3"><label>3</label><mixed-citation publication-type="other" xlink:type="simple">Wang, H., Vo, T., Hajar, A., Li, S., Chen, X., Parissenti, A.M., Brindley, D.N. and Wang, Z. (2014) Multiple Mechanisms Underlying Acquired Resistance to Taxanes in Selected Docetaxel-Resistant Mcf-7 Breast Cancer Cells. BMC Cancer, 14, 37. https://doi.org/10.1186/1471-2407-14-37</mixed-citation></ref><ref id="scirp.80537-ref4"><label>4</label><mixed-citation publication-type="other" xlink:type="simple">Moody, G. (2004) Digital Code of Life: How Bioinformatics is Revolutionizing Science, Medicine, and Business. Wiley, Hoboken, New Jersey.</mixed-citation></ref><ref id="scirp.80537-ref5"><label>5</label><mixed-citation publication-type="other" xlink:type="simple">Gulshan, V., Peng, L., Coram, M., et al. (2016) Development and Validation of a Deep Learning Algorithm for Detection of Diabetic Retinopathy in Retinal Fundus Photographs. JAMA, 316, 2402-2410.</mixed-citation></ref><ref id="scirp.80537-ref6"><label>6</label><mixed-citation publication-type="other" xlink:type="simple">Scholkopf, B. and Smola, A.J. (2002) Learning with Kernels. MIT Press, Cambridge.</mixed-citation></ref><ref id="scirp.80537-ref7"><label>7</label><mixed-citation publication-type="other" xlink:type="simple">Kondor, R. and Lafferty, J.D. (2002) Diffusion Kernels on Graphs and Other Discrete Structures. Proceedings of the International Conference on Machine Learning, 315-322.</mixed-citation></ref><ref id="scirp.80537-ref8"><label>8</label><mixed-citation publication-type="other" xlink:type="simple">Smola, A.J. and Kondor, R. (2003) Kernels and Regularization on Graphs. Proceedings of the Annual Conference on Computational Learning Theory, Lecture Notes in Computer Science, 144-158. https://doi.org/10.1007/978-3-540-45167-9_12</mixed-citation></ref><ref id="scirp.80537-ref9"><label>9</label><mixed-citation publication-type="other" xlink:type="simple">Yanardag, P. and Vishwanathan, S.V.N. (2015) Deep Graph Kernels. In: Proceedings of the 21th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, ACM, New York, 1365-1374. https://doi.org/10.1145/2783258.2783417</mixed-citation></ref><ref id="scirp.80537-ref10"><label>10</label><mixed-citation publication-type="other" xlink:type="simple">Roche-Lima, A. (2016) Implementation and Comparison of Kernel-Based Learning Methods to Predict Metabolic Networks. Network Modeling Analysis in Health Informatics and Bioinformatics, 5, 26. https://doi.org/10.1007/s13721-016-0134-5</mixed-citation></ref><ref id="scirp.80537-ref11"><label>11</label><mixed-citation publication-type="other" xlink:type="simple">Ritchie, M.E., Phipson, B., Wu, D., Hu, Y., Law, C.W., Shi, W. and Smyth, G.K. (2015) Limma Powers Differential Expression Analyses for Rnasequencing and Microarray Studies. Nucleic Acids Research, 43, e47. https://doi.org/10.1093/nar/gkv007</mixed-citation></ref><ref id="scirp.80537-ref12"><label>12</label><mixed-citation publication-type="other" xlink:type="simple">Warde-Farley, D., Donaldson, S.L., Comes, O., Zuberi, K., Badrawi, R., Chao, P., Franz, M., Grouios, C., Kazi, F., Lopes, C.T., Maitland, A., Mostafavi, S., Montojo, J., Shao, Q., Wright, G., Bader, G.D. and Morris, Q. (2010) The Genemania Prediction Server: Biological Network Integration for Gene Prioritization and Predicting Gene Function. Nucleic Acids Research, 38, 214-220.</mixed-citation></ref><ref id="scirp.80537-ref13"><label>13</label><mixed-citation publication-type="other" xlink:type="simple">Fraser, H.B., Hirsh, A.E., Wall, D.P. and Eisen, M.B. (2004) Coevolution of Gene Expression among Interacting Proteins. Proceedings of the National Academy of Science, 24, 9033-9038. https://doi.org/10.1073/pnas.0402591101</mixed-citation></ref><ref id="scirp.80537-ref14"><label>14</label><mixed-citation publication-type="other" xlink:type="simple">Musungu, B.M., Bhatnagar, D., B, R.L., Payne, G.A., Brian, G.O., Fakhoury, A.M. and Geisler, M. (2016) A Network Approach of Gene Coexpression in the Zea mays/Aspergillus avus Pathosystem to Map Host/Pathogen Interaction Pathways. Frontiers in Genetics, 7, 206. https://doi.org/10.3389/fgene.2016.00206</mixed-citation></ref><ref id="scirp.80537-ref15"><label>15</label><mixed-citation publication-type="other" xlink:type="simple">Fiedler, M. (1973) Algebraic Connectivity of Graphs. Czechoslovak Mathematical Journal, 98, Article ID: 298305.</mixed-citation></ref><ref id="scirp.80537-ref16"><label>16</label><mixed-citation publication-type="other" xlink:type="simple">Brouwer, A. and Haemers, W.H. (2011) Spectral Graphs. Springer.</mixed-citation></ref><ref id="scirp.80537-ref17"><label>17</label><mixed-citation publication-type="other" xlink:type="simple">Bernstein, D.S. (2005) Matrix Mathematics. Princeton University Press.</mixed-citation></ref><ref id="scirp.80537-ref18"><label>18</label><mixed-citation publication-type="other" xlink:type="simple">Vishwanathan, S.V.N., Schraudolph, N.N., Kondor, R.I. and Borgwardt, K.M. (2010) Graph Kernels. Journal of Machine Learning Research, 11, 1201-1242.</mixed-citation></ref><ref id="scirp.80537-ref19"><label>19</label><mixed-citation publication-type="book" xlink:type="simple">Sugiyama, M. and Borgwardt, K. (2015) Halting in Random Walk Kernels. In: Cortes, C., Lawrence, N.D., Lee, D.D., Sugiyama, M. and Garnett, R., Eds., Advances in Neural Information Processing Systems 28, Curran Associates, Inc., 1639-1647.</mixed-citation></ref><ref id="scirp.80537-ref20"><label>20</label><mixed-citation publication-type="other" xlink:type="simple">Kang, U., Tong, H. and Sun, J. (2012) Fast Random Walk Graph Kernel. Proceedings of the 12th SIAM International Conference on Data Mining SDM, 828-838. https://doi.org/10.1137/1.9781611972825.71</mixed-citation></ref><ref id="scirp.80537-ref21"><label>21</label><mixed-citation publication-type="other" xlink:type="simple">Nocedal, J. and Wright, S.J. (1999) Numerical Optimization. Springer Series in Operations Research. https://doi.org/10.1007/b98874</mixed-citation></ref><ref id="scirp.80537-ref22"><label>22</label><mixed-citation publication-type="other" xlink:type="simple">Steeb, W.H. and Hardy, Y. (2011) Matrix Calculus and Kronecker Product: A Practical Approach to Linear and Multilinear Algebra. 2nd Edition, World Scientific Publishing Company. https://doi.org/10.1142/8030</mixed-citation></ref><ref id="scirp.80537-ref23"><label>23</label><mixed-citation publication-type="other" xlink:type="simple">Weisfeiler and Lehman, A.A. (1968) A Reduction of a Graph to a Canonical Form and an Algebra Arising during This Reduction. Nauchno-Technicheskaya Informatsia, 9.</mixed-citation></ref><ref id="scirp.80537-ref24"><label>24</label><mixed-citation publication-type="other" xlink:type="simple">Babai, L. and Kucera, L. (1979) Canonical Labelling of Graphs in Linear Average Time. Proceedings Symposium on Foundations of Computer Science, 39-46. https://doi.org/10.1109/SFCS.1979.8</mixed-citation></ref><ref id="scirp.80537-ref25"><label>25</label><mixed-citation publication-type="other" xlink:type="simple">Shervashidze, N., Schweitzer, P., van Leeuwen, E.J., Mehlhorn, K. and Borgwardt, K.M. (2011) Weisfeiler-Lehman Graph Kernels. Journal of Machine Learning Research, 12, 2539-2561.</mixed-citation></ref><ref id="scirp.80537-ref26"><label>26</label><mixed-citation publication-type="other" xlink:type="simple">Sprent, P. (1993) Applied Nonparametric Statistical Methods. 2nd Editon, Chapman and Hall, London.</mixed-citation></ref><ref id="scirp.80537-ref27"><label>27</label><mixed-citation publication-type="journal" xlink:type="simple"><name name-style="western"><surname>Consortium</surname><given-names> G.O. </given-names></name>,<etal>et al</etal>. (<year>2017</year>)<article-title>Expansion of the Gene Ontology Knowledgebase and Resources</article-title><source> Nucleic Acids Research</source><volume> 45</volume>,<fpage> D331</fpage>-<lpage>D338</lpage>.<pub-id pub-id-type="doi"></pub-id></mixed-citation></ref><ref id="scirp.80537-ref28"><label>28</label><mixed-citation publication-type="other" xlink:type="simple">Sugai, M., Gonda, H., Kusunoki, T., Kataki, T., Yokota, Y. and Shimizu, A. (2002) Essential Role of id2 in Negative Regulation of Ige Class Switching. Nature Immunology, 4, 25-29.</mixed-citation></ref><ref id="scirp.80537-ref29"><label>29</label><mixed-citation publication-type="other" xlink:type="simple">Malin, S., McManus, S., Cobaleda, C., Novatchkova, M., Delogu, A., Bouil-let, P., Strasser, A. and Busslinger, M. (2010) Role of stat5 in Controlling Cell Survival and Immunoglobulin Gene Recombination during Pro-b Cell Development. Nature Immunology, 11, 171-179.</mixed-citation></ref><ref id="scirp.80537-ref30"><label>30</label><mixed-citation publication-type="other" xlink:type="simple">Robinson, L.E. and Reeves, S. (2015) Review of Sigas Major Role as a Ffrst Line of Immune Defense and New Indications Regarding Inammation and Gut Health. Epicor Science Report, 25, 25-29.</mixed-citation></ref><ref id="scirp.80537-ref31"><label>31</label><mixed-citation publication-type="other" xlink:type="simple">Rai, T., Wu, X. and Shen, B. (2015) Frequency and Risk Factors of Low Immunoglobulin Levels in Patients with Inammatory Bowel Disease. Gastroenterology Report, 2, 115-121.</mixed-citation></ref><ref id="scirp.80537-ref32"><label>32</label><mixed-citation publication-type="other" xlink:type="simple">Mulder, S.J. and Mulder-Bos, G.C. (2006) Most Probable Origin of Coeliac Disease Is Low Immune Globulin a in the Intestine Caused by Malfunction of Peyers Patches. Medical Hypotheses, 66, 757-762.</mixed-citation></ref><ref id="scirp.80537-ref33"><label>33</label><mixed-citation publication-type="other" xlink:type="simple">Kawakota, S., Tran, T.H., Maruya, M., Suzuki, K., Doi, Y., Tsutsui, Y., Kato, L.M. and Fagarasan, S. (2012) The Inhibitory Receptor pd-1 Regulates iga Selection and Bacterial Composition in the Gut. Science, 336, 485-489.</mixed-citation></ref></ref-list></back></article>