<?xml version="1.0" encoding="UTF-8"?><!DOCTYPE article  PUBLIC "-//NLM//DTD Journal Publishing DTD v3.0 20080202//EN" "http://dtd.nlm.nih.gov/publishing/3.0/journalpublishing3.dtd"><article xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink" dtd-version="3.0" xml:lang="en" article-type="research article"><front><journal-meta><journal-id journal-id-type="publisher-id">OJS</journal-id><journal-title-group><journal-title>Open Journal of Statistics</journal-title></journal-title-group><issn pub-type="epub">2161-718X</issn><publisher><publisher-name>Scientific Research Publishing</publisher-name></publisher></journal-meta><article-meta><article-id pub-id-type="doi">10.4236/ojs.2017.76069</article-id><article-id pub-id-type="publisher-id">OJS-81020</article-id><article-categories><subj-group subj-group-type="heading"><subject>Articles</subject></subj-group><subj-group subj-group-type="Discipline-v2"><subject>Physics&amp;Mathematics</subject></subj-group></article-categories><title-group><article-title>
 
 
  Applying Multivariate Multilevel Models to Explore Arable Land Quality in Sub-Saharan Africa: A Case Study in Kenya
 
</article-title></title-group><contrib-group><contrib contrib-type="author" xlink:type="simple"><name name-style="western"><surname>Davies</surname><given-names>D. Onduru</given-names></name><xref ref-type="aff" rid="aff1"><sup>1</sup></xref><xref ref-type="corresp" rid="cor1"><sup>*</sup></xref></contrib><contrib contrib-type="author" xlink:type="simple"><name name-style="western"><surname>Fred</surname><given-names>Onyango</given-names></name><xref ref-type="aff" rid="aff2"><sup>2</sup></xref></contrib></contrib-group><aff id="aff2"><addr-line>School of Mathematics, Statistics and Actuarial Science, Maseno University, Private Bag, Maseno, Kenya</addr-line></aff><aff id="aff1"><addr-line>ETC East Africa, Yaya, Nairobi, Kenya</addr-line></aff><author-notes><corresp id="cor1">* E-mail:<email>ddonduru@gmail.com(DDO)</email>;</corresp></author-notes><pub-date pub-type="epub"><day>15</day><month>11</month><year>2017</year></pub-date><volume>07</volume><issue>06</issue><fpage>972</fpage><lpage>987</lpage><history><date date-type="received"><day>29,</day>	<month>October</month>	<year>2017</year></date><date date-type="rev-recd"><day>10,</day>	<month>December</month>	<year>2017</year>	</date><date date-type="accepted"><day>13,</day>	<month>December</month>	<year>2017</year></date></history><permissions><copyright-statement>&#169; Copyright  2014 by authors and Scientific Research Publishing Inc. </copyright-statement><copyright-year>2014</copyright-year><license><license-p>This work is licensed under the Creative Commons Attribution International License (CC BY). http://creativecommons.org/licenses/by/4.0/</license-p></license></permissions><abstract><p>
 
 
  Controversy exists on the magnitude and variability of farm nutrient balances and quality of arable land in sub-Saharan Africa with Kenya among those affected negatively. This study investigates quality of arable land by fitting multivariate multilevel model to farm nutrient balance data collected from five agro-climatic zones of Kenya (arable lands). Objectives of the study were to investigate the magnitude and variability of Nitrogen, Phosphorus and Potassium (NPK) farm nutrient balances in arable lands of Kenya, study effects of agro-climatic zones on nutrient balances and to determine effects of household resource endowments on NPK nutrient balances. The study concludes that agro-climatic zones differ with respect to farm nutrient balances; that livestock resource endowments and hired labour have positive effects on the magnitude and direction of farm nutrient balances; and that household ownership of large capital resources do 
  not guarantee a positive effect on farm nutrient balances. The study recommends integration of sound livestock practices and application of agro-climatic zone differentiated interventions in future strategies for addressing farm nutrient balances and arable land quality, and the use of large sample sizes and relevant factors/
  covariates
   in future analysis to shed additional insights on farm nutrient balances and on how arable land quality can be im
  proved.
 
</p></abstract><kwd-group><kwd>Meta-Analysis</kwd><kwd> Multilevel Models</kwd><kwd> Nutrient Balance</kwd><kwd> Sub-Saharan Africa</kwd><kwd> Kenya</kwd></kwd-group></article-meta></front><body><sec id="s1"><title>1. Introduction</title><p>Seminal studies conducted at national and regional levels in sub-Saharan Africa, using nutrient balance approach, have indicated declining arable land quality with severe net nutrient losses of the order of 10 kg Nitrogen, 4 kg phosphates and 10 kg potash per hectare annually [<xref ref-type="bibr" rid="scirp.81020-ref1">1</xref>] with Kenya being one of the countries with net nutrient losses [<xref ref-type="bibr" rid="scirp.81020-ref1">1</xref>] . Empirical roots of nutrient balance studies are widely acknowledged [<xref ref-type="bibr" rid="scirp.81020-ref2">2</xref>] . However, opinions are divided on the extent and intensity of nutrient mining and variability; whether farmers’ achievements contradict nutrient depletion scenarios [<xref ref-type="bibr" rid="scirp.81020-ref3">3</xref>] ; whether levels of nutrient mining differ by agroecological zones and land use systems; whether underlying factors exist to explain direction and magnitude of nutrient balances [<xref ref-type="bibr" rid="scirp.81020-ref4">4</xref>] ; and how nutrient balances can be scaled-up.</p><p>One of the reasons why consensual accounts on nutrient balances remain intractable and illusive and at times anecdotal [<xref ref-type="bibr" rid="scirp.81020-ref5">5</xref>] is the limited use of rigorous statistical techniques to i) handle dependency in data and to reduce biases associated with variance estimates and inflation of Type I error [<xref ref-type="bibr" rid="scirp.81020-ref6">6</xref>] [<xref ref-type="bibr" rid="scirp.81020-ref7">7</xref>] , ii) to quantify between study variability [<xref ref-type="bibr" rid="scirp.81020-ref8">8</xref>] and iii) to handle multiple outcomes/effect sizes simultaneously [<xref ref-type="bibr" rid="scirp.81020-ref9">9</xref>] . Nutrient balance studies are inherently associated with myriad challenges: inadequate systematic replication in space or in time [<xref ref-type="bibr" rid="scirp.81020-ref10">10</xref>] , dependencies in multiple outcomes, multicollinearity in independent variables, non-homogeneity in data, and missing values, and inadequate application of statistical techniques that can deal with nested or clustered data associated with such studies that use complex survey designs [<xref ref-type="bibr" rid="scirp.81020-ref11">11</xref>] [<xref ref-type="bibr" rid="scirp.81020-ref10">10</xref>] . This study explores application of multivariate multilevel models in a meta-analysis of nutrient balances and thereby contributes to addressing the above challenges and controversies. Application of statistical procedures for meta-analysis was previously a domain of the health Sector but has recently been adopted in other disciplines [<xref ref-type="bibr" rid="scirp.81020-ref12">12</xref>] . Meta-analysis statistical techniques have a potential to address challenges and controversies by pooling and analyzing multiple studies together thereby improving statistical power and reducing the likelihood of type II error (failure to determine a difference that truly exist); increasing precision of estimates [<xref ref-type="bibr" rid="scirp.81020-ref13">13</xref>] ; relating outcome heterogeneity to explanatory covariates and factors, and identifying large scale-patterns even when obscured by local factors, thereby minimizing the danger of over-extrapolation from single context-based studies [<xref ref-type="bibr" rid="scirp.81020-ref14">14</xref>] .</p><p>Approaches to model estimation in meta-analysis vary widely. Descriptive analysis and paired t-test have been used in meta-analysis of nutrient balances drawn from 57 studies in Africa and concluded that there were positive soil nitrogen and potassium balances in some spots in Africa [<xref ref-type="bibr" rid="scirp.81020-ref5">5</xref>] while there was nutrient mining in others. Descriptive analysis has been used to identify drivers of tropical deforestation from 152 previous studies [<xref ref-type="bibr" rid="scirp.81020-ref15">15</xref>] , Ordinary Least Squares have been used in analysis of returns to agricultural research and development from 289 studies [<xref ref-type="bibr" rid="scirp.81020-ref16">16</xref>] , a binomial test has been used in meta-analysis of the differences in environmental impacts between organic and conventional farming based on 59 previous studies [<xref ref-type="bibr" rid="scirp.81020-ref17">17</xref>] and vote counting has been used in meta-analysis of agroforestry adoption based on 32 studies from 32 countries [<xref ref-type="bibr" rid="scirp.81020-ref18">18</xref>] . Classical meta-analysis that estimates model parameters in addition to within- and-between study variability (random effects model) [<xref ref-type="bibr" rid="scirp.81020-ref19">19</xref>] [<xref ref-type="bibr" rid="scirp.81020-ref20">20</xref>] has also been used in a meta-analysis of the effects of woody and herbaceous legumes on maize yield in sub-Saharan Africa based on 94 studies from West, East and Southern Africa and concluded that inorganic fertilisers gave better maize grain yield response than legume trees and green manures, natural fallows and unfertilized maize in that order; and that “global maize yield response to legumes was significantly positive and higher than unfertilized maize and natural vegetation fallows” [<xref ref-type="bibr" rid="scirp.81020-ref21">21</xref>] .</p><p>Current methods of meta-analysis, however, have several limitations [<xref ref-type="bibr" rid="scirp.81020-ref10">10</xref>] [<xref ref-type="bibr" rid="scirp.81020-ref11">11</xref>] : Inadequacies in modeling multiple outcomes simultaneously, in addressing dependencies in multiple outcomes (use incorrect standard errors), in dealing with non-linear correlations and non-homogeneity in data and in handling nested or clustered data [<xref ref-type="bibr" rid="scirp.81020-ref11">11</xref>] , yet these challenges characterise nutrient balance studies where response variables (outcomes) are often multivariate and have dependencies. Furthermore, methods such as vote counting and sign tests have been deplored due to their low power and the fact that they ignore sample size and effect magnitude [<xref ref-type="bibr" rid="scirp.81020-ref22">22</xref>] while descriptive statistics do not provide a framework to explore the effects of multiple covariates and factors on the dependent variables.</p><p>Possible approaches to modeling multiple outcomes of nutrient balances, taking into account the above challenges, include: multivariate fixed and random effects models, structural equation models, and multilevel models for modeling primary data among others [<xref ref-type="bibr" rid="scirp.81020-ref23">23</xref>] . Although the fore-mentioned methods offer a potential in meta-analysis, they have not been applied to nutrient balance studies. Further, the application of multivariate fixed and random effects models are constrained by limited availability of within-study correlation and variances for estimating the variance-covariance matrix required in the model when summary statistics are used in meta-analysis and when there are no individual participant data to estimate required variance-covariance matrix [<xref ref-type="bibr" rid="scirp.81020-ref23">23</xref>] . A “work- around” that has been proposed to estimate “missing” correlations in such situations include the use of estimates from similar published work, conducting sensitivity analyses for possible ranges of correlations and the use of Bayesian hierarchical models with vague priors in a Markov Chain Monte Carlo (MCMC) framework among others [<xref ref-type="bibr" rid="scirp.81020-ref23">23</xref>] .</p><p>In this study we demonstrate that multivariate multilevel models can be used in meta-analysis of farm nutrient balance data arising from complex surveys that involve multi-stage sampling, stratification and unequal sampling probabilities [<xref ref-type="bibr" rid="scirp.81020-ref24">24</xref>] . A previous meta-analysis of 54 studies using multilevel models, and through application of simulation studies for comparison, has shown that dependencies and heterogeneity at different model hierarchy can be effectively accounted for and that multiple outcomes can be modeled simultaneously using multivariate multilevel models [<xref ref-type="bibr" rid="scirp.81020-ref6">6</xref>] . Multilevel models also have a potential to estimate variances and standard errors correctly for nested data, model relationships between information at different levels of model hierarchies; and has ability to improve estimation and predictions and to analyse repeated measures data among others [<xref ref-type="bibr" rid="scirp.81020-ref25">25</xref>] .</p><p>This study uses individual participant data from multiple related cross-sectional surveys on nutrient balances from five different agro-ecological zones of Kenya to investigate the quality of arable land by estimating the magnitude and variability of Nitrogen, Phosphorus and Potassium (NPK) nutrient balances, assessing whether agro-climatic zones differ with respect to NPK nutrient balances and determining the effects of household resource endowments on NPK nutrient balances. To meet the research objectives, the study fitted a two-level multilevel model (multivariate multilevel model) with random intercept to farm nutrient balance data in a meta-analysis that used Iterative Generalised Least Squares (IGLS), an equivalent maximum likelihood method [<xref ref-type="bibr" rid="scirp.81020-ref26">26</xref>] [<xref ref-type="bibr" rid="scirp.81020-ref27">27</xref>] , to estimate model parameters as described in the R-package R2MLwiN.</p></sec><sec id="s2"><title>2. Methodology</title><sec id="s2_1"><title>2.1. Dataset</title><p>NUTrient MONitoring (NUTMON) data is used in this study. NUTMON is part of on-going research to investigate land quality and sustainability of smallholder farming systems in the tropics. The data used comprise 14 separate studies, from 5 research initiatives that used NUTMON methodology in different agro-climatic zones of Kenya. A single research initiative working in “n” agro-climatic zones was considered to have “n” separate studies (where n = number of studies). Studies which did not use multi-stage sampling to identify study participants were excluded from the analysis (on-farm and on-station experiments excluded).</p><p>The data comprised 349 observations (individual smallholder farm-households). About 42% and 25% of the smallholder farm-households in the dataset were from semi-humid to semi-arid (ACZ4), and semi-arid areas (ACZ5) of Kenya respectively. Farm households from humid (ACZ1), sub-humid (ACZ2) and semi-humid (ACZ3) areas accounted for 12%, 15% and 7% of total households in the dataset respectively. The arid (ACZ 6) and very arid (ACZ 7), with very low potential for plant production, were not represented in the dataset (<xref ref-type="table" rid="table1">Table 1</xref>).</p><p>The 349 observations have 3 dependent variables: N full balance (kg ha<sup>−</sup><sup>1</sup>); P full balance (kg ha<sup>−</sup><sup>1</sup>); and K full balance (kg ha<sup>−</sup><sup>1</sup>) and 18 selected independent variables (factors/covariates). The latter were measured at two levels: 1) at level of individual farmers (household resource endowments); and 2) at agro-climatic zone level (<xref ref-type="table" rid="table2">Table 2</xref>).</p></sec><sec id="s2_2"><title>2.2. General Analysis Methods</title><p>The study used the following general analysis methods:</p><p>1) Determined whether a two-level multi-level model with multiple outcome variables (multivariate multi-level model) is required for the NUTMON dataset.</p><table-wrap id="table1" ><label><xref ref-type="table" rid="table1">Table 1</xref></label><caption><title> Study areas in Kenya and number of observations (farm-households)</title></caption><table><tbody><thead><tr><th align="center" valign="middle" >Study acronym</th><th align="center" valign="middle" >Humid (ACZ1)</th><th align="center" valign="middle" >Sub-humid (ACZ2)</th><th align="center" valign="middle" >Semi-humid (ACZ3)</th><th align="center" valign="middle" >Semi-humid to semi-arid (ACZ4)</th><th align="center" valign="middle" >Semi-arid (ACZ5)</th><th align="center" valign="middle" >Total</th></tr></thead><tr><td align="center" valign="middle" >ENSET INMASP LEINUTS NUTSAL VARINUTS Total</td><td align="center" valign="middle" >0 0 36 0 6 42</td><td align="center" valign="middle" >0 46 0 0 6 52</td><td align="center" valign="middle" >18 0 0 0 6 24</td><td align="center" valign="middle" >9 59 0 71 6 145</td><td align="center" valign="middle" >9 0 35 36 6 86</td><td align="center" valign="middle" >36 105 71 107 30 349</td></tr></tbody></table></table-wrap><table-wrap id="table2" ><label><xref ref-type="table" rid="table2">Table 2</xref></label><caption><title> Factors and covariates used as independent variables in this study</title></caption><table><tbody><thead><tr><th align="center" valign="middle" ></th><th align="center" valign="middle" >Description</th><th align="center" valign="middle" >Number of variables</th><th align="center" valign="middle" >Explanations</th></tr></thead><tr><td align="center" valign="middle" >1A</td><td align="center" valign="middle" >Level 1 factors/covariates</td><td align="center" valign="middle" ></td><td align="center" valign="middle" ></td></tr><tr><td align="center" valign="middle" >1.1</td><td align="center" valign="middle" >Household Resource endowment</td><td align="center" valign="middle" >17</td><td align="center" valign="middle" >Comprise labour, land units, livestock, nutrient stocks and crop and livestock diversity</td></tr><tr><td align="center" valign="middle" >2</td><td align="center" valign="middle" >Level 2</td><td align="center" valign="middle" ></td><td align="center" valign="middle" ></td></tr><tr><td align="center" valign="middle" >2.1</td><td align="center" valign="middle" >Agro-climatic zone (ACZ)</td><td align="center" valign="middle" >1</td><td align="center" valign="middle" >ACZ1 (Humid), ACZ2 (Sub-humid), ACZ3 (Semi-humid), ACZ4 (Semi-humid-to-Semi arid), ACZ5(Semi-arid)</td></tr><tr><td align="center" valign="middle" ></td><td align="center" valign="middle" >Total variables</td><td align="center" valign="middle" >18</td><td align="center" valign="middle" ></td></tr></tbody></table></table-wrap><p>2) Based on (1) above, applied a two-level multi-level model (multivariate multi-level model) to:</p><p>Estimate an aggregate magnitude and variability of nutrient balances across agro-climatic zones that cover arable lands of Kenya;</p><p>Determine whether agro-climatic zones differ from each other in terms of NPK nutrient balances; and to</p><p>Identify the effects of household resource endowments on NPK nutrient balances.</p></sec><sec id="s2_3"><title>2.3. Determining Necessity of a Two-Level Multi-Level Model (Multivariate Multilevel Model)</title><p>The study fitted a two-level multilevel model (multivariate multilevel model) without predictors (variance component model) to NUTMON dataset to determine whether multilevel modeling was needed at all for this dataset. Intra-class correlation Coefficient (ICC) and Design effect were calculated to aid in model output interpretation.</p><p>The multilevel equations for the variance component model were specified as follows:</p><p>Level 1: y i j = β o j + ϵ i j</p><p>Level 2: β o j = γ o o + ϵ o j</p><p>Written in (mixed model) form by substitution of the level-2 equation into the level-1 equation, the model is:</p><p>y i j = γ o o + ϵ o j + ϵ i j (1)</p><p>where:</p><p>y i j = Individual response variable for i<sup>th</sup> farmer (level-1) in j<sup>th</sup> agro-climatic zone;</p><p>β o j = Random intercept for j<sup>th</sup> agro-climatic zone (mean of all individual farmers in j<sup>th</sup> agroclimatic zone)</p><p>γ o o = Random intercept for all j agro-climatic zones (grand mean of all js)</p><p>ϵ i j = Residual effect (variation) for i<sup>th</sup> farmer around the mean of j<sup>th</sup> agroclimatic zone (random effect)</p><p>ϵ o j = Residual effect (variation) for j<sup>th</sup> agro-climatic zone around the grand mean (of all agro-climatic zones ie across all js)</p><p>ϵ i j ~ N ( 0 , σ e 2 ) ; σ e 2 is the variance at individual farmer (level-1)</p><p>ϵ o j ~ N ( 0 , σ u 2 ) ; σ u 2 is the variance at agro-climatic zone (level-2)</p><p>The study used Iterative Generalised Least Squares (IGLS) estimation algorithms in R2MLwiN package, to return estimates for random coefficients and their standard errors, estimates for deviance statistics and for variances and covariances for single and two level models (<xref ref-type="table" rid="table3">Table 3</xref>).</p><p>The study calculated Study Design Effect<sup>1</sup> for the two level model as follows:</p><p>Designeffect = 1 + ( n c − 1 ) ICC</p><p>where:</p><table-wrap id="table3" ><label><xref ref-type="table" rid="table3">Table 3</xref></label><caption><title> Two-level multilevel variance component model compared with a single level model (fixed part of the model)</title></caption><table><tbody><thead><tr><th align="center" valign="middle"  rowspan="2"  >2[<xref ref-type="bibr" rid="scirp.81020-ref1">1</xref>]*Level-structure of the model</th><th align="center" valign="middle"  rowspan="2"  >Fixed part</th><th align="center" valign="middle"  rowspan="2"  >Coefficient</th><th align="center" valign="middle"  rowspan="2"  >Std. Err</th><th align="center" valign="middle"  colspan="2"  >95% Confidence Interval</th></tr></thead><tr><td align="center" valign="middle" >Lower boundary</td><td align="center" valign="middle" >Upper boundary</td></tr><tr><td align="center" valign="middle" >2[<xref ref-type="bibr" rid="scirp.81020-ref1">1</xref>]*Two-level multilevel model</td><td align="center" valign="middle" >Nitrogen balance</td><td align="center" valign="middle" >−11.92</td><td align="center" valign="middle" >17.93</td><td align="center" valign="middle" >−47.06</td><td align="center" valign="middle" >23.22</td></tr><tr><td align="center" valign="middle" ></td><td align="center" valign="middle" >Phosphorus balance</td><td align="center" valign="middle" >9.85</td><td align="center" valign="middle" >4.56</td><td align="center" valign="middle" >0.92</td><td align="center" valign="middle" >18.78</td></tr><tr><td align="center" valign="middle" ></td><td align="center" valign="middle" >Potassium balance</td><td align="center" valign="middle" >5.47</td><td align="center" valign="middle" >6.29</td><td align="center" valign="middle" >−6.85</td><td align="center" valign="middle" >17.79</td></tr><tr><td align="center" valign="middle" ></td><td align="center" valign="middle" >Deviance statistic</td><td align="center" valign="middle" >10,461</td><td align="center" valign="middle" ></td><td align="center" valign="middle" ></td><td align="center" valign="middle" ></td></tr><tr><td align="center" valign="middle" ></td><td align="center" valign="middle" >No. of observations</td><td align="center" valign="middle" >349</td><td align="center" valign="middle" ></td><td align="center" valign="middle" ></td><td align="center" valign="middle" ></td></tr><tr><td align="center" valign="middle" >One-level model</td><td align="center" valign="middle" >Nitrogen balance</td><td align="center" valign="middle" >2.57</td><td align="center" valign="middle" >4.37</td><td align="center" valign="middle" >−11.14</td><td align="center" valign="middle" >6</td></tr><tr><td align="center" valign="middle" ></td><td align="center" valign="middle" >Phosphorus balance</td><td align="center" valign="middle" >9.72</td><td align="center" valign="middle" >1.77</td><td align="center" valign="middle" >6.25</td><td align="center" valign="middle" >13.2</td></tr><tr><td align="center" valign="middle" ></td><td align="center" valign="middle" >Potassium balance</td><td align="center" valign="middle" >6.46</td><td align="center" valign="middle" >3.13</td><td align="center" valign="middle" >0.33</td><td align="center" valign="middle" >12.59</td></tr><tr><td align="center" valign="middle" ></td><td align="center" valign="middle" >Deviance statistic</td><td align="center" valign="middle" >10,657.2</td><td align="center" valign="middle" ></td><td align="center" valign="middle" ></td><td align="center" valign="middle" ></td></tr><tr><td align="center" valign="middle" ></td><td align="center" valign="middle" >No. of observations</td><td align="center" valign="middle" >349</td><td align="center" valign="middle" ></td><td align="center" valign="middle" ></td><td align="center" valign="middle" ></td></tr></tbody></table></table-wrap><p><sup>1</sup>Quantifies the effects of violating the assumption of independence on standard error estimates; Multiplier to be applied to standard errors to correct for negative bias that results from nested data.</p><p>n c = Average number of farmers per study; In this case (349/14) = 28.1</p><p>ICC = Intraclass correlation coefficient (at level 2); an estimate of proportion of variance at level-2</p><p>ICC at level-2 was estimated separately for Nitrogen, Phosphorus and Potassium farm nutrient balances using:</p><p>ICC = σ u 2 σ e 2 + σ u 2 (2)</p><p>where</p><p>σ e 2 = Residual variance at level-1</p><p>σ u 2 = residual variance at level-2</p><p>σ e 2 + σ u 2 = Total variance at level-2</p><p>The design effects for each nutrient balance were greater than 2.0 (<xref ref-type="table" rid="table4">Table 4</xref>). Previous analysis has shown that a design effect greater than 2.0 indicates the need for multilevel modeling [<xref ref-type="bibr" rid="scirp.81020-ref28">28</xref>] . Thus, the preliminary analysis indicates that multilevel modeling is appropriate for this nutrient balance dataset and a two-level multilevel model (multivariate multilevel) is suitable for this purpose; and is therefore applied in subsequent analyses in line with the objectives of this study.</p></sec><sec id="s2_4"><title>2.4. Estimating Magnitude and Variability of Nutrient Balances</title><p>To estimate an aggregate magnitude and variability of nutrient balances across agro-climatic zones of Kenya, the study used Equation (1), describing a variance component model. Iterative Generalised Least Squares (IGLS) in R2MLwiN package used to quantify the parameters of the model, returned parameter estimates shown in (<xref ref-type="table" rid="table3">Table 3</xref>), Section 2.3.</p><p>Similarly, variability of nutrient balances (heterogeneity) at level-1 and at level- 2 model hierarchy were estimated using Variance Partitioning Coeffcient (VPC)/Intra-class correlation coeffcient (ICC) using Equation (2) (see explanation in Section 2.3):</p><p>VPC e ( ICC ) = σ e 2 σ e 2 + σ u 2 = var ( ϵ i j ) var ( σ e 2 ) + var ( σ u 2 ) (3)</p><p>where</p><p>ϵ i j ~ N ( 0 , σ e 2 ) ; σ e 2 is the variance at individual farmer (level-1)</p><p>ϵ o j ~ N ( 0 , σ u 2 ) ; σ u 2 is the variance at agro-climatic zone (level-2)</p><table-wrap id="table4" ><label><xref ref-type="table" rid="table4">Table 4</xref></label><caption><title> Design effect for NPK nutrient balances</title></caption><table><tbody><thead><tr><th align="center" valign="middle" >Nutrient balance</th><th align="center" valign="middle" >n c</th><th align="center" valign="middle" >ICC</th><th align="center" valign="middle" >Design effect</th></tr></thead><tr><td align="center" valign="middle" >Nitrogen</td><td align="center" valign="middle" >28.1</td><td align="center" valign="middle" >0.48</td><td align="center" valign="middle" >14</td></tr><tr><td align="center" valign="middle" >Phosphorus</td><td align="center" valign="middle" >28.1</td><td align="center" valign="middle" >0.21</td><td align="center" valign="middle" >6.7</td></tr><tr><td align="center" valign="middle" >Potassium</td><td align="center" valign="middle" >28.1</td><td align="center" valign="middle" >0.11</td><td align="center" valign="middle" >4</td></tr></tbody></table></table-wrap><p>n c = Average no. of farmers per study; ICC = Intraclass correlation Coeffcient.</p></sec><sec id="s2_5"><title>2.5. Determining Whether Agro-Climatic Zones Differ from Each Other with Respect to NPK Nutrient Balances</title><p>To determine whether agro-climatic zones differ from each other with respect to nutrient balances, Equation (1) describing a variance component model was used. Parameter estimates were obtained in a similar way as in Section 2.3. The parameter estimates are presented in <xref ref-type="table" rid="table3">Table 3</xref>.</p><p>Further, in assessing whether agro-climatic zones differ from each other, the study determined whether the variance ( σ u 2 ) of the random component of the intercept in Equation (1), ϵ o j , was different from zero. A 95% confidence interval for the variance of ϵ o j was used to aid model output interpretation. Also, a likelihood ratio test was conducted by comparing the deviances of a model with ϵ o j and one without ϵ o j to assess whether σ u 2 (variance at level-2: agroclimatic zone) is significant. The null hypothesis for the latter was σ u 2 = 0 , so we do not need ϵ o j in the model (Ho: no agro-climatic zone variation or cluster effect exists and restricted or single model is “the true model”).</p><p>Natural log used in Likelihood ratio test:</p><p>L R = ( − 2 log L 0 ) − ( − 2 log L 1 ) = D 0 − D 1     with   1   df</p><p>where:</p><p>L 0 = Likelihoodvalueforasinglelevelmodeliewithout   ϵ o j</p><p>L 1 = Likelihoodvalueforatwo-levelmodeliewith   ϵ o j</p><p>D 0 = Deviancestatisticsforasinglelevelmodel-without   ϵ o j</p><p>D 1 = Deviancestatisticforatwo-levelmodeliewith   ϵ o j</p><p>The p-value associated with the Likelihood ratio (LR) test statistic was determined from Chi Square distribution (with 1 degree of freedom).</p></sec><sec id="s2_6"><title>2.6. Effects of Household Resource Endowments on Nutrient Balances</title><p>The study fitted a two-level multilevel model (multivariate multilevel model) to NUTMON dataset to determine the effects of household resource endowments on NPK nutrient balances. The household resource endowments in <xref ref-type="table" rid="table2">Table 2</xref> were added to the model as explanatory variables (in the fixed part of the model) and the intercepts at level-1 and level-2 model hierachy allowed to vary resulting in arandom intercept model. Slopes for the explanatory variables were not allowed to vary since they were fitted to the fixed part of the model only.</p><p>The multilevel equations for this model was specified as follows:</p><p>Level 1: y i j = β o j + β k j _ X k i j _ + ϵ i j , (for i = 1 , 2 , 3 , ⋯ , 349 ; j = 1 , 2 , 3 , 4 , 5 ; k = 1 , 2 , 3 , ⋯ , 18 )</p><p>Level 2: β o j = γ o o + γ o n _ Z o n j _ + ϵ o j ; β k j _ = γ k o _</p><p>Written in mixed model form by substitution of the level-2 equations into the level-1 equation, the model is:</p><p>y i j = γ o o + γ o n _ Z o n j _ + γ k o _ X k i j _ + ϵ o j + ϵ i j (3)</p><p>where at level-1:</p><p>y i j = Individual response variable for i<sup>th</sup> farmer (level-1) in j<sup>th</sup> agro-climatic zone;</p><p>β o j = Random intercept for j<sup>th</sup> agro-climatic zone (mean of all individual farmers in j<sup>th</sup> agroclimatic zone); each agro-climatic zone is assumed to have a different intercept coeffcient, β o j</p><p>x k i j _ = A vector of k predictor variables for the i<sup>th</sup> farmer in j<sup>th</sup> agro-climatic zone</p><p>β k j _ = A vector of k regression coeffcients associated with the predictor variables in j<sup>th</sup> agro-climatic zone:</p><p>x k i j _ = ( X 1 i j X 2 i j X 3 i j ⋮ X k i j ) ;   β k j _ = ( β 1 j β 2 j β 3 j ⋮ β k j )</p><p>ϵ i j = Residual effect (variation) for i<sup>th</sup> farmer in j<sup>th</sup> agro-climatic zone</p><p>where at level-2:</p><p>γ o o = Random intercept for all five agro-climatic zones (grand mean of all j groups); The ( β o j )s’ are considered to vary randomly around a grand mean of all j groups ( γ o o ) at level-2</p><p>Z o n j _ = A vector of n predictor variables measured at agro-climatic zone level (level-2 or j-level)</p><p>γ o n = A vector of n regression coefficients associated with the predictor variables at agro-climatic zone level (non-random coefficients):</p><p>Z o n j _ = ( Z o 1 j Z o 2 j Z o 3 j ⋮ Z 0 n j ) ;   γ o n _ = ( γ o 1 γ o 2 γ o 3 ⋮ γ o n )</p><p>ϵ o j = Residual effect (variation) for j<sup>th</sup> agro-climatic zone; ie the deviation of the intercept of j<sup>th</sup> agro-climatic zone from overall intercept of all agro-climatic zones (all js)</p><p>γ k o = A vector of k (fixed) regression coefficients indicating that the coefficients of Level-1 predictors ( β k j ) do not vary across agro-climatic zone level (non-random slopes at level-2):</p><p>β h j _ = ( β 1 j β 2 j β 3 j ⋮ β k j ) = ( γ 10 γ 20 γ 30 ⋮ γ k 0 )</p><p>β h j : all j values of β h are fixed (do not vary across agro-climatic zone) and are estimated as a single coefficient γ h 0 at level-2, for h = 1 , 2 , 3 , ⋯ , k ; j = 1 , 2 , 3 , 4 , 5</p></sec></sec><sec id="s3"><title>3. Results and Discussion</title><sec id="s3_1"><title>3.1. Magnitude and Variability of Nutrient Balances</title><sec id="s3_1_1"><title>3.1.1. Magnitude and Direction of Nutrient Balances</title><p>The two-level multilevel model (multivariate multilevel model) without predictors (variance component model) fitted to the dataset returned the mean NPK nutrient balances, see (<xref ref-type="table" rid="table3">Table 3</xref>). The mean nitrogen nutrient balance of −11.9 kg ha<sup>−</sup><sup>1</sup> (with 95% confidence interval: −47.0, 23.2) tended to corroborate results of aggregate seminal studies that have reported negative (direction) nitrogen balances at national level [<xref ref-type="bibr" rid="scirp.81020-ref1">1</xref>] . This further confirms that arable land quality in Kenya is being degraded through declining farm nitrogen, though the observed figure was not statistically significant (confidence interval includes zero). The mean aggregate phosphorus (9.8 kg ha<sup>−</sup><sup>1</sup>; p &lt; 0.01; 95% Confidence Interval of 0.9, 18.8) and potassium balances (5.5 kg ha<sup>−</sup><sup>1</sup>; 95% Confidence Interval of −6.9, 17.8) were however positive contrary to seminal aggregate studies that reported negative nutrient balances at national level [<xref ref-type="bibr" rid="scirp.81020-ref2">2</xref>] .</p></sec><sec id="s3_1_2"><title>3.1.2. Variability of Nutrient Balances</title><p>The Variance Partitioning coefficients (adjusted Intra-class correlation coeffeicients) for NPK nutrient balances at different levels of model hierarchy are summarised in <xref ref-type="table" rid="table5">Table 5</xref> while absolute values of variances and covariances are shown in <xref ref-type="table" rid="table6">Table 6</xref>.</p><p>For farm nitrogen nutrient balance, 48% of the variation lies between agro- climatic zones (between agro-climatic zone variability) while 52% of variation lie between farms. For each of the nutrient balances studied, a high proportion of total variation was from between-farm variability, 52%, 79% and 89% for nitrogen, phosphorus and potassium respectively.</p><p>Based on residual variances of each nutrient balance and covariances at level 1 (farm level; <xref ref-type="table" rid="table3">Table 3</xref>), the study observed high positive correlations between Nitrogen and phosphorus nutrient balances (r = 0.8), Nitrogen and potassium nutrient balances (r = 0.82) and moderate correlations between phosphorus and potassium nutrient balances (r = 0.68). These results imply a high dependence between effect sizes at level 1 of the study, dependence that cannot be ignored during analysis. Similarly at level 2, the study observed high dependence between variables as measured by correlations: Nitrogen-phosphorus (r = 0.75),</p><table-wrap id="table5" ><label><xref ref-type="table" rid="table5">Table 5</xref></label><caption><title> Variance partitioning coefficient/Intra-class correlation coeffients for NPK nutrient balances</title></caption><table><tbody><thead><tr><th align="center" valign="middle" >VPC</th><th align="center" valign="middle" >Nitrogen balance</th><th align="center" valign="middle" >Phosphorus balance</th><th align="center" valign="middle" >Potassium balance</th></tr></thead><tr><td align="center" valign="middle" >Level 2 (Agro-climatic zone) Level 1 (Farm)</td><td align="center" valign="middle" >0.48 0.52</td><td align="center" valign="middle" >0.21 0.79</td><td align="center" valign="middle" >0.11 0.89</td></tr></tbody></table></table-wrap><table-wrap id="table6" ><label><xref ref-type="table" rid="table6">Table 6</xref></label><caption><title> Two-level multilevel variance component model compared with a single level model (random part of the model)</title></caption><table><tbody><thead><tr><th align="center" valign="middle" >Random effects parameters</th><th align="center" valign="middle" >Coeffients</th><th align="center" valign="middle" >Standard error</th><th align="center" valign="middle"  colspan="2"  >[95% Conf. Interval]</th></tr></thead><tr><td align="center" valign="middle" >Agro-climatic zone (Level-2) Var Nitrogen Cov Nitrogen-Phosphorus Var Phosphrus Cov Nitrogen-Potassium Cov Phosphorus-Potassium Var Potassium Farms (Level-1) Var Nitrogen Cov Nitrogen-Phosphorus Var Phosphrus Cov Nitrogen-Potassium Cov Phosphorus-Potassium Var Potassium</td><td align="center" valign="middle" >4462.54 779.81 244.42 1175.58 291.61 408.43 4927.10 1689.60 901.30 3215.90 1151.30 3149.10</td><td align="center" valign="middle" >1763.88 392.18 112.36 564.17 144.99 212.66 380.90 147.70 69.70 277.70 111.40 242.70</td><td align="center" valign="middle" >1005.33 11.13 24.19 69.8 7.44 -8.38 4180.50 1400.20 764.80 2671.70 932.80 2673.30</td><td align="center" valign="middle" >7919.74 1548.49 464.65 2281.36 575.79 825.24 5673.70 1979.00 1037.90 3760.10 1369.70 3624.80</td></tr></tbody></table></table-wrap><p>var = Variance; Cov = Covariance</p><p>Nitrogen-potassium (r = 0.87) and Phosphorus-potassium (r = 0.92).</p></sec></sec><sec id="s3_2"><title>3.2. Agro-Climatic Zones and Nutrient Balances</title><p>The study assessed whether agro-climatic zones differ from each other, on average, with respect to farm nitrogen, phosphorus and potassium balances. This was explored preliminarily by looking at variance partitioning coefficient (VPC) and two tests i) assessing whether the variance of the random components of the intercept differ from zero and by ii) conducting likelihood ratio test.</p><p>Variance partitioning coefficient (VPC) measures the proportion of total variance which lies at the Agro-climatic zone level (level-2). Interpreted as VPC, 48%, 21%, and 11% of variation in nitrogen, phosphorus and potassium farm nutrient balances lie between agro-climatic zones respectively (<xref ref-type="table" rid="table5">Table 5</xref>; <xref ref-type="table" rid="table6">Table 6</xref>). This indicates that agro-climatic zones substantially differed with respect to NPK farm nutrient balances.</p><p>Suppose Agro-climatic zones were to differ only slightly or not at all, then the agro-climatic zone j values of ϵ o j (Equation (1)) should differ little from each other and or exhibit low-to-no variance. However, a 95% confidence levels for random part of the model (<xref ref-type="table" rid="table6">Table 6</xref>) indicated that variances for farm nitrogen (95% CI: 1005.33, 7919.74) and phosphorus (95% CI: 69.8, 2281.36) were significantly different from zero (<xref ref-type="table" rid="table6">Table 6</xref>). This indicates that there were significant differences between agro-climatic zones with respect to nutrient balances.</p><p>The study further used likelihood ratio test to tringulate the observation above as variances are known to have positively skewed sampling distributions while 95% confidence intervals assume assymptotic normal sampling distribution and may not be reliable. A likelihood ratio test done by comparing a model with agroclimatic zone effects (with ϵ o j ) and one without ϵ o j , to assess whether σ u 2 (variance at level-2: agroclimatic zone) is significant returned:</p><p>L R = ( − 2 log L 0 ) − ( − 2 log L 1 ) = D 0 − D 1 = 10657 − 10461 = 196.2     with   1   df</p><p>The p-value associated with the Likelihood (LR) test statistic (Chi Square value of 196.2) with 1 degree of freedom is 0.0001. Since the p-value is very small, we reject the null hypothesis (Ho: no agro-climatic zone variation or cluster effect exists and restricted or single model is “the true model”) and conclude that a gro-climatic zone variation exists and is significant ( χ ˜ 2 ( 1 , N = 349 ) = 196.2 , p   &lt; 0.01 ) . This further confirms that there were significant differences between agro-climatic zones with respect to farm nutrient balances.</p></sec><sec id="s3_3"><title>3.3. Household Resource Endowments and Nutrient Balances</title><p>A two-level multilevel model (multivariate multilevel model) fitted to the dataset (see Section 4) to test the hypothesis: All household resource endowments do not have an effect on the magnitude of full N, P and K nutrient balances returned results shown in <xref ref-type="table" rid="table7">Table 7</xref>.</p><p>The observation that more than one household resource endowment variable has an effect on NPK nutrient balances provides a strong evidence against the null hypothesis (e.g. Value of livestock (0.0005 kg N ha<sup>−</sup><sup>1</sup>, p &lt; 0.001); cropping family labour (−0.05101kg K ha<sup>−</sup><sup>1</sup>, p &lt; 0.01), <xref ref-type="table" rid="table7">Table 7</xref>. We thus reject the null hypothesis and conclude that at least one household resource endowment has an effect on the magnitude of full N, P and K farm nutrient balances (<xref ref-type="table" rid="table7">Table 7</xref>).</p><p>A negative relationship between family labour for cropping and NPK nutrient balances was observed (<xref ref-type="table" rid="table7">Table 7</xref>) with cropping family labour having a signify-</p><table-wrap id="table7" ><label><xref ref-type="table" rid="table7">Table 7</xref></label><caption><title> Effects of household resource endowments on NPK nutrient balances</title></caption><table><tbody><thead><tr><th align="center" valign="middle" >Household resource endowment</th><th align="center" valign="middle" >Nitrogen (kg ha<sup>−</sup><sup>1</sup>)</th><th align="center" valign="middle" >Phosphorus (kg ha<sup>−</sup><sup>1</sup>)</th><th align="center" valign="middle" >Potassium (kg ha<sup>−</sup><sup>1</sup>)</th></tr></thead><tr><td align="center" valign="middle" >Constant Average slope% (AVGSLOPE) 20 cm Number of secondary production units (SPUNo: Number of livestock types) Tropical Livestock Units (TLUNo) Value of livestock (VALLVST: in Ksh) Total capital owned (CAPTOT: In Ksh) Cropping family labour (LABCROP: in days) Land rent received (VRENTOUT: in Ksh) Hired labour for RU-Cash (LABHIRUC: in Ksh)</td><td align="center" valign="middle" >−14.61 −1.57** 9.86** −4.77*” 0.0005*** −0.00001*” −0.03545 0.00001 0.01325</td><td align="center" valign="middle" >16.07** −0.50*” 1.32 −1.35 0.0002** −0.00001**** −0.01307 0.00013*** 0.02318**</td><td align="center" valign="middle" >13 −1.61**** 7.36*** −2.65 0.00047**** −0.00001*** −0.05101** −0.00004 0.02078</td></tr></tbody></table></table-wrap><p>****p &lt; 0.0001; ***p &lt; 0.001; **p &lt; 0.01; *p &lt; 0.05; *”p &lt; 0.1</p><p>cant effect (negative) on potassium balance. A unit change in cropping family labour lowering potassium nutrient balance by 0.05101 kg K ha<sup>−</sup><sup>1</sup> (p &lt; 0.01). Although smallholders in Kenya rely heavily on family labour to manage their farms [<xref ref-type="bibr" rid="scirp.81020-ref29">29</xref>] this labour input may be for multiple purposes and not necessarily for strategic farm nutrient management alone.</p><p>Contrary to Cropping family labour, hired labour for redistribution units (LABHIRUC) had a positive effect on the direction of NPK nutrient balances. It significantly predicted phosphorus (P) balances with a unit change in LABHIRUC resulting in a change of 0.023 (p &lt; 0.01) units in phosphorus balances.</p><p>Average slope of land, though a biophysical factor, was considered a proxy to land endowment resource quality. Farmers’ management practices and prices farmers are willing to offer for a given piece of land tend to differ depending on slope percentage, perceived degradation and ease of management attributed to slope effect. The study observed a negative correlation between average slope (%) of land and NPK nutrient balances and that average slope was significantly and negatively correlated with nitrogen balances.</p><p>The study observed mixed results with regards to effects of household resource capital on nutrient balances. While the effects of “total capital owned” significantly lowered NPK nutrient balances, livestock-related capital (value of livestock) had significant positive effect (<xref ref-type="table" rid="table7">Table 7</xref>). Thus, the study has indicated that it is the type of capital (e.g. livestock) owned and not the volume and total value of household capital that may be important in determining nutrient balances, though previous studies indicate that resource-rich farmers have a high chance of returning positive nutrient balances in their farms should they employ nutrient adding, recycling and conserving technologies and practices [<xref ref-type="bibr" rid="scirp.81020-ref30">30</xref>] .</p></sec></sec><sec id="s4"><title>4. Conclusions and Recommendations</title><p>Based on a two-level multilevel (multivariate multilevel) model fitted to the nutrient balance dataset, this study has shown that farm nitrogen mining is taking place and is putting the quality of arable land in Kenya at stake. However, and contrary to on-going narratives on blanket existence of widespread nutrient mining in Kenya, evidences from this study indicate that farm phosphorus and potassium balances are not always negative.</p><p>Agro-climatic zones are characterised by different biophysical potentials that may influence farm nutrient balances to different degrees. The study draws the conclusion that farm nitrogen, phosphorus and potassium balances do differ between agro-climatic zones classified as arable land in Kenya. For example, variances for farm nitrogen and phosphorus were significantly different from zero across agro-climatic zones. The same was corroborated by likelihood ratio test. This serves to indicate the necessity of designating agro-climatic zone specific nutrient management interventions to address declining quality of arable land rather than the use of blanket intervention approaches.</p><p>Household resource endowments and resource flow and allocation patterns have a potential to influence farm nutrient balances. This study explored the effects of household resource endowments on nutrient balances in arable land. The study concludes that livestock household resource endowments is an important determinant of nutrient balances at smallholder farm level, thus recommends improvement of livestock practices at farm level not only to improve on farm nutrient balances but also to increase farm-profitability. However, it is further noted that ownership of large volumes of capital (total value of capital) and family labour resources do not automatically translate into positive effects on farm nutrient balances, but rather it is the type of capital owned (e.g. livestock) and what use it has been put to that matters.</p><p>The study generated interesting results and demonstrated that multivariate multilevel models can be used to conduct meta-analysis of farm nutrient balances and to explore arable land quality despite the small sample size. Future studies with large sample sizes and a large pool of relevant factors and covariates are, however, required to further give higher order insights beyond this study. This can be reinforced by meta-analysis that focuses on summary statistics and the use of simulation modeling to summarise inferences by random numbers rather than by point estimates and standard errors.</p></sec><sec id="s5"><title>Acknowledgements</title><p>Sincere thanks to Dr. Edgar Otumba of Maseno University for his encouragement and to smallholder farmers who participated in research activities leading to generation of data used in this study.</p></sec><sec id="s6"><title>Cite this paper</title><p>Onduru, D.D. and Onyango, F. (2017) Applying Multivariate Multilevel Models to Explore Arable Land Quality in Sub-Saharan Africa: A Case Study in Kenya. Open Journal of Statistics, 7, 972-987. https://doi.org/10.4236/ojs.2017.76069</p></sec></body><back><ref-list><title>References</title><ref id="scirp.81020-ref1"><label>1</label><mixed-citation publication-type="other" xlink:type="simple">Stoorvogel, J.J. and Smaling, E.M.A. (1990) Assessment of Soil Nutrient Depletion in Sub-Sahara Africa: 1983-2000, 4 Volumes. Report 28, The Win and Staring Centre, Netherlands.</mixed-citation></ref><ref id="scirp.81020-ref2"><label>2</label><mixed-citation publication-type="book" xlink:type="simple">Smaling, E.M.A., Nandwa, S.M. and Janssen, B.H. (1997) Soil Fertility Is at Stake, in Reprenishing Soil Fertility in Sub-Saharan Africa. In: Buresh, R., Sanchez, P.A. and Calhoun, F., Eds., American Society of Agronomy and Soil Science Society of America, Madison Wisconsin, 47-61.</mixed-citation></ref><ref id="scirp.81020-ref3"><label>3</label><mixed-citation publication-type="other" xlink:type="simple">Mortimore, M. and Harris, F. (2005) Do Small Farmers’ Achievements Contradict the Nutrient Depletion Scenarios for Africa? Land Use Policy, 22, 43-56. 
https://doi.org/10.1016/j.landusepol.2003.06.003</mixed-citation></ref><ref id="scirp.81020-ref4"><label>4</label><mixed-citation publication-type="other" xlink:type="simple">Hartemink, A.V.K. and van Keulen, H. (2005) Soil Degradation in Sub-Saharan Africa. Land Use Policy, 22, 1. https://doi.org/10.1016/j.landusepol.2004.01.001</mixed-citation></ref><ref id="scirp.81020-ref5"><label>5</label><mixed-citation publication-type="other" xlink:type="simple">Faerge, J. and Magid, J. (2004) Evaluating NUTMON Nutrient Balancing in Sub-Saharan Africa. Nutrient Cycling in Agroecosystems, 69, 101-110. 
https://doi.org/10.1023/B:FRES.0000029680.97610.51</mixed-citation></ref><ref id="scirp.81020-ref6"><label>6</label><mixed-citation publication-type="other" xlink:type="simple">van den Noorgate, W., Lopez-Lopez, J.A., Marin-Martinez, F. and Sanchez-Meca, J. (2012) Three-Level Meta-Analysis of Dependent Effect Sizes. Behavioral Research, 45, 576-594. https://doi.org/10.3758/s13428-012-0261-6</mixed-citation></ref><ref id="scirp.81020-ref7"><label>7</label><mixed-citation publication-type="other" xlink:type="simple">Borenstein, M., Hedges, L.V., Higgins, J.P.T. and Rothstein, H.R. (2009) Comprehensive Meta Analysis (Version 2.2.064). Biostat, Englewood NJ.</mixed-citation></ref><ref id="scirp.81020-ref8"><label>8</label><mixed-citation publication-type="other" xlink:type="simple">Borenstein, M., Hedges, L.V., Higgins, J.P.T. and Rothstein, H.R. (2009) Introduction to Meta-Analysis. John Wiley and Sons Ltd., Hoboken. 
https://doi.org/10.1002/9780470743386</mixed-citation></ref><ref id="scirp.81020-ref9"><label>9</label><mixed-citation publication-type="other" xlink:type="simple">Scammacca, N. Roberts, G. and Stuebing, K.K. (2014) Meta-Analysis with Complex Research Designs: Dealing with Dependence from Multiple Measures and Multiple Group Comparisons. Review of Educational Research, 84, 328-364. 
https://doi.org/10.3102/0034654313500826</mixed-citation></ref><ref id="scirp.81020-ref10"><label>10</label><mixed-citation publication-type="other" xlink:type="simple">Capon, N., Farley, J.U. and Hoenig, S. (1990) Determinants of Financial Performance: A Meta-Analysis. Management Science, 36, 1143-1159. 
https://doi.org/10.1287/mnsc.36.10.1143</mixed-citation></ref><ref id="scirp.81020-ref11"><label>11</label><mixed-citation publication-type="other" xlink:type="simple">Cleophas, T.J. and Zwinderman, A.H. (2007) Meta-Analysis. Circulation, 115, 2870-2875. https://doi.org/10.1161/CIRCULATIONAHA.105.594960</mixed-citation></ref><ref id="scirp.81020-ref12"><label>12</label><mixed-citation publication-type="book" xlink:type="simple">Broeze, K.A., Opmeer, B.C., van der Veen, F. and Bossuyt, P.M. (2010) Individual Patient Data Meta-Analysis: A Promising Approach for Evidence Synthesis in Reproductive Medicine. In: Bhattacharya, S. and Mol, B.W.J., Eds., Human Reproduction Updata, 16, 561-567. https://doi.org/10.1093/humupd/dmq043</mixed-citation></ref><ref id="scirp.81020-ref13"><label>13</label><mixed-citation publication-type="other" xlink:type="simple">Batary, P., Baldi, A., Kleijn, D. and Tscharntke, T. (2010) Landscape-Moderated Biodiversity Effects of Agri-Environmental Management: A Meta-Analysis. Proceedings of the Royal Society Biological Sciences, 278, 1894-1902. 
https://doi.org/10.1098/rspb.2010.1923</mixed-citation></ref><ref id="scirp.81020-ref14"><label>14</label><mixed-citation publication-type="other" xlink:type="simple">Cooper, H., Hedges, L.V. and Valentine, J.C. (2009) The Handbook of Research Synthesis and Meta-Analysis. Russel Sage Foundation, New York.</mixed-citation></ref><ref id="scirp.81020-ref15"><label>15</label><mixed-citation publication-type="other" xlink:type="simple">Geist, H.J. and Lambin, E.F. (2001) What Drives Tropical Deforestation? A Meta-Analysis of Proximate and Underlying Causes of Deforestation Based on Subnational Case Study Evidence. LUCC Report Series No.4, LUCC International Project Office, University of Louvain, Belgium.</mixed-citation></ref><ref id="scirp.81020-ref16"><label>16</label><mixed-citation publication-type="other" xlink:type="simple">Alston, J.M., Chan-Kang, C., Marra, M.C., Pardey, P.G. and Wyatt, T.J. (2000) A Meta-Analysis of Rates of Return to Agricultural RD. International Food Policy Research Institute.</mixed-citation></ref><ref id="scirp.81020-ref17"><label>17</label><mixed-citation publication-type="other" xlink:type="simple">Mondelaers, K., Aertsens, J. and Van Huylenbroeck, G. (2009) A Meta-Analysis of the Differences in Environmental Impacts between Organic and Conventional Farming. British Food Journal, 111, 1098-1119.  
https://doi.org/10.1108/00070700910992925</mixed-citation></ref><ref id="scirp.81020-ref18"><label>18</label><mixed-citation publication-type="other" xlink:type="simple">Tuomisto, H.L., Hodge, I.D., Riordan, P. and Macdonald, D.W. (2012) Does Organic Farming Reduce Environmental Impacts? A Meta-Analysis of European Research. Journal of Environmental Management, 112, Article ID: 309320.  
https://doi.org/10.1016/j.jenvman.2012.08.018</mixed-citation></ref><ref id="scirp.81020-ref19"><label>19</label><mixed-citation publication-type="other" xlink:type="simple">Konstantopoulos, S. (2006) Fixed and Mixed Effects Models in Meta-Analysis. IZA DP No. 2198, Northwestern University and IZA Bonn, Bonn.</mixed-citation></ref><ref id="scirp.81020-ref20"><label>20</label><mixed-citation publication-type="other" xlink:type="simple">Rao, S.R., Graubard, B.I., Schmid, C.H., Morton, S.C., Louis, T.A., Zaslavsky, A.M. and Finkelstein, D.M. (2008) Meta-Analysis of Survey Data: Application to Health Services Research. Health Services Outcomes Research Method, 8, 98-114.  
https://doi.org/10.1007/s10742-008-0032-0</mixed-citation></ref><ref id="scirp.81020-ref21"><label>21</label><mixed-citation publication-type="other" xlink:type="simple">Sileshi, G., Akinnifesi, F.K., Ajayi, O.C. and Place, F. (2008) Meta-Analysis of Maize Yield Response to Woody and Herbaceous Legumes in Sub-Saharan Africa. Plant and Soil, 307, 1-19. https://doi.org/10.1007/s11104-008-9547-y</mixed-citation></ref><ref id="scirp.81020-ref22"><label>22</label><mixed-citation publication-type="other" xlink:type="simple">Stwardt, G. (2010) Meta-Analysis in Applied Ecology. Biology Letters, 6, 78-81.  
https://doi.org/10.1098/rsbl.2009.0546</mixed-citation></ref><ref id="scirp.81020-ref23"><label>23</label><mixed-citation publication-type="other" xlink:type="simple">Mavridis, D. and Salanti, G. (2011) A Practical Introduction to Multivariate Meta-Analysis. Statistical Methods in Medical Research, 22, Article ID: 133158.</mixed-citation></ref><ref id="scirp.81020-ref24"><label>24</label><mixed-citation publication-type="other" xlink:type="simple">Rabe-Hesketh, S. and Skrondal, A. (2006) Multilevel Modelining of Complex Survey Data. Journal of the Royal Statistical Society, 169, 805-827.  
https://doi.org/10.1111/j.1467-985X.2006.00426.x</mixed-citation></ref><ref id="scirp.81020-ref25"><label>25</label><mixed-citation publication-type="other" xlink:type="simple">Afshartous, D. and Wolf, M. (20015) Avoiding Data Snooping in Multilevel and Mixed Effects Models. Institute for Empirical Research in Economics, University of Zurich, Zurich.</mixed-citation></ref><ref id="scirp.81020-ref26"><label>26</label><mixed-citation publication-type="other" xlink:type="simple">Goldstein, H. (1986) Multilevel Mixed Linear Model Analysis Using Iterative Generalised Least Squares. Biometrika, 73, 43-56. https://doi.org/10.1093/biomet/73.1.43</mixed-citation></ref><ref id="scirp.81020-ref27"><label>27</label><mixed-citation publication-type="other" xlink:type="simple">Zhang, Z., Charlton, C.M.J., Parker, R.M.A., Leckie, G. and Browne, W.J. (2016) R2MLwiN: A Package to Run MLwiN from within R. Journal of Statistical Software.  
http://www.bris.ac.uk/cmm/media/r2mlwin/article/Zhang_et_al.pdf</mixed-citation></ref><ref id="scirp.81020-ref28"><label>28</label><mixed-citation publication-type="book" xlink:type="simple">Muthén, B.O. and Satorra, A. (1989) Multilevel Aspects of Varying Parameters in Structural Models. In: Bock, R.D., Ed., Multilevel Analysis of Educational Data, Academic Press, San Diego, 87-99.  
https://doi.org/10.1016/B978-0-12-108840-8.50009-3</mixed-citation></ref><ref id="scirp.81020-ref29"><label>29</label><mixed-citation publication-type="other" xlink:type="simple">De Jager, A. (2007) Practice Makes Perfect: Participatory Innovation in Soil Fertility Management to Improve Rural livelihoods in East Africa. PhD Thesis, Wageningen University, Wageningen.</mixed-citation></ref><ref id="scirp.81020-ref30"><label>30</label><mixed-citation publication-type="other" xlink:type="simple">Elias, E., Morse, S. and Belshaw, D.G.R. (1998) Nitrogen and Phosphorus Balances of Kindo Koisha Farms in Southern Ethiopia. Agriculture Ecosystems and Environment, 71, 93-113. https://doi.org/10.1016/S0167-8809(98)00134-0</mixed-citation></ref></ref-list></back></article>