<?xml version="1.0" encoding="UTF-8"?><!DOCTYPE article  PUBLIC "-//NLM//DTD Journal Publishing DTD v3.0 20080202//EN" "http://dtd.nlm.nih.gov/publishing/3.0/journalpublishing3.dtd"><article xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink" dtd-version="3.0" xml:lang="en" article-type="research article"><front><journal-meta><journal-id journal-id-type="publisher-id">OJE</journal-id><journal-title-group><journal-title>Open Journal of Ecology</journal-title></journal-title-group><issn pub-type="epub">2162-1985</issn><publisher><publisher-name>Scientific Research Publishing</publisher-name></publisher></journal-meta><article-meta><article-id pub-id-type="doi">10.4236/oje.2020.105016</article-id><article-id pub-id-type="publisher-id">OJE-100081</article-id><article-categories><subj-group subj-group-type="heading"><subject>Articles</subject></subj-group><subj-group subj-group-type="Discipline-v2"><subject>Earth&amp;Environmental Sciences</subject></subj-group></article-categories><title-group><article-title>
 
 
  Multi-Level, Multi-Scale Modeling and Predictive Mapping for Jaguars in the Brazilian Pantanal
 
</article-title></title-group><contrib-group><contrib contrib-type="author" xlink:type="simple"><name name-style="western"><surname>Eve</surname><given-names>Bohnett</given-names></name><xref ref-type="aff" rid="aff1"><sup>1</sup></xref><xref ref-type="corresp" rid="cor1"><sup>*</sup></xref></contrib><contrib contrib-type="author" xlink:type="simple"><name name-style="western"><surname>Dave</surname><given-names>Hulse</given-names></name><xref ref-type="aff" rid="aff2"><sup>2</sup></xref></contrib><contrib contrib-type="author" xlink:type="simple"><name name-style="western"><surname>Bilal</surname><given-names>Ahmad</given-names></name><xref ref-type="aff" rid="aff3"><sup>3</sup></xref></contrib><contrib contrib-type="author" xlink:type="simple"><name name-style="western"><surname>Thomas</surname><given-names>Hoctor</given-names></name><xref ref-type="aff" rid="aff4"><sup>4</sup></xref></contrib></contrib-group><aff id="aff4"><addr-line>Center for Landscape Conservation Planning, University of Florida, Gainesville, United States of America</addr-line></aff><aff id="aff3"><addr-line>Institute of Agriculture Sciences and Forestry, University of Swat, Swat, Pakistan</addr-line></aff><aff id="aff2"><addr-line>Florida Institute for Built Environment Resilience, University of Florida, Gainesville, United States of America</addr-line></aff><aff id="aff1"><addr-line>Department of Landscape Architecture, University of Florida, Gainesville, United States of America</addr-line></aff><pub-date pub-type="epub"><day>30</day><month>04</month><year>2020</year></pub-date><volume>10</volume><issue>05</issue><fpage>243</fpage><lpage>263</lpage><history><date date-type="received"><day>4,</day>	<month>April</month>	<year>2020</year></date><date date-type="rev-recd"><day>8,</day>	<month>May</month>	<year>2020</year>	</date><date date-type="accepted"><day>11,</day>	<month>May</month>	<year>2020</year></date></history><permissions><copyright-statement>&#169; Copyright  2014 by authors and Scientific Research Publishing Inc. </copyright-statement><copyright-year>2014</copyright-year><license><license-p>This work is licensed under the Creative Commons Attribution International License (CC BY). http://creativecommons.org/licenses/by/4.0/</license-p></license></permissions><abstract><p>
 
 
  Multi-level multi-scale resource selection models using machine learning were compared and contrasted for generating predictive maps of jaguar habitat (
  <em>Panthera onca)</em> in the Brazilian Pantanal. Multiple spatial scales and temporal movement levels were run within several analytical modeling frameworks for comparison. Included in the analysis were multi-scale raster grains (30 m, 90 m, 180 m, 360 m, 720 m, 1440 m) and GPS collaring temporal movement levels (point, path, and step). Various analytical methods were used for comparison of models that could accommodate data structural levels (group, individual, case-control). Models compared included conditional logistic regression, generalized additive modeling (GAM), and classification regression trees, such as random forests (RF) and gradient boosted regression tree (GBM). The goals of the study were to discuss the potential and limitations for machine learning methods using GPS collaring data to produce predictive habitat suitability mapping using the various scales and levels available. Results indicated that choosing the appropriate temporal level and raster scale improved model outputs. Overall, larger level analytical modeling frameworks and those that used multi-scale raster grains showed the best model evaluation with the inherent condition that they predict a broader scale and subset of data. The identification of the appropriate spatial scale, temporal scale and statistical model need careful consideration in predictive mapping efforts.
 
</p></abstract><kwd-group><kwd>Machine Learning</kwd><kwd> Movement Ecology</kwd><kwd> Habitat Selection</kwd><kwd> Resource Selection</kwd><kwd> Multiple Levels</kwd><kwd> Multiple Scales</kwd><kwd> Predictive Models</kwd><kwd> Gradient Boosting Method</kwd><kwd> Random Forest</kwd></kwd-group></article-meta></front><body><sec id="s1"><title>1. Introduction</title><p>Landscape patterns and processes occur within many spatial and temporal dimensions, and scale is a lens through which to view those dimensions. Landscape ecology examines ecological processes and landscape scales through modeling approaches. Ecological models depend on the entities measured (e.g. which organisms, ecosystems or ecological processes), variables measured (e.g. which environmental or climate covariates), and the processes linking entities and variables. Additionally, they can also respond to changes in spatial extent, spatial grain, temporal duration, and temporal grain used to measure these entities and variables [<xref ref-type="bibr" rid="scirp.100081-ref1">1</xref>] [<xref ref-type="bibr" rid="scirp.100081-ref2">2</xref>] [<xref ref-type="bibr" rid="scirp.100081-ref3">3</xref>]. Wildlife ecologists often employ resource selection models for use-available data with scales defined through nested hierarchical orders of selection, for example, the geographical range of the species (Level I), the home range (Level II), or patch level habitat selection (Level III) [<xref ref-type="bibr" rid="scirp.100081-ref4">4</xref>]. Following resource selection modeling frameworks, one of the approaches researchers apply to integrate scales are buffers of various sizes around the data points to average environmental covariates within a given area. This allows one to assess the effective scale at which the environment shapes animal behavior [<xref ref-type="bibr" rid="scirp.100081-ref5">5</xref>]. McGarigal et al. (2016) proposed a multi-scale, multi-level modeling framework to consider the various spatial and temporal scales necessary to address spatial dependencies within various levels of selection. This conceptual framework develops scale optimized multi-level modeling in which multiple scales are tested simultaneously within each level of resource selection and the scales where the effect of each environmental variable most strongly affects selection can emerge [<xref ref-type="bibr" rid="scirp.100081-ref6">6</xref>] [<xref ref-type="bibr" rid="scirp.100081-ref7">7</xref>]. By quantifying the patterns and processes that naturally occur at different scales in time and space, we can reach conclusions regarding the key ecological and evolutionary processes that compose landscapes.</p><sec id="s1_1"><title>1.1. Representation of Movement in Resource Selection Approaches</title><p>Resource selection may also depend on the how the process of interest is represented. For GPS data, resource selection functions may be based on different sampling units used to represent animal movement: points (locations in space), steps (displacements), and paths (sequences of displacements). Binary response variables include (1) animal movement data and (0) background points generated on the landscape within several levels by using a “used vs. available” sampling design broadly referred to as resource selection function (RSF) [<xref ref-type="bibr" rid="scirp.100081-ref8">8</xref>]. Fine-scale GPS collaring trajectories allow the extension of traditional RSF’s to point, step, and path selection functions. Studies with these movement representations should also assess multiple scales along with levels of selection [<xref ref-type="bibr" rid="scirp.100081-ref7">7</xref>]. In terms of classic habitat selection, for the point selection functions, points are subset into different levels within a broader geographic range, the species range, or the home range [<xref ref-type="bibr" rid="scirp.100081-ref4">4</xref>]. These levels are different for step and path selection functions. Animal steps and paths may be sectioned into periods that represent one or several displacement events, e.g. hourly or daily sections, respectively. Then, background points are generated for steps or paths not traveled, yet were available for animal movement and not chosen by the animals that were sampled [<xref ref-type="bibr" rid="scirp.100081-ref8">8</xref>] [<xref ref-type="bibr" rid="scirp.100081-ref9">9</xref>], and habitat selection inferences are made by comparing realized vs. not used steps or paths. Temporal differences in the generation of background points for path selection have been shown to optimize the scale of effect for large carnivore dispersal studies [<xref ref-type="bibr" rid="scirp.100081-ref10">10</xref>] [<xref ref-type="bibr" rid="scirp.100081-ref11">11</xref>]. For instance, paths refer to sets of locations along 12 hours, 24 hours, or several days for the analysis, depending on the research questions. Overall, temporal separation (point, hourly, daily, or otherwise) in the data can potentially reveal behavioral differences in the temporal scale of animal habitat use.</p></sec><sec id="s1_2"><title>1.2. Statistical Analysis and Modeling Options</title><p>Parametric, semi-parametric, and non-parametric models are important options for analysis on movement ecology. Parametric models generally aim at estimating cause-effect relationships between an organism’s movement features and the environmental covariates. For example, conditional logistic regression is often used in point and step selection approaches to find out which sets of environmental conditions are selected or avoided by organisms. However, these parametric approaches are not recommended for predictive mapping or predicting results on new data. Predictive mapping efforts that utilize non-parametric approaches such as machine learning, for example, are most suitable for predicting on new data [<xref ref-type="bibr" rid="scirp.100081-ref12">12</xref>] [<xref ref-type="bibr" rid="scirp.100081-ref13">13</xref>].</p><p>Emerging studies on machine learning (ML) methods for landscape ecology have used classification and regression trees (CART), showing they outperform other methods for multi-scale modeling [<xref ref-type="bibr" rid="scirp.100081-ref14">14</xref>]. At continental scales where GPS collaring data may be sparse, random forest (RF) models performed adequately [<xref ref-type="bibr" rid="scirp.100081-ref15">15</xref>]. Various statistical methods (Occupancy, GAM, CART) have been used for single scale or multi-scale modeling, determining the effect of an environmental covariate or distance effect on models [<xref ref-type="bibr" rid="scirp.100081-ref16">16</xref>].</p><p>Previous research has also applied ML methods like RF for movement studies for point selection functions for mule deer [<xref ref-type="bibr" rid="scirp.100081-ref17">17</xref>] and Florida panther [<xref ref-type="bibr" rid="scirp.100081-ref18">18</xref>]. Zeller (2018) explored non-parametric and semi-parametric statistical modeling approaches in resource selection functions to derive predictive distribution maps for large carnivore conservation [<xref ref-type="bibr" rid="scirp.100081-ref19">19</xref>]. They compared RSFs generated from points, steps, and paths using conditional logistic regression, to point selection functions using machine learning methods [<xref ref-type="bibr" rid="scirp.100081-ref19">19</xref>].</p><p>How predictive modeling, like machine learning methods, may apply to step and path selection functions is unknown. This study extends previous research on movement ecology and machine learning by applying non-parametric and semi-parametric techniques to multi-scale, multi-level methods for GPS collaring data using also path and step selection functions. Step and path selection functions traditionally use conditional logistic regression, and have recently begun exploring alternative methods such as machine learning. We believe that multi-scale predictive modeling and mapping may improve through the use of machine learning and generalized additive modeling approaches. ML methodologies are becoming more useful to ecologists collating big data of high dimensions from data repositories. Both remote sensing data (e.g. Google Earth Engine) and animal movement data (e.g. MOVEBANK) repositories are making data widely available, which also demands for more sophisticated processing and modeling approaches [<xref ref-type="bibr" rid="scirp.100081-ref20">20</xref>] [<xref ref-type="bibr" rid="scirp.100081-ref21">21</xref>] [<xref ref-type="bibr" rid="scirp.100081-ref22">22</xref>] [<xref ref-type="bibr" rid="scirp.100081-ref23">23</xref>].</p><p>Here we aimed at understanding how parametric, semi-parametric, and non-parametric models can contribute to habitat selection estimates and predictive mapping (<xref ref-type="fig" rid="fig1">Figure 1</xref>). Since steps and paths are most common to represent third-order habitat selection at the level of the resource patches, here we focus at this level of analysis. In this study, multi-scale, multi-level modeling of habitat selection is explored using jaguars in the Brazilian Pantanal as a case study.</p></sec></sec><sec id="s2"><title>2. Materials and Methods</title><sec id="s2_1"><title>2.1. Study Area</title><p>The study area is the Brazilian Pantanal region surrounding the Taiama Ecological</p><p>Station (17.712061S, 57.415956W.) The station is deep in the Brazilian Pantanal, the world’s largest freshwater wetlands located in the state of Mato Grasso do Sul and Mato Grosso, in Western Brazil. Several major tributaries of the Paraguay River incur a seasonal flooding regime from January to July [<xref ref-type="bibr" rid="scirp.100081-ref24">24</xref>]. Vegetation is mainly semi-deciduous forest, open forest, closed forest, savanna (Cerrado), and aquatic or swamp terrain. The area is rich in biodiversity and has a high abundance of jaguars. In the Pantanal region, Taiama Ecological Station is a remote area with few roads or disturbances. It is an ideal place to study the jaguar habitat in its semi-natural form.</p></sec><sec id="s2_2"><title>2.2. Environmental Variables</title><p>Remote sensing information was particularly useful in this study, and the availability of data layers globally has made compiling such large datasets much easier. A total of 12 raster-based environmental data layers were extracted from Google earth engine and open source data layers available online, namely elevation, slope, aspect, land use and land cover, forest non-forest, total canopy cover, roads, water and hydrology, human density, and cattle density (<xref ref-type="table" rid="table1">Table 1</xref>). Data</p><table-wrap id="table1" ><label><xref ref-type="table" rid="table1">Table 1</xref></label><caption><title> Environmental covariates listed with layer name and original source, including some descriptive information where necessary</title></caption><table><tbody><thead><tr><th align="center" valign="middle" >Layer Name</th><th align="center" valign="middle" >Source</th></tr></thead><tr><td align="center" valign="middle" >Elevation</td><td align="center" valign="middle" >SRTM Digital Elevation Model</td></tr><tr><td align="center" valign="middle" >Slope</td><td align="center" valign="middle" >SRTM Digital Elevation Model</td></tr><tr><td align="center" valign="middle" >Aspect</td><td align="center" valign="middle" >SRTM Digital Elevation Model</td></tr><tr><td align="center" valign="middle" >Global Cover</td><td align="center" valign="middle" >ENVISAT’s Medium Resolution Imaging Spectrometer (MERIS) Level 1B Land Cover</td></tr><tr><td align="center" valign="middle" >Forest Non-Forest</td><td align="center" valign="middle" >JAXA L-band PALSAR SAR and ALOS mosaics using backscatter coefficient to determine “Forest” and “Non-Forest”</td></tr><tr><td align="center" valign="middle" >Total Canopy Cover</td><td align="center" valign="middle" >Landsat Vegetation Continuous Fields (VCF) total cover of vegetation of woody plants above 5 m in height.</td></tr><tr><td align="center" valign="middle" >SAR Land Cover</td><td align="center" valign="middle" >HH and HV L-band ALOS/PALSAR, and HH and HV C-band. RADARSAT-2 using a hierarchical object-based image analysis approach to hydrologically variant subregions.</td></tr><tr><td align="center" valign="middle" >Water</td><td align="center" valign="middle" >The Global Inland Water dataset shows inland surface water bodies, including fresh and saline lakes, rivers, and reservoirs.</td></tr><tr><td align="center" valign="middle" >Roads</td><td align="center" valign="middle" >Center for International Earth Science Information Network - CIESIN - Columbia University - Distance Raster generated from Shapefile with Global Roads Open Access Data Set, Version 1 (gROADSv1) 1980-2010. From this distance to roads were calculated.</td></tr><tr><td align="center" valign="middle" >Hydrology</td><td align="center" valign="middle" >WWF HydroSHEDS Raster - Hydrological data and maps based on Shuttle Elevation Derivatives at multiple scales.</td></tr><tr><td align="center" valign="middle" >Human Density</td><td align="center" valign="middle" >WorldPop Raster with estimated the number of people per hectare by 2015, with national totals adjusted to match the estimates of the UN population division.</td></tr><tr><td align="center" valign="middle" >Cattle Density</td><td align="center" valign="middle" >FAO, ILRI, the University of Oxford and the Universit&#233; Libre de Bruxelles. Raster with Global Distribution of Livestock</td></tr></tbody></table></table-wrap><p>were extracted for time periods suitable for the study, unless unavailable, then previous layers were used, for example the roads layer is current to 2010. Collinearity was checked using pairwise comparison for those models where this may be an issue, any variables that had greater than 0.7 pairwise correlation would be rejected. None of the variables met this criterion, and were uncorrelated. Machine learning models do not consider collinearity to be an issue so all data layers can be included.</p><sec id="s2_2_1"><title>2.2.1. Multi-Scale Environmental Data</title><p>The study attempts to understand how various modeling approaches perform, considering spatial information at multiple scales and model levels (Supplementary Information). Point, step (1 hour displacements), and path (24 hour trajectories) approaches were used to represent movement (<xref ref-type="table" rid="table2">Table 2</xref>(a)) at different model levels (group, individual ID strata, case-control) (<xref ref-type="table" rid="table2">Table 2</xref>(b)), furthermore incorporating multi-scale raster grain data to compare single grain (30 m) and multi-grain raster data (30 m, 90 m, 180 m, 360 m, 720 m, 1440 m) (<xref ref-type="table" rid="table2">Table 2</xref>(c)). For clarity, this refers to a study that investigates multiple levels of both temporal frequencies and levels using multi-scale raster grain covariates in the models. A combination of several multi-level multi-scale modeling definitions, where levels are hierarchies of organization in time or space, and scales as the scale and extent of the organization [<xref ref-type="bibr" rid="scirp.100081-ref25">25</xref>].</p><table-wrap-group id="2"><label><xref ref-type="table" rid="table2">Table 2</xref></label><caption><title> Descriptions of the multi-levels and scales for GPS collaring temporal levels, data structural levels and raster grains. (a) GPS collaring temporal levels; (b) Model and data structural levels; (c) Spatial scale</title></caption><table-wrap id="2_1"><caption><title> (b)</title></caption><table><tbody><thead><tr><th align="center" valign="middle" >Model</th><th align="center" valign="middle" >Level</th></tr></thead><tr><td align="center" valign="middle" >Point Selection</td><td align="center" valign="middle" >Home Range</td></tr><tr><td align="center" valign="middle" >Step Selection</td><td align="center" valign="middle" >1 hour steps</td></tr><tr><td align="center" valign="middle" >Path Selection</td><td align="center" valign="middle" >24 hour paths</td></tr></tbody></table></table-wrap><table-wrap id="2_2"><caption><title> (c)</title></caption><table><tbody><thead><tr><th align="center" valign="middle" >Model</th><th align="center" valign="middle" >Resource Selection Order</th></tr></thead><tr><td align="center" valign="middle" >Gradient Boosting Method</td><td align="center" valign="middle" >Group</td></tr><tr><td align="center" valign="middle" >Random Forest</td><td align="center" valign="middle" >Individual ID</td></tr><tr><td align="center" valign="middle" >GAM</td><td align="center" valign="middle" >Case-Control/Individual ID</td></tr><tr><td align="center" valign="middle" >Conditional Logistic</td><td align="center" valign="middle" >Case-Control/Individual ID</td></tr></tbody></table></table-wrap><table-wrap id="2_3"><caption><title></title></caption><table><tbody><thead><tr><th align="center" valign="middle" >Model</th><th align="center" valign="middle" >Raster Scales</th></tr></thead><tr><td align="center" valign="middle" >Gradient Boosting Method</td><td align="center" valign="middle" >All Scales 84 variables</td></tr><tr><td align="center" valign="middle" >Random Forest</td><td align="center" valign="middle" >All Scales 84 variables</td></tr><tr><td align="center" valign="middle" >GAM</td><td align="center" valign="middle" >Univariate Scales 12 variables</td></tr><tr><td align="center" valign="middle" >Conditional Logistic</td><td align="center" valign="middle" >Univariate Scales 12 variables</td></tr></tbody></table></table-wrap></table-wrap-group></sec><sec id="s2_2_2"><title>2.2.2. Raster Grain</title><p>To represent the raster layers at multiple scales, a Gaussian kernel smoother was used to average the layers at multiple extents (90 m, 180 m, 360 m, 720 m, and 1440 m), resulting in a total of 84 variables. If the original raster layers were not in a 30 m grain, they were disaggregated to 30 m for analysis. Specifically, the MERIS global land cover (300 m) grain and the SAR land cover (50 m) were disaggregated to 30 m. Assessing the functional grain of analysis, or the grain at which the organism is responding to the landscape, for connectivity studies has been useful to create resistance maps of habitat preferences [<xref ref-type="bibr" rid="scirp.100081-ref26">26</xref>]. Raster spatial grain is a problem in the multi-scale paradigm that is often not considered within multi-level, multi-scale studies for resource selection [<xref ref-type="bibr" rid="scirp.100081-ref27">27</xref>]. Although similar in technique to expanding distance buffers and averaging the pixels around a point or line.</p><p>The conditional regression model and GAM models were fit univariately to determine the adequate scale [<xref ref-type="bibr" rid="scirp.100081-ref7">7</xref>]. Model selection was performed using AIC and ∆AIC, building an optimal multi-scale model with one chosen raster grain for each environmental covariate. The RF and GBM models run with all multi-scale data layers because of the inherent tree system used to build the models, producing variable importance plots to determine the most valuable raster grain to the model.</p></sec></sec><sec id="s2_3"><title>2.3. Study Species</title><p>Modeling methods rely on niche habitat concepts for environmental covariates to construct accurate models of jaguar distributions on the landscape [<xref ref-type="bibr" rid="scirp.100081-ref28">28</xref>]. In other studies, jaguars exist in primary forest habitat, or areas with high forest cover, far from deforested patches or other human activities like cattle pastures, roads, or croplands. Jaguar populations are shown to decline with increasing human population density [<xref ref-type="bibr" rid="scirp.100081-ref29">29</xref>] and roads [<xref ref-type="bibr" rid="scirp.100081-ref30">30</xref>]. Jaguars prefer areas having topography with moderate slopes. They also prefer riparian areas with high amounts of water [<xref ref-type="bibr" rid="scirp.100081-ref31">31</xref>] [<xref ref-type="bibr" rid="scirp.100081-ref32">32</xref>].</p></sec><sec id="s2_4"><title>2.4. Movement Data</title><p>GPS collars (Lotek Globalstar and Iridium Collars) for jaguars (n = 11, five females and six males) are the largest group of animals monitored in the Northern Pantanal. Data were made freely available by Morato et al. (2018), and capture procedures and permits were described in Morato et al. 2016. Monitoring occurred from October 2013 to February 2016 for 909 total days of data collection with individuals ranging from a minimum of 26 days and a maximum of 597 days. Collars were programmed to collect one relocation every hour, summing up 42,741 observed locations for all animals. Data collected followed protocols approved by Instituto Chico Mendes de Conserva&#231;&#227;o da Biodiversidade (Minist&#233;rio do Meio Ambiente, Brazil (ICMBio-SISBIO)). All procedures followed guidelines approved by the American Society of Mammologists [<xref ref-type="bibr" rid="scirp.100081-ref30">30</xref>].</p><sec id="s2_4_1"><title>2.4.1. Point Selection Functions (PSF)</title><p>Minimum convex polygons have been the traditional method for home range estimation, drawing a polygon around the point locations for the animal, to be used as the area available to animals in their routine movements. This technique provided a crude estimate of the home range, most commonly reported with 95 percent of data points [<xref ref-type="bibr" rid="scirp.100081-ref33">33</xref>]. Here minimum convex polygons 95% (MCP95) were determined using the MCP function in the adehabitatHR package in R [<xref ref-type="bibr" rid="scirp.100081-ref34">34</xref>]. Random points within the MCP were generated using the dismo package in R [<xref ref-type="bibr" rid="scirp.100081-ref35">35</xref>].</p></sec><sec id="s2_4_2"><title>2.4.2. Step Selection Functions (SSF)</title><p>The GPS collars captured one point every hour. These hourly point data were subset into “steps”, using the first point as the start of the step, and the next point as the end of the step. Background steps had the same original step distance projected into a different angle around the starting point. Steps from hourly data had a total of 85,388 presences and absences, generating one background step for each step. Step selection was performed in program R, using the package AdeHabitatLT [<xref ref-type="bibr" rid="scirp.100081-ref34">34</xref>].</p></sec><sec id="s2_4_3"><title>2.4.3. Path Selection Functions (PathSF)</title><p>Animal trajectories were subset into 24-hour time sequences of hourly steps, generating longer paths for daily intervals, with a total of 4409 present and absent paths. Absences were generated using a correlated random walk (CRW) method. The CRW began at the starting point, simulating a trajectory of a similar length at alternate angles. CRWs are a completely randomized simulation of blind jaguar movement at any chance direction. CRW does not account for any decisions the jaguars normally encounter in time or space.</p><p>Nonetheless, the correlated random walk provided a randomized path to understand the simplest baseline from which to compare the actual jaguar movement. The mean of all steps values in the path aggregated to one single value to represent each path extracted covariate. Paths were generated in program R, package SiMRiv [<xref ref-type="bibr" rid="scirp.100081-ref36">36</xref>].</p></sec></sec><sec id="s2_5"><title>2.5. Study Design</title><p>Since the use-available (presence-absence) data for steps and paths were generated from the original data points, then these steps and paths can be paired in a case-control framework for the analysis. The conditional logistic and GAM models fit in a case-control framework allowing for a direct comparison between these two models.</p><p>However, the RF model used a higher order level at the individual ID strata and was not case-control. Therefore, RF performs the analysis for all steps and all background steps of individual animals during the duration of the study, and not matching presence steps with the generated absence steps them directly. The GBM algorithm is an even larger level using the entire group’s paths and steps together without any subsetting into individual strata or case-control (<xref ref-type="table" rid="table3">Table 3</xref>). The two levels (group and individual stratum) inherent in the machine learning algorithms make models not directly comparable to the conditional logistic and GAM which have a case-control level.</p></sec><sec id="s2_6"><title>2.6. Statistical Modeling Frameworks</title><sec id="s2_6_1"><title>2.6.1. Conditional Logistic Regression</title><p>Traditional resource selection functions for GPS collaring studies use an explanatory modeling approach such as conditional logistic for case-control for the steps and paths. Hooten et al. (2014) developed a point process model. In a very basic interpretation of the model, the probability density function for use [ x ] u is equal to a weighted distribution of availability [ x ] a , then further indexing resource observations by relocation at time t (Equation (1) and Equation (2)) [<xref ref-type="bibr" rid="scirp.100081-ref37">37</xref>].</p><p>x [ ( s t ) ] u = g ( x ( s t ) , β ) [ x ( s t ) ] a ∫ ​ g ( x ( s ) , β ) [ x ( s ) ] a d s = [ x ( s t ) | β ] u (1)</p><p>The likelihood is maximized for resource coefficients β.</p><p>∏ t = 1 T [ x ( s t ) | β ] u (2)</p><p>A vector of resource covariates, β is a set of regression coefficients, x, a normalizing constant, and g ( x , β ) is a resource selection function [<xref ref-type="bibr" rid="scirp.100081-ref37">37</xref>]. The weighted distribution framework is shown to account for the high amount of autocorrelation in GPS telemetry data [<xref ref-type="bibr" rid="scirp.100081-ref8">8</xref>]. All conditional logistic regression models used the mclogit package in program R. The mclogit package includes case-control and individual level strata for model fitting.</p></sec><sec id="s2_6_2"><title>2.6.2. Generalized Additive Model</title><p>The generalized additive models are a semi-parametric extension of the generalized linear models that allow for non-linear functions of the environmental covariates. This method assumes that functions are additive and components smoothed. It estimates an additive approximation to the multivariate regression function, employing univariate smoothers and using individual estimates to</p><table-wrap id="table3" ><label><xref ref-type="table" rid="table3">Table 3</xref></label><caption><title> Data Structures of models that use group level, individual id, and case-control levels</title></caption><table><tbody><thead><tr><th align="center" valign="middle" >Data Structure</th><th align="center" valign="middle" ></th><th align="center" valign="middle" ></th><th align="center" valign="middle" ></th><th align="center" valign="middle" ></th><th align="center" valign="middle" ></th></tr></thead><tr><td align="center" valign="middle" >Group Level - GBM</td><td align="center" valign="middle"  colspan="2"  >Individual ID Level - Random Forest</td><td align="center" valign="middle"  colspan="3"  >Paired Case Control Level - Conditional Logistic Regression - Generalized Additive Model</td></tr><tr><td align="center" valign="middle" >Use</td><td align="center" valign="middle" >Use</td><td align="center" valign="middle" >Individual ID</td><td align="center" valign="middle" >Use</td><td align="center" valign="middle" >Individual ID</td><td align="center" valign="middle" >Case Control</td></tr><tr><td align="center" valign="middle" >1 (Present)</td><td align="center" valign="middle" >1 (Present)</td><td align="center" valign="middle" >1</td><td align="center" valign="middle" >1 (Present)</td><td align="center" valign="middle" >1</td><td align="center" valign="middle" >1</td></tr><tr><td align="center" valign="middle" >0 (Absent)</td><td align="center" valign="middle" >0 (Absent)</td><td align="center" valign="middle" >1</td><td align="center" valign="middle" >0 (Absent)</td><td align="center" valign="middle" >1</td><td align="center" valign="middle" >1</td></tr><tr><td align="center" valign="middle" >1 (Present)</td><td align="center" valign="middle" >1 (Present)</td><td align="center" valign="middle" >3</td><td align="center" valign="middle" >1 (Present)</td><td align="center" valign="middle" >3</td><td align="center" valign="middle" >2</td></tr><tr><td align="center" valign="middle" >0 (Absent)</td><td align="center" valign="middle" >0 (Absent)</td><td align="center" valign="middle" >3</td><td align="center" valign="middle" >0 (Absent)</td><td align="center" valign="middle" >3</td><td align="center" valign="middle" >2</td></tr></tbody></table></table-wrap><p>explain relationships between variables.</p><p>y i = β 0 + f 1 ( x 1 i ) + f 2 ( x 2 i ) + ⋅ ⋅ ⋅ + f q ( x q i ) + ϵ i (3)</p><p>The smoothing splines, thin-plate splines, cubic splines, and splines with variable knots (k = 3, k = 8) applied to applicable covariates (Equation (3)). In this way, the environmental covariates are split into knots, and data in each knot section are fit independently, furthermore adding functions of knots to predict the link function. GAMs are frequently used in species distribution models [<xref ref-type="bibr" rid="scirp.100081-ref38">38</xref>]. The data were fit with individual id strata and case-control utilizing the Cox Proportional Hazard function, where time events were all set to 1, and the cases (use-available) added as weights [<xref ref-type="bibr" rid="scirp.100081-ref39">39</xref>]. This method is shown to be comparative to a conditional logistic model and with the additive effects of smooths for the GAM. All GAM models used the gam package in program R [<xref ref-type="bibr" rid="scirp.100081-ref39">39</xref>].</p></sec><sec id="s2_6_3"><title>2.6.3. Random Forests Classification</title><p>Decision trees, like Random Forest (RF), are used to create partitions or splits between the predictors, forming them into regression trees. These models are ensemble models that allow for multiple models to be fit, combining the results with the rationale that this will produce a better result than a single model. It does this through the model fitting with training data and then using testing data to estimate error and the importance of each variable. RF is one approach to classify data into decision trees by generating B different bootstrapped training sets in a technique called “bagging” (Equation (4)). Bagging is a non-parametric modeling technique that is useful for high-variance predictors. Bagging averages the observations, and can significantly lower the variance compared to traditional classification trees [<xref ref-type="bibr" rid="scirp.100081-ref40">40</xref>].</p><p>f ^ b a g ( x ) = 1 B ∑ b = 1 B f ^ * b ( x ) (4)</p><p>Models generated by bagging alone have issues with becoming correlated due to selecting the strong predictor in the topmost split for all of the trees generated. Random forest is an extension of bagging, such that trees generated by bagging by using a subset of randomly chosen p predictors ( p ), to decorrelate the trees from having dominant predictors in any of the models [<xref ref-type="bibr" rid="scirp.100081-ref41">41</xref>].</p><p>Further, model-averaging with classification trees that have low pairwise correlations, due to this variable separation among trees, reduces model bias and improves model accuracy [<xref ref-type="bibr" rid="scirp.100081-ref42">42</xref>]. Out-of-bag samples are then used for accuracy and error rates then averaged for the tree prediction. The randomForest package in program R allows for proper tuning of variability in the tree, which can allow for the selection of the number of variables to be split by each node. The package also allows for the individual id of the animal to be added as strata. Random forest models used program R with package randomForest.</p></sec><sec id="s2_6_4"><title>2.6.4. Gradient Boosted Method</title><p>Gradient Boosted Method (GBM) works similarly to RF except that it does not use a bootstrapped dataset. In GBM, trees are built using the residuals from previously grown decision trees to improve the function. Boosting works as an optimization algorithm, gradient descent method. Boosting minimizes the loss function at each step, reducing the residuals through shrinkage methods whereby irrelevant predictors are made to have minimal effect on predictions [<xref ref-type="bibr" rid="scirp.100081-ref38">38</xref>].</p><p>f ^ ( x ) = ∑ b = 1 B λ f ^ b ( x ) (5)</p><p>The shrinkage parameter λ works out inconsistencies in the residuals even further by forming new arrangements of trees (5) [<xref ref-type="bibr" rid="scirp.100081-ref43">43</xref>]. These methods reduce bias and variance compared to RF by using forward stepwise selection and model averaging techniques in fitting tree sequentially in contrast to bootstrapping the data [<xref ref-type="bibr" rid="scirp.100081-ref38">38</xref>]. GBM models “learn” slowly, i.e. the regression tree grows each split. Training data are used to generate an initial decision tree. Then the residuals are fit to new trees using a shrinkage parameter repeatedly and additively to update the final model. Boosting avoids overfitting that is a limitation of other classification tree methods [<xref ref-type="bibr" rid="scirp.100081-ref41">41</xref>]. The GBM models used package gbm.step in program R [<xref ref-type="bibr" rid="scirp.100081-ref44">44</xref>]. This package lacks an argument to specify the strata of the individual animal ids, thus making all presences and absences within the entire generated set the response. Group level is a much larger level than if they could be subset by individual id or as a case-control.</p></sec></sec><sec id="s2_7"><title>2.7. Model Evaluation</title><p>In many wildlife studies, AIC (Akaike’s Information Criterion) is normally used to select models and select for the best set of predictors. AIC does not evaluate the ability of models’ predictive functions. Learning methods that subset the data into training and testing observations are validating the efficacy of the model. Model evaluation using k-fold cross-validation subset data into training data subsets, or folds (k), and then fit models using K − 1 folds for the model training. Five folds were used and divided evenly the presence and background data. The step selection data was a subset in 5 folds (n = 8539). The path selection data was a subset in 5-folds (n = 881). Model evaluation metrics were used to evaluate model accuracy. This study used Area Under the Curve (AUC), Cohen’s kappa (Kappa), and the True Skill Statistic (TSS). AUC is a graphic method for specificity and sensitivity, with AUC values greater than 0.5 known to perform better than completely random noise. The Kappa statistic is based on thresholds derived from a confusion matrix, looking for the maximum Kappa value between 0 and 1 to determine model efficacy. The True Skill Statistic uses sensitivity and specificity for a confusion matrix and ranges from −1 to +1, and any values 0 or less indicate random models [<xref ref-type="bibr" rid="scirp.100081-ref45">45</xref>]. All models (RF, GBM, GAM, and conditional logistic regression) were compared using model evaluation metrics (AUC, ROC, cor, KAPPA, TSS) achieved by running 5-fold cross-validation.</p></sec></sec><sec id="s3"><title>3. Results</title><p>In this study, we assessed predictive modeling approaches for a multi-level multi-scale GPS-collaring study. Our approach allowed us to determine which of the levels and scales might perform adequately for predictive mapping of the landscape. In this case, the multi-scale path selection function GBM model performed the best (AUC = 1, cor = 0.989, TSS = 1, Kappa = 1). There were comparatively good single-scale path selection function RF model results. Additionally, the single and multi-scale point selection function RF also performed similarly well. Predictive maps were generated for the machine learning outputs (RF and GMB) and habitat suitability results were scaled at equal intervals for comparison of the landscape predictions (<xref ref-type="fig" rid="fig2">Figure 2</xref>).</p><p>It became imperative to identify the best fitting model for the smallest scale and level that could generate predictive maps. In this case, the smallest level of</p><p>data, single-scale and multi-scale SSFs, did not perform adequately on any models. The PSF case-control models were the next smallest temporal level. However, the model did not evaluate well, nor fit the data. The multi-scale PSF, with an individual strata level, did fit the data well and can be considered the best fitting smallest scale model. Through examining the results, it became clear that the largest level of models fit the data better, although were also the most broadly applied and less specific to the data themselves, so we thought to search for the most specific model to the data as possible.</p><p>For the largest level model, the “group” level, the gradient boosted tree (GBM), gave the highest model accuracy for the PSF. The level of this analysis is comparatively larger than other models. The GBM model only slightly outperformed the RF algorithm; however, the RF performs at a slightly more specific level of the individual id strata. We assume that larger level RSFs will likely evaluate as being better models because of the broader level of analysis. Models that are more specific, i.e. specifying strata (individual id, case-control), are more specific to pairing the data generated for each path or step not traversed. Additionally, when we consider the point selection function as having no case-controls or anything to pair due to the inherent randomness of background point generation within the MCP, pairing data points is non-consequential and thus at a higher level than the steps or paths. Usually, point selection outperforms step and path selection; although step and path are more specific to an animals’ hourly or daily movements. Therefore, taking methods at different temporal and levels of analysis can mean that the researcher should attempt to classify the best fitting and smallest levels of analysis as possible during model evaluation to generate the most accurate predictions.</p><p>For the explanatory models, the conditional logistic regression only performed on the 30 m<sup>2</sup> raster data point selection function (AUC = 0.821, cor = 0.54, TSS = 0.50, and Kappa = 0.50), and GAM performed on the multi-scale point selection function (AUC = 0.90, cor = 0.654, TSS = 0.657, Kappa = 0.656). These results can be interpreted as better than random. All other models were unable to fit GAM or conditional logistic regression. In this case, the case-control framework did not improve the analysis, as point selection functions generate background points randomly without any temporal or spatial “pairing” in the data, rendering the case-control functionality completely random although the level of this analysis could be considered “individual strata” within the home range MCP that the background points were generated. GAM operated at the level of individual id, and was able to outperform the conditional logistic regression for single and multi-grain point selection.</p>Model ResultsSingle Grain (30 m<sup>2</sup>) Point Selection Function<p>Using the smallest available grain for all layers, the point selection function showed the RF model performed very well, followed by GBM (<xref ref-type="table" rid="table4">Table 4</xref>(a)). In this case, the point “temporal level”, individual ID strata “level” was the most</p><table-wrap-group id="4"><label><xref ref-type="table" rid="table4">Table 4</xref></label><caption><title> Model evaluation for the area under the curve (AUC), correlation, true skills statistic (TSS) and Cohen’s Kappa. (a) Point selection with 30 m<sup>2</sup> scale rasters; (b) Step selection with 30 m<sup>2</sup> scale rasters; (c) Path selection with 30 m<sup>2</sup> scale rasters; (d) Point selection multi-scale rasters; (e) Step selection multi-scale rasters; (f) Path selection with multi-scale rasters</title></caption><table-wrap id="4_1"><caption><title> (b)</title></caption><table><tbody><thead><tr><th align="center" valign="middle" >Model</th><th align="center" valign="middle" >AUC</th><th align="center" valign="middle" >cor</th><th align="center" valign="middle" >TSS</th><th align="center" valign="middle" >Kappa</th></tr></thead><tr><td align="center" valign="middle" >RF</td><td align="center" valign="middle" >1</td><td align="center" valign="middle" >0.989337</td><td align="center" valign="middle" >1</td><td align="center" valign="middle" >1</td></tr><tr><td align="center" valign="middle" >GMB</td><td align="center" valign="middle" >0.988558</td><td align="center" valign="middle" >0.903022</td><td align="center" valign="middle" >0.896347</td><td align="center" valign="middle" >0.895994</td></tr><tr><td align="center" valign="middle" >GAM</td><td align="center" valign="middle" >0.879735</td><td align="center" valign="middle" >0.625121</td><td align="center" valign="middle" >0.605795</td><td align="center" valign="middle" >0.605548</td></tr><tr><td align="center" valign="middle" >Conditional Logistic</td><td align="center" valign="middle" >0.821929</td><td align="center" valign="middle" >0.540328</td><td align="center" valign="middle" >0.507053</td><td align="center" valign="middle" >0.50537</td></tr></tbody></table></table-wrap><table-wrap id="4_2"><caption><title> (c)</title></caption><table><tbody><thead><tr><th align="center" valign="middle" >Model</th><th align="center" valign="middle" >AUC</th><th align="center" valign="middle" >cor</th><th align="center" valign="middle" >TSS</th><th align="center" valign="middle" >Kappa</th></tr></thead><tr><td align="center" valign="middle" >RF</td><td align="center" valign="middle" >0.739253</td><td align="center" valign="middle" >0.46462</td><td align="center" valign="middle" >0.393011</td><td align="center" valign="middle" >0.393657</td></tr><tr><td align="center" valign="middle" >GBM</td><td align="center" valign="middle" >0.703558</td><td align="center" valign="middle" >0.372691</td><td align="center" valign="middle" >0.305952</td><td align="center" valign="middle" >0.306359</td></tr><tr><td align="center" valign="middle" >GAM</td><td align="center" valign="middle" >0.558275</td><td align="center" valign="middle" >0.102469</td><td align="center" valign="middle" >0.085603</td><td align="center" valign="middle" >0.085621</td></tr><tr><td align="center" valign="middle" >Conditional Logistic</td><td align="center" valign="middle" >0.549032</td><td align="center" valign="middle" >0.081891</td><td align="center" valign="middle" >0.076443</td><td align="center" valign="middle" >0.076415</td></tr></tbody></table></table-wrap><table-wrap id="4_3"><caption><title> (d)</title></caption><table><tbody><thead><tr><th align="center" valign="middle" >Model</th><th align="center" valign="middle" >AUC</th><th align="center" valign="middle" >cor</th><th align="center" valign="middle" >TSS</th><th align="center" valign="middle" >Kappa</th></tr></thead><tr><td align="center" valign="middle" >RF</td><td align="center" valign="middle" >1</td><td align="center" valign="middle" >0.979821</td><td align="center" valign="middle" >1</td><td align="center" valign="middle" >1</td></tr><tr><td align="center" valign="middle" >GBM</td><td align="center" valign="middle" >0.978913</td><td align="center" valign="middle" >0.8614446</td><td align="center" valign="middle" >0.8516936</td><td align="center" valign="middle" >0.8516711</td></tr><tr><td align="center" valign="middle" >GAM</td><td align="center" valign="middle" >0.746084</td><td align="center" valign="middle" >0.416801</td><td align="center" valign="middle" >0.383126</td><td align="center" valign="middle" >0.383275</td></tr><tr><td align="center" valign="middle" >Conditional Logistic</td><td align="center" valign="middle" >0.630573</td><td align="center" valign="middle" >0.216279</td><td align="center" valign="middle" >0.209406</td><td align="center" valign="middle" >0.209485</td></tr></tbody></table></table-wrap><table-wrap id="4_4"><caption><title> (e)</title></caption><table><tbody><thead><tr><th align="center" valign="middle" >Model</th><th align="center" valign="middle" >AUC</th><th align="center" valign="middle" >cor</th><th align="center" valign="middle" >TSS</th><th align="center" valign="middle" >Kappa</th></tr></thead><tr><td align="center" valign="middle" >RF</td><td align="center" valign="middle" >1</td><td align="center" valign="middle" >0.989594</td><td align="center" valign="middle" >1</td><td align="center" valign="middle" >1</td></tr><tr><td align="center" valign="middle" >GBM</td><td align="center" valign="middle" >0.993498</td><td align="center" valign="middle" >0.927041</td><td align="center" valign="middle" >0.921899</td><td align="center" valign="middle" >0.9216746</td></tr><tr><td align="center" valign="middle" >GAM</td><td align="center" valign="middle" >0.902305</td><td align="center" valign="middle" >0.654069</td><td align="center" valign="middle" >0.657657</td><td align="center" valign="middle" >0.6568519</td></tr><tr><td align="center" valign="middle" >Conditional Logistic</td><td align="center" valign="middle" >0.746150</td><td align="center" valign="middle" >0.248888</td><td align="center" valign="middle" >0.000709</td><td align="center" valign="middle" >0.0006918</td></tr></tbody></table></table-wrap><table-wrap id="4_5"><caption><title> (f)</title></caption><table><tbody><thead><tr><th align="center" valign="middle" >Model</th><th align="center" valign="middle" >AUC</th><th align="center" valign="middle" >cor</th><th align="center" valign="middle" >TSS</th><th align="center" valign="middle" >Kappa</th></tr></thead><tr><td align="center" valign="middle" >RF</td><td align="center" valign="middle" >0.739331</td><td align="center" valign="middle" >0.464646</td><td align="center" valign="middle" >0.394652</td><td align="center" valign="middle" >0.395227</td></tr><tr><td align="center" valign="middle" >GBM</td><td align="center" valign="middle" >0.712909</td><td align="center" valign="middle" >0.391378</td><td align="center" valign="middle" >0.319602</td><td align="center" valign="middle" >0.320075</td></tr><tr><td align="center" valign="middle" >GAM</td><td align="center" valign="middle" >0.559197</td><td align="center" valign="middle" >0.104748</td><td align="center" valign="middle" >0.081383</td><td align="center" valign="middle" >0.081383</td></tr><tr><td align="center" valign="middle" >Conditional Logistic</td><td align="center" valign="middle" >0.5028</td><td align="center" valign="middle" >0.000508</td><td align="center" valign="middle" >0</td><td align="center" valign="middle" >0</td></tr></tbody></table></table-wrap><table-wrap id="4_6"><caption><title></title></caption><table><tbody><thead><tr><th align="center" valign="middle" >Model</th><th align="center" valign="middle" >AUC</th><th align="center" valign="middle" >cor</th><th align="center" valign="middle" >TSS</th><th align="center" valign="middle" >Kappa</th></tr></thead><tr><td align="center" valign="middle" >GBM</td><td align="center" valign="middle" >1</td><td align="center" valign="middle" >0.997403</td><td align="center" valign="middle" >1</td><td align="center" valign="middle" >1</td></tr><tr><td align="center" valign="middle" >RF</td><td align="center" valign="middle" >1</td><td align="center" valign="middle" >0.98323</td><td align="center" valign="middle" >1</td><td align="center" valign="middle" >1</td></tr><tr><td align="center" valign="middle" >Conditional Logistic</td><td align="center" valign="middle" >0.630938</td><td align="center" valign="middle" >0.130467</td><td align="center" valign="middle" >0.187526</td><td align="center" valign="middle" >0.187623</td></tr><tr><td align="center" valign="middle" >GAM</td><td align="center" valign="middle" >0.842983</td><td align="center" valign="middle" >−0.59011</td><td align="center" valign="middle" >−0.1051</td><td align="center" valign="middle" >−0.1048</td></tr></tbody></table></table-wrap></table-wrap-group><p>successful model out of all of the various levels (step or path) at this 30 m<sup>2</sup> raster scale. This scale and level also had the best performing conditional logistic regression models.</p>Single Grain (30 m<sup>2</sup>) Step Selection Function<p>The best model for the 30 m<sup>2</sup> grain step selection function was RF, followed by GBM (<xref ref-type="table" rid="table4">Table 4</xref>(b)). The regression tree models (GBM, RF) performed much better than random. All of the GAM models showed a slightly better than random score for AUC. The conditional logistic regression models both fit no better than random and can be considered to have not fit the data sufficiently.</p>Single Grain (30 m<sup>2</sup>) Path Selection Function<p>The results from the single grain path selection function showed better model evaluation metrics for all models than step selection (<xref ref-type="table" rid="table4">Table 4</xref>(c)). The RF performed the best out of all other models, and GAM and conditional logistic models path selection models showed significant improvement when compared with the step selection.</p>Multi-Scale Point Selection<p>The multi-scale data improved all model results, improving all of the model estimates when compared with the 30 m<sup>2</sup> grain (<xref ref-type="table" rid="table4">Table 4</xref>(d)). The RF and GBM models were overall the best fitting models. This scale and level also showed the best GAM model for all models where adding a univariate model fitting approach improved the model estimates.</p>Multi-Scale Step Selection<p>The multi-scaled step selection function produced similar results to those found in the 30 m<sup>2</sup>, with negligible increases in the AUC, cor, Kappa, and TSS (<xref ref-type="table" rid="table4">Table 4</xref>(e)). From this we can understand that using the smallest grain possible or resampled to 30 m<sup>2</sup> performed similarly to that of using multiple scales.</p>Multi-Scale Path Selection<p>The multi-grain path selection GBM was the best fit model and was fit with 84 multi-scale environmental predictor variables, making only slight improvements over the 30 m<sup>2</sup> and multi-scale point selection RF models (<xref ref-type="table" rid="table4">Table 4</xref>(f)).</p></sec><sec id="s4"><title>4. Discussion</title><p>This research explored methods for modeling the predictive habitat suitability and jaguar resource selection in the area surrounding the Taiama NR in the Brazilian Pantanal. The applicability of parametric models like conditional logistic regression, and non-parametric models that use machine learning (ML) methods, were applied GPS collaring data for various movement sampling units, study designs, scales, and grains available for habitat selection mapping. This study was able to apply multi-level multi-scale modeling similar to other studies [<xref ref-type="bibr" rid="scirp.100081-ref5">5</xref>] [<xref ref-type="bibr" rid="scirp.100081-ref6">6</xref>] [<xref ref-type="bibr" rid="scirp.100081-ref7">7</xref>], with results indicating that temporal and model levels were able to influence the interpretation of the models thus qualifying multi-level, multi-scale resource selection studies as producing better models.</p><p>This study also assessed the applicability of ML methods operating at RSF orders such as individual strata or group level, not strictly within a case-control framework like conditional logistic regression or GAM. Similar to other studies that have sought to compare ML methods to conditional logistic regression [<xref ref-type="bibr" rid="scirp.100081-ref14">14</xref>] [<xref ref-type="bibr" rid="scirp.100081-ref19">19</xref>], this study also found that machine learning methods perform better in general. However, the caveat being that the conditional logistic regression provides interpretable model outputs that enable ecologists to determine exact relationships between the study species and the environmental covariates, whereas machine learning methods provide better predictive models for the landscape that have non-interpretable environmental relationships.</p><p>Previous studies have demonstrated the importance of choice of raster grain for producing resistance surfaces that are then used with movement simulations such as least cost paths [<xref ref-type="bibr" rid="scirp.100081-ref46">46</xref>]. Furthermore, multi-level multi-scale models and resistance surfaces have also been used for connectivity estimates [<xref ref-type="bibr" rid="scirp.100081-ref7">7</xref>]. This study revealed that the increase in multiple-scales only had a improvement for some models, similar to other studies that have shown for some organisms that a multi-scale approach has no improvement over single scale [<xref ref-type="bibr" rid="scirp.100081-ref16">16</xref>], which here is demonstrated that various models do not necessarily perform better with multi-scale inputs.</p><p>These results are generally consistent with other findings that random forest and other machine learning algorithms perform “better” than logistic or conditional logistic regression. In this case, the conditional logistic regression fit only slightly better than random except for the point selection function at a single 30 m<sup>2</sup> grain. This study demonstrates a direct comparison between a semi-parametric GAM and conditional logistic regression using case-control data. The GAM improved model estimates compared to conditional logistic regression for all level models, and on the right dataset for these techniques a large improvement in model fit could be shown to improve model evaluation. Advancements in machine learning may include developing specific tools to accommodate case-controls, where specific random forest algorithms developed with conditional logistic regression could be developed specifically for this purpose. Models would have to all be fit using a case-control framework to be directly comparable at one level. Otherwise, levels for individual strata, and group level can be seen as having this overarching discrepancy.</p><p>This multi-level approach allowed us to further understand the effects of level on predictive modeling approaches. From these results, it may be assumed that larger temporal and model levels fit these particular data better, and that looking at smaller levels like case-control for the most specific step level was not able to perform adequate enough to use the results. It was our objective to identify the levels and scale to suit the analysis and the results indicated that larger scale models fit the data best, although are not as specific to movements of the organism.</p></sec><sec id="s5"><title>5. Limitations of the Study</title><p>Due to the computational package functionality of each statistical model to operate at the levels for the entire group, or strata for individual id, or work within a case-control framework, this difference in model level potential within the analysis became a subject of concern. For example, GBM operates at the group level, and random forest at the individual id strata, GAM and conditional logistic at the individual id strata and case-control. Furthermore, this study explores the inherent limitations of current machine learning packages for working within one level of analysis, suggesting a supervised learning approach that can either be specific to one level of RSF for direct comparison, or comparison at higher order levels if necessary.</p><p>The machine learning derived predictive maps and models used in this study are not meant for direct interpretation of variable importance such as giving direct estimates of preferred canopy cover or distance to water. In predictive modeling, the goal is to accurately predict and project something new and optimize accuracy of making predictions, in contrast to understanding why these models predicted in the way they do [<xref ref-type="bibr" rid="scirp.100081-ref13">13</xref>]. The Gini Index provided very different variable importance plots between RF and GBM. Differences are likely based in the methods the algorithms use to make the trees, as well as the level of the RSF inherent within the tree building process. In this case, model interpretation becomes less important, as the real interest is in generating accurate predictions on new sets of data, which is one major benefits of choosing machine learning algorithms over statistical data models. In the process of comparing conditional logistic regression, an explanatory model, with predictive models such as GAM, RF, and GBM, we are trying to use both tools to understand how the jaguars respond to the landscape, and also predict onto the wider landscape. Utilizing tools from data modeling and machine learning algorithms may be the best way to bridge gaps in methodological development between the two (explanatory and predictive) polarized types of modeling framework [<xref ref-type="bibr" rid="scirp.100081-ref47">47</xref>]. Here we attempt both, and see how we can gain information about jaguar distribution for predicting a larger landscape region.</p></sec><sec id="s6"><title>6. Conclusion</title><p>This study analyzed non-parametric, semi-parametric, and parametric methods for multiple temporal levels (point, step, and path selection), model levels (group, individual, case-control), and raster grains to compare the applicability of predictive statistical methods in comparison to explanatory methods, such as conditional logistic regression for predicting large areas of the landscape. We compared the parametric statistical approach using conditional logistic regression, with non-parametric and semi-parametric models that accounted for non-linearities such as generalized additive models and classification trees (RF and GBM), comparing the results using model selection methods (AUC, cor, KAPPA, TSS) derived from k-fold cross validation. The results revealed differences in predicting landscape resource selection using non-linear modeling approaches. This case study illustrates inability for a direct comparison of machine learning and explanatory modeling approaches for step and path selection functions due to the inherent data levels (case-control, individual stratum, group) that the models will accept.</p></sec><sec id="s7"><title>Author Contributions</title><p>E.B. conceived of the idea. E.B. developed the analytical methods and performed the computations, wrote the manuscript. D.H. and T.H. supervised the final draft and finding of the work. D.H. suggested major revisions to conceptual structures and language. B.A. discussed the results and contributed comments to the manuscript.</p></sec><sec id="s8"><title>Acknowledgements</title><p>Special thanks to the field team at Centro Nacional de Pesquisa e Conserva&#231;&#227;o de Mam&#237;feros Carn&#237;voros, Instituto Chico Mendes de Conserva&#231;&#227;o da Biodiversidade, Atibaia, SP, Brazil who were involved in the fieldwork and project discussion for this project. Espcially Dr. Morato and Dr. Santos who made extensive comments throughout manuscript preparation. Special thanks to the GIS preparation team that helped assemble remote sensing data layers for the analysis. Special thanks to Kathy Zeller for making initial comments.</p></sec><sec id="s9"><title>Conflicts of Interest</title><p>The authors declare no conflicts of interest regarding the publication of this paper.</p></sec><sec id="s10"><title>Cite this paper</title><p>Bohnett, E., Hulse, D., Ahmad, B. and Hoctor, T. (2020) Multi-Level, Multi-Scale Modeling and Predictive Mapping for Jaguars in the Brazilian Pantanal. Open Journal of Ecology, 10, 243-263. https://doi.org/10.4236/oje.2020.105016</p></sec></body><back><ref-list><title>References</title><ref id="scirp.100081-ref1"><label>1</label><mixed-citation publication-type="other" xlink:type="simple">Cushman, S.A. and Huettmann, F. (2010) Spatial Complexity, Informatics, and Wildlife Conservation. Springer Japan, Tokyo. https://doi.org/10.1007/978-4-431-87771-4</mixed-citation></ref><ref id="scirp.100081-ref2"><label>2</label><mixed-citation publication-type="other" xlink:type="simple">Levin, S.A. (1992) The Problem of Pattern and Scale in Ecology: The Robert H. MacArthur Award Lecture. Ecology, 73, 1943-1967. https://doi.org/10.2307/1941447</mixed-citation></ref><ref id="scirp.100081-ref3"><label>3</label><mixed-citation publication-type="other" xlink:type="simple">Turner, M. (1989) Landscape Ecology: The Effect of Pattern on Process. Annual Review of Ecology and Systematics, 20, 171-197. https://doi.org/10.1146/annurev.es.20.110189.001131</mixed-citation></ref><ref id="scirp.100081-ref4"><label>4</label><mixed-citation publication-type="other" xlink:type="simple">Johnson, D.H. (1980) The Comparison of Usage and Availability Measurements for Evaluating Resource Preference. Ecology, 61, 65-71. https://doi.org/10.2307/1937156</mixed-citation></ref><ref id="scirp.100081-ref5"><label>5</label><mixed-citation publication-type="other" xlink:type="simple">DeCesare, N.J., Hebblewhite, M., Schmiegelow, F., Hervieux, D., McDermid, G.J., Neufeld, L., et al. (2012) Transcending Scale Dependence in Identifying Habitat with Resource Selection Functions. Ecological Applications, 22, 1068-1083. https://doi.org/10.1890/11-1610.1</mixed-citation></ref><ref id="scirp.100081-ref6"><label>6</label><mixed-citation publication-type="other" xlink:type="simple">Bauder, J.M., Breininger, D.R., Bolt, M.R., Legare, M.L., Jenkins, C.L., Rothermel, B.B., et al. (2018) Multi-Level, Multi-Scale Habitat Selection by a Wide-Ranging, Federally Threatened Snake. Landscape Ecology, 33, 743-763. https://doi.org/10.1007/s10980-018-0631-2</mixed-citation></ref><ref id="scirp.100081-ref7"><label>7</label><mixed-citation publication-type="other" xlink:type="simple">Zeller, K.A., Vickers, T.W., Ernest, H.B. and Boyce, W.M. (2017) Multi-Level, Multi-Scale Resource Selection Functions and Resistance Surfaces for Conservation Planning: Pumas as a Case Study. PLoS ONE, 12, e0179570. https://doi.org/10.1371/journal.pone.0179570</mixed-citation></ref><ref id="scirp.100081-ref8"><label>8</label><mixed-citation publication-type="other" xlink:type="simple">Johnson, D.S., Thomas, D.L., Ver Hoef, J.M. and Christ, A. (2008) A General Framework for the Analysis of Animal Resource Selection from Telemetry Data. Biometrics, 64, 968-976. https://doi.org/10.1111/j.1541-0420.2007.00943.x</mixed-citation></ref><ref id="scirp.100081-ref9"><label>9</label><mixed-citation publication-type="other" xlink:type="simple">Zeller, K.A., McGarigal, K., Cushman, S.A., Beier, P., Vickers, T.W. and Boyce, W.M. (2016) Using Step and Path Selection Functions for Estimating Resistance to Movement: Pumas as a Case Study. Landscape Ecology, 31, 1319-1335. https://doi.org/10.1007/s10980-015-0301-6</mixed-citation></ref><ref id="scirp.100081-ref10"><label>10</label><mixed-citation publication-type="other" xlink:type="simple">Elliot, N.B., Cushman, S.A., Macdonald, D.W. and Loveridge, A.J. (2014) The Devil Is in the Dispersers: Predictions of Landscape Connectivity Change with Demography. Journal of Applied Ecology, 51, 1169-1178. https://doi.org/10.1111/1365-2664.12282</mixed-citation></ref><ref id="scirp.100081-ref11"><label>11</label><mixed-citation publication-type="other" xlink:type="simple">Krishnamurthy, R., Cushman, S.A., Sarkar, M.S., Malviya, M., Naveen, M., Johnson, J.A., et al. (2016) Multi-Scale Prediction of Landscape Resistance for Tiger Dispersal in Central India. Landscape Ecology, 31, 1355-1368. https://doi.org/10.1007/s10980-016-0363-0</mixed-citation></ref><ref id="scirp.100081-ref12"><label>12</label><mixed-citation publication-type="other" xlink:type="simple">Drew, C.A., Wiersma, Y.F. and Huettmann, F. (2011) Predictive Species and Habitat Modeling in Landscape Ecology. Springer, New York. https://doi.org/10.1007/978-1-4419-7390-0</mixed-citation></ref><ref id="scirp.100081-ref13"><label>13</label><mixed-citation publication-type="other" xlink:type="simple">Kuhn, M. and Johnson, K. (2013) Applied Predictive Modeling. Springer, New York. https://doi.org/10.1007/978-1-4614-6849-3</mixed-citation></ref><ref id="scirp.100081-ref14"><label>14</label><mixed-citation publication-type="book" xlink:type="simple">Cushman, S.A. and Wasserman, T.N. (2018) Landscape Applications of Machine Learning: Comparing Random Forests and Logistic Regression in Multi-Scale Optimized Predictive Modeling of American Marten Occurrence in Northern Idaho, USA. In: Humphries, G., Magness, D.R. and Huettmann, F., Eds., Machine Learning for Ecology and Sustainable Natural Resource Management, Springer International Publishing, Cham, 185-203. https://doi.org/10.1007/978-3-319-96978-7_9</mixed-citation></ref><ref id="scirp.100081-ref15"><label>15</label><mixed-citation publication-type="other" xlink:type="simple">Mi, C., Huettmann, F., Guo, Y., Han, X. and Wen, L. (2017) Why Choose Random Forest to Predict Rare Species Distribution with Few Samples in Large Undersampled Areas? Three Asian Crane Species Models Provide Supporting Evidence. PeerJ, 5, e2849. https://doi.org/10.7717/peerj.2849</mixed-citation></ref><ref id="scirp.100081-ref16"><label>16</label><mixed-citation publication-type="other" xlink:type="simple">Martin, A.E. and Fahrig, L. (2012) Measuring and Selecting Scales of Effect for Landscape Predictors in Species-Habitat Models. Ecological Applications, 22, 2277-2292. https://doi.org/10.1890/11-2224.1</mixed-citation></ref><ref id="scirp.100081-ref17"><label>17</label><mixed-citation publication-type="other" xlink:type="simple">Shoemaker, K.T., Heffelfinger, L.J., Jackson, N.J., Blum, M.E., Wasley, T. and Stewart, K.M. (2018) A Machine-Learning Approach for Extending Classical Wildlife Resource Selection Analyses. Ecology and Evolution, 8, 3556-3569. https://doi.org/10.1002/ece3.3936</mixed-citation></ref><ref id="scirp.100081-ref18"><label>18</label><mixed-citation publication-type="other" xlink:type="simple">Frakes, R.A., Belden, R.C., Wood, B.E. and James, F.E. (2015) Landscape Analysis of Adult Florida Panther Habitat. PLoS ONE, 10, e0133044. https://doi.org/10.1371/journal.pone.0133044</mixed-citation></ref><ref id="scirp.100081-ref19"><label>19</label><mixed-citation publication-type="other" xlink:type="simple">Zeller, K.A., Jennings, M.K., Vickers, T.W., Ernest, H.B., Cushman, S.A. and Boyce, W.M. (2018) Are All Data Types and Connectivity Models Created Equal? Validating Common Connectivity Approaches with Dispersal Data. Diversity and Distributions, 24, 868-879. https://doi.org/10.1111/ddi.12742</mixed-citation></ref><ref id="scirp.100081-ref20"><label>20</label><mixed-citation publication-type="other" xlink:type="simple">Duhart, C., Dublon, G., Mayton, B., Davenport, G. and Paradiso, J.A. (2019) Deep Learning for Wildlife Conservation and Restoration Efforts. 36th International Conference on Machine Learning, Long Beach, 5.</mixed-citation></ref><ref id="scirp.100081-ref21"><label>21</label><mixed-citation publication-type="other" xlink:type="simple">Gorelick, N., Hancher, M., Dixon, M., Ilyushchenko, S., Thau, D. and Moore, R. (2017) Google Earth Engine: Planetary-Scale Geospatial Analysis for Everyone. Remote Sensing of Environment, 202, 18-27. https://doi.org/10.1016/j.rse.2017.06.031</mixed-citation></ref><ref id="scirp.100081-ref22"><label>22</label><mixed-citation publication-type="other" xlink:type="simple">Miller, H.J., Dodge, S., Miller, J. and Bohrer, G. (2019) Towards an Integrated Science of Movement: Converging Research on Animal Movement Ecology and Human Mobility Science. International Journal of Geographical Information Science, 33, 855-876. https://doi.org/10.1080/13658816.2018.1564317</mixed-citation></ref><ref id="scirp.100081-ref23"><label>23</label><mixed-citation publication-type="other" xlink:type="simple">Wearn, O.R., Freeman, R. and Jacoby, D.M.P. (2019) Responsible AI for Conservation. Nature Machine Intelligence, 1, 72-73. https://doi.org/10.1038/s42256-019-0022-7</mixed-citation></ref><ref id="scirp.100081-ref24"><label>24</label><mixed-citation publication-type="other" xlink:type="simple">Evans, T.L., Costa, M., Tomas, W.M. and Camilo, A.R. (2014) Large-Scale Habitat Mapping of the Brazilian Pantanal Wetland: A Synthetic Aperture Radar Approach. Remote Sensing of Environment, 155, 89-108. https://doi.org/10.1016/j.rse.2013.08.051</mixed-citation></ref><ref id="scirp.100081-ref25"><label>25</label><mixed-citation publication-type="other" xlink:type="simple">McGarigal, K., Wan, H.Y., Zeller, K.A., Timm, B.C. and Cushman, S.A. (2016) Multi-Scale Habitat Selection Modeling: A Review and Outlook. Landscape Ecology, 31, 1161-1175. https://doi.org/10.1007/s10980-016-0374-x</mixed-citation></ref><ref id="scirp.100081-ref26"><label>26</label><mixed-citation publication-type="other" xlink:type="simple">Galpern, P. and Manseau, M. (2013) Finding the Functional Grain: Comparing Methods for Scaling Resistance Surfaces. Landscape Ecology, 28, 1269-1281. https://doi.org/10.1007/s10980-013-9873-1</mixed-citation></ref><ref id="scirp.100081-ref27"><label>27</label><mixed-citation publication-type="other" xlink:type="simple">McGarigal, K., Zeller, K.A. and Cushman, S.A. (2016) Multi-Scale Habitat Selection Modeling: Introduction to the Special Issue. Landscape Ecology, 31, 1157-1160. https://doi.org/10.1007/s10980-016-0388-4</mixed-citation></ref><ref id="scirp.100081-ref28"><label>28</label><mixed-citation publication-type="other" xlink:type="simple">Morato, R.G., Connette, G.M., Stabach, J.A., De Paula, R.C., Ferraz, K.M.P.M., Kantek, D.L.Z., et al. (2018) Resource Selection in an Apex Predator and Variation in Response to Local Landscape Characteristics. Biological Conservation, 228, 233-240. https://doi.org/10.1016/j.biocon.2018.10.022</mixed-citation></ref><ref id="scirp.100081-ref29"><label>29</label><mixed-citation publication-type="other" xlink:type="simple">J&amp;#281;drzejewski, W., Robinson, H.S., Abarca, M., Zeller, K.A., Velasquez, G., Paemelaere, E.A.D., et al. (2018) Estimating Large Carnivore Populations at Global Scale Based on Spatial Predictions of Density and Distribution—Application to the Jaguar (Panthera onca). PLoS ONE, 13, e0194719. https://doi.org/10.1371/journal.pone.0194719</mixed-citation></ref><ref id="scirp.100081-ref30"><label>30</label><mixed-citation publication-type="other" xlink:type="simple">Morato, R.G., Stabach, J.A., Fleming, C.H., Calabrese, J.M., De Paula, R.C., Ferraz, K.M.P.M., et al. (2016) Space Use and Movement of a Neotropical Top Predator: The Endangered Jaguar. PLoS ONE, 11, e0168176. https://doi.org/10.1371/journal.pone.0168176</mixed-citation></ref><ref id="scirp.100081-ref31"><label>31</label><mixed-citation publication-type="other" xlink:type="simple">Cullen Junior, L., Sana, D.A., Lima, F., Abreu, K.C. de and Uezu, A. (2013) Selection of Habitat by the Jaguar, Panthera onca (Carnivora: Felidae), in the Upper Paraná River, Brazil. Zoologia (Curitiba), 30, 379-387. https://doi.org/10.1590/S1984-46702013000400003</mixed-citation></ref><ref id="scirp.100081-ref32"><label>32</label><mixed-citation publication-type="other" xlink:type="simple">de la Torre, J.A., Nú&amp;#241;ez, J.M. and Medellín, R.A. (2017) Habitat Availability and Connectivity for Jaguars (Panthera onca) in the Southern Mayan Forest: Conservation Priorities for a Fragmented Landscape. Biological Conservation, 206, 270-282. https://doi.org/10.1016/j.biocon.2016.11.034</mixed-citation></ref><ref id="scirp.100081-ref33"><label>33</label><mixed-citation publication-type="other" xlink:type="simple">Boitani, L. and Fuller, T.K. (2000) Research Techniques in Animal Ecology: Controversies and Consequences. Columbia University Press, New York.</mixed-citation></ref><ref id="scirp.100081-ref34"><label>34</label><mixed-citation publication-type="other" xlink:type="simple">Calenge, C. (2015) Analysis of Animal Movements in R: The adehabitatLT Package. 85.</mixed-citation></ref><ref id="scirp.100081-ref35"><label>35</label><mixed-citation publication-type="other" xlink:type="simple">Hijmans, R.J. and Ghosh, A. (2019) Spatial Data Analysis with R. 135.</mixed-citation></ref><ref id="scirp.100081-ref36"><label>36</label><mixed-citation publication-type="other" xlink:type="simple">Porto, M. and Quaglietta, L. (2019) “SiMRiv” (Version 1.0.3): An R Package for Simulation and Analysis of Spatially-Explicit Individual Multistate (Animal) Movements in Any Landscape. 15.</mixed-citation></ref><ref id="scirp.100081-ref37"><label>37</label><mixed-citation publication-type="other" xlink:type="simple">Hooten, M.B., Hanks, E.M., Johnson, D.S. and Alldredge, M.W. (2014) Temporal Variation and Scale in Movement-Based Resource Selection Functions. Statistical Methodology, 17, 82-98. https://doi.org/10.1016/j.stamet.2012.12.001</mixed-citation></ref><ref id="scirp.100081-ref38"><label>38</label><mixed-citation publication-type="other" xlink:type="simple">Elith, J., Leathwick, J.R. and Hastie, T. (2008) A Working Guide to Boosted Regression Trees. Journal of Animal Ecology, 77, 802-813. https://doi.org/10.1111/j.1365-2656.2008.01390.x</mixed-citation></ref><ref id="scirp.100081-ref39"><label>39</label><mixed-citation publication-type="other" xlink:type="simple">Hastie, T. (2019) Generalized Additive Models 1.16.1. CRAN Repository.</mixed-citation></ref><ref id="scirp.100081-ref40"><label>40</label><mixed-citation publication-type="other" xlink:type="simple">De’ath, G. (2007) Boosted Trees for Ecological Modeling and Prediction. Ecology, 88, 243-251. https://doi.org/10.1890/0012-9658(2007)88[243:BTFEMA]2.0.CO;2</mixed-citation></ref><ref id="scirp.100081-ref41"><label>41</label><mixed-citation publication-type="other" xlink:type="simple">James, G., Witten, D., Hastie, T. and Tibshirani, R. (2013) An Introduction to Statistical Learning: with Applications in R. Springer, New York. https://doi.org/10.1007/978-1-4614-7138-7</mixed-citation></ref><ref id="scirp.100081-ref42"><label>42</label><mixed-citation publication-type="other" xlink:type="simple">Cutler, D.R., Edwards, T.C., Beard, K.H., Cutler, A., Hess, K.T., Gibson, J., et al. (2007) Random Forests for Classification in Ecology. Ecology, 88, 2783-2792. https://doi.org/10.1890/07-0539.1</mixed-citation></ref><ref id="scirp.100081-ref43"><label>43</label><mixed-citation publication-type="other" xlink:type="simple">James, G., Witten, D., Hastie, T. and Robert, T. (2017) An Introduction to Statistical Learning: With Applications in R.</mixed-citation></ref><ref id="scirp.100081-ref44"><label>44</label><mixed-citation publication-type="other" xlink:type="simple">Ridgeway, G. (2019) Generalized Boosted Models: A Guide to the GBM Package. 15.</mixed-citation></ref><ref id="scirp.100081-ref45"><label>45</label><mixed-citation publication-type="other" xlink:type="simple">Allouche, O., Tsoar, A. and Kadmon, R. (2006) Assessing the Accuracy of Species Distribution Models: Prevalence, Kappa and the True Skill Statistic (TSS): Assessing the Accuracy of Distribution Models. Journal of Applied Ecology, 43, 1223-1232. https://doi.org/10.1111/j.1365-2664.2006.01214.x</mixed-citation></ref><ref id="scirp.100081-ref46"><label>46</label><mixed-citation publication-type="other" xlink:type="simple">Etherington, T.R. (2016) Least-Cost Modelling and Landscape Ecology: Concepts, Applications, and Opportunities. Current Landscape Ecology Reports, 1, 40-53. https://doi.org/10.1007/s40823-016-0006-9</mixed-citation></ref><ref id="scirp.100081-ref47"><label>47</label><mixed-citation publication-type="other" xlink:type="simple">Shmueli, G. (2010) To Explain or to Predict? Statistical Science, 25, 289-310. https://doi.org/10.1214/10-STS330</mixed-citation></ref></ref-list></back></article>