<?xml version="1.0" encoding="UTF-8"?><!DOCTYPE article  PUBLIC "-//NLM//DTD Journal Publishing DTD v3.0 20080202//EN" "http://dtd.nlm.nih.gov/publishing/3.0/journalpublishing3.dtd"><article xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink" dtd-version="3.0" xml:lang="en" article-type="research article"><front><journal-meta><journal-id journal-id-type="publisher-id">OJE</journal-id><journal-title-group><journal-title>Open Journal of Ecology</journal-title></journal-title-group><issn pub-type="epub">2162-1985</issn><publisher><publisher-name>Scientific Research Publishing</publisher-name></publisher></journal-meta><article-meta><article-id pub-id-type="doi">10.4236/oje.2024.141005</article-id><article-id pub-id-type="publisher-id">OJE-130746</article-id><article-categories><subj-group subj-group-type="heading"><subject>Articles</subject></subj-group><subj-group subj-group-type="Discipline-v2"><subject>Earth&amp;Environmental Sciences</subject></subj-group></article-categories><title-group><article-title>
 
 
  Perceptions of Bark Beetle Landscape Disturbance Effects on Natural Resources and Drinking Water: Assessing Communication and Knowledge Exchange in the Rocky Mountain Region, USA
 
</article-title></title-group><contrib-group><contrib contrib-type="author" xlink:type="simple"><name name-style="western"><surname>Stuart</surname><given-names>P. Cottrell</given-names></name><xref ref-type="aff" rid="aff1"><sup>1</sup></xref><xref ref-type="corresp" rid="cor1"><sup>*</sup></xref></contrib><contrib contrib-type="author" xlink:type="simple"><name name-style="western"><surname>Katherine</surname><given-names>Mattor</given-names></name><xref ref-type="aff" rid="aff2"><sup>2</sup></xref></contrib><contrib contrib-type="author" xlink:type="simple"><name name-style="western"><surname>Jana</surname><given-names>Raadik Cottrell</given-names></name><xref ref-type="aff" rid="aff3"><sup>3</sup></xref></contrib></contrib-group><aff id="aff1"><addr-line>Human Dimensions of Natural Resources, Colorado State University, Fort Collins, CO, USA</addr-line></aff><aff id="aff3"><addr-line>University Honors Program, Colorado State University, Fort Collins, CO, USA</addr-line></aff><aff id="aff2"><addr-line>Forest and Rangeland Stewardship (FRS), Colorado State University, Fort Collins, CO, USA</addr-line></aff><pub-date pub-type="epub"><day>16</day><month>01</month><year>2024</year></pub-date><volume>14</volume><issue>01</issue><fpage>77</fpage><lpage>100</lpage><history><date date-type="received"><day>25,</day>	<month>December</month>	<year>2023</year></date><date date-type="rev-recd"><day>23,</day>	<month>January</month>	<year>2024</year>	</date><date date-type="accepted"><day>26,</day>	<month>January</month>	<year>2024</year></date></history><permissions><copyright-statement>&#169; Copyright  2014 by authors and Scientific Research Publishing Inc. </copyright-statement><copyright-year>2014</copyright-year><license><license-p>This work is licensed under the Creative Commons Attribution International License (CC BY). http://creativecommons.org/licenses/by/4.0/</license-p></license></permissions><abstract><p>
 
 
  Widespread changes to forested watersheds affected by the mountain pine beetle (
  <em>Dendroctonus ponderosae</em> Hopkins) epidemic across western North America raised concerns about the effects of this climate-induced disturbance on drinking water and natural resources. Effective communication and knowledge exchange across scientists and stakeholders (
  <em>i.e.</em>, drinking water managers) is essential for constructively responding to such landscape scale disturbances, providing improved adaptive capacity through knowledge sharing. An assessment of stakeholder knowledge levels, information needs, primary concerns, and suggested communication strategies were conducted via an online elicitation survey and World Science Caf&#233; workshops. Knowledge levels, assessed via a survey of local water managers and experts, were relatively low with approximately half of the respondents reporting little to no knowledge of the effects of mountain pine beetle on drinking water quality and quantity, thereby indicating limited knowledge exchange between scientists and drinking water stakeholders. Increased accessibility and dissemination of research findings pertinent to the mountain pine beetle epidemic’s effects on drinking water quality and quantity is necessary for natural resource management. Recommendations for improved communication among scientists and drinking water stakeholders in particular and forest health in general include dispersal of non-academic research summaries, information exchange through existing media and community resources, demonstration projects, and information clearinghouses. This information provides a better understanding of the challenges, concerns, and first-hand experience of stakeholders of a landscape disturbance issue to apply this knowledge to enhance land management practice and how researchers on this overall project enhanced science communication efforts.
 
</p></abstract><kwd-group><kwd>Adaptive Capacity</kwd><kwd> Climate Change</kwd><kwd> Forested Watersheds</kwd><kwd> Water Quality</kwd><kwd> Water Quantity</kwd></kwd-group></article-meta></front><body><sec id="s1"><title>1. Introduction</title><p>The mountain pine beetle (Dendroctonus ponderosae Hopkins) (MPB) epidemic across western North America represents one of many ecological disturbances attributed to changing climate conditions [<xref ref-type="bibr" rid="scirp.130746-ref1">1</xref>] [<xref ref-type="bibr" rid="scirp.130746-ref2">2</xref>] and forest management practices including fire suppression over multiple decades [<xref ref-type="bibr" rid="scirp.130746-ref3">3</xref>] [<xref ref-type="bibr" rid="scirp.130746-ref4">4</xref>] [<xref ref-type="bibr" rid="scirp.130746-ref5">5</xref>] . This epidemic infestation killed trees on millions of hectares of forested watersheds. Such climate related ecological disturbances are increasingly identified as a threat to the resilience of social-ecological systems because these changes are outside the normal systemic functions [<xref ref-type="bibr" rid="scirp.130746-ref6">6</xref>] [<xref ref-type="bibr" rid="scirp.130746-ref7">7</xref>] . The widespread changes to forested watersheds resulting from this epidemic raise concerns about potential effects to drinking water resources [<xref ref-type="bibr" rid="scirp.130746-ref1">1</xref>] [<xref ref-type="bibr" rid="scirp.130746-ref8">8</xref>] [<xref ref-type="bibr" rid="scirp.130746-ref9">9</xref>] . Beetle-killed forests cause concern about the disturbance’s effect on stream flow generation mechanisms, water quality and yield [<xref ref-type="bibr" rid="scirp.130746-ref8">8</xref>] [<xref ref-type="bibr" rid="scirp.130746-ref10">10</xref>] [<xref ref-type="bibr" rid="scirp.130746-ref11">11</xref>] [<xref ref-type="bibr" rid="scirp.130746-ref12">12</xref>] [<xref ref-type="bibr" rid="scirp.130746-ref13">13</xref>] . Potential effects to water quality include increases in nitrogen and phosphorous concentrations, dissolved and total organic carbon (DOC and TOC, respectively), increased concentrations of heavy metals, natural organic matter (NOM), and disinfectant byproducts (DBPs) precursors [<xref ref-type="bibr" rid="scirp.130746-ref12">12</xref>] [<xref ref-type="bibr" rid="scirp.130746-ref13">13</xref>] [<xref ref-type="bibr" rid="scirp.130746-ref14">14</xref>] with potential implications for unsafe drinking water.</p><p>Climate change induced ecological disturbances are increasingly recognized as a major 21<sup>st</sup> century challenge [<xref ref-type="bibr" rid="scirp.130746-ref4">4</xref>] [<xref ref-type="bibr" rid="scirp.130746-ref6">6</xref>] . Climate-induced ecological disturbances require adaptive capacity of social and ecological systems to effectively respond and adapt to such disturbances [<xref ref-type="bibr" rid="scirp.130746-ref15">15</xref>] [<xref ref-type="bibr" rid="scirp.130746-ref16">16</xref>] . This is especially true regarding drinking water resources in particular and forest health in general [<xref ref-type="bibr" rid="scirp.130746-ref17">17</xref>] . A key component of social adaptive capacity is knowledge exchange, with current research emphasizing the need for improved communication to increase knowledge exchange of current and potential effects of these ecological disturbances [<xref ref-type="bibr" rid="scirp.130746-ref18">18</xref>] [<xref ref-type="bibr" rid="scirp.130746-ref19">19</xref>] [<xref ref-type="bibr" rid="scirp.130746-ref20">20</xref>] [<xref ref-type="bibr" rid="scirp.130746-ref21">21</xref>] . Effective communication and knowledge exchange can support management responses and guide applicable research, thereby increasing adaptive capacity to landscape scale climate-induced disturbances [<xref ref-type="bibr" rid="scirp.130746-ref17">17</xref>] .</p><p>Understanding the effects of the MPB epidemic on drinking water resources requires effective communication and knowledge exchange between research scientists and drinking water stakeholders. Potential changes to drinking water quality and quantity resulting from the MPB epidemic elucidate the need for increased adaptability of water resource management in response to changing ecological conditions of the landscape. Effective communication enables knowledge exchange between scientists, drinking water providers, and other stakeholders and is an important component of adaptation [<xref ref-type="bibr" rid="scirp.130746-ref6">6</xref>] [<xref ref-type="bibr" rid="scirp.130746-ref22">22</xref>] [<xref ref-type="bibr" rid="scirp.130746-ref23">23</xref>] . This paper reports social science findings from the second step in a larger five-year social-biophysical research effort involving the coupling of online elicitation survey data with World Science Caf&#233;’ workshop results. The biophysical research conducted by the Colorado School of Mines examined the biogeochemical effects of MPB to drinking water quality and forest health issues, while the social science at Colorado State University examines methods for improving scientist-stakeholder communication for enhanced knowledge exchange not only for water quality issues but forest management as well. The goal is to identify effective strategies for communicating scientists’ research findings and drinking water manager perceptions of changes to water quality and wildland fire management due to bark beetle outbreaks and document collective efforts between the two research groups (School of Mines (COM) and Colorado State University (CSU)) for science communication.</p><sec id="s1_1"><title>1.1. Background</title><sec id="s1_1_1"><title>1.1.1. Adaptive Capacity and the Role of Knowledge Exchange</title><p>Climate-induced ecological disturbances and forest management practices including fire suppression over multiple decades [<xref ref-type="bibr" rid="scirp.130746-ref24">24</xref>] [<xref ref-type="bibr" rid="scirp.130746-ref25">25</xref>] challenge the viability of social-ecological systems, particularly water resources [<xref ref-type="bibr" rid="scirp.130746-ref17">17</xref>] [<xref ref-type="bibr" rid="scirp.130746-ref26">26</xref>] [<xref ref-type="bibr" rid="scirp.130746-ref27">27</xref>] [<xref ref-type="bibr" rid="scirp.130746-ref28">28</xref>] in Colorado. While the adaptation of water resource management to the complexities of weather conditions has been established over time, where variations in weather and climate associated disturbances will occur within a “predictable envelope of variability” [<xref ref-type="bibr" rid="scirp.130746-ref29">29</xref>] , the events associated with climate change disturbances occur outside this envelope and introduce a need for increased adaptation in water resource decision-making [<xref ref-type="bibr" rid="scirp.130746-ref28">28</xref>] . Such events occur outside predictable variability range and thus outweigh the existing resources and capabilities to successfully address the associated challenges resource managers will face [<xref ref-type="bibr" rid="scirp.130746-ref30">30</xref>] [<xref ref-type="bibr" rid="scirp.130746-ref31">31</xref>] .</p><p>Adaptive capacity is the ability of a social-ecological system to adapt to disturbances and maintain ecological and/or social resilience [<xref ref-type="bibr" rid="scirp.130746-ref4">4</xref>] [<xref ref-type="bibr" rid="scirp.130746-ref26">26</xref>] . The United Nations Intergovernmental Panel on Climate Change (IPCC) defines adaptive capacity as “the ability to respond successfully to climate variability and change” [<xref ref-type="bibr" rid="scirp.130746-ref32">32</xref>] . Within social systems, adaptive capacity presents opportunities for adaptation through flexibility and learning in the context of ecological disturbances and uncertainty [<xref ref-type="bibr" rid="scirp.130746-ref6">6</xref>] [<xref ref-type="bibr" rid="scirp.130746-ref22">22</xref>] [<xref ref-type="bibr" rid="scirp.130746-ref33">33</xref>] . Limited knowledge of the effects of climate-induced disturbances such as the mountain pine beetle epidemic leads to high levels of uncertainty for water managers [<xref ref-type="bibr" rid="scirp.130746-ref26">26</xref>] although there is much science done in forest ecology alluding to the need for knowledge sharing. Through adaptation the negative social impacts of ecological disturbances to water resources are reduced and the primary functions of the system are maintained [<xref ref-type="bibr" rid="scirp.130746-ref17">17</xref>] [<xref ref-type="bibr" rid="scirp.130746-ref34">34</xref>] . Adaptive capacity is a function of the levels of information exchange, resources, and learning opportunities related to the attributes of the system, also known as knowledge exchange [<xref ref-type="bibr" rid="scirp.130746-ref29">29</xref>] [<xref ref-type="bibr" rid="scirp.130746-ref33">33</xref>] .</p><p>Knowledge exchange through communication and learning opportunities among different parties enables information and resource exchange and is an important component of adaptive capacity [<xref ref-type="bibr" rid="scirp.130746-ref6">6</xref>] [<xref ref-type="bibr" rid="scirp.130746-ref22">22</xref>] . It is a necessary component for successful adaptation in the face of climate-induced disturbances, especially with respect to water resource management [<xref ref-type="bibr" rid="scirp.130746-ref17">17</xref>] . Successful knowledge exchange occurs when information from one entity transforms the actions or behaviors of another [<xref ref-type="bibr" rid="scirp.130746-ref35">35</xref>] . The incorporation of new information facilitates the adaptive capacity of water management systems to climate-induced disturbances [<xref ref-type="bibr" rid="scirp.130746-ref23">23</xref>] [<xref ref-type="bibr" rid="scirp.130746-ref28">28</xref>] . Improved knowledge exchange of scientific findings of the effects of climate-induced disturbances may provide drinking water providers the ability to prepare for potential changes to drinking water quality and quantity, if necessary, or prevent unnecessary actions from being taken if limited effects are identified [<xref ref-type="bibr" rid="scirp.130746-ref31">31</xref>] [<xref ref-type="bibr" rid="scirp.130746-ref36">36</xref>] . Knowledge exchange also provides relevant information for natural resource managers to share with local stakeholders and residents [<xref ref-type="bibr" rid="scirp.130746-ref37">37</xref>] [<xref ref-type="bibr" rid="scirp.130746-ref38">38</xref>] . In addition, knowledge exchange provides an opportunity for researchers to understand the challenges, concerns, and first-hand experience of stakeholders, which they can then apply to the formation and focus of their research and dissemination of results [<xref ref-type="bibr" rid="scirp.130746-ref17">17</xref>] [<xref ref-type="bibr" rid="scirp.130746-ref37">37</xref>] .</p><p>Communication and therefore successful knowledge exchange among scientists and stakeholders is limited [<xref ref-type="bibr" rid="scirp.130746-ref17">17</xref>] [<xref ref-type="bibr" rid="scirp.130746-ref35">35</xref>] . Limited communication and knowledge exchange can decrease the effectiveness of science if it is not relevant to stakeholders, including water providers and natural resource managers, and in turn will limit the efficacy of stakeholder actions [<xref ref-type="bibr" rid="scirp.130746-ref37">37</xref>] [<xref ref-type="bibr" rid="scirp.130746-ref39">39</xref>] [<xref ref-type="bibr" rid="scirp.130746-ref40">40</xref>] [<xref ref-type="bibr" rid="scirp.130746-ref41">41</xref>] . Effective communication and knowledge exchange is limited by differing information needs, values and perspectives, and limited opportunities for communication amongst scientist and stakeholder populations [<xref ref-type="bibr" rid="scirp.130746-ref36">36</xref>] [<xref ref-type="bibr" rid="scirp.130746-ref37">37</xref>] .</p><p>Investigations of knowledge exchange identifies how well society can effectively respond to climate-induced disturbances; but such studies of water management systems are relatively nonexistent [<xref ref-type="bibr" rid="scirp.130746-ref17">17</xref>] . To identify existing knowledge exchange and adaptive capacity there is a need to assess the current levels of knowledge and associated communication needs among water providers [<xref ref-type="bibr" rid="scirp.130746-ref17">17</xref>] [<xref ref-type="bibr" rid="scirp.130746-ref23">23</xref>] [<xref ref-type="bibr" rid="scirp.130746-ref42">42</xref>] . The MPB epidemic in the Rocky Mountain region provided the opportunity to assess current knowledge and the communication needs of drinking water stakeholders.</p></sec><sec id="s1_1_2"><title>1.1.2. Mountain Pine Beetle and Drinking Water</title><p>Insect outbreaks have affected large, North American forests in recent decades. The primary insect of focus in this paper is the mountain pine beetle (MPB) in Colorado, an endemic bark beetle normally infesting and killing a small percentage of lodgepole pine trees [<xref ref-type="bibr" rid="scirp.130746-ref4">4</xref>] [<xref ref-type="bibr" rid="scirp.130746-ref5">5</xref>] [<xref ref-type="bibr" rid="scirp.130746-ref9">9</xref>] [<xref ref-type="bibr" rid="scirp.130746-ref14">14</xref>] annually. However, since 1997, widespread MPB caused tree mortality has affected more than 42 million acres of forested watersheds in the western United States [<xref ref-type="bibr" rid="scirp.130746-ref43">43</xref>] . This is attributed to warmer temperatures in the winter that led to increased MPB populations in epidemic proportions in concert with increased susceptibility of trees to MPB because of drought-related stress [<xref ref-type="bibr" rid="scirp.130746-ref25">25</xref>] [<xref ref-type="bibr" rid="scirp.130746-ref44">44</xref>] [<xref ref-type="bibr" rid="scirp.130746-ref45">45</xref>] . The extensive beetle-killed area raised concerns about the epidemic’s effect on drinking water quality and quantity from these forested watersheds that supply water to over 30 million people [<xref ref-type="bibr" rid="scirp.130746-ref8">8</xref>] [<xref ref-type="bibr" rid="scirp.130746-ref11">11</xref>] [<xref ref-type="bibr" rid="scirp.130746-ref12">12</xref>] [<xref ref-type="bibr" rid="scirp.130746-ref13">13</xref>] [<xref ref-type="bibr" rid="scirp.130746-ref43">43</xref>] [<xref ref-type="bibr" rid="scirp.130746-ref46">46</xref>] as the effect of reducing tree density on water quantity has been expected to increase water yield [<xref ref-type="bibr" rid="scirp.130746-ref47">47</xref>] [<xref ref-type="bibr" rid="scirp.130746-ref48">48</xref>] , which might be relevant in semi-arid or arid environments, yet Penn et al. 2016 [<xref ref-type="bibr" rid="scirp.130746-ref49">49</xref>] found limited evidence of increased water yield in MPB effected headwater watersheds in Colorado. Potential water quality effects include changes in nutrient concentrations in water due to a loss of vegetation uptake [<xref ref-type="bibr" rid="scirp.130746-ref14">14</xref>] , increased heavy metal mobility from soils due to increased dissolved and total organic carbon (DOC and TOC, respectively), and the formation of potential disinfectant byproducts (DBP) from chlorination of water with higher concentrations of natural organic matter (NOM) from all the dead vegetation [<xref ref-type="bibr" rid="scirp.130746-ref12">12</xref>] .</p><p>This research encompasses the second phase of a social science component of a larger project investigating potential water resource changes resulting from the MPB epidemic to identify feedback between climate change, insect driven forest disturbance, biogeochemical processes and management (e.g., forest and water treatment) practices [<xref ref-type="bibr" rid="scirp.130746-ref13">13</xref>] . The landscape covered in the overall study included northern Colorado and southern Wyoming where more than four million acres of forest were affected by the MPB [<xref ref-type="bibr" rid="scirp.130746-ref13">13</xref>] [<xref ref-type="bibr" rid="scirp.130746-ref50">50</xref>] . More specifically, the Platte River and Colorado River watersheds included supply water to over 30 million Colorado and Wyoming residential water users and 3.5 million acres of irrigated agricultural land [<xref ref-type="bibr" rid="scirp.130746-ref46">46</xref>] . We had four objectives for this study: 1) gauge knowledge levels and information needs about MPB effects on drinking water resources among drinking water resource stakeholders, 2) identify stakeholder concerns and potential solutions about MPB effects on water quality, 3) determine important topics about MPB and drinking water resources to communicate with the general public, and 4) identify mechanisms to improve communication across drinking water professionals (e.g., managers) more generally at a broader scale and to document evidence of the science communication efforts by the research teams from COM and CSU.</p></sec></sec></sec><sec id="s2"><title>2. Materials and Methods</title><p>The qualitative mixed methods reported is the second phase of the social science component of a larger project funded by the National Science Foundation-Water Sustainability and Climate Program (NSF-WSC) investigating potential water resource changes resulting from the MPB epidemic and the associated drinking water management response to define feedbacks between climate change, insect driven forest disturbance, biogeochemical processes and management (e.g., forest and water treatment) practices [<xref ref-type="bibr" rid="scirp.130746-ref13">13</xref>] . We used a qualitative elicitation survey online and World Science Caf&#233; workshops to collect data for this phase of the project. The population of interest was drinking water stakeholders (experts at national and regional water conferences) and water-related professionals in Colorado and Wyoming regarding the MPB disturbance effects to drinking water resources in particular and forest health in general. Drinking water stakeholders include drinking water providers, community watershed group representatives, local government, drinking water consultants (e.g., engineers, restoration professionals), and state and federal agency representatives. The scientists referred to in the paper are our research team representing the biogeochemists and hydrologists at Colorado School of Mines (COM) (n = 16) and the forest and social scientists at Colorado State University (CSU) (n = 11).</p><sec id="s2_1"><title>2.1. Qualitative Survey</title><p>We conducted two qualitative surveys using SurveyMonkey online software [<xref ref-type="bibr" rid="scirp.130746-ref51">51</xref>] in phase 1 of the study [<xref ref-type="bibr" rid="scirp.130746-ref13">13</xref>] . The online survey used an elicitation method to collect and summarize expert knowledge for a specific topic of interest [<xref ref-type="bibr" rid="scirp.130746-ref13">13</xref>] [<xref ref-type="bibr" rid="scirp.130746-ref52">52</xref>] [<xref ref-type="bibr" rid="scirp.130746-ref53">53</xref>] [<xref ref-type="bibr" rid="scirp.130746-ref54">54</xref>] . The elicitation methodology has increasingly been used to guide decision-making and inform future research endeavors in environmental and social sciences [<xref ref-type="bibr" rid="scirp.130746-ref53">53</xref>] [<xref ref-type="bibr" rid="scirp.130746-ref55">55</xref>] . The dispersed attributes of the internet-based survey approach provide respondents the necessary flexibility and time to submit their responses and reduces potential bias that may arise through group discussions [<xref ref-type="bibr" rid="scirp.130746-ref56">56</xref>] . The elicitation approach was identified as an effective method for measuring knowledge levels and communication needs [<xref ref-type="bibr" rid="scirp.130746-ref20">20</xref>] .</p><sec id="s2_1_1"><title>2.1.1. Survey Development</title><p>A literature review of public perceptions of MPB effects on forest health and drinking water resources was used to develop online survey questions. The survey included five open-ended questions concerning respondent knowledge of science and research on MPB, perceived drinking water quality issues and challenges, and suggestions to improve communication and outreach about MPB effects on drinking water and demographics. Qualitative analysis was used to obtain more detailed individualized responses and unexpected phenomena otherwise unattainable through closed-ended questions [<xref ref-type="bibr" rid="scirp.130746-ref57">57</xref>] [<xref ref-type="bibr" rid="scirp.130746-ref58">58</xref>] . We pilot tested the survey spring 2013 with colleagues to make any necessary revisions before its release.</p></sec><sec id="s2_1_2"><title>2.1.2. Study Population and Sampling Procedures</title><p>Respondents were selected as a purposeful sample [<xref ref-type="bibr" rid="scirp.130746-ref59">59</xref>] representing drinking water stakeholders in the study area. Email addresses were identified “through attendance lists from the June 2013 American Water Works Association (AWWA) Annual Conference and Exposition in Denver, Colorado and the AWWA Rocky Mountain Region Section conference, held at Keystone, Colorado in September 2013” [<xref ref-type="bibr" rid="scirp.130746-ref13">13</xref>] . The second set of respondents were identified from attendees of the Sustaining Colorado Watersheds Conference (SCWC), which included representatives of community watershed groups, state and federal agencies, and consulting firms, and was hosted by the Colorado Watershed Assembly, Colorado Foundation for Water Education, and Colorado Riparian Association in Avon, Colorado in November 2014. Non-probability sampling was used including inclusion and exclusion criteria to acquire a sample of 682 invited respondents from the list of conference attendees. Inclusion criteria included drinking water providers and water professionals from the Rocky Mountain Region that were involved in the provision of drinking water resources and provided their consent to participate in the research [<xref ref-type="bibr" rid="scirp.130746-ref13">13</xref>] . Exclusion criterium included attendees working outside the study region and not involved in drinking water provision or management. Reminder emails were sent to non-respondents within two weeks of the initial invitation. The survey was open online for three months (September to November 2013) [<xref ref-type="bibr" rid="scirp.130746-ref13">13</xref>] [<xref ref-type="bibr" rid="scirp.130746-ref60">60</xref>] .</p><p>Of the 229 who began the elicitation surveys (34% response rate), a total of 122 completed questions relevant to the analysis reported here. Approximately 81% of respondents’ drinking water systems provide water for over 10,000 households. Most respondents (67%) reported surface water as their systems’ drinking water source, 18% reported a blend of groundwater and surface water, and 16% reported groundwater as the primary drinking water source. The majority (75%) reported their drinking water source comes from MPB affected watersheds.</p><p>The 2013 survey sought information from participants of the national and the Rocky Mountain Section of the American Water Works Association (AWWA) conferences. Fifty-three percent of those respondents were drinking water providers and 27% were water resources consultants. Other respondents (20%) to the AWWA survey were associated with academic institutions, state or federal land agencies, or community watershed groups. The 2014 survey collected information from participants of the Sustaining Colorado Watershed Conference (SCWC). Twenty-three percent of the SCWC survey respondents were community watershed group representatives, 19% were associated with local government (state, county), and 15% were with federal agencies. The remainder of respondents to the SCWC survey (43%) included drinking water providers, consultants, scientists, water educators, and state or federal employees.</p></sec><sec id="s2_1_3"><title>2.1.3. Analysis</title><p>Using QSR NVivo (version 10) software, a thematic analysis organized data into key themes [<xref ref-type="bibr" rid="scirp.130746-ref59">59</xref>] . Themes and categories were identified a priori including information needs, watershed management issues, and drinking water challenges. Open and axial coding was used to determine themes and sub-themes not previously identified [<xref ref-type="bibr" rid="scirp.130746-ref57">57</xref>] [<xref ref-type="bibr" rid="scirp.130746-ref58">58</xref>] [<xref ref-type="bibr" rid="scirp.130746-ref59">59</xref>] . Qualitative responses were categorized and independently coded by the members of the CSU research team. The relevance of identified themes was based on the proportion of respondents identifying each theme; therefore, findings reported here are those identified by most respondents.</p></sec></sec><sec id="s2_2"><title>2.2. Beetle Caf&#233; Workshops</title><p>The World “Science” Caf&#233; [<xref ref-type="bibr" rid="scirp.130746-ref61">61</xref>] was used to create a dynamic network of conversation and knowledge sharing organized around critical questions for this study [<xref ref-type="bibr" rid="scirp.130746-ref62">62</xref>] as phase 2 coupled on the phase 1 survey results. This workshop approach which we called the Beetle Caf&#233; for our purposes, organizes groups of people together to discuss a specific topic, providing an opportunity for concepts generated from small group discussions to be confirmed and strengthened by the larger group.</p><p>The Beetle Caf&#233; supplemented data from the elicitation surveys providing greater detail via experiences, insights, and ideas about the effects of MPB-induced tree mortality on drinking water quality and quantity through two workshops. The workshops, entitled the Beetle Caf&#233;, were held at the 2013 Joint Annual Conference of the Rocky Mountain Section of the American Water Works Association (RMSAWWA) and the Rocky Mountain Water Environment Association (RMWEA) in Keystone, Colorado and the 2014 Sustaining Colorado Watersheds Conference. The Beetle Caf&#233;s were used specifically to identify potential water resource changes resulting from the MPB epidemic and how information related to drinking water resources should be communicated. The Caf&#233; format included small groups for participants to identify challenges related to MPB affecting drinking water quality and supply, discuss potential solutions, and identify stakeholder communication needs through an interactive process involving: 1) an initial brainstorm to plot key thoughts, 2) clarification of key ideas and grouping into thematic areas, and 3) discussion of the thematic areas, posed to the entire group. A graphic illustrator was used during the workshops (<xref ref-type="fig" rid="fig1">Figure 1</xref>) to illustrate the flow of information from the small groups [<xref ref-type="bibr" rid="scirp.130746-ref63">63</xref>] . Ideas generated from each group were clarified and summarized as part of a final discussion among the participants at the workshop and data were analyzed via the same method as the online survey data.</p></sec></sec><sec id="s3"><title>3. Results</title><p>The online elicitation surveys from Phase 1 of the study [<xref ref-type="bibr" rid="scirp.130746-ref13">13</xref>] and Beetle Caf&#233; workshops informed us of knowledge levels, communication needs, challenges, and public outreach recommendations regarding the MPB effects on drinking water resources. The following highlights results in accordance with the four objectives of the study.</p><sec id="s3_1"><title>3.1. Elicitation Surveys</title><sec id="s3_1_1"><title>3.1.1. Knowledge Levels</title><p>The first task (objective 1) was to identify respondents’ current knowledge levels about the potential effects of MPB on drinking water. The majority of AWWA respondents reported limited knowledge of MPB impacts to drinking water with 53% identifying little to no knowledge about the science and research on the MPB effects to drinking water resources, while 36% had moderate and 12% had high levels of reported knowledge (<xref ref-type="table" rid="table1">Table 1</xref>). Forty-four percent of SCWC respondents identified having little to no knowledge about the science related to MPB and drinking water resources, while 30% reported moderate and 26% reported high levels of knowledge.</p><p>Concerns stated by respondents with little to no reported knowledge of MBP impacts for both samples included potential effects of wildfire on water quality through increased nutrients, soil erosion concerns, and forest management challenges [<xref ref-type="bibr" rid="scirp.130746-ref13">13</xref>] . For respondents with moderate to high levels of knowledge, the most common areas of prior knowledge were the potential effects on water quality, snowpack, and changes in streamflow volume and timing. Respondents with moderate to high knowledge levels indicated they read current published research and identified topics/knowledge of water quality (i.e., total organic carbon, natural organic matter, nutrient enrichment, color, and heavy metals), potential increased risk of wildfire, and increased streamflow and associated erosion, turbidity, and sediment. Several of the respondents with higher levels of reported knowledge stated that they were involved in cooperative outreach, research, and activities to mitigate MPB effects on water resources [<xref ref-type="bibr" rid="scirp.130746-ref13">13</xref>] .</p></sec><sec id="s3_1_2"><title>3.1.2. Research Communication</title><p>The next objective was to determine how communication of research on MPB effects on drinking water could be improved and potential solutions. Respondents from the AWWA and the SCWC surveys indicated different priorities for research communication (<xref ref-type="table" rid="table2">Table 2</xref> contents drawn from [<xref ref-type="bibr" rid="scirp.130746-ref13">13</xref>] ). Though not related to specific types of research, most AWWA respondents requested improved dissemination and accessibility of research related to MPB effects on drinking water, including preliminary findings, research direction, and overall results. Their suggestions for improving the dissemination of research included setting up a centralized source for research findings to distribute non-academic summaries, and to publicize the location of such sources. Secondly, the AWWA respondents felt MPB-associated research did not need to be communicated more</p><table-wrap id="table1" ><label><xref ref-type="table" rid="table1">Table 1</xref></label><caption><title> Reported knowledge levels by survey</title></caption><table><tbody><thead><tr><th align="center" valign="middle"  rowspan="2"  >Survey</th><th align="center" valign="middle"  colspan="3"  >Knowledge levels (%)</th></tr></thead><tr><td align="center" valign="middle" >None/Little</td><td align="center" valign="middle" >Moderate</td><td align="center" valign="middle" >High</td></tr><tr><td align="center" valign="middle" >2013 AWWA (n = 93)</td><td align="center" valign="middle" >53</td><td align="center" valign="middle" >36</td><td align="center" valign="middle" >12</td></tr><tr><td align="center" valign="middle" >2014 SCWC (n = 26)</td><td align="center" valign="middle" >44</td><td align="center" valign="middle" >30</td><td align="center" valign="middle" >26</td></tr></tbody></table></table-wrap><table-wrap id="table2" ><label><xref ref-type="table" rid="table2">Table 2</xref></label><caption><title> Responses to survey questions by survey in ranked order</title></caption><table><tbody><thead><tr><th align="center" valign="middle" >Topic</th><th align="center" valign="middle" >2013 AWWA Survey (n = 96)</th><th align="center" valign="middle" >2014 SCWC Survey (n = 26)</th></tr></thead><tr><td align="center" valign="middle" >Research Communication Needs</td><td align="center" valign="middle" >Improve accessibility of information No parts of MPB research on water resources need to be communicated more effectively. MPB effects on drinking water quality</td><td align="center" valign="middle" >MPB effects on drinking water quality and quantity Improve accessibility of information Correlation between forest watershed health and drinking water resources</td></tr><tr><td align="center" valign="middle" >Identified Challenges</td><td align="center" valign="middle" >Addressing water quality effects of MPB Increased fire danger and the resulting effects on water quality and quantity Changes to water quantity as a result of MPB</td><td align="center" valign="middle" >Issues associated with increased water quantity Addressing water quality effects of MPB Understanding linkage between forest watershed health to hydrologic change and drinking water</td></tr><tr><td align="center" valign="middle" >Drinking Water Safety</td><td align="center" valign="middle" >Drinking water has not deteriorated or become unsafe Unsure or do not know Yes—Deteriorated water quality; degraded enough to cause treatment issues (increasing chemical usage and cost) but not health or safety issues</td><td align="center" valign="middle" >Drinking water has not deteriorated or become unsafe Yes—Deteriorated water quality Unsure or do not know</td></tr><tr><td align="center" valign="middle" >Public Outreach</td><td align="center" valign="middle" >The effects of MPB on drinking water quantity and quality Connection between forest health and drinking water General information on the MPB biology and status</td><td align="center" valign="middle" >The effects of MPB on drinking water quantity and quality Methods to mitigate MPB effects to drinking water General information on the MPB biology and status</td></tr></tbody></table></table-wrap><p>Note: Results drawn from Phase 1 online data (see [<xref ref-type="bibr" rid="scirp.130746-ref13">13</xref>] ) were used for similarity/comparison with Phase 2 Bark Beetle Workshop data.</p><p>effectively, even though 53% of AWWA respondents had previously indicated limited knowledge levels. The third most common communication need identified by AWWA respondents was information on the effects of bark beetle infestation on drinking water quality. They specifically identified the need for research findings on MPB associated changes in potential disinfection byproducts (DBPs) precursors, total trihalomethanes (TTHM) formation potential, total organic carbon (TOC) and natural organic matter (NOM), nutrient enrichment, and the effects of pesticides used to combat MPB. Additional research communication requests from a smaller number of respondents included: the timeline for expected effects to occur following infestation, the effectiveness of water treatment mitigation approaches, and the correlation between mountain pine beetle and wildfire risk.</p><p>The primary request of SCWC survey respondents was improved communication of research on the MPB effects to both drinking water quality and quantity. Respondents did not separate these topics nor provide specific requests for the types of information they wanted. The second most common response from SCWC surveys was to improve the accessibility of research project information and findings. Respondents requested information on the research questions being looked at, the preliminary results, and study findings. They suggested improving accessibility of research by providing a compilation of research reports, sharing articles and project web links through a central listserv or website, and presenting information at professional and/or community group meetings.</p><p>The third topic identified by SCWC respondents was the communication of research on the relation between forest watershed health and the effects on drinking water quality and runoff. Specific requests included changes in spring snowmelt runoff timing and amounts, how forest management techniques (i.e., harvesting beetle-killed trees) affect water quality and quantity, and the effects of stream temperature fluctuations on water resources. Other issues were identified by a few respondents, including requests for information on the MPB effects to streamflow and groundwater recharge, as well as recommended mitigation approaches to minimize MPB effects on forests and drinking water, the relation of MPB killed trees to wildfire occurrence, and the expected timeline for effects to persist after the beetle infestation.</p></sec><sec id="s3_1_3"><title>3.1.3. Identified Challenges</title><p>Of the topics most important (objective three), the greatest challenges noted thematically were water quality and quantity and understanding the linkage between watershed health in forests and drinking water (see <xref ref-type="table" rid="table2">Table 2</xref> from [<xref ref-type="bibr" rid="scirp.130746-ref13">13</xref>] ). More specifically, the greatest challenge for the AWWA sample was treatment of potential water quality issues resulting from trees killed by MPB killed in forested watersheds. Increased turbidity, NOM, DBP, TOC, DOC, and changes in taste and odor of water were the specific concerns of the AWWA sample. Several also suggested the unknown duration of these effects was a considerable challenge while others were concerned about the increased treatment costs associated with these water quality changes and their ability to pass these costs on to consumers. Secondly were the challenges of increased wildfire danger in MPB-killed forest watersheds and related fire impacts to water quality and quantity. These concerns were common with little to moderate knowledge levels reported and less common amongst experts with higher levels of reported knowledge. Water quantity change was the third most identified challenge by the AWWA sample. Specifically identified concerns was water runoff (levels and timing of), and the direct and indirect effects on groundwater storage and water yield [<xref ref-type="bibr" rid="scirp.130746-ref13">13</xref>] . For the issues of water quality, several experts stressed their concerns of the potential of increased costs of water treatment associated “with water quantity, specifically sediment control” [<xref ref-type="bibr" rid="scirp.130746-ref13">13</xref>] among the transportation and treatment infrastructure. Further concerns indicated the uncertainty of the long-term impacts of bark beetle infestation as well as the challenge for effectively communicating this information to the water users and the public.</p><p>Many SCWC respondents identified issues associated with increased water quantity as their greatest concern. The primary issues these respondents identified with this were increased runoff, erosion, sediment mobilization, and organic debris. Changes to water quality were the second most identified concern of SCWC respondents, with less detail than the AWWA respondents regarding the types of water quality issues. Some respondents identified concern regarding erosion and changes in organic matter impacts to water quality. The third largest area of concern raised by SCWC respondents was the challenge of understanding the connection of forest watershed health to changes in hydrology and drinking water, with many emphasizing the concern of potential increased wildfire associated with MPB killed forests.</p></sec><sec id="s3_1_4"><title>3.1.4. Drinking Water Safety</title><p>For the question of whether drinking water quality had decreased or become unsafe because of bark beetle infestations, most respondents indicated no perceived changes to safety of water quality (<xref ref-type="table" rid="table2">Table 2</xref>) [<xref ref-type="bibr" rid="scirp.130746-ref13">13</xref>] . The remaining survey respondents were unsure if drinking water quality had changed. The AWWA and SCWC respondents who believed water quality had deteriorated indicated these issues were dealt with effectively via water treatment plants; therefore, did not present health or safety issues. Some respondents noted concern about potential increases in water treatment costs at water treatment plants because of increased TOC level reactions with chlorine and subsequent potential increases in TTHM [<xref ref-type="bibr" rid="scirp.130746-ref13">13</xref>] . Other respondents were either unsure or did not know if drinking water quality deteriorated or became unsafe to drink.</p></sec><sec id="s3_1_5"><title>3.1.5. Public Outreach</title><p>To address objective four, for both online survey groups [<xref ref-type="bibr" rid="scirp.130746-ref13">13</xref>] most felt MPB effects on drinking water were the greatest information to communicate to stakeholders to enhance awareness and understanding of potential effects of MPB on drinking water quality (see <xref ref-type="table" rid="table1">Table 1</xref>). More specifically information needs included potential taste and odor changes to water, clarifying short- versus long-term changes to drinking water quality, mitigation efforts being taken by drinking water providers to address these changes, as well as the increased costs to water users due to potential needs for additional treatment necessity to mediate MPB effects.</p><p>The second most identified topic to communicate to the public by AWWA survey respondents was the link between drinking water and forest health. This included the effects of drought and climate change, identifying if there is increased wildfire potential associated with MPB, as well as the effects of MPB associated forest management to drinking water. The second most identified topic by the SCWC respondents was to communicate to the public the methods used to mitigate the effects of MPB, including water treatment efforts to address drinking water quality issues, and the use of forest treatments to prevent and/or mitigate the MPB effects.</p><p>Across both survey groups the third most identified topic to communicate to the public was information about bark beetle disturbance generally, including its ecological characteristics (i.e., it is an endemic species, its normal life cycle, preferred forest habitat, etc.) and the current status of the MPB outbreak.</p></sec></sec><sec id="s3_2"><title>3.2. Beetle Caf&#233; Workshops</title><p>Twenty-five experts representing a variety of drinking water stakeholders participated in the Beetle Caf&#233; workshops. From these in-depth discussions we gathered information on the primary issues and challenges, potential solutions, and recommended public outreach mechanisms related to MPB effects on drinking water resources. Knowledge levels ranged from low to high, with the majority having moderate amounts of knowledge regarding the potential MPB effects on drinking water quality.</p><sec id="s3_2_1"><title>3.2.1. Identified Challenges</title><p>Several challenges of the MPB effects on drinking water were identified through the two Beetle Caf&#233; workshops (<xref ref-type="table" rid="table3">Table 3</xref>). The effects of MPB on drinking water quality were the highest priority challenge identified in both workshops. The AWWA workshop participants identified specific water quality challenges, including increased turbidity, TOC, DOC, DBPs, and heavy metals.</p><table-wrap id="table3" ><label><xref ref-type="table" rid="table3">Table 3</xref></label><caption><title> Beetle Caf&#233; Workshop Findings</title></caption><table><tbody><thead><tr><th align="center" valign="middle" ></th><th align="center" valign="middle" >2013 AWWA Workshop (n = 11)</th><th align="center" valign="middle" >2014 SCWC Workshop (n = 14)</th></tr></thead><tr><td align="center" valign="middle" >Issues and Challenges Identified</td><td align="center" valign="middle" >o Water quality o Potential effects of wildfire (increased erosion from extreme runoff events) o Management planning (mitigation costs and division of resources) o Increased water runoff o Changes in water supply o Climate change</td><td align="center" valign="middle" >o Water quality o Connection between forest management and water o Linkage to landscape health o Changes in soil biogeochemistry o Overall ecosystem o Dispelling myths o Long-term effects</td></tr><tr><td align="center" valign="middle" >Solutions</td><td align="center" valign="middle" >o Public awareness o Planning ahead o Mitigation o Goal setting</td><td align="center" valign="middle" >o Public education o Coordinate information o Accessibility of information o Demonstration projects</td></tr><tr><td align="center" valign="middle" >Public Outreach</td><td align="center" valign="middle" >o General information on MPB o How MPB affects the public o Maintain consumer confidence o Cost of doing nothing</td><td align="center" valign="middle" >o General information on MPB o How MPB affects the public o Link between forests and drinking water o Mitigation efforts</td></tr></tbody></table></table-wrap><p>Other concerns differed between the two workshops. In the AWWA workshop the potential for increased fire risk resulting from the MPB epidemic was the second chief concern discussed, with participants identifying several challenges to drinking water provision that result from fire, including extreme runoff events and associated erosion. During the SCWC Beetle Caf&#233; workshop, the second most discussed concern was the connection of forest management to drinking water quality. Participants were concerned there was a lack of understanding of how forest management activities (e.g., harvesting of beetle-killed trees) could affect drinking water resources. These participants recognized the overall linkage between forest and water resources and were concerned about the limited connection between forest management decisions and drinking water management.</p><p>The third major challenge identified at the AWWA Beetle Caf&#233; workshop was the cost and time associated with management planning related to drinking water provision. Participants were concerned about the division of resources and management priorities among different jurisdictions regarding management of forest watersheds, as well as water infrastructure management. The third prominent challenge discussed at the SCWC Beetle Caf&#233; workshop was the lack of information regarding the potential long-term effects of the bark beetle epidemic to drinking water resources and forested watersheds. Participants raised concerns about misinformation regarding the effects of the MPB and how these myths have or could potentially influence management decisions.</p></sec><sec id="s3_2_2"><title>3.2.2. Solutions</title><p>Potential solutions to these concerns were identified during the Beetle Caf&#233; workshops. Increased public awareness through education and improved communication was the most identified solution at both workshops. The SCWC workshop participants emphasized the use of demonstration projects as an important educational opportunity for both forest and water management mitigation efforts. The second primary solution identified from both workshops was to improve planning efforts across jurisdictions. To address this the AWWA Beetle Caf&#233; participants recommended coordinating goal setting and management efforts between different entities associated with the forested watersheds and drinking water systems affected by the MPB. Participants at the SCWC Beetle Caf&#233; workshop suggested the coordination of both scientific and on-the-ground information through databases and information clearinghouses to address the challenges of the MPB epidemic.</p></sec><sec id="s3_2_3"><title>3.2.3. Key Messages to Communicate to the Public</title><p>The workshops concluded with a discussion of the key messages that should be communicated to the public regarding potential MPB effects on drinking water quality (Objective 4). Participants from both Beetle Caf&#233; workshops believed general information about the MPB needed to be communicated to the public. Another common message was to share information about how the MPB was affecting or could affect the public through changes in drinking water quality and quantity. AWWA workshop participants discussed how consumer confidence should be maintained through proper messaging, including the communication of the effects to drinking water and consumers if no mitigation occurred. SCWC workshop participants emphasized the importance of communicating information about the linkage of forest health and water resources, and mitigation efforts used to address the MPB effects on the forest and by drinking water providers.</p></sec></sec></sec><sec id="s4"><title>4. Discussion and Knowledge Exchange Recommendations</title><p>Answering calls for research assessing how human perspectives respond to bark beetle outbreaks and evaluations of how stakeholders respond to changing resource conditions [<xref ref-type="bibr" rid="scirp.130746-ref4">4</xref>] [<xref ref-type="bibr" rid="scirp.130746-ref5">5</xref>] , this study sought to identify effective means of communication of MPB effects to drinking water quality and quantity among scientists and drinking water stakeholders in the northern Colorado and southern Wyoming region. Effective communication between researchers (our team of scientists) and drinking water stakeholders provides an opportunity for knowledge exchange to occur. A growing facet of literature [<xref ref-type="bibr" rid="scirp.130746-ref4">4</xref>] [<xref ref-type="bibr" rid="scirp.130746-ref17">17</xref>] [<xref ref-type="bibr" rid="scirp.130746-ref20">20</xref>] indicates successful knowledge exchange is a critical component for adaptation to climate-induced ecological disturbances affecting social-ecological systems [<xref ref-type="bibr" rid="scirp.130746-ref3">3</xref>] , such as the MPB epidemic. Our intent was to establish baseline information to identify how well this population is prepared to respond to climate-induced disturbances, such as the MPB, and identify mechanisms for improved communication, learning, and knowledge exchange. This empirical analysis of stakeholder knowledge levels, communication needs, and concerns provides the groundwork to understand knowledge exchange associated with the MPB ecological disturbance and identify strategies to improve communication and adaptive capacity in response to ecological disturbances. Methodologically, the combined elicitation and Beetle Caf&#233; workshop approaches [<xref ref-type="bibr" rid="scirp.130746-ref59">59</xref>] [<xref ref-type="bibr" rid="scirp.130746-ref64">64</xref>] [<xref ref-type="bibr" rid="scirp.130746-ref65">65</xref>] provided a depth of information less attainable through other approaches. In our attempt to identify baseline knowledge levels and research communication needs necessary to understand and further examine knowledge exchange and its contribution to adaptive capacity in climatic shifting conditions, findings identify communication opportunities to address uncertainty, or at least to begin to address it.</p><sec id="s4_1"><title>4.1. Knowledge Levels and Research Communication Needs</title><p>Knowledge levels were relatively low with approximately half of the survey respondents reporting little to no knowledge of the effects of MPB to drinking water quality and quantity. With low reported knowledge levels these findings indicate limited knowledge exchange among scientists and drinking water stakeholders. Knowledge of climate-induced change due to MPB impacts and the associated vulnerabilities takes many forms and is inherently uncertain. Knowledge exchange is much more than just providing facts but involves an exchange of information. This exchange of information among our team of scientists, science in general, and local drinking water managers involves numerous factors that influence how people respond and react to the information and communicating the effects of the MPB disturbance to drinking water resources is not easy. Limitations to the exchange of information are attributed to differences in communication venues, networks, and information sources.</p><p>Research communication needs identified by respondents supported the finding of limited knowledge exchange. One important difference between populations is that a majority of the AWWA respondents, consisting primarily of drinking water providers, did not believe research communication with scientists needed to be improved. In sight of the low levels of knowledge reported by the respondents, this finding indicates a general lack of awareness of the research conducted and its relevance to effective drinking water management, confirming the need for improved communication between scientists and stakeholders.</p><p>The most common theme across survey respondents and Beetle Caf&#233; participants was the need for increased accessibility and dissemination of scientific research findings. They were interested in learning about current research efforts, methods, preliminary findings, and results. Specific information requests from a variety of drinking water stakeholders (i.e., drinking water providers, consultants, community watershed group representatives, local government, and agency representatives) focused on the MPB effects to drinking water quality and quantity. The prominence of this request for increased accessibility and dissemination of research findings supports a recent analysis of stakeholder needs regarding climate-related information where stakeholders requested access to research information, improved communication and data coordination, and improved outreach to the public [<xref ref-type="bibr" rid="scirp.130746-ref18">18</xref>] .</p><p>One solution for improving communication is through increased multidisciplinary efforts among scientists and stakeholders [<xref ref-type="bibr" rid="scirp.130746-ref36">36</xref>] [<xref ref-type="bibr" rid="scirp.130746-ref66">66</xref>] . Similarly, the use of citizen-science initiatives and participation in existing community-based programs are an effective mechanism to share scientific information with stakeholders and provide public input to scientific processes [<xref ref-type="bibr" rid="scirp.130746-ref67">67</xref>] . Intermediary or boundary organizations have played an important role in natural resources through knowledge transfer with scientists, practitioners, policymakers, and other stakeholders that should be considered [<xref ref-type="bibr" rid="scirp.130746-ref23">23</xref>] [<xref ref-type="bibr" rid="scirp.130746-ref38">38</xref>] [<xref ref-type="bibr" rid="scirp.130746-ref68">68</xref>] . The common need for improved accessibility of research findings we found across stakeholders identifies an opportunity for improving knowledge exchange through intermediary organizations. For example, the local watershed groups and other outreach organizations may serve as intermediaries for information exchange between scientists and stakeholders [<xref ref-type="bibr" rid="scirp.130746-ref69">69</xref>] . These entities may play a crucial role in improving adaptive capacity of drinking water systems by enabling knowledge exchange between scientists, stakeholders, and the public.</p></sec><sec id="s4_2"><title>4.2. Stakeholder Challenges</title><p>Challenges associated with the effects of MPB to drinking water resources identified from the surveys and workshops reveal stakeholder concerns. Again, the effects of MPB to drinking water quality and quantity were commonly identified by both populations. The potential for increased wildfire risk in MPB affected forests and the associated impacts to drinking water quality and runoff was also identified in both populations, raised by those with lower reported knowledge levels. Although a limited connection between MPB and wildfire has been established scientifically [<xref ref-type="bibr" rid="scirp.130746-ref24">24</xref>] [<xref ref-type="bibr" rid="scirp.130746-ref45">45</xref>] [<xref ref-type="bibr" rid="scirp.130746-ref70">70</xref>] [<xref ref-type="bibr" rid="scirp.130746-ref71">71</xref>] [<xref ref-type="bibr" rid="scirp.130746-ref72">72</xref>] [<xref ref-type="bibr" rid="scirp.130746-ref73">73</xref>] , the prevalence of this concern is tied to recent wildfires (2012) and flooding (2013) which had severe impacts to drinking water within the region. Understanding the primary challenges and concerns of stakeholders provides useful information for scientists to account for when disseminating research findings and developing future research objectives [<xref ref-type="bibr" rid="scirp.130746-ref69">69</xref>] . Understanding stakeholder challenges and concerns increases our ability to connect scientific knowledge of climate disturbance impacts with local needs, to inform scientific endeavors with local knowledge, and thereby improve adaptive capacity [<xref ref-type="bibr" rid="scirp.130746-ref16">16</xref>] [<xref ref-type="bibr" rid="scirp.130746-ref17">17</xref>] [<xref ref-type="bibr" rid="scirp.130746-ref23">23</xref>] .</p></sec><sec id="s4_3"><title>4.3. Stakeholder Recommendations</title><p>Solutions outlined by survey respondents and workshop participants provide additional insight into potential mechanisms to improve communication among scientists, stakeholders, and the public. Survey respondents recommended improving the accessibility of research findings through increased use of non-academic research summaries, sharing results through centralized information sources, and exchanging information through professional associations and community meetings. Beetle Caf&#233; workshop participants provided additional recommendations for improving research accessibility, including demonstration projects, cross-jurisdictional planning processes, and coordination of scientific and on-the-ground data through databases and information clearinghouses. Topics to communicate with the public, include a focus on the linkage between forest health and drinking water, how the MPB epidemic can affect the public, methods for mitigating MPB’s effects on forests and drinking water, and an overview of the biology and ecology of the MPB insect and its impact to forests and drinking water.</p><p>Among the communication achievements of the project was the development of key messages for placed-based science education and public educational programs about the effects of mountain pine beetle infestation on water quality and natural resources. This was accomplished via an NBC News Learn “Sustainability: Water - Dead Trees &amp; Dirty Water in the Rockies” video [see https://www.youtube.com/watch?v = IOtBBJuKg5U] and through a university honors seminar conducted collaboratively between COM and CSU entitled “Naked Trees, Killer Beetles, and Dirty Water” [<xref ref-type="bibr" rid="scirp.130746-ref74">74</xref>] (see https://warnercnr.colostate.edu/announcements/naked-trees-killer-beetles-dirty-water/) for 61 plus undergraduate students at Colorado State University over seven years culminating in outreach videos, educational outreach at Outdoor School with 6<sup>th</sup> grade kids in Jefferson County Colorado and 9<sup>th</sup> grade biology classes at Rocky Mountain High School in Fort Collins Colorado. This class continues at Colorado State University once a year. A final K-12 Train the Teacher’s Workshop [<xref ref-type="bibr" rid="scirp.130746-ref75">75</xref>] focused on creation of curriculum resources for the classroom developed collaboratively among university students, K-12 teachers and the research project scientists at COM and CSU. The Integrated Ground Water Modeling Institute at COM continued science communication efforts of this project in the Denver metropolitan area until the lab was moved to Princeton University as part the High Meadows Environmental Institute https://igwmc.princeton.edu/people/university-affiliation/hmei/.</p><p>The project developed new approaches to study landscape level bark beetle disturbances and social perspectives on high severity outbreaks in collaboration with the NSF funded Research Collaborative Network (Mountain Social Ecological Observatory Network (MtnSEON)) see https://webpages.uidaho.edu/mtnseon/ [<xref ref-type="bibr" rid="scirp.130746-ref4">4</xref>] [<xref ref-type="bibr" rid="scirp.130746-ref5">5</xref>] . This led to further understanding of factors that influence adaptive capacity for increasing resilience to bark beetles [<xref ref-type="bibr" rid="scirp.130746-ref5">5</xref>] [<xref ref-type="bibr" rid="scirp.130746-ref16">16</xref>] using mountain pine beetle (Dendroctonus ponderosae) in the western U.S. as a model as well as identification of priority research questions [<xref ref-type="bibr" rid="scirp.130746-ref4">4</xref>] on insect forest disturbances through socio-environmental collaboration.</p><p>Further, a theoretical framework was developed by a research workshop group in 2016 funded internally at CSU to provide land managers and policymakers a potential tool for identifying limitations for adaptive capacity in social ecological systems (SES) in hopes of addressing future bark beetle infestation events [<xref ref-type="bibr" rid="scirp.130746-ref16">16</xref>] . This effort was intended to motivate future research in the assessment of adaptive capacity and to foster collaboration among scientists and land manager efforts to manage for bark beetle impacts.</p></sec></sec><sec id="s5"><title>5. Conclusions</title><p>In sum, improved accessibility of study findings via non-academic research summaries, centralized information sources for state level governmental agencies, and professional association and community meetings is recommended. Examples include demonstration projects, cross-jurisdictional planning processes, and coordination of scientific and on-the-ground data through databases and information clearinghouses. Communication topics for outreach include the link between forest health and drinking water safety, mitigating MPB’s effects on forests and drinking water, and ecological aspects of MPB insects in their impact on forest health and drinking water resources.</p><p>Communicating the role of bark beetle disturbances in natural resources is an important aspect of educating governance agencies, water user groups, and the general public [<xref ref-type="bibr" rid="scirp.130746-ref5">5</xref>] [<xref ref-type="bibr" rid="scirp.130746-ref16">16</xref>] . Results allude to further study needs among other populations (i.e., forest ecologists and natural resource managers). Additional research will build on these results to determine knowledge outreach needs, and stakeholder and public concerns, as well as optimal outlets for science communication outreach. This information will continue to inform the hydrological and biogeochemical research being conducted, as well as aid in development of outreach and educational materials for sharing the biophysical and social science findings of this project [<xref ref-type="bibr" rid="scirp.130746-ref74">74</xref>] .</p></sec><sec id="s6"><title>Acknowledgements</title><p>The authors would like to thank all survey respondents and Beetle Caf&#233; workshop participants for taking the time to participate in this study. Thanks are given to Karina Branson with ConverSketch (see https://www.conversketch.com) for her graphic facilitation expertise as shown in <xref ref-type="fig" rid="fig1">Figure 1</xref>.</p></sec><sec id="s7"><title>Funding</title><p>Supported by The National Science Foundation Water Sustainability and Climate Grants 1204460 and 1204787 from 2013 to 2018.</p></sec><sec id="s8"><title>Conflicts of Interest</title><p>The authors declare no conflicts of interest regarding the publication of this paper.</p></sec><sec id="s9"><title>Cite this paper</title><p>Cottrell, S.P., Mattor, K. and Raadik Cottrell, J. (2024) Perceptions of Bark Beetle Landscape Disturbance Effects on Natural Resources and Drinking Water: Assessing Communication and Knowledge Exchange in the Rocky Mountain Region, USA. Open Journal of Ecology, 14, 77-100. https://doi.org/10.4236/oje.2024.141005</p></sec></body><back><ref-list><title>References</title><ref id="scirp.130746-ref1"><label>1</label><mixed-citation publication-type="other" xlink:type="simple">Embrey, S., Remais, J.V. and Hess, J. (2012) Climate Change and Ecosystem Disruption: The Health Impacts of the North American Rocky Mountain Pine Beetle Infestation. American Journal of Public Health, 102, 818-827. https://doi.org/10.2105/AJPH.2011.300520</mixed-citation></ref><ref id="scirp.130746-ref2"><label>2</label><mixed-citation publication-type="book" xlink:type="simple">Hofstetter, R.W. and Gandhi, K.J.K. (2022) Interactions among Climate, Disturbance, and Bark Beetles Affect Forest Landscapes of the Future. In: Hofstetter, R.W. and Gandhi, K.J.K., Eds., Bark Beetle Management, Ecology, and Climate Change, Academic Press, London, 395-404. https://doi.org/10.1016/B978-0-12-822145-7.00003-9</mixed-citation></ref><ref id="scirp.130746-ref3"><label>3</label><mixed-citation publication-type="other" xlink:type="simple">Abrams, J., Huber-Stearns, H., Steen-Adams, M., Davis, E.J., Bone, C., Nelson, M.F. and Moseley, C. (2021) Adaptive Governance in a Complex Social-Ecological Context: Emergent Responses to a Native Forest Insect Outbreak. Sustainability Science, 16, 53-68. https://doi.org/10.1007/s11625-020-00843-5</mixed-citation></ref><ref id="scirp.130746-ref4"><label>4</label><mixed-citation publication-type="other" xlink:type="simple">Morris, J., Cottrell, S., Fettig, C., Hansen, W., Sherriff, R., Carter, V., Clear, J., Clement, J., DeRose, R., Hicke, J., Higuera, P., Mattor, K., Seddon, A., Seppa, H., Stednick, J. and Seybold, S. (2017) Managing Bark Beetle Impacts on Ecosystems and Society: Priority Questions to Motivate Future Research. Journal of Applied Ecology, 54, 750-760. https://doi.org/10.1111/1365-2664.12782</mixed-citation></ref><ref id="scirp.130746-ref5"><label>5</label><mixed-citation publication-type="other" xlink:type="simple">Morris, J., Cottrell, S., Fettig, C., Hansen, W., Sherriff, R., Carter, V., Clear, J., Clement, J., DeRose, R., Hicke, J., Higuera, P., Mattor, K., Seddon, A., Seppa, H., Stednick, J. and Seybold, S. (2018) Bark Beetles as Agents of Change in Social-Ecological Systems. Frontiers in Ecology and the Environment, 16, S34-S43. https://doi.org/10.1002/fee.1754</mixed-citation></ref><ref id="scirp.130746-ref6"><label>6</label><mixed-citation publication-type="other" xlink:type="simple">Folke, C., Kofinas, G.P. and Chapin, F.S. (2009) Principles of Ecosystem Stewardship: Resilience-Based Natural Resource Management in a Changing World. Springer, New York. https://doi.org/10.1007/978-0-387-73033-2</mixed-citation></ref><ref id="scirp.130746-ref7"><label>7</label><mixed-citation publication-type="other" xlink:type="simple">Fettig, C.J., Asaro, C., Nowak, J.T., Dodds, K.J., Gandhi, K.J., Moan, J.E. and Robert, J. (2022) Trends in Bark Beetle Impacts in North America during a Period (2000-2020) of Rapid Environmental Change. Journal of Forestry, 120, 693-713. https://doi.org/10.1093/jofore/fvac021</mixed-citation></ref><ref id="scirp.130746-ref8"><label>8</label><mixed-citation publication-type="other" xlink:type="simple">Bearup, L.A., Maxwell, R.M., Clow, D.W. and McCray, J.E. (2014) Hydrological Effects of Forest Transpiration Loss in Bark Beetle-Impacted Watersheds. Nature Climate Change, 4, 481-486. https://doi.org/10.1038/nclimate2198</mixed-citation></ref><ref id="scirp.130746-ref9"><label>9</label><mixed-citation publication-type="other" xlink:type="simple">Mikkelson, K.M., Maxwell, R.M., Ferguson, I., Stednick, J.D., McCray, J.E. and Sharp, J.O. (2013) Mountain Pine Beetle Infestation Impacts: Modeling Water and Energy Budgets at the Hill-Slope Scale. Ecohydrology, 6, 64-72. https://doi.org/10.1002/eco.278</mixed-citation></ref><ref id="scirp.130746-ref10"><label>10</label><mixed-citation publication-type="other" xlink:type="simple">Brouillard, B.M., Dickenson, E.R., Mikkelson, K.M. and Sharp, J.O. (2016) Water Quality following Extensive Beetle-Induced Tree Mortality: Interplay of Aromatic Carbon Loading, Disinfection Byproducts, and Hydrologic Drivers. Science of the Total Environment, 572, 649-659. https://doi.org/10.1016/j.scitotenv.2016.06.106</mixed-citation></ref><ref id="scirp.130746-ref11"><label>11</label><mixed-citation publication-type="other" xlink:type="simple">Mikkelson, K.M., Dickenson, E.R., Maxwell, R.M., McCray, J.E. and Sharp, J.O. (2012) Water-Quality Impacts from Climate-Induced Forest Die-Off. Nature Climate Change, 3, 218-222. https://doi.org/10.1038/nclimate1724</mixed-citation></ref><ref id="scirp.130746-ref12"><label>12</label><mixed-citation publication-type="other" xlink:type="simple">Mikkelson, K.M., Bearup, L.A., Maxwell, R.M., Stednick, J.D., McCray, J.E. and Sharp, J.O. (2013) Bark Beetle Infestation Impacts on Nutrient Cycling, Water Quality and Interdependent Hydrological Effects. Biogeochemistry, 115, 1-21. https://doi.org/10.1007/s10533-013-9875-8</mixed-citation></ref><ref id="scirp.130746-ref13"><label>13</label><mixed-citation publication-type="book" xlink:type="simple">Mattor, K.M., Cottrell, S.P., Czaja, M.R., Stednick, J.D. and Dickenson, E.R.V. (2018) The Effects of Mountain Pine Beetle on Drinking Water Quality: Assessing Communication Strategies and Knowledge Levels in the Rocky Mountain Region. In: Urquhart, J., Marzano, M. and Potter, C., Eds., The Human Dimensions of Forest and Tree Health, Palgrave Macmillan, Cham, 355-381. https://doi.org/10.1007/978-3-319-76956-1_14</mixed-citation></ref><ref id="scirp.130746-ref14"><label>14</label><mixed-citation publication-type="other" xlink:type="simple">Rhoades, C.C.: McCutchan, J.H., Cooper, L.A., Clow, D., Detmer, T.M., Briggs, J.S., Stednick, J.D., Veblen, T.T., Ertz, R.M. and Likens, G.E. (2013) Biogeochemistry of Beetle-Killed Forests: Explaining a Weak Nitrate Response. Proceedings of the National Academy of Sciences of the United States of America, 110, 1756-1760. https://doi.org/10.1073/pnas.1221029110</mixed-citation></ref><ref id="scirp.130746-ref15"><label>15</label><mixed-citation publication-type="other" xlink:type="simple">Folke, C. (2006) Resilience: The Emergence of a Perspective for Social-Ecological Systems Analyses. Global Environmental Change, 16, 253-267. https://doi.org/10.1016/j.gloenvcha.2006.04.002</mixed-citation></ref><ref id="scirp.130746-ref16"><label>16</label><mixed-citation publication-type="other" xlink:type="simple">Cottrell, S., Mattor, K.M., Morris, J.L., Fettig, C.J., McGrady, P., Maguire, D., James, P.M.A., Clear, J., Wurtzebach, Z., Wei, Y., Brunelle, A., Western, J., Maxwell, R., Rotar, M., Gallagher, L. and Roberts, R. (2019) Adaptive Capacity in Social-Ecological Systems: A Framework for Addressing Bark Beetle Disturbances in Natural Resource Management. Sustainability Sciences, 15, 555-567. https://doi.org/10.1007/s11625-019-00736-2</mixed-citation></ref><ref id="scirp.130746-ref17"><label>17</label><mixed-citation publication-type="other" xlink:type="simple">Kiparsky, M., Milman, A. and Vicuna, S. (2012) Climate and Water: Knowledge of Impacts to Action on Adaptation. Annual Review of Environment and Resources, 37, 163-194. https://doi.org/10.1146/annurev-environ-050311-093931</mixed-citation></ref><ref id="scirp.130746-ref18"><label>18</label><mixed-citation publication-type="other" xlink:type="simple">Dilling, L. and Berggren, J. (2005) What Do Stakeholders Need to Manage for Climate Change and Variability? A Document-Based Analysis from Three Mountain States in the Western USA. Regional Environmental Change, 15, 657-667. https://doi.org/10.1007/s10113-014-0668-y</mixed-citation></ref><ref id="scirp.130746-ref19"><label>19</label><mixed-citation publication-type="book" xlink:type="simple">Folke, C., Colding, J. and Berkes, F. (2009) Synthesis: Building Resilience and Adaptive Capacity in Social-Ecological Systems. In: Berkes, F., Colding, J. and Folke, C., Eds., Navigating Social-Ecological Systems: Building Resilience for Complexity and Change, Cambridge University Press, Cambridge, 352-387. https://doi.org/10.1017/CBO9780511541957.020</mixed-citation></ref><ref id="scirp.130746-ref20"><label>20</label><mixed-citation publication-type="other" xlink:type="simple">Nguyen, V., Young, N. and Cooke, S.J. (2017) A Roadmap for Knowledge Exchange and Mobilization Research in Conservation and Natural Resource Management. Conservation Biology, 31, 789-798. https://doi.org/10.1111/cobi.12857</mixed-citation></ref><ref id="scirp.130746-ref21"><label>21</label><mixed-citation publication-type="other" xlink:type="simple">Walker, B., Gunderson, L., Kinzig, A., Folke, C., Carpenter, S. and Schultz, L. (2006) A Handful of Heuristics and Some Propositions for Understanding Resilience in Social-Ecological Systems. Ecology and Society, 11, Article 13. http://www.ecologyandsociety.org/vol11/iss1/art13/</mixed-citation></ref><ref id="scirp.130746-ref22"><label>22</label><mixed-citation publication-type="other" xlink:type="simple">Armitage, D. (2005) Adaptive Capacity and Community-Based Natural Resource Management. Environmental Management, 35, 703-715. https://doi.org/10.1007/s00267-004-0076-z</mixed-citation></ref><ref id="scirp.130746-ref23"><label>23</label><mixed-citation publication-type="other" xlink:type="simple">Dilling, L., Lackstrom, K., Haywood, B., Dow, K., Lemos, M.C., Berggren, J. and Kalafatis, S. (2015) What Stakeholder Needs Tell Us about Enabling Adaptive Capacity: The Intersection of Context and Information Provision across Regions in the United States. Weather, Climate, and Society, 7, 5-17. https://doi.org/10.1175/WCAS-D-14-00001.1</mixed-citation></ref><ref id="scirp.130746-ref24"><label>24</label><mixed-citation publication-type="other" xlink:type="simple">Dhar, A., Parrott, L. and Hawkins, C.D.B. (2016) Aftermath of Mountain Pine Beetle Outbreak in British Columbia: Stand Dynamics, Management Response and Ecosystem Resilience. Forests, 7, Article 171. https://doi.org/10.3390/f7080171</mixed-citation></ref><ref id="scirp.130746-ref25"><label>25</label><mixed-citation publication-type="other" xlink:type="simple">Dhar, A., Parrott, L. and Heckbert, S. (2016) Consequences of Mountain Pine Beetle Outbreak on Forest Ecosystem Services in Western Canada. Canadian Journal of Forest Research, 46, 987-999. https://doi.org/10.1139/cjfr-2016-0137</mixed-citation></ref><ref id="scirp.130746-ref26"><label>26</label><mixed-citation publication-type="other" xlink:type="simple">Clarvis, M.H. and Engle, N.L. (2015) Adaptive Capacity of Water Governance Arrangements: A Comparative Study of Barriers and Opportunities in Swiss and US States. Regional Environmental Change, 15, 517-527. https://doi.org/10.1007/s10113-013-0547-y</mixed-citation></ref><ref id="scirp.130746-ref27"><label>27</label><mixed-citation publication-type="other" xlink:type="simple">Kundzewicz, Z.W., Mata, L.J., Arnell, N.W., D&amp;#246;ll, P., Jimenez, B., Miller, K., Oki, T., &amp;#350;en, Z. and Shiklomanov, I. (2008) The Implications of Projected Climate Change for Freshwater Resources and Their Management. Hydrological Sciences Journal, 53, 3-10. https://doi.org/10.1623/hysj.53.1.3</mixed-citation></ref><ref id="scirp.130746-ref28"><label>28</label><mixed-citation publication-type="other" xlink:type="simple">Pahl-Wostl, C. (2007) Transitions towards Adaptive Management of Water Facing Climate and Global Change. Water Resources Management, 21, 49-62. https://doi.org/10.1007/s11269-006-9040-4</mixed-citation></ref><ref id="scirp.130746-ref29"><label>29</label><mixed-citation publication-type="other" xlink:type="simple">Armitage, D.R. and Plummer, R. (2010) Adaptive Capacity and Environmental Governance. Springer, Berlin. https://doi.org/10.1007/978-3-642-12194-4_1</mixed-citation></ref><ref id="scirp.130746-ref30"><label>30</label><mixed-citation publication-type="other" xlink:type="simple">Bergkamp, G.J.J., Orlando, B. and Burton, I. (2003) Change: Adaptation of Water Resources Management to Climate Change. IUCN: The World Conservation Union and WANI: Water and Nature Initiative. https://doi.org/10.2305/IUCN.CH.2003.WANI.1.en</mixed-citation></ref><ref id="scirp.130746-ref31"><label>31</label><mixed-citation publication-type="book" xlink:type="simple">de Loe, R. and Plummer, R. (2010) Climate Change, Adaptive Capacity, and Governance for Drinking Water in Canada. In: Armitage, D.R. and Plummer, R., Eds., Adaptive Capacity and Environmental Governance, Springer, Berlin, 157-178. https://doi.org/10.1007/978-3-642-12194-4_8</mixed-citation></ref><ref id="scirp.130746-ref32"><label>32</label><mixed-citation publication-type="book" xlink:type="simple">Adger, W.N., Agrawala, S., Mirza, M.M.Q., Conde, C., O’Brien, K., Pulhin, J., Pulwarty, R., Smit, B. and Takahashi, K. (2007) Assessment of Adaptation Practices, Options, Constraints and Capacity. In: Parry, M.L., Canziani, O.F., Palutikof, J.P., van der Linden, P.J. and Hanson, C.E., Eds., Climate Change 2007: Impacts, Adaptation and Vulnerability, Cambridge University Press, Cambridge, 717-743.</mixed-citation></ref><ref id="scirp.130746-ref33"><label>33</label><mixed-citation publication-type="other" xlink:type="simple">Smit, B. and Wandel, J. (2006) Adaptation, Adaptive Capacity and Vulnerability. Global Environmental Change, 16, 282-292. https://doi.org/10.1016/j.gloenvcha.2006.03.008</mixed-citation></ref><ref id="scirp.130746-ref34"><label>34</label><mixed-citation publication-type="other" xlink:type="simple">Pahl-Wostl, C.A. (2009) Conceptual Framework for Analysing Adaptive Capacity and Multi-Level Learning Processes in Resource Governance Regimes. Global Environmental Change, 19, 354-365. https://doi.org/10.1016/j.gloenvcha.2009.06.001</mixed-citation></ref><ref id="scirp.130746-ref35"><label>35</label><mixed-citation publication-type="other" xlink:type="simple">Roux, D.J., Rogers, K.H., Biggs, H.C., Ashton, P.J. and Sergeant, A. (2006) Bridging the Science-Management Divide: Moving from Unidirectional Knowledge Transfer to Knowledge Interfacing and Sharing. Ecology and Society, 11, Article 4.http://www.ecologyandsociety.org/vol11/iss1/art4/ https://doi.org/10.5751/ES-01643-110104</mixed-citation></ref><ref id="scirp.130746-ref36"><label>36</label><mixed-citation publication-type="other" xlink:type="simple">Timmerman, J. and Langaas, S. (2005) Water Information: What Is It Good for? The Use of Information in Transboundary Water Management. Regional Environmental Change, 5, 177-187. https://doi.org/10.1007/s10113-004-0087-6</mixed-citation></ref><ref id="scirp.130746-ref37"><label>37</label><mixed-citation publication-type="other" xlink:type="simple">Hulme, P.E. (2014) Bridging the Knowing—Doing Gap: Know-Who, Know-What, Know-Why, Know-How and Know-When. Journal of Applied Ecology, 51, 1131-1136. https://doi.org/10.1111/1365-2664.12321</mixed-citation></ref><ref id="scirp.130746-ref38"><label>38</label><mixed-citation publication-type="other" xlink:type="simple">Osmond, D.L., Nadkarni, N.M., Driscoll, C.T., Andrews, E., Gold, A.J., Allred, S.R.B., Berkowitz, A.R., Klemens, M.W., Loecke, T.L., McGarry, M.A., Schwarz, K., Washington, M.L. and Groffman, P.M. (2010) The Role of Interface Organizations in Science Communication and Understanding. Frontiers in Ecology and the Environment, 8, 306-313. https://doi.org/10.1890/090145</mixed-citation></ref><ref id="scirp.130746-ref39"><label>39</label><mixed-citation publication-type="other" xlink:type="simple">Addison, P.F., Rumpff, L., Bau, S.S., Carey, J.M., Chee, Y.E., Jarrad, F.C., McBride, M.F. and Burgman, M.A. (2013) Practical Solutions for Making Models Indispensable in Conservation Decision-Making. Diversity and Distributions, 19, 490-502. https://doi.org/10.1111/ddi.12054</mixed-citation></ref><ref id="scirp.130746-ref40"><label>40</label><mixed-citation publication-type="other" xlink:type="simple">Borowski, I. and Hare, M. (2007) Exploring the Gap between Water Managers and Researchers: Difficulties of Model-Based Tools to Support Practical Water Management. Water Resources Management, 21, 1049-1074. https://doi.org/10.1007/s11269-006-9098-z</mixed-citation></ref><ref id="scirp.130746-ref41"><label>41</label><mixed-citation publication-type="other" xlink:type="simple">Cook, C.N., Hockings, M. and Carter, R.W. (2009) Conservation in the Dark? The Information Used to Support Management Decisions. Frontiers in Ecology and the Environment, 8, 181-186. https://doi.org/10.1890/090020</mixed-citation></ref><ref id="scirp.130746-ref42"><label>42</label><mixed-citation publication-type="other" xlink:type="simple">Flint, C.G., McFarlane, B. and Muller, M. (2009) Human Dimensions of Forest Disturbance by Insects: An International Synthesis. Environmental Management, 43, 1174-1186. https://doi.org/10.1007/s00267-008-9193-4</mixed-citation></ref><ref id="scirp.130746-ref43"><label>43</label><mixed-citation publication-type="other" xlink:type="simple">USDAFS: United States Department of Agriculture Forest Service (2015) Western Bark Beetle Strategy for Human Safety, Recovery and Resiliency. http://www.fs.usda.gov/Internet/FSE_DOCUMENTS/stelprdb5337222.pdf</mixed-citation></ref><ref id="scirp.130746-ref44"><label>44</label><mixed-citation publication-type="other" xlink:type="simple">Edburg, S.L., Hicke, J.A., Brooks, P.D., Pendall, E.G., Ewers, B.E., Norton, U., Gochis, D., Gutmann, E.D. and Meddens, A.J. (2012) Cascading Impacts of Bark Beetle-Caused Tree Mortality on Coupled Biogeophysical and Biogeochemical Processes. Frontiers in Ecology and the Environment, 10, 416-424. https://doi.org/10.1890/110173</mixed-citation></ref><ref id="scirp.130746-ref45"><label>45</label><mixed-citation publication-type="other" xlink:type="simple">Hart, S.J., Schoennagel, T., Veblen, T.T. and Chapman, T.B. (2015) Area Burned in the Western United States Is Unaffected by Recent Mountain Pine Beetle Outbreaks. Proceedings of the National Academy of Sciences of the United States of America, 112, 4375-4380. https://doi.org/10.1073/pnas.1424037112</mixed-citation></ref><ref id="scirp.130746-ref46"><label>46</label><mixed-citation publication-type="other" xlink:type="simple">CWA: Colorado Watershed Assembly (2015) Water Facts. Denver. https://www.coloradowater.org/</mixed-citation></ref><ref id="scirp.130746-ref47"><label>47</label><mixed-citation publication-type="other" xlink:type="simple">Filoso, S., Bezerra, M.O., Weiss, K.C.B., Palmer, M.A., Prestegaard, K. and Richter, B. (2017) Impacts of Forest Restoration on Water Yield: A Systematic Review. PLOS ONE, 12, e0183210. https://doi.org/10.1371/journal.pone.0183210</mixed-citation></ref><ref id="scirp.130746-ref48"><label>48</label><mixed-citation publication-type="other" xlink:type="simple">Simonit, S., Connors, J.P., Yoo, J., Kinzig, A. and Perrings, C. (2015) The Impact of Forest Thinning on the Reliability of Water Supply in Central Arizona. PLOS ONE, 10, e0121596. https://doi.org/10.1371/journal.pone.0121596</mixed-citation></ref><ref id="scirp.130746-ref49"><label>49</label><mixed-citation publication-type="other" xlink:type="simple">Penn, C.A., Bearup, L.A., Maxwell, R.M. and Clow, D.W. (2016) Numerical Experiments to Explain Multiscale Hydrological Responses to Mountain Pine Beetle Tree Mortality in a Headwater Watershed. Water Resources Research, 52, 3143-3161. https://doi.org/10.1002/2015WR018300</mixed-citation></ref><ref id="scirp.130746-ref50"><label>50</label><mixed-citation publication-type="other" xlink:type="simple">CSFS: Colorado State Forest Service (2015) 2014 Report on the Health of Colorado’s Forests. Fort Collins. http://csfs.colostate.edu/forest-management/common-forest-insects-diseases/mountain-pine-beetle</mixed-citation></ref><ref id="scirp.130746-ref51"><label>51</label><mixed-citation publication-type="other" xlink:type="simple">SurveyMonkey. (2015) Create Surveys. Palo Alto. https://www.surveymonkey.com</mixed-citation></ref><ref id="scirp.130746-ref52"><label>52</label><mixed-citation publication-type="other" xlink:type="simple">Bosetti, V., Catenacci, M., Fiorese, G. and Verdolini, E. (2012) The Future Prospect of PV and CSP Solar Technologies: An Expert Elicitation Survey. Energy Policy, 49, 308-317. https://doi.org/10.1016/j.enpol.2012.06.024</mixed-citation></ref><ref id="scirp.130746-ref53"><label>53</label><mixed-citation publication-type="other" xlink:type="simple">Martin, T.G., Burgman, M.A., Fidler, F., Kuhnert, P.M., Low-Choy, S., Mcbride, M. and Mengersen, K. (2012) Eliciting Expert Knowledge in Conservation Science. Conservation Biology, 26, 29-38. https://doi.org/10.1111/j.1523-1739.2011.01806.x</mixed-citation></ref><ref id="scirp.130746-ref54"><label>54</label><mixed-citation publication-type="other" xlink:type="simple">Van Houtven, G., Mansfield C., Phaneuf, D.J., Von Haefen, R., Milstead, B., Kenney, M.A. and Reckhow, K.H. (2014) Combining Expert Elicitation and Stated Preference Methods to Value Ecosystem Services from Improved Lake Water Quality. Ecological Economics, 99, 40-52. https://doi.org/10.1016/j.ecolecon.2013.12.018</mixed-citation></ref><ref id="scirp.130746-ref55"><label>55</label><mixed-citation publication-type="other" xlink:type="simple">Donlan, C.J., Wingfield, D.K., Crowder, L.B. and Wilcox, C. (2010) Using Expert Opinion Surveys to Rank Threats to Endangered Species: A Case Study with Sea Turtles. Conservation Biology, 24, 1586-1595. https://doi.org/10.1111/j.1523-1739.2010.01541.x</mixed-citation></ref><ref id="scirp.130746-ref56"><label>56</label><mixed-citation publication-type="other" xlink:type="simple">Doria, M.D., Boyd, E., Tompkins, E.L. and Adger, W.N. (2009) Using Expert Elicitation to Define Successful Adaptation to Climate Change. Environmental Science &amp; Policy, 12, 810-819. https://doi.org/10.1016/j.envsci.2009.04.001</mixed-citation></ref><ref id="scirp.130746-ref57"><label>57</label><mixed-citation publication-type="other" xlink:type="simple">Denzin, N.K. and Lincoln, Y.S. (1998) The Landscape of Qualitative Research: Theories and Issues. SAGE, Thousand Oaks.</mixed-citation></ref><ref id="scirp.130746-ref58"><label>58</label><mixed-citation publication-type="other" xlink:type="simple">Strauss, A. and Corbin, J. (1998) Basics of Qualitative Research: Techniques and Procedures for Developing Grounded Theory. 2nd Edition, SAGE, Thousand Oaks.</mixed-citation></ref><ref id="scirp.130746-ref59"><label>59</label><mixed-citation publication-type="other" xlink:type="simple">Creswell, J.W. (2003) Research Design: Qualitative, Quantitative, and Mixed Method Approaches. 2nd Edition, SAGE, Thousand Oaks.</mixed-citation></ref><ref id="scirp.130746-ref60"><label>60</label><mixed-citation publication-type="other" xlink:type="simple">Dillman, D.A., Smyth, J.D. and Christian, L.M. (2009) Internet, Mail, and Mixed-Mode Surveys: The Tailored Design Method. 3rd Edition, John Wiley and Sons, Hoboken.</mixed-citation></ref><ref id="scirp.130746-ref61"><label>61</label><mixed-citation publication-type="other" xlink:type="simple">L&amp;#246;hr, K., Weinhardt, M. and Sieber, S. (2020) The “World Café” as a Participatory Method for Collecting Qualitative Data. International Journal of Qualitative Methods, 19. https://doi.org/10.1177/1609406920916976</mixed-citation></ref><ref id="scirp.130746-ref62"><label>62</label><mixed-citation publication-type="other" xlink:type="simple">Brown, J. and Isaacs, D. (2050) The World Café: Shaping Our Futures through Conversations That Matter. Berrett-Koehler Publishers, Inc., San Francisco.</mixed-citation></ref><ref id="scirp.130746-ref63"><label>63</label><mixed-citation publication-type="other" xlink:type="simple">Mullen, K. and Thompson, J. (2013) Graphic Recording: Using Vivid Visuals to Communicate Climate Change. The Electronic Journal of Communication, 23, 1-24.</mixed-citation></ref><ref id="scirp.130746-ref64"><label>64</label><mixed-citation publication-type="other" xlink:type="simple">Golicic, S. and Davis, D. (2012) Implementing Mixed Methods Research in Supply Chain Management. International Journal of Physical Distribution &amp; Logistics Management, 42, 726-741. https://doi.org/10.1108/09600031211269721</mixed-citation></ref><ref id="scirp.130746-ref65"><label>65</label><mixed-citation publication-type="other" xlink:type="simple">Molina-Azorín, J. and Font, X. (2016) Mixed Methods in Sustainable Tourism Research: An Analysis of Prevalence, Designs and Application in JOST (2005-2014). Journal of Sustainable Tourism, 24, 549-573. https://doi.org/10.1080/09669582.2015.1073739</mixed-citation></ref><ref id="scirp.130746-ref66"><label>66</label><mixed-citation publication-type="other" xlink:type="simple">Nisbet, M.C., Hixon, M.A., Moore, K.D. and Nelson, M. (2010) Four Cultures: New Synergies for Engaging Society on Climate Change. Frontiers in Ecology and the Environment, 8, 329-331. https://doi.org/10.1890/1540-9295-8.6.329</mixed-citation></ref><ref id="scirp.130746-ref67"><label>67</label><mixed-citation publication-type="other" xlink:type="simple">Groffman, P.M., Stylinski, C., Nisbet, M.C., Duarte, C.M., Jordan, R., Burgin, A., Previtali. M.A. and Coloso, J. (2010) Restarting the Conversation: Challenges at the Interface between Ecology and Society. Frontiers in Ecology and the Environment, 8, 284-291. https://doi.org/10.1890/090160</mixed-citation></ref><ref id="scirp.130746-ref68"><label>68</label><mixed-citation publication-type="other" xlink:type="simple">Sternlieb, F., Bixler, R.P., Huber-Stearns, H. and Huayhuaca, C. (2013) A Question of Fit: Reflections on Boundaries, Organizations and Social-Ecological Systems. Journal of Environmental Management, 130, 117-125. https://doi.org/10.1016/j.jenvman.2013.08.053</mixed-citation></ref><ref id="scirp.130746-ref69"><label>69</label><mixed-citation publication-type="other" xlink:type="simple">Czaja, M. and Cottrell, S.P. (2014) Integrating Social Science Research into Wildland Fire Management. Disaster Prevention and Management, 23, 381-394. https://doi.org/10.1108/DPM-10-2013-0193</mixed-citation></ref><ref id="scirp.130746-ref70"><label>70</label><mixed-citation publication-type="other" xlink:type="simple">Roberts, R., Jones, K., Cottrell, S.P. and Duke, E. (2020) Examining Motivations Influencing Watershed Partnership Participation in the Intermountain Western United States. Environmental Science &amp; Policy, 107, 114-122. https://doi.org/10.1016/j.envsci.2020.02.021</mixed-citation></ref><ref id="scirp.130746-ref71"><label>71</label><mixed-citation publication-type="other" xlink:type="simple">Czaja, M., Bright, A. and Cottrell, S.P. (2015) Integrative Complexity, Beliefs, and Attitudes: Application to Prescribed Fire. Journal of Forest Policy and Economics, 62, 54-61. https://doi.org/10.1016/j.forpol.2015.07.003</mixed-citation></ref><ref id="scirp.130746-ref72"><label>72</label><mixed-citation publication-type="other" xlink:type="simple">Hicke, J., Johnson, M., Hayes, J. and Preisler, H. (2012) Effects of Bark Beetle-Caused Tree Mortality on Wildfire. Forest Ecology and Management, 271, 81-90. https://doi.org/10.1016/j.foreco.2012.02.005</mixed-citation></ref><ref id="scirp.130746-ref73"><label>73</label><mixed-citation publication-type="other" xlink:type="simple">McGrady, P., Cottrell, S., Raadik Cottrell, J., Clement, J. and Czaja, M. (2016) Local Perceptions of Mountain Pine Beetle Infestation, Forest Management, and Connection to National Forests in Colorado and Wyoming. Human Ecology, 44, 185-196. https://doi.org/10.1007/s10745-015-9803-8</mixed-citation></ref><ref id="scirp.130746-ref74"><label>74</label><mixed-citation publication-type="other" xlink:type="simple">Gallagher, L., Morse, M., Maxwell, R.M., Cottrell, S. and Mattor, K. (2016) Using the Mountain Pine Beetle Infestation of the Rocky Mountain West to Develop a Collaborative, Experiential Course on Science Communication. American Geophysical Union, Fall Meeting 2016, San Francisco, 12-16 December 2016, ED13A-0929.</mixed-citation></ref><ref id="scirp.130746-ref75"><label>75</label><mixed-citation publication-type="other" xlink:type="simple">Gallagher, L., Mikkelson, K.M., Leonard, L., Cottrell, S., Navarre-Sitchler, A., Sharp, J. and Maxwell, R.M. (2018) Naked Trees, Killer Beetles and Dirty Water: A K-12 Teacher Workshop on the Mountain Pine Beetle Infestation and Its Impacts to Water in the Rocky Mountain West. American Geophysical Union, Fall Meeting 2018, Washington DC, 11 December 2018, ED11D-0752.</mixed-citation></ref></ref-list></back></article>