<?xml version="1.0" encoding="UTF-8"?><!DOCTYPE article  PUBLIC "-//NLM//DTD Journal Publishing DTD v3.0 20080202//EN" "http://dtd.nlm.nih.gov/publishing/3.0/journalpublishing3.dtd"><article xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink" dtd-version="3.0" xml:lang="en" article-type="research article"><front><journal-meta><journal-id journal-id-type="publisher-id">OJN</journal-id><journal-title-group><journal-title>Open Journal of Nursing</journal-title></journal-title-group><issn pub-type="epub">2162-5336</issn><publisher><publisher-name>Scientific Research Publishing</publisher-name></publisher></journal-meta><article-meta><article-id pub-id-type="doi">10.4236/ojn.2017.712100</article-id><article-id pub-id-type="publisher-id">OJN-81018</article-id><article-categories><subj-group subj-group-type="heading"><subject>Articles</subject></subj-group><subj-group subj-group-type="Discipline-v2"><subject>Medicine&amp;Healthcare</subject></subj-group></article-categories><title-group><article-title>
 
 
  The Relationship between Understaffing of Nurses and Patient Safety in Hospitals—A Literature Review with Thematic Analysis
 
</article-title></title-group><contrib-group><contrib contrib-type="author" xlink:type="simple"><name name-style="western"><surname>Malin</surname><given-names>Knutsen Glette</given-names></name><xref ref-type="aff" rid="aff1"><sup>1</sup></xref></contrib><contrib contrib-type="author" xlink:type="simple"><name name-style="western"><surname>Karina</surname><given-names>Aase</given-names></name><xref ref-type="aff" rid="aff2"><sup>2</sup></xref></contrib><contrib contrib-type="author" xlink:type="simple"><name name-style="western"><surname>Siri</surname><given-names>Wiig</given-names></name><xref ref-type="aff" rid="aff2"><sup>2</sup></xref></contrib></contrib-group><aff id="aff2"><addr-line>Faculty of health Sciences, University of Stavanger, Stavanger, Norway</addr-line></aff><aff id="aff1"><addr-line>Department of Health, Western Norway University of Applied Sciences, Haugesund, Norway</addr-line></aff><pub-date pub-type="epub"><day>07</day><month>12</month><year>2017</year></pub-date><volume>07</volume><issue>12</issue><fpage>1387</fpage><lpage>1429</lpage><history><date date-type="received"><day>5,</day>	<month>October</month>	<year>2017</year></date><date date-type="rev-recd"><day>10,</day>	<month>December</month>	<year>2017</year>	</date><date date-type="accepted"><day>13,</day>	<month>December</month>	<year>2017</year></date></history><permissions><copyright-statement>&#169; Copyright  2014 by authors and Scientific Research Publishing Inc. </copyright-statement><copyright-year>2014</copyright-year><license><license-p>This work is licensed under the Creative Commons Attribution International License (CC BY). http://creativecommons.org/licenses/by/4.0/</license-p></license></permissions><abstract><p>
 
 
   
   <b>Introduction: </b>
   Patient safety and the occurrence of adverse events in hospitals is a topic which has been widely addressed over the last decades. In that respect, there has been an increasing interest in the effect of working conditions on patient safety, and whether understaffing and adverse events are correlated. This paper therefore reports results from a study of under
   - 
   staffing of nurses understood as a lack of nurses available to conduct the tasks required of them. This implies that nurses are forced to ignore or postpone important tasks, thereby compromising patient safety. <b>Purpose:</b> The purpose of the study is to increase the knowledge of understaffing of hospital nurses, and the consequences that understaffing may have on patient safety. <b>Methods:</b> A literature search of the databases Chinal, Medline, Cochrane library, Isi Web of Science and Academic Search premiere was conducted in the period January 2014 to February, 2016. <b>Results:</b> Results are categorized into two main themes and four subthemes. The first main theme describes the direct relationship between understaffing and patient safety. Poor staffing increases the risk of mortality, and adverse conditions such as pressure ulcers, deep vein thrombosis and hospital-related infections. The second main theme relates to the indirect implications of understaffing for patient safety. These implications pertain to the lack of time that nurses could give each patient, limitations in the quality of nursing, and challenges in safe medication administration. <b>Conclusions: </b>The study documents the relationship between understaffing of nurses and adverse events in hospitals, revealingthat understaffing of nurses is a risk factor for hospitalized patients. 
  
 
</p></abstract><kwd-group><kwd>Understaffing</kwd><kwd> Patient Safety</kwd><kwd> Adverse Events</kwd><kwd> Mortality</kwd><kwd> Patient Harm</kwd></kwd-group></article-meta></front><body><sec id="s1"><title>1. Introduction</title><sec id="s1_1"><title>1.1. Incidence of Adverse Events</title><p>The incidence of patients experiencing adverse events while hospitalized has proven a major problem [<xref ref-type="bibr" rid="scirp.81018-ref1">1</xref>] [<xref ref-type="bibr" rid="scirp.81018-ref2">2</xref>] [<xref ref-type="bibr" rid="scirp.81018-ref3">3</xref>] [<xref ref-type="bibr" rid="scirp.81018-ref4">4</xref>] . Reports and research on the occurrences of adverse events shows that a great number of patients experience adverse events while receiving health care all over the world [<xref ref-type="bibr" rid="scirp.81018-ref4">4</xref>] [<xref ref-type="bibr" rid="scirp.81018-ref5">5</xref>] [<xref ref-type="bibr" rid="scirp.81018-ref6">6</xref>] [<xref ref-type="bibr" rid="scirp.81018-ref7">7</xref>] . An international study conducted in England, Germany and the USA, with focus on medication errors, found that the prevalence of adverse event related to drugs alone ranged from 3.22% to 5.64% of the patients hospitalized in 2006 [<xref ref-type="bibr" rid="scirp.81018-ref8">8</xref>] . There have been a greater media and research attention to patient safety and the effect of staffing on the occurrence of adverse events [<xref ref-type="bibr" rid="scirp.81018-ref9">9</xref>] [<xref ref-type="bibr" rid="scirp.81018-ref10">10</xref>] [<xref ref-type="bibr" rid="scirp.81018-ref11">11</xref>] . International media have previously described patients being exposed to adverse events with severe consequences, of which many are caused by poor staffing [<xref ref-type="bibr" rid="scirp.81018-ref12">12</xref>] [<xref ref-type="bibr" rid="scirp.81018-ref13">13</xref>] . There are several studies on this topic, but with varying foci such as mortality, adverse events related to specific patient groups and specific patient diagnosis, medication errors, patient satisfaction, work environment and economic perspectives [<xref ref-type="bibr" rid="scirp.81018-ref14">14</xref>] [<xref ref-type="bibr" rid="scirp.81018-ref15">15</xref>] [<xref ref-type="bibr" rid="scirp.81018-ref16">16</xref>] [<xref ref-type="bibr" rid="scirp.81018-ref17">17</xref>] [<xref ref-type="bibr" rid="scirp.81018-ref18">18</xref>] . Evidence in this area has also previously been synthesized in literature reviews [<xref ref-type="bibr" rid="scirp.81018-ref19">19</xref>] [<xref ref-type="bibr" rid="scirp.81018-ref20">20</xref>] [<xref ref-type="bibr" rid="scirp.81018-ref21">21</xref>] , but no reviews have documented the direct and indirect relationship between understaffing of nurses and patient safety.</p></sec><sec id="s1_2"><title>1.2. Patient Safety</title><p>The US Department of Health &amp; Human Services defines patient safety as “the freedom of accidental or preventable injuries produced by medical care”. Patient safety measures are defined as interventions or work intended to reduce the occurrence of preventable events [<xref ref-type="bibr" rid="scirp.81018-ref22">22</xref>] . Several different bodies ensure patient safety in hospitals. Health care providers have a responsibility to perform professionally appropriate health care. Each hospital must ensure that the health care providers work under conditions that promote safe practice, for example with appropriate equipment, adequate staffing and safe routines. Additionally, both health care workers and the health care system must comply with the law, professional standards and procedures to provide safe healthcare services [<xref ref-type="bibr" rid="scirp.81018-ref23">23</xref>] .</p></sec><sec id="s1_3"><title>1.3. Legislation</title><p>The requirement of professional responsibility is the most central demand in the legislation when it comes to safety practice in the healthcare service. The demand of professional responsibility is according to law, a shared responsibility, were the health workers are responsible for their own actions, and the healthcare system is responsible for the environment these actions are conducted in. Further on health workers, in this case nurses are obligated to perform safe healthcare through the nature of their public authorization, which is an arrangement built on common national and international demands in the nursing education and is a requirement to legally assess nursing tasks [<xref ref-type="bibr" rid="scirp.81018-ref23">23</xref>] .</p></sec><sec id="s1_4"><title>1.4. The Nurse’s Role in Patient Safety</title><p>The International Council of Nursing states that nurses carry a responsibility to perform safe practice and to obtain the knowledge to do so. They are obligated to provide holistic patient care, which include giving the patients and families accurate information and education. Nurses are expected to participate in maintaining safe working conditions and safe practice [<xref ref-type="bibr" rid="scirp.81018-ref24">24</xref>] .</p></sec><sec id="s1_5"><title>1.5. Purpose of the Study</title><p>The purpose of this study is to increase the knowledge of understaffing amongst nurses in hospitals, and the possible consequences of understaffing for patient safety. More specifically the study examines understaffing as a risk factor for hospitalized patients. The following research question has guided the study: How can understaffing amongst nurses in hospitals affect patient safety?</p></sec><sec id="s1_6"><title>1.6. Clarification of Terms</title><p>Understaffing is a term with numerous connotations and meanings. In the literature, understaffing is used, for instance, in reference to high patient-nurse ratios, heavy workload, large patient load, nursing hours per patient, and high bed occupancy. The common denominator of these definitions are that understaffing is a lack of personnel, in this case nurses, to conduct their required tasks. In this study, the term understaffing is defined as “a disparity between load of responsibilities/tasks and the possibility to conduct them in a professional manner”.</p><p>A nurse is in this study, defined as a person with a bachelor education in nursing, having regular contact with patients admitted to a hospital ward.</p></sec></sec><sec id="s2"><title>2. Methods</title><p>A literature review was conducted using a systematic approach as described by Bettany-Saltikov [<xref ref-type="bibr" rid="scirp.81018-ref25">25</xref>] . Methods on thematically retrieving, synthesizing and analyzing the data was conducted following the method of Dixon-Woods et al. [<xref ref-type="bibr" rid="scirp.81018-ref26">26</xref>] and Pope [<xref ref-type="bibr" rid="scirp.81018-ref27">27</xref>] . The review was reported using PRISMA guidelines and the PRISMA float diagram [<xref ref-type="bibr" rid="scirp.81018-ref28">28</xref>] .</p><sec id="s2_1"><title>2.1. Inclusion and Exclusion Criteria</title><p>To be included in the review, articles had to be written in English, they had to have a clear qualitative or quantitative design, and they had to have been published between1997 and 2016. Eligible studies had to be concerned with nurses with patient contact, working in hospitals, some form of understaffing (excessive workload, high patient-to-nurse ratio, number of working hours per patient) and patient safety.</p></sec><sec id="s2_2"><title>2.2. Identification of Studies</title><p>The search strategy was developed in accordance with Bettany-Saltikov [<xref ref-type="bibr" rid="scirp.81018-ref25">25</xref>] methodology for literature reviews in nursing. Literature searches were conducted in the Cinahl, Medline, Isi Web of Science, Cochrane Library and Academic Search Premiere databases between early February and the end of January 2016. All databases focus on health and social science. In addition, secondary searches were made based on the reference lists of included articles, and a manual search was conducted in selected journals of specific interests such as BMC Health Services Research [<xref ref-type="bibr" rid="scirp.81018-ref29">29</xref>] . The terms used when searching the databases included understaffing, nurse, patient safety, lack of nurses, staffing levels, manning levels, downsizing, short-staffed, short-handed, inadequate staffing, insufficient staffing, workload, patient outcome, patient security, patient mortality and adverse events. Terms which disclosed understaffing (lack of nurses, staffing levels, manning levels) were combined with terms disclosing nurses (healthcare worker, RN, trained nurse) and hospital (healthcare facility, Hospital ward, medical institution) in a systematic manner which included all possible combinations of these words. (A comprehensive list of the searches done in each database can be found in Attachment 1)</p></sec><sec id="s2_3"><title>2.3. Quality Assessment of Studies</title><p>All included studies were of quantitative study design, and underwent a quality assessment according to the Cochrane Quality Assessment Tool for Quantitative Studies [<xref ref-type="bibr" rid="scirp.81018-ref30">30</xref>] . This assessment tool was developed for use in public health, and is suitable for quality assessment in most areas of public health [<xref ref-type="bibr" rid="scirp.81018-ref30">30</xref>] . The quality assessment involves grading six areas in each study (selection bias, study design, confounders, blinding, data collecting methods, withdrawals and drop-outs). Each domain is given points (1 - 3 points) based on relevant questions. Based on the total ranking score, each study was graded as having strong, moderate or weak quality. Studies graded “moderate” or “strong” were included in the review. (Attachment 2 gives a full overview of the quality assessment.)</p></sec><sec id="s2_4"><title>2.4. Data Extraction</title><p>We used a predesigned form for data extraction according to Dixon-Woods et al. [<xref ref-type="bibr" rid="scirp.81018-ref26">26</xref>] , describing the study design, quality, objectives, data material/partici- pants, main findings, and the location of the study. First author retracted data from all included studies under detailed supervision from the research group. Recognition of themes was made through “identification of prominent or recurrent results in the articles analyzed, to produce an account of evidence” [<xref ref-type="bibr" rid="scirp.81018-ref26">26</xref>] .</p></sec><sec id="s2_5"><title>2.5. Selection of Studies</title><p>The database searches identified 2847 records. Six articles were found through secondary searches and recommendations from researchers in the field of patient safety. Of the 2609 articles screened, 2495 were excluded. The remaining 114 articles were read and evaluated in full text (see <xref ref-type="fig" rid="fig1">Figure 1</xref>, The PRISMA 2009 Flow diagram if article selection process). Following the full text evaluation, 43 articles were included based on the inclusion and exclusion criteria. 10 of these</p><p>studies did not pass the quality assessment, and were excluded, resulting in a total of 33 quantitative studies being included in the current review. First author performed the searches and undertook the screening of titles and abstracts against inclusion criteria, with supervision from the research group. First researcher then undertook the read-through of selected full-text articles. Where there was question of inclusion eligibility, the research group was consulted independently to assess full-text item suitability.</p></sec><sec id="s2_6"><title>2.6. Analysis</title><p>The results of the included studies were analyzed through Thematic analysis which involve finding prominent or recurrent themes in included articles, and gather the themes under suitable headings [<xref ref-type="bibr" rid="scirp.81018-ref26">26</xref>] . The predesigned form was used to organize the main results of the included studies, allowing the researcher to detect patterns or recurring subjects in the literature. The recurring subjects were then organized in to sub-themes and themes.</p></sec><sec id="s2_7"><title>2.7. Consent</title><p>Data represented in this study emerged from already published peer reviewed articles. Data collection did not involve human subjects, and a written informed consent has therefore not been obtained.</p></sec><sec id="s2_8"><title>2.8. Availability of Data and Materials</title><p>All the data supporting the conclusions can be found in <xref ref-type="table" rid="table1">Table 1</xref> with information on the included studies. Information on the search words, combinations and results, can be found in the supplementary file 2 Database search report.</p></sec></sec><sec id="s3"><title>3. Results</title><p>This literature review synthesizes evidence about the effects of the understaffing of nurses on patient safety in hospitals. Thirty-three studies of moderate-to-strong quality were included, from which two main themes and four subthemes emerged.</p><p>Twenty-three studies [<xref ref-type="bibr" rid="scirp.81018-ref14">14</xref>] [<xref ref-type="bibr" rid="scirp.81018-ref16">16</xref>] [<xref ref-type="bibr" rid="scirp.81018-ref18">18</xref>] [<xref ref-type="bibr" rid="scirp.81018-ref31">31</xref>] - [<xref ref-type="bibr" rid="scirp.81018-ref50">50</xref>] found a direct relationship between understaffing and patient safety. Eight of these studies focused on mortality in patients admitted to a hospital. Fourteen studies described how patients were directly harmed as a consequence of understaffing in the form of infections, pressure ulcers and other adverse hospital events. One study described the relationship between nurse staffing and length of hospital stays.</p><p>Six studies [<xref ref-type="bibr" rid="scirp.81018-ref51">51</xref>] - [<xref ref-type="bibr" rid="scirp.81018-ref56">56</xref>] found an indirect relationship between understaffing and patient safety, focusing on important nursing tasks that were left undone due to nurses lack of time to carry them out. Two of these studies showed how understaffing affected the administration of medication.</p><p>One study [<xref ref-type="bibr" rid="scirp.81018-ref17">17</xref>] investigated both direct and indirect consequences, and three studies [<xref ref-type="bibr" rid="scirp.81018-ref57">57</xref>] [<xref ref-type="bibr" rid="scirp.81018-ref58">58</xref>] [<xref ref-type="bibr" rid="scirp.81018-ref59">59</xref>] found weak or no association between understaffing and patient safety.</p><sec id="s3_1"><title>3.1. Study Characteristics</title><p>Of the thirty-three studies included, there are nine cohort studies, thirteen cross-sectional studies, two correlation studies, one case control study, three retrospective observational studies, two retrospective longitudinal studies and one with a four-stage sampling design. It was not possible to categorize the methods used in two of the studies. (<xref ref-type="table" rid="table1">Table 1</xref> lists the articles and study characteristics). All of the studies investigated the relationship between understaffing of nurses working in hospitals and patient safety.</p><table-wrap-group id="1"><label><xref ref-type="table" rid="table1">Table 1</xref></label><caption><title> Overview of included articles</title></caption><table-wrap id="1_1"><table><tbody><thead><tr><th align="center" valign="middle" >Author study design quality country</th><th align="center" valign="middle" >Aim</th><th align="center" valign="middle" >Informants/data material</th><th align="center" valign="middle" >Main findings</th><th align="center" valign="middle" >Themes</th></tr></thead><tr><td align="center" valign="middle" >Aiken et al. (2014) [<xref ref-type="bibr" rid="scirp.81018-ref31">31</xref>] Retrospective observational study Moderate Belgium, England, Finland, Ireland, The Netherlands, Norway, Spain, Sweden, Switzerland</td><td align="center" valign="middle" >To determine whether differences in patient to nurse ratio and nurses educational qualifications were associated with hospital mortality after common surgical procedures.</td><td align="center" valign="middle" >Discharge data from 422.730 patients 50 years or older, who underwent surgery and survey of 26.516 Nurses</td><td align="center" valign="middle" >Each increase of one patient per nurse is associated with a 7% increase in the likelihood of a surgical patient dying within 30 days of admission, whereas each 10% increase in the percent of bachelor degree nurses in hospital is associated with a 7% decrease in this likelihood.</td><td align="center" valign="middle" >Direct consequences: mortality</td></tr><tr><td align="center" valign="middle" >Aiken et al. (2002) [<xref ref-type="bibr" rid="scirp.81018-ref14">14</xref>] Cross-sectional analyses Moderate USA, California</td><td align="center" valign="middle" >To determine the association between the patient-to-nurse ratio and patient mortality, failure to rescue among surgical patients, and factors related to nurse retention</td><td align="center" valign="middle" >Data from 10.184 staff nurses surveyed, 232.342 general, orthopedic and vascular surgery patients and administrative data from 168 general hospitals</td><td align="center" valign="middle" >Each additional patient per nurse was associated with a 7% increase in the likelihood of dying within 30 days of admission and a 7% increase in the odds of failure to rescue (Patient and hospital characteristics were adjusted).</td><td align="center" valign="middle" >Direct consequences: mortality</td></tr><tr><td align="center" valign="middle" >Al-Kandari &amp; Thomas (2009) [<xref ref-type="bibr" rid="scirp.81018-ref51">51</xref>] Cross-sectional survey Moderate Kuwait</td><td align="center" valign="middle" >To identify the perceived adverse patient outcomes related to nurse’ workload</td><td align="center" valign="middle" >780 registered nurses working in medical and surgical wards of five governmental hospitals in Kuwait.</td><td align="center" valign="middle" >Five major perceived adverse patient outcomes: 1) complaints from patient and their families, 2) patient received a late dose or missed a dose of medication, 3) discovering pressure ulcer, 4) wound infection and 5) infection on the site of IV cannula.</td><td align="center" valign="middle" >Indirect consequences: Poor basic quality of care</td></tr><tr><td align="center" valign="middle" >Amarvadi et al. (2000) [<xref ref-type="bibr" rid="scirp.81018-ref32">32</xref>] Observational cohort study Moderate USA</td><td align="center" valign="middle" >To determine if having a 1:2 rather than a 1:3 or more night-time nurse-to-patient ratio (NNPR) in the intensive care unit affected hospital mortality</td><td align="center" valign="middle" >Adult patients who had esophageal resection in Maryland 1994 to 1998 (366 patients)</td><td align="center" valign="middle" >There were no significant difference in the risk of in-hospital mortality between patients with a NNRP &gt; 1:2 (Night time nurse-to-patient ratio &gt; one nurse caring for one or two patients) and those with a NNRP &lt; 1:2 (Nurse caring for three or more patients) Patients with a NNPR &lt; 1:2 had an increased risk of reintubation, pneumonia and sepsis</td><td align="center" valign="middle" >Direct consequences: Patient harm</td></tr><tr><td align="center" valign="middle" >Carthonet al. (2012) [<xref ref-type="bibr" rid="scirp.81018-ref33">33</xref>] Cross-sectional survey Moderate USA, Pennsylvania</td><td align="center" valign="middle" >To determine the association between nurse staffing and postsurgical outcomes for older black adults, including 30-day mortality and failure to rescue.</td><td align="center" valign="middle" >548.397 patients ages 65 and older, undergoing general, orthopedic or vascular surgery</td><td align="center" valign="middle" >One additional patient in the average nurse’s workload was associated with higher odds of 30 day mortality for all patients. Odds of failure to rescue were higher for patient in settings with poorer nursing staffing</td><td align="center" valign="middle" >Direct consequences: Mortality</td></tr><tr><td align="center" valign="middle" >Cho et al. (2015) [<xref ref-type="bibr" rid="scirp.81018-ref52">52</xref>] Cross sectional study Moderate South Korea</td><td align="center" valign="middle" >To examine the relationship of nurse staffing levels and work environment with patient adverse events</td><td align="center" valign="middle" >4864 nurses Data from 58 hospitals Discharge data from 113,426 Patients</td><td align="center" valign="middle" >A large number of patients per nurse were significantly associated with a greater incidence of administration of wrong medication or dose, pressure ulcers and patient falls with injury.</td><td align="center" valign="middle" >Indirect consequences: medication errors and patient harm.</td></tr></tbody></table></table-wrap><table-wrap id="1_2"><table><tbody><thead><tr><th align="center" valign="middle" >Cho et al. (2003) [<xref ref-type="bibr" rid="scirp.81018-ref16">16</xref>] can’t tell Moderate USA</th><th align="center" valign="middle" >Examine the effects of nurse staffing on adverse events, morbidity, mortality and medical costs</th><th align="center" valign="middle" >Existing databases from 232 acute care hospitals and 124,204 patients in 20 surgical diagnosis-related groups. 857 patients with hemorrhagic and ischemic stroke who were admitted to ICUs of 185 Korean hospitals</th><th align="center" valign="middle" >An increase of one hour worked by registered nurses per patient per day was associated with an 8.9% decrease in the odds of pneumonia. Hospitals with higher ICU staffing were more likely to fully provide basic care. Better staffing were associated with lower in-hospital and 30-day mortality. 30-day mortality had a more distinct decrease with lower staffing rates</th><th align="center" valign="middle" >Direct consequence: Patient harm</th></tr></thead><tr><td align="center" valign="middle" >Cho &amp; Yun (2009) [<xref ref-type="bibr" rid="scirp.81018-ref34">34</xref>] Cross-sectional design including a survey Moderate Korea</td><td align="center" valign="middle" >To examine differences in provision of basic nursing care and in-hospital and 30-day mortality by nurse staffing of ICUs and general wards among acute stroke patients</td><td align="center" valign="middle" >ICUs of 185 Korean hospitals</td><td align="center" valign="middle" >Better staffing was associated with lower in-hospital and 30-day mortality. 30-day mortality had a more distinct decrease with lower staffing rates.</td><td align="center" valign="middle" >Direct consequences: Mortality</td></tr><tr><td align="center" valign="middle" >Cimotti et al. (2006) [<xref ref-type="bibr" rid="scirp.81018-ref35">35</xref>] Prospective cohort study Strong Canada</td><td align="center" valign="middle" >To examine the association between registered nurse staffing and healthcare associated bloodstream infections in infants in neonatal intensive care units.</td><td align="center" valign="middle" >2675 infants admitted to the NICUs for more than 48 hours and all registered nurse who worked in the same NICUs during the study</td><td align="center" valign="middle" >A greater number of hours of care provided by RNs in NICU 2 were associated with decreased risk of bloodstream infections. Number of hours of care provided by RNs in NICU 1 was not associated with bloodstream infections.</td><td align="center" valign="middle" >Direct consequences: Patient harm</td></tr><tr><td align="center" valign="middle" >de Cordova et al. (2014) [<xref ref-type="bibr" rid="scirp.81018-ref37">37</xref>] Longitudinal study Moderate USA</td><td align="center" valign="middle" >Examine the association between night nurse staffing and work force characteristics and length of stay (LOS)</td><td align="center" valign="middle" >Monthly observations of administrative data from 138 acute care hospitals (N = 8243)</td><td align="center" valign="middle" >Higher night staffing and higher skill mix were associated with reduced LOS</td><td align="center" valign="middle" >Direct consequences: Patient harm</td></tr><tr><td align="center" valign="middle" >Daud-Gallotti et al. (2012) [<xref ref-type="bibr" rid="scirp.81018-ref36">36</xref>] Prospective cohort study Strong Brazil</td><td align="center" valign="middle" >Evaluate the role of nursing workload in the occurrence of HAI in medical intensive care units.</td><td align="center" valign="middle" >195 ICU-Patients</td><td align="center" valign="middle" >22% developed HAI (healthcare-associated infection). Average NAS (Nursing activity score) and average proportion of non-compliance with NPC (Non-compliance to the nurse’s patient-care plans) were significantly higher in HAI patients. Only excessive nursing workload and severity of the patient’s clinical condition remained as risk factors to HAI.</td><td align="center" valign="middle" >Direct consequences: Patient harm</td></tr><tr><td align="center" valign="middle" >Duffield et al. (2011) [<xref ref-type="bibr" rid="scirp.81018-ref17">17</xref>] Longitudinal, Retrospective study combined with a cross-sectional study Moderate Australia</td><td align="center" valign="middle" >Examine the relationship of nurse staffing and workload, in the context of the work environment, to patient outcomes.</td><td align="center" valign="middle" >Data from the public hospital system. Five years of data for 80 public hospitals</td><td align="center" valign="middle" >Increased RN staff were associated with significantly decreased rates of pressure ulcer, pneumonia, and sepsis, GI bleeding, physiological/metabolic derangement, pulmonary failure, sepsis and shock. There were several nursing-tasks left undone or postponed as a consequence of heavy workload.</td><td align="center" valign="middle" >Direct and indirect consequences: Poor basic care quality and patient harm</td></tr></tbody></table></table-wrap><table-wrap id="1_3"><table><tbody><thead><tr><th align="center" valign="middle" >Hugonnet et al. (2007) [<xref ref-type="bibr" rid="scirp.81018-ref18">18</xref>] Prospective observational cohort study Moderate Switzerland</th><th align="center" valign="middle" >To determine whether low nurse-to-patient ratio increases risk for VAP and whether this effect is similar for early-onset and late-onset VAP.</th><th align="center" valign="middle" >2470 ICU patients. Variable such as number of patients and nurses on duty, patient characteristics, nurse training levels</th><th align="center" valign="middle" >262 VAP episodes were diagnosed in 22.3% of the patients who underwent mechanical ventilation The median daily nurse-to-patient ratio was 1.9 over the study period. High nurse-to-patient ratio was associated with a decreased risk for late-onset VAP, but there was no association with early-onset VAP</th><th align="center" valign="middle" >Direct consequences: patient harm</th></tr></thead><tr><td align="center" valign="middle" >Holden et al. (2011) [<xref ref-type="bibr" rid="scirp.81018-ref53">53</xref>] Cross-sectional survey Moderate. USA</td><td align="center" valign="middle" >To measure each of the three types of workload experienced by nurses and to assess whether and which measures of workload were related to three important outcomes.</td><td align="center" valign="middle" >99 nurses from two hospitals</td><td align="center" valign="middle" >The task level measure of mental workload related to interruptions, divided intention, and being rushed was associated with burnout and medication error. Workload was not significantly associated with any other outcomes</td><td align="center" valign="middle" >Indirect consequences: Medication errors</td></tr><tr><td align="center" valign="middle" >Kiekkas et al. (2008) [<xref ref-type="bibr" rid="scirp.81018-ref38">38</xref>] Observational prospective study (cohort study) Moderate Greece</td><td align="center" valign="middle" >Investigate differences in mortality of intensive care unit (ICU) patient according to the ratio between total patient care demands and nurse staffing</td><td align="center" valign="middle" >396 patients admitted in the general ICU of an academic, tertiary care, Greek Hospital from October 2005 to September 2006</td><td align="center" valign="middle" >Mortality on all patients increased from 22% in the low-exposure group (&lt;21.9) Therapeutic Intervention Scoring System (TISS-28) point per nurse-workload measurement) to 25.0% in the medium exposure group (21.9 - 25.8 TISS-28 point per nurse) and reached up to 28.8% in the high-exposure group (&gt;25.8 TISS-28 score per nurse) Despite these increases, differences in adjusted ICU mortality among groups did not reach statistical significance</td><td align="center" valign="middle" >Direct consequences patient mortality</td></tr><tr><td align="center" valign="middle" >Kovner et al. (2002) [<xref ref-type="bibr" rid="scirp.81018-ref50">50</xref>] Cross-sectional descriptive study Moderate USA</td><td align="center" valign="middle" >To examine the impact of nurse staffing on selected adverse events hypothesized to be sensitive to nursing care</td><td align="center" valign="middle" >Nurse staffing data from 1990-1996 from the American hospital association annual survey of hospitals. Includes 530 - 570 hospitals for each of the years from 1990-1996, with 187 hospitals having data for all seven years.</td><td align="center" valign="middle" >Registered nurse (RN) hours per patient per day were inversely related to all adverse events, but was significant (P &lt; 0.05) only for pneumonia</td><td align="center" valign="middle" >Direct consequences: Patient harm</td></tr><tr><td align="center" valign="middle" >Liang et al. (2012) [<xref ref-type="bibr" rid="scirp.81018-ref39">39</xref>] Longitudinal, cross-sectional Study Strong Taiwan</td><td align="center" valign="middle" >To explore the effects of nurse staffing ratios on patient mortality in acute care hospitals.</td><td align="center" valign="middle" >108 hospital nursing units in 32 of Taiwan’s’ 441 accredited Western medicine district/regional hospitals and medical centers. Data from a survey on hospital nurse staffing levels and patient outcomes.</td><td align="center" valign="middle" >The risk of incidence of death seemed to be higher in high patient-nurse ratio groups than in low patient-nurse ratio groups. The risk of incidence of death in high healthcare workforce-bed ratio groups was much lower than in low healthcare workforce-bed ratio groups.</td><td align="center" valign="middle" >Direct consequences: Patient harm</td></tr></tbody></table></table-wrap><table-wrap id="1_4"><table><tbody><thead><tr><th align="center" valign="middle" >Needleman et al. (2002) [<xref ref-type="bibr" rid="scirp.81018-ref40">40</xref>] Cohort study Strong USA</th><th align="center" valign="middle" >Not reported</th><th align="center" valign="middle" >Administrative data from 1997 for 799 hospitals in 11 states, covering 5,075,969 discharges of medical patients and 1,104,659 surgical patients</th><th align="center" valign="middle" >A higher proportion of hours of care per day provided by registered nurses and a greater number of hours of care provided per day were associated with a shorter length of stay and lower rates of urinary tract infections and upper gastrointestinal bleeding. A higher hour of care provided by RNs was associated with a lower rate of pneumonia, shock or cardiac arrest, and “failure to rescue”.</th><th align="center" valign="middle" >Direct consequences: Patient harm</th></tr></thead><tr><td align="center" valign="middle" >Person et al. (2004) [<xref ref-type="bibr" rid="scirp.81018-ref41">41</xref>] Cross-sectional analysis Moderate USA</td><td align="center" valign="middle" >Assess the association of nurse staffing with in-hospital mortality for patients with acute myocardial infarction.</td><td align="center" valign="middle" >118,940 patients admitted with AMI in 6668 hospitals in the US</td><td align="center" valign="middle" >Patients treated in environments with higher RN staffing were less likely to die in-hospital. Patients treated in environments with higher LPN (licensed practical nurse) staffing were more likely to die in-hospital. (The data was adjusted with patient demographic, clinical characteristics, treatment, hospital volume, technology index teaching and urban status)</td><td align="center" valign="middle" >Direct consequences: Mortality</td></tr><tr><td align="center" valign="middle" >Potter et al. (2003) [<xref ref-type="bibr" rid="scirp.81018-ref54">54</xref>] Moderate Prospective, correlation study USA</td><td align="center" valign="middle" >To determine baseline values of patient outcome measures and the relationship of nurse staffing to patient outcomes.</td><td align="center" valign="middle" >32 acute inpatient care units 3418 patients</td><td align="center" valign="middle" >The percentage of RN hours was negatively correlated with patient pain and self-care ability, and positive correlated with patient health status and five out of seven measures of post-discharge patient satisfaction.</td><td align="center" valign="middle" >Indirect consequences: Poor quality of basic care</td></tr><tr><td align="center" valign="middle" >Rogowski et al. (2013) [<xref ref-type="bibr" rid="scirp.81018-ref42">42</xref>] Retrospective cohort study Strong USA</td><td align="center" valign="middle" >To study the adequacy of Neo Natal Intensive Care Unit (NICU) nurse staffing in the United States using national guidelines and analyze its association with infant outcomes</td><td align="center" valign="middle" >newborn very low-birth-weight infants discharged from the NICUs in 2008 (n = 5771) and 2009 (n = 5630) All registered nurses with infant assignments.</td><td align="center" valign="middle" >The percentage of Very Low Birth Weight (VLBW) infants with hospital associated infections were 16.4% in 2008 and 13.9% in 2009. Relative to the guidelines, on average, hospitals understaffed 47% of all NICU infants in 2008 and 31% in 2009. A 1 standard deviation increase in the amount of a nurse per infant to meet the guidelines was associated with higher odds of infection in 2008 and 2009</td><td align="center" valign="middle" >Direct consequences: Patient harm</td></tr><tr><td align="center" valign="middle" >Sasicbay-Akkadecbanunt et al. (2003) [<xref ref-type="bibr" rid="scirp.81018-ref43">43</xref>] cross-sectional study Moderate UK</td><td align="center" valign="middle" >To examine the association between in-hospital mortality and four nurse staffing variables.</td><td align="center" valign="middle" >Data of 2531 patients admitted to seven medical units and 10 surgical units of a 2300 bed university hospital.</td><td align="center" valign="middle" >The nurse-to-patient ratio was statistically correlated with in-hospital mortality. Nurse-to-patient ratio had an individual effect on in-hospital mortality. The ratio of total staff to patients was the best predictor of in hospital mortality among four staffing variables. There was not a significant relationship between in hospital mortality and the proportion of RNs to total nursing staff, the mean years of RN experience and the percentage of bachelor degree prepared nurses.</td><td align="center" valign="middle" >Direct consequences: Mortality</td></tr></tbody></table></table-wrap><table-wrap id="1_5"><table><tbody><thead><tr><th align="center" valign="middle" >Schreuders et al. (2014) [<xref ref-type="bibr" rid="scirp.81018-ref57">57</xref>] Retrospective longitudinal study Moderate Australia</th><th align="center" valign="middle" >To compare characteristics of hospitalizations with and without complications and examine the impact of nurse staffing on inpatient complications</th><th align="center" valign="middle" >Administrative data from Western Australian Department of Health (2001-2008)</th><th align="center" valign="middle" >Nurse staffing levels were not associated with decreased patient complication risks.</th><th align="center" valign="middle" >No significant relationship</th></tr></thead><tr><td align="center" valign="middle" >Seynaeve et al. (2011) [<xref ref-type="bibr" rid="scirp.81018-ref56">56</xref>] Cross-sectional survey. Moderate USA, Antwerp</td><td align="center" valign="middle" >To examine the association between in-hospital mortality and four nurse staffing variables.</td><td align="center" valign="middle" >Data of 2531 patients admitted to seven medical units and 10 surgical units of a 2300 bed university hospital.</td><td align="center" valign="middle" >Statistically correlated with in-hospital mortality. Nurse-to-patient ratio had an individual effect on in-hospital mortality. The ratio of total staff to patients was the best predictor of in hospital mortality among four staffing variables. There was not a significant relationship between in hospital mortality and the proportion of RNs to total nursing staff, the mean years of RN experience and the percentage of bachelor degree prepared nurses.</td><td align="center" valign="middle" >Direct consequences: Mortality</td></tr><tr><td align="center" valign="middle" >Shuldham et al. (2008) [<xref ref-type="bibr" rid="scirp.81018-ref58">58</xref>] Retrospective case control study Strong UK</td><td align="center" valign="middle" >To explore the relationship between nurse staffing characteristics and patient outcomes.</td><td align="center" valign="middle" >All patients, included day cases, who were admitted at two hospitals as an in-patient over 12 months</td><td align="center" valign="middle" >Weak association between nurse staffing and the majority of the outcomes in the lower dependency category wards. The Incidence Rate Ratio (IRR) for falls, GI bleeds, sepsis and Deep Vein Thrombosis (DVT) were reduced where nursing hour per patient day increased, but the numbers were not statistical significant. When adding bank hours (extra staff from the hospital), in addition to the permanent staff, only the result of pressure sores and DVT reached statistical significance.</td><td align="center" valign="middle" >No statistical significance. Indirect consequences: Patient harm</td></tr><tr><td align="center" valign="middle" >Stone et al. (2007) [<xref ref-type="bibr" rid="scirp.81018-ref44">44</xref>] Observational study Moderate USA</td><td align="center" valign="middle" >To examine effects of a comprehensive set of working condition on elderly patient safety outcome in intensive care units.</td><td align="center" valign="middle" >To examine effects of a comprehensive set of working condition on elderly patient safety outcome in intensive care units.</td><td align="center" valign="middle" >Units with higher staffing levels had lower incidence of CLBSI (central line blood stream infections), ventilator-associated pneumonia, 30-day mortality and pressure ulcer.</td><td align="center" valign="middle" >Direct consequences: Patient harm.</td></tr><tr><td align="center" valign="middle" >Tarnow-Mordi et al. (2000) [<xref ref-type="bibr" rid="scirp.81018-ref45">45</xref>] Retrospective observational analyses Strong UK</td><td align="center" valign="middle" >Not reported</td><td align="center" valign="middle" >1050 admissions in the ICU</td><td align="center" valign="middle" >Adjusted mortality were more than two times higher in patients exposed to low ICU workload. After exclusion of measures of nursing requirement, adjusted mortality increased with the ratio of occupied to appropriately staffed beds during each patient’s stay.</td><td align="center" valign="middle" >Direct consequence: Mortality</td></tr></tbody></table></table-wrap><table-wrap id="1_6"><table><tbody><thead><tr><th align="center" valign="middle" >Twigg et al. (2011) [<xref ref-type="bibr" rid="scirp.81018-ref47">47</xref>] Retrospective cohort study and Time-series study Strong Australia</th><th align="center" valign="middle" >To determine the impact of implementing the NHPPD (Nursing hours per patient day) staffing method on 14 nursing-sensitive outcomes</th><th align="center" valign="middle" >236,453 patients from three adult hospital wards. Changes in nursing-sensitive outcomes were examined comparing the pre NHPPD-implementation-stage 0 and the post implementation-stage 2.</th><th align="center" valign="middle" >Significant decreases in the rates of nine out of fourteen nursing-sensitive outcomes when examining hospital-level data following implementation of NHPPD: Mortality, central nervous system complications, pressure ulcers, deep vein thrombosis, sepsis, ulcer/gastritis/upper gastrointestinal bleed, shock/cardiac arrest, pneumonia and average length of stay.</th><th align="center" valign="middle" >Direct consequences: Patient harm and patient mortality</th></tr></thead><tr><td align="center" valign="middle" >Unruh (2003) [<xref ref-type="bibr" rid="scirp.81018-ref48">48</xref>] Cohort study Moderate USA</td><td align="center" valign="middle" >To examine the changes in licensed nursing staff and assess the relationship of nursing staff with patient adverse events in hospitals</td><td align="center" valign="middle" >A convenience sample of all Pennsylvania, acute-care, hospitals, 1991 to 1997</td><td align="center" valign="middle" >Greater incidence of nearly all adverse events occurred in hospitals with fewer licensed nurses. There were a higher incidence of pressure ulcer and pneumonia in hospitals with a lower proportion of licensed nurses</td><td align="center" valign="middle" >Direct consequences: Patient harm</td></tr><tr><td align="center" valign="middle" >Van den Heedeet al. (2009) [<xref ref-type="bibr" rid="scirp.81018-ref59">59</xref>] Cross-sectional analysis Moderate Belgium</td><td align="center" valign="middle" >Examine the association between nurse staffing levels and 10 different patient outcomes potentially sensitive to nursing care</td><td align="center" valign="middle" >Data from 115 Belgian acute hospitals for the year 2003.</td><td align="center" valign="middle" >No significant relationship between acuity adjusted NHPPD (Nursing hours per patient day), proportions of registered nurses with at least a Bachelors’ degree and 10 patient outcomes.</td><td align="center" valign="middle" >No significant relationship</td></tr><tr><td align="center" valign="middle" >Weissman et al. (2007) [<xref ref-type="bibr" rid="scirp.81018-ref49">49</xref>] Can’t tell Moderate USA</td><td align="center" valign="middle" >To determine the relationship between peak hospital workload and rates of adverse events.</td><td align="center" valign="middle" >A random sample of 24,676 patients discharged from the medical/surgical services at 4 US hospitals</td><td align="center" valign="middle" >Admissions and patients per nurse were significantly related to the likelihood of an adverse event. For example 0.1% increase in the patient-to-nurse ratio led to a 28% increase in the adverse event rate in one urban teaching hospital with high occupancy. These results were only significant for this hospital. There were no significant results in the other three hospitals in the study.</td><td align="center" valign="middle" >Direct consequences patient harm</td></tr><tr><td align="center" valign="middle" >Yang (2003) [<xref ref-type="bibr" rid="scirp.81018-ref46">46</xref>] Correlation study Moderate Taiwan</td><td align="center" valign="middle" >To examine the effect of nurse staffing variables-daily average hours of care, ratio of RNs to average patients’ census, workload, and skill mix on patient outcomes as measured by five adverse occurrences</td><td align="center" valign="middle" >Data from hospital statistics. Sample composed of 347 FTE (fulltime equivalent) RNs distributed in 21 units with 793 beds ranging from 34 to 48 with a mean of 37.76 beds, as well as 29,424 inpatients.</td><td align="center" valign="middle" >Significantly positive correlation between daily average hours of care and urinary tract infections (r = 0.523, p &lt; 0.05) and patient falls (r = 0.456, p &lt; 0.05). Ratio of RNs to patient census negatively correlated to patient falls, urinary tract infections and complaints. Positive and significant relationship between workload and respiratory tract infections, patients’ complaints and their acuity level.</td><td align="center" valign="middle" >Direct consequences: Patient harm</td></tr><tr><td align="center" valign="middle" >Zhu et al. (2012) [<xref ref-type="bibr" rid="scirp.81018-ref55">55</xref>] Four stage sampling design Moderate China</td><td align="center" valign="middle" >To examine the relationship between nurse staffing and patient outcomes in hospitals in mainland China.</td><td align="center" valign="middle" >7802 nurses and 5430 patients</td><td align="center" valign="middle" >Higher levels of nurses per patient had a statistically significant positive effect on the conduct of important nurse related tasks, and therefore on patient outcomes.</td><td align="center" valign="middle" >Indirect consequences: poor quality of basic care.</td></tr></tbody></table></table-wrap></table-wrap-group></sec><sec id="s3_2"><title>3.2. Thematic Analysis</title><p>The thematic analysis [<xref ref-type="bibr" rid="scirp.81018-ref26">26</xref>] [<xref ref-type="bibr" rid="scirp.81018-ref60">60</xref>] generated two main themes and two subthemes concerning understaffing and consequences for patient safety.</p><p>Theme 1: Direct consequences</p><p>Twenty-three studies reported that understaffing had direct and severe consequences for patients.</p><p>1A) Patient harm</p><p>Sixteen of the twenty-three studies examined several adverse events as a direct consequence of understaffing among nurses working in hospitals [<xref ref-type="bibr" rid="scirp.81018-ref16">16</xref>] [<xref ref-type="bibr" rid="scirp.81018-ref17">17</xref>] [<xref ref-type="bibr" rid="scirp.81018-ref18">18</xref>] [<xref ref-type="bibr" rid="scirp.81018-ref32">32</xref>] [<xref ref-type="bibr" rid="scirp.81018-ref35">35</xref>] [<xref ref-type="bibr" rid="scirp.81018-ref36">36</xref>] [<xref ref-type="bibr" rid="scirp.81018-ref37">37</xref>] [<xref ref-type="bibr" rid="scirp.81018-ref40">40</xref>] [<xref ref-type="bibr" rid="scirp.81018-ref42">42</xref>] [<xref ref-type="bibr" rid="scirp.81018-ref44">44</xref>] [<xref ref-type="bibr" rid="scirp.81018-ref46">46</xref>] [<xref ref-type="bibr" rid="scirp.81018-ref47">47</xref>] [<xref ref-type="bibr" rid="scirp.81018-ref48">48</xref>] [<xref ref-type="bibr" rid="scirp.81018-ref49">49</xref>] [<xref ref-type="bibr" rid="scirp.81018-ref50">50</xref>] [<xref ref-type="bibr" rid="scirp.81018-ref58">58</xref>] . Several studies found that understaffing increased the patient’s risk of contracting pneumonia, urinary tract infections or other hospital-related infections [<xref ref-type="bibr" rid="scirp.81018-ref16">16</xref>] [<xref ref-type="bibr" rid="scirp.81018-ref17">17</xref>] [<xref ref-type="bibr" rid="scirp.81018-ref35">35</xref>] [<xref ref-type="bibr" rid="scirp.81018-ref36">36</xref>] [<xref ref-type="bibr" rid="scirp.81018-ref40">40</xref>] [<xref ref-type="bibr" rid="scirp.81018-ref42">42</xref>] [<xref ref-type="bibr" rid="scirp.81018-ref44">44</xref>] [<xref ref-type="bibr" rid="scirp.81018-ref47">47</xref>] [<xref ref-type="bibr" rid="scirp.81018-ref48">48</xref>] [<xref ref-type="bibr" rid="scirp.81018-ref49">49</xref>] [<xref ref-type="bibr" rid="scirp.81018-ref50">50</xref>] . Cho and colleagues [<xref ref-type="bibr" rid="scirp.81018-ref16">16</xref>] found that one extra hour of work by registered nurses per patient per day was associated with a 8.9% decrease in the odds of the patients getting pneumonia. Cimiotti et al. [<xref ref-type="bibr" rid="scirp.81018-ref35">35</xref>] also found a negative association between number of hours of care provided by registered nurses and the risk of bloodstream infections in infants receiving neonatal care, but only in one of the two neonatal intensive care units (NICU) investigated. The authors attribute these differences in results to variation in the hospitals’ and infants’ characteristics.</p><p>Along with hospital-related infections, the incidence of pressure wounds was also a problem that, according to the literature, increased in proportion to understaffing [<xref ref-type="bibr" rid="scirp.81018-ref17">17</xref>] [<xref ref-type="bibr" rid="scirp.81018-ref44">44</xref>] [<xref ref-type="bibr" rid="scirp.81018-ref47">47</xref>] [<xref ref-type="bibr" rid="scirp.81018-ref48">48</xref>] [<xref ref-type="bibr" rid="scirp.81018-ref52">52</xref>] . Twigg et al. [<xref ref-type="bibr" rid="scirp.81018-ref47">47</xref>] reported that surgical patients experienced significant lower pressure wounds rates in all three hospitals investigated, after those hospitals adopted a new staffing method called Nursing Hour Per Patient Day (NHPPD). This staffing method significantly increased the staffing levels. In other words, increased staffing levels led to decreased rates of pressure wounds. A lower proportion of licensed nurses working was associated with a higher incidence of pressure wounds in the hospital investigated by Unruh [<xref ref-type="bibr" rid="scirp.81018-ref48">48</xref>] . Van den Heede et al. [<xref ref-type="bibr" rid="scirp.81018-ref59">59</xref>] in contrast, did not find any significant relationship between acuity adjusted nursing hours per patient day and pressure wounds. Kovner et al. [<xref ref-type="bibr" rid="scirp.81018-ref60">60</xref>] also investigated the direct consequences of understaffing but did not find any significance between registered nurses (RNs) hour per patient per day and three types of adverse events: pulmonary compromise, urinary tract infection, and thrombosis. Other studies, however, found a significant relationship between understaffing and both thrombosis and shock/cardiac arrest [<xref ref-type="bibr" rid="scirp.81018-ref17">17</xref>] [<xref ref-type="bibr" rid="scirp.81018-ref40">40</xref>] [<xref ref-type="bibr" rid="scirp.81018-ref47">47</xref>] . Schreuders et al. [<xref ref-type="bibr" rid="scirp.81018-ref57">57</xref>] found an inconsistency in the relationship between understaffing and patient complications such as urinary tract infections and surgical wound infections related to patient characteristics such as age, gender and health status. The direction of the association between nurse staffing and inpatient complications was not consistent for different patient complications.</p><p>Lastly, one study found that higher night staffing reduced the prevalence of extended hospital stays [<xref ref-type="bibr" rid="scirp.81018-ref37">37</xref>] .</p><p>2B) Patient mortality</p><p>Nine studies found understaffing to affect mortality in hospitalized patients. Both surgical and medical patients were investigated [<xref ref-type="bibr" rid="scirp.81018-ref14">14</xref>] [<xref ref-type="bibr" rid="scirp.81018-ref31">31</xref>] [<xref ref-type="bibr" rid="scirp.81018-ref33">33</xref>] [<xref ref-type="bibr" rid="scirp.81018-ref34">34</xref>] [<xref ref-type="bibr" rid="scirp.81018-ref38">38</xref>] [<xref ref-type="bibr" rid="scirp.81018-ref39">39</xref>] [<xref ref-type="bibr" rid="scirp.81018-ref41">41</xref>] [<xref ref-type="bibr" rid="scirp.81018-ref43">43</xref>] [<xref ref-type="bibr" rid="scirp.81018-ref45">45</xref>] .</p><p>In one observational study from 2014 and one cross-sectional analysis from 2002 Aiken and colleagues found that after adjusting for patient and hospital characteristics, each additional patient per nurse was associated with a 7% increase in the likelihood of dying within 30 days after admission. Carthon et al. [<xref ref-type="bibr" rid="scirp.81018-ref33">33</xref>] reported similar results, finding that an increase of one patient in the nurse’s patient load increased the occurrence of deaths in hospitalized patients. They also found that older surgical patients were affected more by understaffing than other groups of patients. Older surgical patients had a poorer post-surgical course when their nurses had a heavier workload, including a higher chance of death and failed resuscitation [<xref ref-type="bibr" rid="scirp.81018-ref33">33</xref>] . One study investigated mortality in the form of failure to rescue (from an adverse health-related event), finding that understaffing had a negative effect also in this area [<xref ref-type="bibr" rid="scirp.81018-ref33">33</xref>] .</p><p>In two studies, no correlation between mortality and understaffing were found [<xref ref-type="bibr" rid="scirp.81018-ref38">38</xref>] [<xref ref-type="bibr" rid="scirp.81018-ref68">68</xref>] . Amarvadi and colleagues [<xref ref-type="bibr" rid="scirp.81018-ref32">32</xref>] investigated the understaffing-mortality problem by taking a closer look at the night shift. They used the night time nurse-to-patient ratio to calculate staffing, and found no increased risk of dying in hospital whether one night nurse cared for one or two patients or for three or more. Kiekkas et al. [<xref ref-type="bibr" rid="scirp.81018-ref38">38</xref>] found that an increased workload among the nurses did affect hospital mortality, but these numbers did not reach statistical significance.</p><p>Theme 2: Indirect consequences</p><p>Six studies found understaffing to affect patient safety, not by causing the patient direct harm but by increasing the risk for direct harm later on.</p><p>2A) Poor quality of basic care.</p><p>Four studies concluded that understaffing led to poor quality of care [<xref ref-type="bibr" rid="scirp.81018-ref15">15</xref>] [<xref ref-type="bibr" rid="scirp.81018-ref17">17</xref>] [<xref ref-type="bibr" rid="scirp.81018-ref54">54</xref>] [<xref ref-type="bibr" rid="scirp.81018-ref69">69</xref>] . Several nursing tasks, such as patient communication, skin care, oral hygiene, documentation, responding to patient alarms and mobilization were left undone, postponed or not prioritized due to lack of time, as a consequence of understaffing of nurses [<xref ref-type="bibr" rid="scirp.81018-ref17">17</xref>] [<xref ref-type="bibr" rid="scirp.81018-ref55">55</xref>] . Zhu and colleagues [<xref ref-type="bibr" rid="scirp.81018-ref55">55</xref>] found that 30.39% of nurses reported that the care that they delivered was of moderate or poor quality. Duffield et al. [<xref ref-type="bibr" rid="scirp.81018-ref17">17</xref>] found in their longitudinal study that patient communication was not prioritized in as many as 39.5% of the shifts. Skin care and back rubs (24.0%) and oral hygiene (19.3%) were also frequently reported undone. Patients’ ability for self-care and patient satisfaction was also negatively associated with understaffing [<xref ref-type="bibr" rid="scirp.81018-ref15">15</xref>] [<xref ref-type="bibr" rid="scirp.81018-ref54">54</xref>] .</p><p>2B) Errors in administration of medication.</p><p>Two studies focused on understaffing and medication errors [<xref ref-type="bibr" rid="scirp.81018-ref53">53</xref>] [<xref ref-type="bibr" rid="scirp.81018-ref56">56</xref>] , reporting that heavy nursing workload, interruptions and being rushed increased the risk of adverse events in conjunction with the administration of medication. Several other studies found an association between understaffing and medication errors, even when this was not their focus [<xref ref-type="bibr" rid="scirp.81018-ref15">15</xref>] [<xref ref-type="bibr" rid="scirp.81018-ref17">17</xref>] [<xref ref-type="bibr" rid="scirp.81018-ref52">52</xref>] . These findings showed that understaffing led to missed or late doses of medication, poor pain management resulting from difficulties in administering needed pain medication, and medication errors in general [<xref ref-type="bibr" rid="scirp.81018-ref15">15</xref>] [<xref ref-type="bibr" rid="scirp.81018-ref17">17</xref>] .</p></sec></sec><sec id="s4"><title>4. Discussion</title><p>The results of the literature review indicate that understaffing of nurses have a negative effect on patient safety. The negative effect is reflected through various consequences for the patient’s wellbeing, health, and outcome of hospitalization. Even though the results of this study are divided into themes and subthemes, all four themes are interrelated. The literature review shows that the indirect consequences of understaffing (lack of managing important nursing task such as measuring vital signs, patient mobilization and responding to patient alarms) may cause severe and direct consequences (thrombosis, patient falls and mortality) later in the course of treatment.</p><p>A relationship between the themes can for example be seen in relation to pressure wounds; hygiene measures, skincare, and mobilization are measures intended to prevent pressure wounds [<xref ref-type="bibr" rid="scirp.81018-ref61">61</xref>] , and were not always undertaken by the nurses due to understaffing [<xref ref-type="bibr" rid="scirp.81018-ref17">17</xref>] [<xref ref-type="bibr" rid="scirp.81018-ref55">55</xref>] . Pressure wounds will, according to the literature, increase the patient’s risk of contracting wound infections that prove fatal [<xref ref-type="bibr" rid="scirp.81018-ref61">61</xref>] . Further, poor quality of care may also prevent nurses from discovering other severe conditions like thrombosis, pneumonia and wound infections.</p><p>Failure to provide basic care as a consequence of understaffing affects patients in ways that might not always be apparent. Tasks that do not seem as important as other tasks are constantly postponed or left undone, placing the patient at risk of severe harm.</p><p>As previously stated, the results of the studies reviewed here indicate that understaffing affects patient safety in numerous negative ways. However, several other aspects must be taken in consideration before formulating conclusions.</p><p>Many of the studies of mortality were conducted in intensive care units (ICU) [<xref ref-type="bibr" rid="scirp.81018-ref16">16</xref>] [<xref ref-type="bibr" rid="scirp.81018-ref32">32</xref>] [<xref ref-type="bibr" rid="scirp.81018-ref34">34</xref>] [<xref ref-type="bibr" rid="scirp.81018-ref36">36</xref>] . Considering that a patient admitted to an ICU in most cases will be in an acute phase of the disease [<xref ref-type="bibr" rid="scirp.81018-ref62">62</xref>] , will mean they are in greater risk of any adverse event regardless of staffing. At the same time, these patients may be more vulnerable to lack of surveillance, medication errors, and lack of basic care as described in Theme 2-Indirect consequences. Hence, these patients might actually be more affected by staffing levels than others.</p><p>Several of the studies describe surgical patients in conjunction with both patient mortality and patient harm [<xref ref-type="bibr" rid="scirp.81018-ref14">14</xref>] [<xref ref-type="bibr" rid="scirp.81018-ref31">31</xref>] [<xref ref-type="bibr" rid="scirp.81018-ref33">33</xref>] . Surgical procedures are associated with certain risks like pneumonia, infections, pressure ulcers, and even mortality. These are adverse events described in Theme 1―Direct consequences, that may occur regardless of understaffing [<xref ref-type="bibr" rid="scirp.81018-ref63">63</xref>] . Since these studies are limited to surgical patients, this needs to be considered when interpreting the results. The same applies to studies of elderly patients, who are also at an increased risk of being affected by adverse events of both Theme 1―Direct consequences, and Theme 2-Indirect consequences. As Carthon et al. [<xref ref-type="bibr" rid="scirp.81018-ref33">33</xref>] argue studies of the elderly are valuable in this setting, having found that elderly patients are even more affected by understaffing than other patient groups.</p><p>Furthermore, the data used in most of the included studies were based singularly on administrative data (hospital statistics, discharge data, staffing data) and/or surveys. This type of data brings a few challenges. There will always be a chance of underreporting of adverse events, which may lead to unreliable results [<xref ref-type="bibr" rid="scirp.81018-ref48">48</xref>] [<xref ref-type="bibr" rid="scirp.81018-ref49">49</xref>] . ICD Codes (international identification of disease) are in most health facilities used to register diseases and health issues [<xref ref-type="bibr" rid="scirp.81018-ref64">64</xref>] . Errors in these coding’s, or lack of accuracy in coding, may affect the results, especially if the errors are systematic [<xref ref-type="bibr" rid="scirp.81018-ref68">68</xref>] . In some cases patient characteristics may be limited because of lack of clinical information in administrative databases [<xref ref-type="bibr" rid="scirp.81018-ref16">16</xref>] [<xref ref-type="bibr" rid="scirp.81018-ref46">46</xref>] . The same is true for staffing characteristics [<xref ref-type="bibr" rid="scirp.81018-ref50">50</xref>] . On the other hand, this type of data material will provide a great deal of information and include a larger sample of patient and nurses, which is important to create a wide picture of the problem understaffing and patient safety.</p><p>Another important aspect is that most of the studies are conducted in high income countries all over the world. There is one study from Brazil [<xref ref-type="bibr" rid="scirp.81018-ref61">61</xref>] and two studies from Taiwan [<xref ref-type="bibr" rid="scirp.81018-ref39">39</xref>] [<xref ref-type="bibr" rid="scirp.81018-ref46">46</xref>] which are countries that are borderline in form of developed and developing countries. This must be taken in consideration when reading the results. Even though the remaining studies were conducted in high income countries such as USA, Australia, UK, and Belgium it is important to keep in mind that staffing levels, hospital characteristics, and nurse characteristics will vary. Nurses’ responsibilities may also differ, and therefore workload may differ in both quantity and type, which may make direct comparisons of the result of these studies difficult.</p><p>Lastly, the health personnel in this study include Registered Nurses (RNs), even though some of the studies also included data regarding other health personnel, the results of this study do not consider the effect of other health personnel on patient safety. It is known that for example nursing assistants and licensed practical nurses (LPN) are huge contributors to the basic care given in hospital wards. Further, there are also research results showing that wards with low RN-rates in the skill mix compared with other groups such as LPNs has less fortune outcomes when it comes to adverse events [<xref ref-type="bibr" rid="scirp.81018-ref31">31</xref>] [<xref ref-type="bibr" rid="scirp.81018-ref37">37</xref>] . Another factor included in some of the understaffing research, which have not been included in this study, is work environment, which has also shown to affect patient safety [<xref ref-type="bibr" rid="scirp.81018-ref14">14</xref>] [<xref ref-type="bibr" rid="scirp.81018-ref52">52</xref>] .</p><p>Kane and colleagues systematic literature review from 2007 [<xref ref-type="bibr" rid="scirp.81018-ref19">19</xref>] also showed an association between understaffing of nurses and several adverse events (mortality and nurse sensitive patient outcomes). This study included factors such as the effect of LPNs, nurses’ experience, education and staffing policy. Other literature reviews have concentrated on specific adverse advents such as medication errors [<xref ref-type="bibr" rid="scirp.81018-ref20">20</xref>] , mortality [<xref ref-type="bibr" rid="scirp.81018-ref65">65</xref>] or healthcare associated infections [<xref ref-type="bibr" rid="scirp.81018-ref21">21</xref>] or special settings like critical or intensive care [<xref ref-type="bibr" rid="scirp.81018-ref66">66</xref>] [<xref ref-type="bibr" rid="scirp.81018-ref67">67</xref>] . The effect poor quality care such as absence of skincare, mobilization or oral hygiene (indirect consequences) may have on patient outcomes in form of direct consequences (infections, pressure wounds, mortality) have not been explored in previous literature reviews.</p><p>As showed, there may be characteristics about the patient, the hospital, and the ward, that affect the results of the studies included in our literature review. Understaffing may be one of the contributing factors that affect patient safety, but other factors may most likely also be contributing</p>Methodological Limitations<p>There are possible limitations in our literature review and several confounders need to be addressed when reviewing the results. Manual searches could have been conducted in other additional journals, by using citation tracking, and by assessing unpublished literature to increase chances of finding further relevant items. To test for additional findings, we tested new search terms and search words, without identifying new items meeting our inclusion criteria. The study was conducted according to strict methodological guidelines for literature reviews [<xref ref-type="bibr" rid="scirp.81018-ref68">68</xref>] and we believe that the majority of publications of relevance for our topic and research question are identified, although relevant publications could be missed by traditional database searches due to not being indexed in such a way as to allow identification within the parameters of such a search [<xref ref-type="bibr" rid="scirp.81018-ref69">69</xref>] .</p><p>Secondly we excluded studies of other health facilities than hospitals, and other health personnel than nurses, and also publications on discharge outcomes, in accordance with the exclusion criteria. This may have led to the loss of valuable information about understaffing and patient safety.</p><p>Thirdly, the thematic analysis method used in this review is more commonly used in studies with singularly qualitative designs, or with mixed methods [<xref ref-type="bibr" rid="scirp.81018-ref27">27</xref>] . Yet, early in the search process, this method proved to be the right one, as the themes emerged from the data. Meta-analysis, and so-called pooling of data―more commonly used in reviews of quantitative data―could not be used because of the wide range of results and study designs [<xref ref-type="bibr" rid="scirp.81018-ref27">27</xref>] .</p><p>Finally, some general risks of bias will always be present in literature reviews. Studies with valuable results, but not written in English, are excluded because of the exclusion criteria [<xref ref-type="bibr" rid="scirp.81018-ref25">25</xref>] . Furthermore, if the method of identifying relevant studies is not sensitive enough, there is always a risk of relevant studies being overlooked [<xref ref-type="bibr" rid="scirp.81018-ref70">70</xref>] . Bias may also occur during data retraction, if the same data is not retracted from each study [<xref ref-type="bibr" rid="scirp.81018-ref70">70</xref>] . Dixon-Woods et al. [<xref ref-type="bibr" rid="scirp.81018-ref26">26</xref>] mention some weaknesses with the use of thematic analysis. There can be a lack of transparency in the decisions made during the analysis process. To compensate, we have described the process in detail, showed examples in the tables to illustrate the findings, and demonstrated how the research group collaborated during the review process.</p></sec><sec id="s5"><title>5. Conclusion</title><p>The literature review documents that understaffing of nurses can affect patient safety negatively in both direct―(pressure wounds, infections, mortality) and indirect ways (poor documentation, failure to mobilize patients, lack of proper surveillance). The type of ward, hospital, patient group, and country in the included studies vary, but all studies show that too few nurses at the hospital wards give too little time to perform important nursing tasks, which may have consequences of varying degrees of severity for the patient. The current results show that numerous characteristics and factors (e.g. type of hospital, ward, and patient characteristics) are important when investigating the relationship between understaffing and patient safety. All of these characteristics and factors must be considered when reading the results of this and other studies. More research on the topic is needed, as the articles included in this study mention the lack of research, especially in the Nordic countries. Lastly, no clear and direct causal relationship between understaffing and patient safety is found, but the findings leads us to the conclusion that understaffing of nurses constitutes a risk factor for hospitalized patients and could be one threat to patient safety.</p></sec><sec id="s6"><title>Availability of Data and Materials</title><p>All the data supporting the conclusions can be found in <xref ref-type="table" rid="table1">Table 1</xref> with information on the included studies. Information on the search words, combinations and results, can be found in the supplementary file Database search report.</p></sec><sec id="s7"><title>Ethics</title><p>The results of this systematic review emerged from analysis of data extracted from already published peer reviewed articles. The study does not involve any data collection involving human subjects and does not require any consent or ethical approval.</p></sec><sec id="s8"><title>Competing Interests</title><p>None.</p></sec><sec id="s9"><title>Author’s Contributions</title><p>All members of the research group participated in the conception and design of the study as well as in analysis and interpretation of data. The first researcher undertook acquisition of data and the drafting of the manuscript. All authors were involved in critically revising the manuscript for important intellectual content and all read and approved the final manuscript.</p></sec><sec id="s10"><title>Cite this paper</title><p>Glette, M.K., Aase, K. and Wiig, S. (2017) The Relationship between Understaffing of Nurses and Patient Safety in Hospitals―A Literature Review with Thematic Analysis. Open Journal of Nursing, 7, 1387-1429. https://doi.org/10.4236/ojn.2017.712100</p></sec><sec id="s11"><title>Attachment 1: Database Search Report</title><p>Search words:</p><p>1) Understaffing</p><p>2) Lack of nurses</p><p>3) Staffing levels</p><p>4) Under manning</p><p>5) Manning levels</p><p>6) Downsizing</p><p>7) Short-staffed</p><p>8) Short-handed</p><p>9) Inadequate in number of workers</p><p>10) Inadequate staffing</p><p>11) Insufficient number of personnel</p><p>12) Workload</p><p>13) Nurses</p><p>14) Health worker</p><p>15) RN (registered nurse)</p><p>16) Employee</p><p>17) Trained nurse</p><p>18) Patient safety</p><p>19) Patient</p><p>20) Outcome</p><p>21) Patient security</p><p>22) Patient mortality</p><p>23)Adverseevents</p><p>24) Hospital</p><p>25) Health care facilities</p><p>26) Hospital ward</p><p>27) Medical institution</p><p>Searches done in Chinal 04.02.14-</p><p>*Search word 4 (undermanning) didn’t give any results in any combinations. **Search word 5 (Manning levels) didn’t give any results in any combinations. ***Search word 6 (Downsizing) didn’t give any results in any combinations. ****Search word 8 (short-handed) didn’t give any results in any combinations.</p><p>Searches done in Medline―15.02.14</p><p>Searches done in ISI Web of science 31.03.14-</p><p>*Reduced the result to 7 hits, by checking of nursing and excluding case report, meeting and editorial. **Reduced the result to 280 hits, by checking of English, nursing and excluding Editorial, meeting and case report. ***Reduced the result to 34 hits by checking of nursing and English. ****Reduced the result to 36 hits by checking of nursing and English and excluding case report. *****Reduced the result to 5 by checking of nursing, English an exclude newsletter, editorial, reference material and case report.</p><p>Searches done in Cohrane library 29.04.14-</p><p>Searches done in Academic search premiere 31.04.14-</p><p>Searches done in Chinal December 2015-February 2016 (Year 2014-2015)</p></sec><sec id="s12"><title>Attachment 2: Quality Assessment of Included Studies</title><p>Fulltext Quality Assesement tool for quantitative studies: http://www.ephpp.ca/PDF/Quality%20Assessment%20Tool_2010_2.pdf</p><p>Fulltext Quality Assessment tool for quantitative studies dictionary: http://www.ephpp.ca/PDF/QADictionary_dec2009.pdf</p></sec></body><back><ref-list><title>References</title><ref id="scirp.81018-ref1"><label>1</label><mixed-citation publication-type="other" xlink:type="simple">Brennan, T.A., Leape, L.L., Laird, N.M., Hebert, L., Localio, A.R., Lawthers, A.G., Newhouse, J.P., Weiler, P.C. and Hiatt, H.H. (1991) Incidence of Adverse Events and Negligence in Hospitalized Patients. New England Journal of Medicine, 324, 370-376. https://doi.org/10.1056/NEJM199102073240604</mixed-citation></ref><ref id="scirp.81018-ref2"><label>2</label><mixed-citation publication-type="other" xlink:type="simple">Vincent, C., Neale, G. and Woloshynowych, M. (2001) Adverse Events in British Hospitals: Preliminary Retrospective Record Review. BMJ, 322, 517-519.</mixed-citation></ref><ref id="scirp.81018-ref3"><label>3</label><mixed-citation publication-type="other" xlink:type="simple">Donaldson, M.S., Kohn, L.T. and Corrigan, J. (2000) To Err Is Human: Building a Safer Health System. National Academy Press, Washington.</mixed-citation></ref><ref id="scirp.81018-ref4"><label>4</label><mixed-citation publication-type="other" xlink:type="simple">Baker, C.R., Norton, P.G., Flintoft, V., Blais, R., Brown, A., Cox, J., Etchells, E., Ghali, W.A., Hébert, P., Majumdar, S.R., O’Beirne, M., Palacios-Derflingher, L., Reid, R.J., Sheps, S. and Tamblyn, R. (2004) The Canadian Adverse Events Study: The Incidence of Adverse Events among Hospital Patients in Canada. CMAJ: Canadian Medical Association Journal, 170, 1678-1686. https://doi.org/10.1503/cmaj.1040498</mixed-citation></ref><ref id="scirp.81018-ref5"><label>5</label><mixed-citation publication-type="other" xlink:type="simple">de Vries, E.N., Ramrattan, M.A., Smorenburg, S.M., Gouma, D.J. and Boermeester, M.A. (2008) The Incidence and Nature of In-Hospital Adverse Events: A Systematic Review. Quality &amp; Safety in Health Care, 17, 216-223. https://doi.org/10.1136/qshc.2007.023622</mixed-citation></ref><ref id="scirp.81018-ref6"><label>6</label><mixed-citation publication-type="other" xlink:type="simple">Schioler, T., Lipczak, H., Pedersen, B.L., Mogensen, T.S., Bech, K.B., Stockmarr, A., Svenning, A.R. and Frolich, A. (2001) Incidence of Adverse Events in Hospitals. A Retrospective Study of Medical Records. Ugeskr Laeger, 163, 5370-5378.</mixed-citation></ref><ref id="scirp.81018-ref7"><label>7</label><mixed-citation publication-type="other" xlink:type="simple">Skjellanger, A.G., Deilk&amp;#229;s, E.T., S&amp;#248;rensen, R., Advocaat-Vedvik, J., Brudvik, M., Schreiner, M., Fredheim, N., Longva, K.W., Austdal, C., Lemser, M. and Nikolaisen, J. (2014) I trygge hender 24-7. 96.</mixed-citation></ref><ref id="scirp.81018-ref8"><label>8</label><mixed-citation publication-type="other" xlink:type="simple">Stausberg, J. (2014) International Prevalence of Adverse Drug Events in Hospitals: an Analysis of Routine Data from England, Germany, and the USA. BMC Health Services Research, 14, 125. https://doi.org/10.1186/1472-6963-14-125</mixed-citation></ref><ref id="scirp.81018-ref9"><label>9</label><mixed-citation publication-type="other" xlink:type="simple">Fisher, C. (2014) Nurses: Overworked and Understaffed on the Front Lines.  http://www.healthline.com/health-news/nurses-overworked-understaffed-070714</mixed-citation></ref><ref id="scirp.81018-ref10"><label>10</label><mixed-citation publication-type="other" xlink:type="simple">Johan, C. (2004) Underbemanning och stress risikerar pasientsaekerheten. www.ostrasmaland.se/NYHETER/Oskarshamn/underbemanning_och_stress_risikerar 
_patientsaekerheten</mixed-citation></ref><ref id="scirp.81018-ref11"><label>11</label><mixed-citation publication-type="other" xlink:type="simple">Mikkelsen, M., S&amp;#230;ther, A.S., Norman, M.G. and Kippernes, G.A. (2011) A-Hus ansatte varsler: Pasienter d&amp;#248;r i korridorene. http://www.vg.no/nyheter/innenriks/sykehus-norge/ahus-ansatte-varsler-pasienter-doer-i-korridorene/a/10072472/</mixed-citation></ref><ref id="scirp.81018-ref12"><label>12</label><mixed-citation publication-type="other" xlink:type="simple">Sandvik, S., Tomter, L. and Sporst&amp;#248;l, E. (2011) Unerbemanning Rammer Pasientene.  http://www.nrk.no/norge/_-underbemanning-rammer-pasientene-1.7835724</mixed-citation></ref><ref id="scirp.81018-ref13"><label>13</label><mixed-citation publication-type="other" xlink:type="simple">Triggle, N. (2013) Hospitals in England Told to Publish Staffing Levels.  http://www.bbc.com/news/health-24994016</mixed-citation></ref><ref id="scirp.81018-ref14"><label>14</label><mixed-citation publication-type="other" xlink:type="simple">Aiken, L.H., Clarke, S.P., Sloane, D.M., Sochalski, J. and Silber, J.H. (2002) Hospital nurse Staffing and Patient Mortality, Nurse Burnout, and Job Dissatisfaction. JAMA: Journal of the American Medical Association, 288, 1987-1993. https://doi.org/10.1001/jama.288.16.1987</mixed-citation></ref><ref id="scirp.81018-ref15"><label>15</label><mixed-citation publication-type="other" xlink:type="simple">Al-Kandari, F. and Thomas, D. (2009) Perceived Adverse Patient Outcomes Correlated to Nurses’ Workload in Medical and Surgical Wards of Selected Hospitals in Kuwait. Journal of Clinical Nursing, 18, 581-590. https://doi.org/10.1111/j.1365-2702.2008.02369.x</mixed-citation></ref><ref id="scirp.81018-ref16"><label>16</label><mixed-citation publication-type="other" xlink:type="simple">Cho, S., Ketefian, S., Barkauskas, V.H. and Smith, D.G. (2003) The Effects of Nurse Staffing on Adverse Events, Morbidity, Mortality, and Medical Costs. Nursing Research, 52, 71-79. https://doi.org/10.1097/00006199-200303000-00003</mixed-citation></ref><ref id="scirp.81018-ref17"><label>17</label><mixed-citation publication-type="other" xlink:type="simple">Duffield, C., Diers, D., O’Brien-Pallas, L., Aisbett, C., Roche, M., King, M. and Aisbett, K. (2011) Nursing Staffing, Nursing Workload, the Work Environment and Patient Outcomes. Applied Nursing Research, 24, 244-255. https://doi.org/10.1016/j.apnr.2009.12.004</mixed-citation></ref><ref id="scirp.81018-ref18"><label>18</label><mixed-citation publication-type="other" xlink:type="simple">Hugonnet, S., U&amp;#231;kay, I. and Pittet, D. (2007) Staffing Level: A Determinant of Late-Onset Ventilator-Associated Pneumonia. Critical Care, 11, R80. https://doi.org/10.1186/cc5974</mixed-citation></ref><ref id="scirp.81018-ref19"><label>19</label><mixed-citation publication-type="other" xlink:type="simple">Kane, R.L., Shamliyan, T., Mueller, C., Duval, S. and Wilt, T.J. (2007) Nurse Staffing and Quality of Patient Care. Evidence Report/Technology Assessment (Full Rep), Number 151, 1-115.</mixed-citation></ref><ref id="scirp.81018-ref20"><label>20</label><mixed-citation publication-type="other" xlink:type="simple">Blegen, M.A., Goode, C.J. and Reed, L. (1998) Nurse Staffing and Patient Outcomes. Nursing Research, 47, 43-50. https://doi.org/10.1097/00006199-199801000-00008</mixed-citation></ref><ref id="scirp.81018-ref21"><label>21</label><mixed-citation publication-type="other" xlink:type="simple">Weinstein, R.A., Stone, P.W., Pogorzelska, M., Kunches, L. and Hirschhorn, L.R. (2008) Hospital Staffing and Health Care-Associated Infections: A Systematic Review of the Literature. Clinical Infectious Diseases, 47, 937-944. https://doi.org/10.1086/591696</mixed-citation></ref><ref id="scirp.81018-ref22"><label>22</label><mixed-citation publication-type="other" xlink:type="simple">Agency for Healthcare Research and Quality (2014) Patient Safety Network, Glossary. http://psnet.ahrq.gov/glossary.aspx?indexLetter=P</mixed-citation></ref><ref id="scirp.81018-ref23"><label>23</label><mixed-citation publication-type="other" xlink:type="simple">Aase, K. (2010) Pasientsikkerhet- teori og praksis i helsevesenet. Universitesforlaget, Oslo, 317.</mixed-citation></ref><ref id="scirp.81018-ref24"><label>24</label><mixed-citation publication-type="other" xlink:type="simple">ICN (2012) The ICN Code of Ethics for Nurses. I.c.o. nurses, Editor, International Counsil of Nurses, Geneva.</mixed-citation></ref><ref id="scirp.81018-ref25"><label>25</label><mixed-citation publication-type="other" xlink:type="simple">Bettany-Saltikov, J. (2012) How to Do a Systematic Literature Review in Nursing A Step-By-Step Guide. Open University Press, Berkshire, 173.</mixed-citation></ref><ref id="scirp.81018-ref26"><label>26</label><mixed-citation publication-type="other" xlink:type="simple">Dixon-Woods, M., Agarwal, S., Jones, D., Young, B. and Sutton, A. (2005) Synthesising Qualitative and Quantitative Evidence: A Review of Possible Methods. Journal of Health Services Research &amp; Policy, 10, 45-53. https://doi.org/10.1177/135581960501000110</mixed-citation></ref><ref id="scirp.81018-ref27"><label>27</label><mixed-citation publication-type="other" xlink:type="simple">Pope, C., Popay J. and Mays, N. (2007) Synthesising Quantitative and Qualitative Health Research: A Guide to Methods. McGraw-Hill Education, New York.</mixed-citation></ref><ref id="scirp.81018-ref28"><label>28</label><mixed-citation publication-type="other" xlink:type="simple">PRISMA (2009) The Prisma Checklist.  http://www.prisma-statement.org/statement.htm</mixed-citation></ref><ref id="scirp.81018-ref29"><label>29</label><mixed-citation publication-type="other" xlink:type="simple">Biomed Central (2014) BMC Health Services Research.  http://www.biomedcentral.com/</mixed-citation></ref><ref id="scirp.81018-ref30"><label>30</label><mixed-citation publication-type="other" xlink:type="simple">Effective Public Health Practice Project (2009) Quality Assessment Tool for Quantitative Studies. http://www.ephpp.ca/tools.html</mixed-citation></ref><ref id="scirp.81018-ref31"><label>31</label><mixed-citation publication-type="other" xlink:type="simple">Aiken, L.H., Sloane, D.M., Bruyneel, L., Van den Heede, K., Griffiths, P., Busse, R., Diomidous, M.T., Kinnunen, M., Kózka, J., Lesaffre, M., McHugh, E., Moreno-Casbas, M.D., Rafferty, A.M., Schwendimann, R., Scott, P.A., Tishelman, C., van Achterberg, T. and Sermeus, W. (2014) Nurse Staffing and Education and Hospital Mortality in Nine European Countries: A Retrospective Observational Study. Lancet, 383, 1824-1830. https://doi.org/10.1016/S0140-6736(13)62631-8</mixed-citation></ref><ref id="scirp.81018-ref32"><label>32</label><mixed-citation publication-type="other" xlink:type="simple">Amaravadi, R.K., Dimick, J.B., Pronovost, P.J. and Lipsett, P.A. (2000) ICU Nurse-to-Patient Ratio Is Associated with Complications and Resource Use after Esophagectomy. Intensive Care Medicine, 26, 1857-1862. https://doi.org/10.1007/s001340000720</mixed-citation></ref><ref id="scirp.81018-ref33"><label>33</label><mixed-citation publication-type="other" xlink:type="simple">Carthon, J.M., Kutney-Lee, A., Jarrin, O., Sloane, D. and Aiken, L.H. (2012) Nurse staffing and Postsurgical Outcomes in Black Adults. Journal of the American Geriatrics Society, 60, 1078-1084. https://doi.org/10.1111/j.1532-5415.2012.03990.x</mixed-citation></ref><ref id="scirp.81018-ref34"><label>34</label><mixed-citation publication-type="other" xlink:type="simple">Cho, S.-H. and Yun, S.-C. (2009) Bed-to-Nurse Ratios, Provision of Basic Nursing Care, and In-Hospital and 30-Day Mortality among Acute Stroke Patients Admitted to an Intensive Care Unit: Cross-Sectional Analysis of Survey and Administrative Data. International Journal of Nursing Studies, 46, 1092-1101. https://doi.org/10.1016/j.ijnurstu.2009.02.001</mixed-citation></ref><ref id="scirp.81018-ref35"><label>35</label><mixed-citation publication-type="other" xlink:type="simple">Cimiotti, J.P., Haas, J., Saiman, L. and Larson, E.L. (2006) Impact of Staffing on Bloodstream Infections in the Neonatal Intensive Care Unit. Archives of Pediatrics &amp; Adolescent Medicine, 160, 832-836. https://doi.org/10.1001/archpedi.160.8.832</mixed-citation></ref><ref id="scirp.81018-ref36"><label>36</label><mixed-citation publication-type="other" xlink:type="simple">Daud-Gallotti, R.M., Costa, S.F., Guimar&amp;#227;es, T., Padilha, K.G., Inoue, E.N., Vasconcelos, T.N., Rodrigues, F.d.S.C., Barbosa, E.V., Figueiredo, W.B. and Levin, A.S. (2012) Nursing Workload as a Risk Factor for Healthcare Associated Infections in ICU: A Prospective Study. PloS One, 7, e52342. https://doi.org/10.1371/journal.pone.0052342</mixed-citation></ref><ref id="scirp.81018-ref37"><label>37</label><mixed-citation publication-type="other" xlink:type="simple">de Cordova, P.B., Phibbs, C.S., Schmitt, S.K. and Stone, P.W. (2014) Night and Day in the VA: Associations between Night Shift Staffing, Nurse Workforce Characteristics, and Length of Stay. Research in Nursing &amp; Health, 37, 90-97. https://doi.org/10.1002/nur.21582</mixed-citation></ref><ref id="scirp.81018-ref38"><label>38</label><mixed-citation publication-type="other" xlink:type="simple">Kiekkas, P., Sakellaropoulos, G.C., Brokalaki, H., Manolis, E., Samios, A., Skartsani, C. and Baltopoulos, G.I. (2008) Association between Nursing Workload and Mortality of Intensive Care Unit Patients. Journal of Nursing Scholarship, 40, 385-390. https://doi.org/10.1111/j.1547-5069.2008.00254.x</mixed-citation></ref><ref id="scirp.81018-ref39"><label>39</label><mixed-citation publication-type="other" xlink:type="simple">Liang, Y.-W., Tsay, S.-F. and Chen, W.-Y. (2012) Effects of Nurse Staffing Ratios on Patient Mortality in Taiwan Acute Care Hospitals: A Longitudinal Study. Journal of Nursing Research, 20, 1-8. https://doi.org/10.1097/JNR.0b013e3182466ddc</mixed-citation></ref><ref id="scirp.81018-ref40"><label>40</label><mixed-citation publication-type="other" xlink:type="simple">Needleman, J., Buerhaus, P., Mattke, S., Stewart, M. and Zelevinsky, K. (2002) Nurse-Staffing Levels and the Quality of Care in Hospitals. New England Journal of Medicine, 346, 1715-1722. https://doi.org/10.1056/NEJMsa012247</mixed-citation></ref><ref id="scirp.81018-ref41"><label>41</label><mixed-citation publication-type="other" xlink:type="simple">Person, S.D., Allison, J.J., Kiefe, C.I., Weaver, M.T., Williams, O.D., Centor, R.M. and Weissman, N.W. (2004) Nurse Staffing and Mortality for Medicare Patients with Acute Myocardial Infarction. Medical Care, 42, 4-12. https://doi.org/10.1097/01.mlr.0000102369.67404.b0</mixed-citation></ref><ref id="scirp.81018-ref42"><label>42</label><mixed-citation publication-type="other" xlink:type="simple">Rogowski, J.A., Staiger, D., Patrick, T., Horbar, J., Kenny, M. and Lake, E.T. (2013) Nurse Staffing and NICU Infection Rates. JAMA Pediatrics, 167, 444-450. https://doi.org/10.1001/jamapediatrics.2013.18</mixed-citation></ref><ref id="scirp.81018-ref43"><label>43</label><mixed-citation publication-type="other" xlink:type="simple">Sasichay-Akkadechanunt, T., Scalzi, C.C. and Jawad, A.F. (2003) The Relationship between Nurse Staffing and Patient Outcomes. Journal of Nursing Administration, 33, 478-485. https://doi.org/10.1097/00005110-200309000-00008</mixed-citation></ref><ref id="scirp.81018-ref44"><label>44</label><mixed-citation publication-type="other" xlink:type="simple">Stone, P.W., Mooney-Kane, C., Larson, E.L., Horan, T., Glance, L.G., Zwanziger, J. and Dick, A.W. (2007) Nurse Working Conditions and Patient Safety Outcomes. Medical Care, 45, 571-578. https://doi.org/10.1097/MLR.0b013e3180383667</mixed-citation></ref><ref id="scirp.81018-ref45"><label>45</label><mixed-citation publication-type="other" xlink:type="simple">Tarnow-Mordi, W., Hau, C., Warden, A. and Shearer, A. (2000) Hospital Mortality in Relation to Staff Workload: A 4-Year Study in an Adult Intensive-Care Unit. The Lancet, 356, 185-189. https://doi.org/10.1016/S0140-6736(00)02478-8</mixed-citation></ref><ref id="scirp.81018-ref46"><label>46</label><mixed-citation publication-type="other" xlink:type="simple">Yang, K.-P. (2003) Relationships between nurse Staffing and Patient Outcomes. Journal of Nursing Research, 11, 149-158. https://doi.org/10.1097/01.JNR.0000347631.87723.de</mixed-citation></ref><ref id="scirp.81018-ref47"><label>47</label><mixed-citation publication-type="other" xlink:type="simple">Twigg, D., Duffield, C., Bremner, A., Rapley, P. and Finn, J. (2011) The Impact of the Nursing Hours per Patient Day (NHPPD) Staffing Method on Patient Outcomes: A Retrospective Analysis of Patient and Staffing Data. International Journal of Nursing Studies, 48, 540-548. https://doi.org/10.1016/j.ijnurstu.2010.07.013</mixed-citation></ref><ref id="scirp.81018-ref48"><label>48</label><mixed-citation publication-type="other" xlink:type="simple">Unruh, L. (2003) Licensed Nurse Staffing and Adverse Events in Hospitals. Medical Care, 41, 142-152. https://doi.org/10.1097/00005650-200301000-00016</mixed-citation></ref><ref id="scirp.81018-ref49"><label>49</label><mixed-citation publication-type="other" xlink:type="simple">Weissman, J.S., Rothschild, J.M., Bendavid, E., Sprivulis, P., Cook, E.F., Evans, R.S., Kaganova, Y., Bender, M., David-Kasdan, J. and Haug, P. (2007) Hospital Workload and Adverse Events. Medical Care, 45, 448-455. https://doi.org/10.1097/01.mlr.0000257231.86368.09</mixed-citation></ref><ref id="scirp.81018-ref50"><label>50</label><mixed-citation publication-type="other" xlink:type="simple">Kovner, C., Jones, C., Zhan, C.L., Gergen, P.J. and Basu, J. (2002) Nurse Staffing and Postsurgical Adverse Events: An Analysis of Administrative Data from a Sample of U.S. Hospitals, 1990-1996. Health Services Research, 37, 611-629. https://doi.org/10.1111/1475-6773.00040</mixed-citation></ref><ref id="scirp.81018-ref51"><label>51</label><mixed-citation publication-type="other" xlink:type="simple">Al-Kandari, F. and Thomas, D. (2009) Perceived Adverse Patient Outcomes Correlated to Nurses’ Workload in Medical and Surgical Wards of Selected Hospitals in Kuwait. Journal of Clinical Nursing, 18, 581-590. https://doi.org/10.1111/j.1365-2702.2008.02369.x</mixed-citation></ref><ref id="scirp.81018-ref52"><label>52</label><mixed-citation publication-type="other" xlink:type="simple">Cho, E., Chin, D.L., Kim, S. and Hong, O. (2015) The Relationships of Nurse Staffing Level and Work Environment With Patient Adverse Events. Journal of Nursing Scholarship.</mixed-citation></ref><ref id="scirp.81018-ref53"><label>53</label><mixed-citation publication-type="other" xlink:type="simple">Holden, R.J., Scanlon, M.C., Patel, N.R., Kaushal, R., Escoto, K.H., Brown, R.L., Alper, S.J., Arnold, J.M., Shalaby, T.M., Murkowski, K. and Karsh, B.-T. (2011) A Human Factors Framework and Study of the Effect of Nursing Workload on Patient Safety and Employee Quality of Working Life. BMJ Quality &amp; Safety, 20, 15-24. https://doi.org/10.1136/bmjqs.2008.028381</mixed-citation></ref><ref id="scirp.81018-ref54"><label>54</label><mixed-citation publication-type="other" xlink:type="simple">Potter, P., Barr, N., McSweeney, M. and Sledge, J. (2003) Identifying Nurse Staffing and Patient Outcome Relationships: A Guide for Change in Care Delivery. Nursing Economic, 21, 158-166.</mixed-citation></ref><ref id="scirp.81018-ref55"><label>55</label><mixed-citation publication-type="other" xlink:type="simple">Zhu, X.W., You, L.M., Zheng, J., Liu, K., Fang, J.B., Hou, S.X., Lu, M.M., Lv, A.L., Ma, W.G. and Wang, H.H. (2012) Nurse Staffing Levels Make a Difference on Patient Outcomes: A Multisite Study in Chinese Hospitals. Journal of Nursing Scholarship, 44, 266-273. https://doi.org/10.1111/j.1547-5069.2012.01454.x</mixed-citation></ref><ref id="scirp.81018-ref56"><label>56</label><mixed-citation publication-type="other" xlink:type="simple">Seynaeve, S., Verbrugghe, W., Claes, B., Vandenplas, D., Reyntiens, D. and Jorens, P.G. (2011) Adverse Drug Events in Intensive Care Units: A Cross-Sectional Study of Prevalence and Risk Factors. American Journal of Critical Care, 20, e131-e140. https://doi.org/10.4037/ajcc2011818</mixed-citation></ref><ref id="scirp.81018-ref57"><label>57</label><mixed-citation publication-type="other" xlink:type="simple">Schreuders, L.W., Bremner, A.P., Geelhoed, E. and Finn, J. (2015) The Relationship between Nurse Staffing and Inpatient Complications. Journal of Advanced Nursing, 71, 800-812. https://doi.org/10.1111/jan.12572</mixed-citation></ref><ref id="scirp.81018-ref58"><label>58</label><mixed-citation publication-type="other" xlink:type="simple">Shuldham, C., Parkin, C., Firouzi, A., Roughton, M. and Lau-Walker, M. (2009) The Relationship between Nurse Staffing and Patient Outcomes: A Case Study. International Journal of Nursing Studies, 46, 986-992. https://doi.org/10.1016/j.ijnurstu.2008.06.004</mixed-citation></ref><ref id="scirp.81018-ref59"><label>59</label><mixed-citation publication-type="other" xlink:type="simple">Van den Heede, K., Sermeus, W., Diya, L., Clarke, S.P., Lesaffre, E., Vleugels, A. and Aiken, L.H. (2009) Nurse Staffing and Patient Outcomes in Belgian Acute Hospitals: Cross-Sectional Analysis of Administrative Data. International Journal of Nursing Studies, 46, 928-939. https://doi.org/10.1016/j.ijnurstu.2008.05.007</mixed-citation></ref><ref id="scirp.81018-ref60"><label>60</label><mixed-citation publication-type="other" xlink:type="simple">Pope, C., Mays, N. and Popay, J. (2007) Synthesising Qualitative and Quantitative Health Evidence: A Guide to Methods: A Guide to Methods. Guide to Methods: McGraw-Hill Education.</mixed-citation></ref><ref id="scirp.81018-ref61"><label>61</label><mixed-citation publication-type="other" xlink:type="simple">Reddy, M., Gill, S.S. and Rochon, P.A. (2006) Preventing Pressure Ulcers: A Systematic Review. JAMA, 296, 974-984. https://doi.org/10.1001/jama.296.8.974</mixed-citation></ref><ref id="scirp.81018-ref62"><label>62</label><mixed-citation publication-type="other" xlink:type="simple">Torpy, J.M., Lynm, C. and Glass, R.M. (2009) JAMA Patient Page. Intensive Care Units. JAMA, 301, 1304. https://doi.org/10.1001/jama.301.12.1304</mixed-citation></ref><ref id="scirp.81018-ref63"><label>63</label><mixed-citation publication-type="other" xlink:type="simple">Heisler, J. (2014) Understanding the Risk Involved with Surgery.  http://surgery.about.com/od/beforesurgery/a/RisksSurgery_2.htm</mixed-citation></ref><ref id="scirp.81018-ref64"><label>64</label><mixed-citation publication-type="other" xlink:type="simple">World Health Organization (2014) International Classifications of Diseases. http://www.who.int/classifications/icd/en/</mixed-citation></ref><ref id="scirp.81018-ref65"><label>65</label><mixed-citation publication-type="other" xlink:type="simple">McGahan, M., Kucharski, G. and Coyer, F. (2012) Nurse Staffing Levels and the Incidence of Mortality and Morbidity in the Adult Intensive Care Unit: A Literature Review. Australian Critical Care, 25, 64-77. https://doi.org/10.1016/j.aucc.2012.03.003</mixed-citation></ref><ref id="scirp.81018-ref66"><label>66</label><mixed-citation publication-type="other" xlink:type="simple">Numata, Y., Schulzer, M., van der Wal, R., Globerman, J., Semeniuk, P., Balka, E., and Fitzgerald, J.M. (2006) Nurse Staffing Levels and Hospital Mortality in Critical Care Settings: Literature Review and Meta-Analysis. Journal of Advanced Nursing, 55, 435-448. https://doi.org/10.1111/j.1365-2648.2006.03941.x</mixed-citation></ref><ref id="scirp.81018-ref67"><label>67</label><mixed-citation publication-type="other" xlink:type="simple">West, E., Mays, N., Rafferty, A.M., Rowan, K. and Sanderson, C. (2009) Nursing Resources and Patient Outcomes in Intensive Care: A Systematic Review of the Literature. International Journal of Nursing Studies, 46, 993-1011. https://doi.org/10.1016/j.ijnurstu.2007.07.011</mixed-citation></ref><ref id="scirp.81018-ref68"><label>68</label><mixed-citation publication-type="other" xlink:type="simple">Aveyard, H. (2014) Doing a Literature Review in Health and Social Care: A Practical Guide. 3rd ed. ed., Maidenhead: McGraw-Hill/Open University Press.</mixed-citation></ref><ref id="scirp.81018-ref69"><label>69</label><mixed-citation publication-type="other" xlink:type="simple">Hempel, S., Rubenstein, L.V., Shanman, R.M., Foy, R., Golder, S., Danz, M. and Shekelle, P.G. (2011) Identifying Quality Improvement Intervention Publications—A Comparison of Electronic Search Strategies. Implementation Science, 6, 85. https://doi.org/10.1186/1748-5908-6-85</mixed-citation></ref><ref id="scirp.81018-ref70"><label>70</label><mixed-citation publication-type="other" xlink:type="simple">Nightingale, A. (2009) A Guide to Systematic Literature Reviews. Surgery (Oxford), 27, 381-384. https://doi.org/10.1016/j.mpsur.2009.07.005</mixed-citation></ref></ref-list></back></article>