<?xml version="1.0" encoding="UTF-8"?><!DOCTYPE article  PUBLIC "-//NLM//DTD Journal Publishing DTD v3.0 20080202//EN" "http://dtd.nlm.nih.gov/publishing/3.0/journalpublishing3.dtd"><article xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink" dtd-version="3.0" xml:lang="en" article-type="research article"><front><journal-meta><journal-id journal-id-type="publisher-id">AJIBM</journal-id><journal-title-group><journal-title>American Journal of Industrial and Business Management</journal-title></journal-title-group><issn pub-type="epub">2164-5167</issn><publisher><publisher-name>Scientific Research Publishing</publisher-name></publisher></journal-meta><article-meta><article-id pub-id-type="doi">10.4236/ajibm.2022.122013</article-id><article-id pub-id-type="publisher-id">AJIBM-115572</article-id><article-categories><subj-group subj-group-type="heading"><subject>Articles</subject></subj-group><subj-group subj-group-type="Discipline-v2"><subject>Business&amp;Economics</subject></subj-group></article-categories><title-group><article-title>
 
 
  The Functional Resonance Analysis Method: A Performance Appraisal Tool for Risk Assessment and Accident Investigation in Complex and Dynamic Socio-Technical Systems
 
</article-title></title-group><contrib-group><contrib contrib-type="author" xlink:type="simple"><name name-style="western"><surname>Issa</surname><given-names>Diop</given-names></name><xref ref-type="aff" rid="aff1"><sup>1</sup></xref><xref ref-type="corresp" rid="cor1"><sup>*</sup></xref></contrib><contrib contrib-type="author" xlink:type="simple"><name name-style="western"><surname>Georges</surname><given-names>Abdul-Nour</given-names></name><xref ref-type="aff" rid="aff1"><sup>1</sup></xref></contrib><contrib contrib-type="author" xlink:type="simple"><name name-style="western"><surname>Dragan</surname><given-names>Komljenovic</given-names></name><xref ref-type="aff" rid="aff2"><sup>2</sup></xref></contrib></contrib-group><aff id="aff2"><addr-line>Hydro-Quebec Research Institute (IREQ), Varennes, Canada</addr-line></aff><aff id="aff1"><addr-line>Department of Industrial Engineering, University of Quebec in Trois-Rivieres (UQTR), Trois-Rivieres, Canada</addr-line></aff><pub-date pub-type="epub"><day>16</day><month>02</month><year>2022</year></pub-date><volume>12</volume><issue>02</issue><fpage>195</fpage><lpage>230</lpage><history><date date-type="received"><day>21,</day>	<month>January</month>	<year>2022</year></date><date date-type="rev-recd"><day>25,</day>	<month>February</month>	<year>2022</year>	</date><date date-type="accepted"><day>28,</day>	<month>February</month>	<year>2022</year></date></history><permissions><copyright-statement>&#169; Copyright  2014 by authors and Scientific Research Publishing Inc. </copyright-statement><copyright-year>2014</copyright-year><license><license-p>This work is licensed under the Creative Commons Attribution International License (CC BY). http://creativecommons.org/licenses/by/4.0/</license-p></license></permissions><abstract><p>
 
 
  This article aims at systematically reviewing the entire collection of papers published on the development and application of the functional resonance analysis method (FRAM) in the last decade. The Preferred Reporting Item 
  for Systematic Reviews and Meta-Analyses (PRISMA) methodology ha
  s
   b
  een utilized as a formal systematic literature review standard for data gathering. The analysis encompassed 47 documents devoted to this subject matter, systematically retrieved from the online database Scopus. The findings revealed the necessity for the development of systemic safety assessment approaches to explain performance variability of complex and dynamic socio-technical systems (risk assessment or accident investigation). Indeed, it is crucial to rigorously assess the performance variability throughout safety appraisal since unexpected performance variability can combine in undesirable manners and consequently denotes a threat for safety and losses of human life. However, the FRAM process has some pros and cons as discussed in this review. Consequently, other assessment methods exist to complement the FRAM process
  .
 
</p></abstract><kwd-group><kwd>Functional Resonance Analysis Method (FRAM)</kwd><kwd> Resilience Engineering (RE)</kwd><kwd> Decision-Making</kwd><kwd> Strategic Asset Management (SAM)</kwd><kwd> Risk Management (RM)</kwd><kwd> Industry 4.0</kwd><kwd> Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA)</kwd></kwd-group></article-meta></front><body><sec id="s1"><title>1. Introduction</title><p>The proper working of our society needs complex and dynamic socio-technical systems. The latter consists of, for e.g., electrical power utilities, nuclear power plants, transportation networks, air traffic systems, health care systems, railway traffic grids, maritime mining systems, maritime transportation systems, oil platforms, gas-and-water distribution systems, etc.</p><p>Conventionally, risk and accidents have been investigated by focusing on how failures or malfunctions could occur and how the consequences could disseminate through the system (Hollnagel, 2012; Diop et al., 2021). Many scholars have been interested in studying everyday work as executed by practitioners, namely “work as done”, for the insight of how safety is coined in practice, instead of concentrating on “work as imagined” by management or regulations (legal liabilities), with the aim of optimizing the company’s value chain (Hollnagel, 2012; de Vries, 2017). Resilience engineering is a well-known approach suggested in risk management and uncertainties analysis to investigate the ability of a system to adapt and generate a fruitful result in everyday operations (Diop et al., 2021). Hollnagel (2013) defined resilience engineering as “The intrinsic ability of a system to adjust its functioning prior to, during, or following changes and disturbances, so that it can sustain required operations under both expected and unexpected conditions”. Hence, the purpose stands for the shift of interest from “Safety I” philosophy to “Safety II” philosophy toward everyday operations or “events”. The “Safety I” thinking focuses on what goes wrong rather than what goes right (“Safety II” thinking) (Hollnagel, 2014). Therefore, one should examine how socio-technical work is achieved in practice and in a daily basis to grasp safety.</p><p>The FRAM idea was developed to meet the benefit in “going behind human error and beyond the failure concept” by modelling the functions<sup>1</sup> that are required for everyday performance to be successful in congruence with the Resilience Engineering approach (RE) that constantly claimed that safety is beyond the non-appearance of failures (Hollnagel, 2012). The FRAM relies on the principle of “equivalence of successes and failures” and the principle of “approximate adjustments”. Therefore, in fact, performance is continuously variable. The performance variability of a given function might impact the performance variability of other functions and in this manner cause a “functional resonance” or non-linear effects (analogized to stochastic resonance among signals with fluctuating amplitudes and frequencies) (Hollnagel, 2012).</p><p>This new idea emerged at the beginning of 2004 driven by the limitations of deterministic and probabilistic methods to appreciate complex and dynamic socio-technical systems’ comportment (Patriarca et al., 2020; Hollnagel, 2004). Earlier, the precursors have adopted the FRAM as a socio-technical approach to investigate accident and assess safety (systemic functional approach) in complex socio-technical systems<sup>2</sup> (Hollnagel, 2004; Hollnagel et al., 2008; Lundblad et al., 2008; Sawaragi et al., 2006; Woltjer &amp; Hollnagel, 2007). Today, the FRAM has been established to model complex and dynamic socio-technical systems to apprehend not only why things sometimes fail but also why they normally succeed.</p><p>It is worth emphasizing that, in practical terms, this method investigates how occupational activities occur retrospectively (“analyses of accidents or events”) or prospectively (“analyses of current work domain or envisioned scenarios for risk management”, etc.) by examining work activities with the purpose of understanding how work is accomplished every day and how things turned wrong or right (Patriarca et al., 2020). Nevertheless, the FRAM is a method instead of being a model. This denotes that it does not express any hypotheses regarding neither how the studied system is designed or structured, nor what are the potential causes and relations between causes and consequences, nor in search of failures and abnormal functioning (Hollnagel, 2012). The FRAM expresses results in respect of how functions become coupled and how daily performance variability can resonate (i.e., add force to each other and so trigger the variability of one function to be high) (Hollnagel, 2012; Patriarca et al., 2020).</p><p>Currently, the FRAM is gaining popularity accounting for a research component of major interest in the scientific community. It is well supported by several ad hoc working groups (The FRAMily meeting) and is applied in various high-risk fields such Nuclear Power, Aircraft De-icing, Air Traﬀic Management Safety Assessment, Health Care, Railway Traffic, Maritime Mining, Maritime Transportation etc. (for e.g.: Hollnagel, Woods, &amp; Leveson, 2012; Hollnagel, 2012; Hollnagel, 2018; Hollnagel et al., 2014; Hounsgaard, 2016; Macchi, 2010; Nemeth &amp; Hollnagel, 2016; Slater et al., 2022; Huang et al., 2019; Lee &amp; Chung, 2018; Slim, 2020). However, studies systematically reviewing the scientific production on this topic is lacking as mentioned by Patriarca et al. (2020). On these grounds, this article focuses on systematically reviewing the whole collection of papers published on the development and application of the FRAM in the last decade in complex and dynamic socio-technical systems. The PRISMA guidelines have been used as a proper systematic literature review process to methodically collect and analyze data.</p><p>The remainder of this paper is structured as follows: Section II introduces the methodology of the literature review. Section 3 summarizes the results of the bibliometric analysis. Section 4 provides a discussion of the key findings. Finally, Section 5 concludes the review and provides new research targets.</p></sec><sec id="s2"><title>2. Methodology</title><p>A systematic and critical literature search has been conducted to have a mapping of the state of the art relevant to this topic. We quantify the scientific production and measure its quality and impact. A computerized bibliometric<sup>3</sup> analysis was conducted for papers published between January 1, 2011, and December 1, 2021. Bibliometrix analysis helps assess both the qualitative and quantitative research endeavors as well as the suitability in a field of study (Afuye et al., 2021; Ellegaard &amp; Wallin, 2015). To illustrate the results of the dada search and paper selection process, the PRISMA guidelines has been applied as a recognized systematic literature review model for data collecting and processing (Moher et al., 2009). The PRISMA is a checklist ensuring that the paper selection process is replicable and obvious. <xref ref-type="fig" rid="fig1">Figure 1</xref> depicts the PRISMA approach for the literature search. Data were systematically retrieved from the online database Scopus on December 15, 2021. Furthermore, a backward analysis was conducted to assess the publication trend of the scientific papers on the FRAM in complex and dynamic socio-technical systems. To identify all references published within the survey period related to this subject matter, the query string is defined as follows:</p><p>(Title (“resilience” and “functional resonance analysis method”) or title (“functional resonance analysis method”)) and pub year &gt; 1999 and (limit-to (language, “English”)).</p><p>The initial search retrieves an amount of 47 papers devoted to the development and application of the functional resonance analysis method (FRAM) in</p><p>the last decade. Further analysis was necessary to identify whether the document is appropriate or not. Hence, each paper was subjected to a further examination of its abstract and keywords. Therefore, if the paper appeared to be relevant, it was selected to be utterly read and investigated. Moreover, snowball approach was performed by examining the cited references of the earlier chosen papers to find more papers relevant for this study. Precisely, documents were included in the analysis if they were published as a journal paper, a conference paper, or a book, written in English and their abstract indicated that the document focuses on FRAM. Each document was read entirely to ascertain whether its content is appropriate to our review or not. The selected manuscripts (i.e., documents matching the inclusion criteria, including their metadata) were then exported to the reference management software Endnote and transformed into R data frame utilizing the opensource R package BIBLIOMETRIX (Aria &amp; Cuccurullo, 2017). Though, all papers were not discussed in detail to keep the length of this review within appropriate limits. Merely those papers that are most suitable and relevant to this analysis were discussed in depth.</p></sec><sec id="s3"><title>3. Results—Descriptive Analysis</title><p>The descriptive analysis describes the annual research progress, the leading productive authors, papers, countries, and most relevant keywords. This section presents the bibliometric analysis outcomes of the research trends and academic collaboration networks. It gives a mapping of the annual research growth, the topic structure (co-occurrence network, thematic maps, social structure, etc.), as well as the foremost productive authors, papers, countries, the most recurring keywords, and keywords Plus<sup>4</sup>.</p><sec id="s3_1"><title>3.1. Main Findings about the Collection</title><p><xref ref-type="table" rid="table1">Table 1</xref> shows the main findings about the collection on the functional resonance analysis method (FRAM).</p><p><xref ref-type="fig" rid="fig2">Figure 2</xref> illustrates the annual scientific production associated with this subject matter. An annual percentage growth rate of 6.5% of publications was observed. The number of publications declined substantially between 2018 and 2019 before a high peak was observed in 2021. This increase corroborates the growing interest in using the FRAM methodology for the assessment of complex and dynamic socio-technical systems (environments characterized by high mishap hazard). These metrics infer that the annual number of papers published within the survey period is stable. Therefore, this research area is steady in respect of volume of publications (Afuye et al., 2021; Ellegaard &amp; Wallin, 2015).</p></sec><sec id="s3_2"><title>3.2. Sources Impact</title><p><xref ref-type="table" rid="table2">Table 2</xref> shows the most relevant sources. Reliability Engineering and System</p><table-wrap id="table1" ><label><xref ref-type="table" rid="table1">Table 1</xref></label><caption><title> Main findings about the collection on FRAM (Source: own representation)</title></caption><table><tbody><thead><tr><th align="center" valign="middle" ></th><th align="center" valign="middle" ></th><th align="center" valign="middle" >DOCUMENT TYPES</th><th align="center" valign="middle" ></th></tr></thead><tr><td align="center" valign="middle" >Description</td><td align="center" valign="middle" >Results</td><td align="center" valign="middle" >Description</td><td align="center" valign="middle" >Results</td></tr><tr><td align="center" valign="middle" >Timespan</td><td align="center" valign="middle" >2011:2022</td><td align="center" valign="middle" >Article</td><td align="center" valign="middle" >30</td></tr><tr><td align="center" valign="middle" >Sources (journals, books, etc.)</td><td align="center" valign="middle" >29</td><td align="center" valign="middle" >Book</td><td align="center" valign="middle" >1</td></tr><tr><td align="center" valign="middle" >Documents</td><td align="center" valign="middle" >47</td><td align="center" valign="middle" >Book chapter</td><td align="center" valign="middle" >1</td></tr><tr><td align="center" valign="middle" >Average years from publication</td><td align="center" valign="middle" >2.43</td><td align="center" valign="middle" >Conference paper</td><td align="center" valign="middle" >12</td></tr><tr><td align="center" valign="middle" >Average citations per documents</td><td align="center" valign="middle" >131.4</td><td align="center" valign="middle" >Review</td><td align="center" valign="middle" >3</td></tr><tr><td align="center" valign="middle" >Average citations per year per doc.</td><td align="center" valign="middle" >23.01</td><td align="center" valign="middle" >-</td><td align="center" valign="middle" >-</td></tr><tr><td align="center" valign="middle" >References</td><td align="center" valign="middle" >2043</td><td align="center" valign="middle" >-</td><td align="center" valign="middle" >-</td></tr><tr><td align="center" valign="middle" >AUTHORS</td><td align="center" valign="middle" ></td><td align="center" valign="middle" >AUTHORS COLLABORATION</td><td align="center" valign="middle" ></td></tr><tr><td align="center" valign="middle" >Description</td><td align="center" valign="middle" >Results</td><td align="center" valign="middle" >Description</td><td align="center" valign="middle" >Results</td></tr><tr><td align="center" valign="middle" >Authors</td><td align="center" valign="middle" >151</td><td align="center" valign="middle" >Single-authored documents</td><td align="center" valign="middle" >3</td></tr><tr><td align="center" valign="middle" >Author appearances</td><td align="center" valign="middle" >179</td><td align="center" valign="middle" >Documents per author</td><td align="center" valign="middle" >0.311</td></tr><tr><td align="center" valign="middle" >Authors of single-authored docs.</td><td align="center" valign="middle" >3</td><td align="center" valign="middle" >Authors per document</td><td align="center" valign="middle" >3.21</td></tr><tr><td align="center" valign="middle" >Authors of multi-authored docs.</td><td align="center" valign="middle" >148</td><td align="center" valign="middle" >Co-authors per documents</td><td align="center" valign="middle" >3.81</td></tr><tr><td align="center" valign="middle" >-</td><td align="center" valign="middle" >-</td><td align="center" valign="middle" >Collaboration index</td><td align="center" valign="middle" >3.36</td></tr><tr><td align="center" valign="middle" >DOCUMENT CONTENTS</td><td align="center" valign="middle" ></td><td align="center" valign="middle" >-</td><td align="center" valign="middle" >-</td></tr><tr><td align="center" valign="middle" >Description</td><td align="center" valign="middle" >Results</td><td align="center" valign="middle" >-</td><td align="center" valign="middle" >-</td></tr><tr><td align="center" valign="middle" >Keywords Plus (ID)</td><td align="center" valign="middle" >416</td><td align="center" valign="middle" >-</td><td align="center" valign="middle" >-</td></tr><tr><td align="center" valign="middle" >Author’s keywords (DE)</td><td align="center" valign="middle" >112</td><td align="center" valign="middle" >-</td><td align="center" valign="middle" >-</td></tr></tbody></table></table-wrap><table-wrap id="table2" ><label><xref ref-type="table" rid="table2">Table 2</xref></label><caption><title> Most relevant sources. (Source: own representation)</title></caption><table><tbody><thead><tr><th align="center" valign="middle" >Sources</th><th align="center" valign="middle" >Papers</th><th align="center" valign="middle" >Impact Factor<sup>5</sup></th><th align="center" valign="middle" >H-index<sup>6</sup></th><th align="center" valign="middle" >SJR<sup>7</sup></th><th align="center" valign="middle" >SNIP<sup>8</sup></th></tr></thead><tr><td align="center" valign="middle" >Reliability Engineering and System Safety</td><td align="center" valign="middle" >8</td><td align="center" valign="middle" >7.030</td><td align="center" valign="middle" >146</td><td align="center" valign="middle" >1.761</td><td align="center" valign="middle" >2.707</td></tr><tr><td align="center" valign="middle" >Safety Science</td><td align="center" valign="middle" >6</td><td align="center" valign="middle" >4.877</td><td align="center" valign="middle" >111</td><td align="center" valign="middle" >1.178</td><td align="center" valign="middle" >2.473</td></tr><tr><td align="center" valign="middle" >Cognition Technology and Work</td><td align="center" valign="middle" >4</td><td align="center" valign="middle" >2.920</td><td align="center" valign="middle" >36</td><td align="center" valign="middle" >0.518</td><td align="center" valign="middle" >1.430</td></tr><tr><td align="center" valign="middle" >Applied Ergonomics</td><td align="center" valign="middle" >2</td><td align="center" valign="middle" >4.170</td><td align="center" valign="middle" >98</td><td align="center" valign="middle" >1.093</td><td align="center" valign="middle" >2.489</td></tr><tr><td align="center" valign="middle" >Lecture Notes in Mechanical Engineering</td><td align="center" valign="middle" >2</td><td align="center" valign="middle" >0.55</td><td align="center" valign="middle" >16</td><td align="center" valign="middle" >0.150</td><td align="center" valign="middle" >0.287</td></tr></tbody></table></table-wrap><p>Safety ranks first with a total number of 8 publications followed by Safety Science and Cognition Technology and Work with respectively 6 and 4 publications as shows in <xref ref-type="fig" rid="fig3">Figure 3</xref> depicting the source clustering through Bradford’s law. <xref ref-type="fig" rid="fig4">Figure 4</xref> shows the Source growth.</p></sec><sec id="s3_3"><title>3.3. Authors Impact</title><p><xref ref-type="table" rid="table3">Table 3</xref> shows the most relevant authors. Costantino F., Di Gravio G., Patriarca R., and Hollnagel E. rank first followed by Kaya G.K. and Haddad A.N.</p><p><xref ref-type="table" rid="table4">Table 4</xref> shows the most cited authors. Hollnagel E. ranks first with 608 citations followed by Costantino F., Di Gravio G., Patriarca R. <xref ref-type="fig" rid="fig5">Figure 5</xref> depicts the citation network, i.e., the citations within the collection of papers. It provides information about how authors relate to others in this specific field of research.</p><p><xref ref-type="fig" rid="fig6">Figure 6</xref> depicts the top-authors’ production over the time. A given line embodies an author timeline. The bubble at a particular year implies that the author published at least a paper in that year. The bubble size is proportional to the total number of papers that author published in that year. Finally, the color intensity is proportional to the total number of citations per year of the document published in that year.</p><p><xref ref-type="fig" rid="fig7">Figure 7</xref> illustrates the author productivity through Lotka’s law. The latter illustrates “the frequency of publication by authors in any given field. As the number of articles published increases, authors producing that many publications become less frequent” (Lotka, 1926). The general formula of Lotka’s law is expressed as follows: Y = C/X<sup>n</sup> (where X is the number of publications, Y the relative frequency of authors with X publications, and n and C are constants depending on the specific field (n ≈ 2). Only 3.30% of the authors have published four papers. Most of them (88.70%) have authored one paper.</p><table-wrap id="table3" ><label><xref ref-type="table" rid="table3">Table 3</xref></label><caption><title> Most relevant authors. (Source: own representation)</title></caption><table><tbody><thead><tr><th align="center" valign="middle" >Authors</th><th align="center" valign="middle" >Articles</th><th align="center" valign="middle" >Total link strength<sup>9</sup></th></tr></thead><tr><td align="center" valign="middle" >Costantino F. (Patriarca et al., 2020; Patriarca et al., 2018; Patriarca et al., 2017a; Patriarca et al., 2017b)</td><td align="center" valign="middle" >4</td><td align="center" valign="middle" >156</td></tr><tr><td align="center" valign="middle" >Di Gravio G. (Patriarca et al., 2020; Patriarca et al., 2018; Patriarca et al., 2017a; Patriarca et al., 2017b)</td><td align="center" valign="middle" >4</td><td align="center" valign="middle" >156</td></tr><tr><td align="center" valign="middle" >Patriarca R. (Patriarca et al., 2020; Patriarca et al., 2018; Patriarca et al., 2017a; Patriarca et al., 2017b)</td><td align="center" valign="middle" >4</td><td align="center" valign="middle" >156</td></tr><tr><td align="center" valign="middle" >Hollnagel E. (Hollnagel, 2012; Patriarca et al., 2020; Raben et al., 2018; Fran&#231;a et al., 2021)</td><td align="center" valign="middle" >4</td><td align="center" valign="middle" >82</td></tr><tr><td align="center" valign="middle" >Kaya G.K. (Kaya et al., 2019, 2021; Kaya &amp; Hocaoglu, 2020)</td><td align="center" valign="middle" >3</td><td align="center" valign="middle" >47</td></tr><tr><td align="center" valign="middle" >De Carvalho P.V.R. (De Carvalho, 2011; Cabrera et al., 2014)</td><td align="center" valign="middle" >2</td><td align="center" valign="middle" >108</td></tr><tr><td align="center" valign="middle" >Haddad A.N. (Fran&#231;a et al., 2021, Rosa et al., 2015)</td><td align="center" valign="middle" >2</td><td align="center" valign="middle" >52</td></tr><tr><td align="center" valign="middle" >Smoczyński P. (Smoczyński et al., 2018a; Smoczyński et al., 2018b)</td><td align="center" valign="middle" >2</td><td align="center" valign="middle" >26</td></tr><tr><td align="center" valign="middle" >Bellini E. (Bellini et al. (2020), Bellini et al. (2016)</td><td align="center" valign="middle" >2</td><td align="center" valign="middle" >7</td></tr><tr><td align="center" valign="middle" >McCloskey R. (Salehi et al., 2021; McGill et al., 2021)</td><td align="center" valign="middle" >2</td><td align="center" valign="middle" >28</td></tr><tr><td align="center" valign="middle" >Pardo-Ferreira, M.D.C. (Pardo-Ferreira et al., 2019)</td><td align="center" valign="middle" >1</td><td align="center" valign="middle" >62</td></tr></tbody></table></table-wrap><table-wrap id="table4" ><label><xref ref-type="table" rid="table4">Table 4</xref></label><caption><title> Most cited authors (Source: own representation)</title></caption><table><tbody><thead><tr><th align="center" valign="middle" >Authors</th><th align="center" valign="middle" >Citations</th><th align="center" valign="middle" >Total link strength</th></tr></thead><tr><td align="center" valign="middle" >Hollnagel E.</td><td align="center" valign="middle" >608</td><td align="center" valign="middle" >82</td></tr><tr><td align="center" valign="middle" >Costantino F.</td><td align="center" valign="middle" >181</td><td align="center" valign="middle" >156</td></tr><tr><td align="center" valign="middle" >Di Gravio G.</td><td align="center" valign="middle" >181</td><td align="center" valign="middle" >156</td></tr><tr><td align="center" valign="middle" >Patriarca R.</td><td align="center" valign="middle" >181</td><td align="center" valign="middle" >156</td></tr><tr><td align="center" valign="middle" >De Carvalho P.V.R.</td><td align="center" valign="middle" >163</td><td align="center" valign="middle" >108</td></tr><tr><td align="center" valign="middle" >Haddad A.N.</td><td align="center" valign="middle" >55</td><td align="center" valign="middle" >52</td></tr><tr><td align="center" valign="middle" >Rosa L.V.</td><td align="center" valign="middle" >53</td><td align="center" valign="middle" >52</td></tr><tr><td align="center" valign="middle" >Bellini E.</td><td align="center" valign="middle" >42</td><td align="center" valign="middle" >7</td></tr><tr><td align="center" valign="middle" >Nesi P.</td><td align="center" valign="middle" >42</td><td align="center" valign="middle" >7</td></tr><tr><td align="center" valign="middle" >Tronci M.</td><td align="center" valign="middle" >39</td><td align="center" valign="middle" >34</td></tr><tr><td align="center" valign="middle" >Pardo-Ferreira, M.D.C.</td><td align="center" valign="middle" >36</td><td align="center" valign="middle" >62</td></tr><tr><td align="center" valign="middle" >Kaya G.K.</td><td align="center" valign="middle" >20</td><td align="center" valign="middle" >47</td></tr></tbody></table></table-wrap></sec><sec id="s3_4"><title>3.4. Social Structure—Collaboration Analysis</title><p>The collaboration analysis provides information about how authors and countries interact to others in a particular domain of research. <xref ref-type="fig" rid="fig8">Figure 8</xref> below depicts the author collaboration network (co-author network) classified in 4 clusters<sup>10</sup>. It</p><p>finds research groups of scholars and pivotal authors. The size of a link in the network depends on the relationship between the authors. The higher the relationship, the stronger the edge size. <xref ref-type="fig" rid="fig9">Figure 9</xref> represents the authors’ bibliographic coupling categorized in four clusters. The relatedness of authors is established based on the number of references they shared or cited (“Bibliographic coupling occurs when two works reference a common third work in their bibliographies. It is an indication that a probability exists that the two works treat a related subject matter” (Martyn, 1964)). <xref ref-type="fig" rid="fig1">Figure 1</xref>0 and <xref ref-type="table" rid="table5">Table 5</xref> describe the</p><table-wrap id="table5" ><label><xref ref-type="table" rid="table5">Table 5</xref></label><caption><title> Most relevant countries by corresponding authors. (Source: own representation)</title></caption><table><tbody><thead><tr><th align="center" valign="middle" >Country</th><th align="center" valign="middle" >Freq</th><th align="center" valign="middle" >SCP</th><th align="center" valign="middle" >MCP</th><th align="center" valign="middle" >MCP Ratio</th></tr></thead><tr><td align="center" valign="middle" >Brazil</td><td align="center" valign="middle" >0.1316</td><td align="center" valign="middle" >3</td><td align="center" valign="middle" >2</td><td align="center" valign="middle" >0.40</td></tr><tr><td align="center" valign="middle" >Italy</td><td align="center" valign="middle" >0.1316</td><td align="center" valign="middle" >4</td><td align="center" valign="middle" >1</td><td align="center" valign="middle" >0.20</td></tr><tr><td align="center" valign="middle" >Turkey</td><td align="center" valign="middle" >0.1053</td><td align="center" valign="middle" >4</td><td align="center" valign="middle" >0</td><td align="center" valign="middle" >0.00</td></tr><tr><td align="center" valign="middle" >United Kingdom</td><td align="center" valign="middle" >0.1053</td><td align="center" valign="middle" >3</td><td align="center" valign="middle" >1</td><td align="center" valign="middle" >0.25</td></tr><tr><td align="center" valign="middle" >Netherlands</td><td align="center" valign="middle" >0.0789</td><td align="center" valign="middle" >3</td><td align="center" valign="middle" >0</td><td align="center" valign="middle" >0.00</td></tr><tr><td align="center" valign="middle" >Spain</td><td align="center" valign="middle" >0.0789</td><td align="center" valign="middle" >1</td><td align="center" valign="middle" >2</td><td align="center" valign="middle" >0.67</td></tr><tr><td align="center" valign="middle" >Australia</td><td align="center" valign="middle" >0.0526</td><td align="center" valign="middle" >2</td><td align="center" valign="middle" >0</td><td align="center" valign="middle" >0.00</td></tr><tr><td align="center" valign="middle" >China</td><td align="center" valign="middle" >0.0526</td><td align="center" valign="middle" >2</td><td align="center" valign="middle" >0</td><td align="center" valign="middle" >0.00</td></tr><tr><td align="center" valign="middle" >Denmark</td><td align="center" valign="middle" >0.0526</td><td align="center" valign="middle" >1</td><td align="center" valign="middle" >1</td><td align="center" valign="middle" >0.50</td></tr><tr><td align="center" valign="middle" >Canada</td><td align="center" valign="middle" >0.0263</td><td align="center" valign="middle" >1</td><td align="center" valign="middle" >0</td><td align="center" valign="middle" >0.00</td></tr><tr><td align="center" valign="middle" >Germany</td><td align="center" valign="middle" >0.0263</td><td align="center" valign="middle" >1</td><td align="center" valign="middle" >0</td><td align="center" valign="middle" >0.00</td></tr><tr><td align="center" valign="middle" >India</td><td align="center" valign="middle" >0.0263</td><td align="center" valign="middle" >1</td><td align="center" valign="middle" >0</td><td align="center" valign="middle" >0.00</td></tr><tr><td align="center" valign="middle" >Kazakhstan</td><td align="center" valign="middle" >0.0263</td><td align="center" valign="middle" >0</td><td align="center" valign="middle" >1</td><td align="center" valign="middle" >1.00</td></tr><tr><td align="center" valign="middle" >Korea</td><td align="center" valign="middle" >0.0263</td><td align="center" valign="middle" >1</td><td align="center" valign="middle" >0</td><td align="center" valign="middle" >0.00</td></tr><tr><td align="center" valign="middle" >Norway</td><td align="center" valign="middle" >0.0263</td><td align="center" valign="middle" >1</td><td align="center" valign="middle" >0</td><td align="center" valign="middle" >0.00</td></tr><tr><td align="center" valign="middle" >Poland</td><td align="center" valign="middle" >0.0263</td><td align="center" valign="middle" >1</td><td align="center" valign="middle" >0</td><td align="center" valign="middle" >0.00</td></tr><tr><td align="center" valign="middle" >Ukraine</td><td align="center" valign="middle" >0.0263</td><td align="center" valign="middle" >1</td><td align="center" valign="middle" >0</td><td align="center" valign="middle" >0.00</td></tr></tbody></table></table-wrap><p>most relevant countries by corresponding authors nationalities. It shows the number of published papers in both Single Country Publications (SCP) and Multiple Country Publications (MCP). Brazil, Italy, and Turkey rank first with the largest number of papers. Documents published by SCP have a higher-trend productivity growth rate.</p><p><xref ref-type="table" rid="table6">Table 6</xref> depicts the most cited countries. <xref ref-type="fig" rid="fig1">Figure 1</xref>1 illustrates their bibliographic coupling grouped in 3 clusters: CLUSTER 1: Canada, China, Denmark, Germany, Kazakhstan, Netherlands, Poland, South Korea, Spain, Turkey, United Kingdom; CLUSTER 2: Australia, Italy, Norway, Portugal, Sweden, CLUSTER 3: Brazil, United States. The citation analysis depicts the structure of the research area through the connections between countries. The timespan helps to explore the conceptual structures and analyze the evolution of themes over time. The collaboration networks show how countries relate to others in the research topic.</p></sec><sec id="s3_5"><title>3.5. Conceptual Structure—Co-Word Analysis</title><p>This section describes the word treemap and the clusters of most popular keywords. <xref ref-type="fig" rid="fig1">Figure 1</xref>2 below depict the co-word network visualization of the co-occurrence analysis based on author’s keywords. The co-word networks describe the conceptual structure (i.e., the links between concepts) which characterizes the relationship between the keywords. The networks show the relationship among keywords within a document indicating themes or topics. Its node</p><table-wrap id="table6" ><label><xref ref-type="table" rid="table6">Table 6</xref></label><caption><title> Most cited countries. (Source: own representation)</title></caption><table><tbody><thead><tr><th align="center" valign="middle" >Country</th><th align="center" valign="middle" >Total citations</th><th align="center" valign="middle" >Documents</th><th align="center" valign="middle" >Total link strength</th></tr></thead><tr><td align="center" valign="middle" >Sweden</td><td align="center" valign="middle" >566</td><td align="center" valign="middle" >3</td><td align="center" valign="middle" >17</td></tr><tr><td align="center" valign="middle" >Denmark</td><td align="center" valign="middle" >570</td><td align="center" valign="middle" >2</td><td align="center" valign="middle" >10</td></tr><tr><td align="center" valign="middle" >Germany</td><td align="center" valign="middle" >549</td><td align="center" valign="middle" >2</td><td align="center" valign="middle" >3</td></tr><tr><td align="center" valign="middle" >France</td><td align="center" valign="middle" >548</td><td align="center" valign="middle" >1</td><td align="center" valign="middle" >0</td></tr><tr><td align="center" valign="middle" >Italy</td><td align="center" valign="middle" >223</td><td align="center" valign="middle" >6</td><td align="center" valign="middle" >54</td></tr><tr><td align="center" valign="middle" >Brazil</td><td align="center" valign="middle" >171</td><td align="center" valign="middle" >6</td><td align="center" valign="middle" >52</td></tr><tr><td align="center" valign="middle" >United Kingdom</td><td align="center" valign="middle" >63</td><td align="center" valign="middle" >5</td><td align="center" valign="middle" >26</td></tr><tr><td align="center" valign="middle" >Australia</td><td align="center" valign="middle" >62</td><td align="center" valign="middle" >8</td><td align="center" valign="middle" >31</td></tr><tr><td align="center" valign="middle" >Portugal</td><td align="center" valign="middle" >51</td><td align="center" valign="middle" >2</td><td align="center" valign="middle" >25</td></tr><tr><td align="center" valign="middle" >Norway</td><td align="center" valign="middle" >48</td><td align="center" valign="middle" >3</td><td align="center" valign="middle" >22</td></tr></tbody></table></table-wrap><p>corresponds to a keyword. Bigger is a link, greater is the relationship. This supports identify the intellectual domain of FRAM and provide research hotspots in this subject matter for future studies.</p><p>Information in <xref ref-type="fig" rid="fig1">Figure 1</xref>3 and <xref ref-type="fig" rid="fig1">Figure 1</xref>4 shows respectively the Tree-Mapfor the most pivotal Author’s Keywords (DE) and Keywords Plus (ID) associated with FRAM analyses. The Word Tree-Mapoutlines hot themes or the dynamic trends of major themes of the author (Cobo et al., 2011). It is key to studying hot themes within the sphere of research.</p><p>The Three-Fields Plot is depicted in <xref ref-type="fig" rid="fig1">Figure 1</xref>5 using the items: Country (AU_CO), Authors (AU) and Author’s Keywords (DE). Appendix 1 shows the Three-Fields Plot for Keywords Plus (ID).</p></sec><sec id="s3_6"><title>3.6. Thematic Map</title><p>Clusters identified through the co-word analysis above are deemed as themes that can be classified according to their density and centrality in a two-dimensional diagram (Cobo et al., 2011; Aria &amp; Cuccurullo, 2017). Themes can be analyzed according to the quadrant wherein they are positioned. <xref ref-type="fig" rid="fig1">Figure 1</xref>6 depicts the thematic map encompassing seven clusters identified through the analysis of the centrality and density ranking of Keywords Plus. The cluster in the motor themes (first quadrant with the highest centrality and the highest density)<sup>11</sup> connoting that these themes is well-developed and significant for the</p><p>shaping of the research area. It contains Keywords Plus “human”, “functional resonance analysis method”, “health care”, “delivery of health care”, “health care personnel”, “semi structured interview”, and “controlled study” as the most co-occurring words. The cluster straddling between the motor themes and the basic themes, with a good centrality and density, includes words: “functional resonance analysis method”, “ferroelectric ram”, “risk assessment”, “safety engineering”, “sociotechnical systems”, “resilience engineering”, “performance variability”, “safety management” being the most recurring words. The cluster in the highly developed and isolated themes or niche themes (second quadrant with low centrality and high density) includes the single word “complex processes” implying that it has low reputation for the subject matter. The two clusters in the emerging or declining themes denoting they are weakly studied(third quadrant with low centrality and low density) encompasses words “oil spills”, “urban transportation” as the most repetitive words. The cluster in the basic and transversal themes relating to general and various research areas (fourth quadrant with high centrality and low density) incorporates words “accident prevention”, “accident analysis”, “aircraft accidents”, “air traffic control”, “roads and streets”, “advanced traffic management systems”, “air transportation”, “automation”, “behavioral research”. Lastly, the cluster straddling between the motor themes and the highly developed and isolated themes, with a good centrality and high density, includes the only word: “uncertainty analysis”.</p></sec></sec><sec id="s4"><title>4. Discussion</title><p>The study carried out a comprehensive bibliometric literature review of the application of the functional resonance analysis method (FRAM) intended for the assessment of performance variability in complex and dynamic socio-technical systems. The following paragraphs discuss the FRAM approach and some of its limitations. We also carry out a comparison of different assessment methods and the FRAM tool.</p><sec id="s4_1"><title>4.1. The FRAM Approach</title><p>There is a rising appeal in utilizing the FRAM methodology for the assessment of what precisely is happening in complex and dynamic socio-technical systems in practical high hazard environments (for e.g.: de Vries, 2017; De Carvalho, 2011; Adriaensen et al., 2019; Aguilera et al., 2016; Albery et al., 2016; Anvarifar et al., 2017; Belmonte et al., 2011; Bjerga et al., 2016; Buikstra et al., 2020; Clay-Williams et al., 2015; Costantino et al., 2018; Duan et al., 2015; Falegnami et al., 2019; Praetorius et al., 2015; Ferreira &amp; Ca&#241;as, 2019; Fran&#231;a et al., 2019; Gattola et al., 2018; Smith et al., 2020; Jensen &amp; Aven, 2017; Furniss et al., 2016; Gao et al., 2019). The FRAM is a relatively new performance appraisal tool for risk assessment or accident investigation, in line with the thinking of the resilience engineering (RE) and reflects the “Safety II” theory rather than the traditional “Safety I” theory toward everyday operations or “events” (Hollnagel, 2012, 2014). The “Safety I” thinking (such as in Failure Mode and Effects Analysis, FMEA) focuses on what goes wrong (how a component may fail), while the “Safety II” thinking concentrates on what goes right (define the functions that are mandatory for the system to attain its objective). The FRAM approach enables practitioners to describe a complex and dynamic socio-technical system in the matter of the functions and the interactions among functions forming this system. Thus, performance variability can be investigated to understand where it may occur then disseminate all over the system (functional resonance) i.e., in what manner functional variability can deteriorate into unforeseen and undesirable outcomes. The RE, an attitude that has constantly advocated that safety is beyond the absence of failures, tackles how the socio-technical system may adjust to withstand disturbance within the mandatory parameters then maintain performance in required parameters (for e.g., Cabrera et al., 2014).</p><p>The outcomes of “how functions become coupled” and how “everyday performance variability may resonate” are the main objectives of the FRAM approach. The latter is a method rather than a model (Hollnagel, 2012). Accordingly, it neither formulates hypotheses about potential causes and cause/consequence relationships nor regarding how the system under probe is organized or structured. It is based on four comprehensive principles in line with the RE approach, namely:</p><p>&#183; the principle of equivalence of success and failure<sup>12</sup>,</p><p>&#183; the principle of approximate adjustments<sup>13</sup>,</p><p>&#183; the principle of emergence<sup>14</sup>,</p><p>&#183; the principle of functional resonance<sup>15</sup>.</p><p><xref ref-type="fig" rid="fig1">Figure 1</xref>7 describes the four core steps of the FRAM approach (Hollnagel, 2012).</p><p>First and foremost, Step 0 (preliminaries) is a requirement for defining the</p><p>analysis objective. Two analyses purposes are possible: 1) risk assessment (system descriptions, for e.g. Rosa et al., 2015) or 2) accident investigation (probe of the causes of the accident and draw the relevant conclusions, for e.g. De Carvalho, 2011; Herrera &amp; Woltjer, 2010).</p><p>The first step (Step 1: Identify and Describe the Functions) focuses on identifying the functions (i.e. activities or set of activities) that are required for a given system or organisation to produce a certain outcome. Functions may be accomplished by technological systems or human operators, individually or cooperatively. Six aspects, namely Intput (I), Output (O), Preconditions (P), Recourses (R), Time (T), Control IC), describe a function as illustrated graphically by a hexagon in <xref ref-type="fig" rid="fig1">Figure 1</xref>8. Thus, activities are identified, described and classified in term of how they are accomplished everyday rather than how they are imagined, facilitating to enhance insight of how variability may arise and propagate. Functions are classified either foreground, i.e., functions whose variability might influence the result of the assessment, or background, i.e., functions that are relatively stable and have less influence on the result of the assessment. Function-coupling is characterized as the interaction among functions. Function can be upstream (arising before another one) or downstream (arising after another one). This requires appropriate acknowledgement of the system.</p><p>The second step (Step 2: identification of variability) characterizes both the potential variability and the expected actual variability of the functions to determine the variation in the functional output instead of the change in the function. The potential variability refers to the model, while the expected actual variability refers to an instantiation of the model (“the FRAM model represents the set of functions that together account for the activity being analysed and the potential couplings among functions. An instantiation describes the couplings that existed or may exist for a given scenario or a set of conditions, and thus represents a realisation of the model” (Hollnagel, 2012)). This determines how each individual function can be influenced by internal (endogenous) or external (exogenous) performance variability.</p><p>The third step (Step 3: aggregation of variability) focuses on the combination of variability (i.e., functional resonance). It supports to identify which functions</p><p>may encounter potential performance variability and how the outcome may spread through the system. Once the functions are coupled, the interaction among them comes to be evident. The potential variability appraisal enables to recognize how upstream function variations impact downstream functions by up-down coupling. Thus, the true interest of the evaluation is to grasp the variation in the outcome of the function more willingly than the variation in the function itself; (“since a FRAM model does not stand for any specific situation, it can only represent the potential performance variability. The range of this can be estimated based on established scientific knowledge as well as practical experience from a domain. An instantiation represents a concrete instance of the model for given (actual or assumed) circumstances and set(s) of conditions, and the details provided by the instantiation makes it possible to be more precise about whether and how the potential variability can become actual variability. It is, however, not enough to know what the actual variability may be for individual functions. It is also necessary to know how variability may combine and thereby lead to outcomes that are either unexpected or out of scale—or both. In other words, it is necessary to know how functional resonance can come about. This is done by using the idea of function upstream-downstream coupling” (Hollnagel, 2012)).</p><p>The fourth step (Step 4: consequences of the analysis) aims at managing and controlling performance variability as well as encouraging effective outcomes (rather than only weakening undesirable outcomes). As soon as unforeseen or unwanted outcomes arise, safety measures should allow useful actions to be taken. In addition to the well-established methods such as safety prevention (barriers or defense), eliminating the hazards at the source if known, protection, etc., the FRAM methodology recommends two further solutions, namely monitoring (performance indicators) and dampening, in line with the four principles of underlying the FRAM. Therefore, the answer is to manage performance variability, typically by attempting to dampen the variability in order to diminish resonance influences (Hollnagel, 2012).</p><p>The RE and the FRAM idea recognize that things succeed and fail in fundamentally the similar way (i.e., the equivalence of successes and failures). The Principle of Approximate Adjustments means that adjustments are omnipresent and beneficial. This principle elucidates why resources like workforce, time, information, are not infinite and require recurrent approximate adjustments rather than exact. Indeed, organizations recurrently adapt and adjust their performance<sup>16</sup>. For e.g., an organization setting of objectives and priorities as well as actions to be undertaken against uncertainties of the environment such as supervisory requirements and legal liabilities, challenges of talents acquisition and their retention in the workplace, uncertainty in worldwide markets deregulation, technological innovation and technological obsolescence, constantly rising customer demands. Likewise, challenges are the current uncertain business context caused by the coronavirus disease pandemic, natural disasters, terrorist attacks and major cyberattacks (Diop et al., 2021). Subsequently, numerous socio-technical systems are problematic. The occupational conditions never entirely agree with what has been predetermined or suggested. The subsequent performance variability is the explanation why things either succeed or fail. However, the explanations that make the adjustments essential also imply that they are approximate rather than exact. The reason why things generally succeed or sometimes fail is attributable to approximate adjustments. In other words, outright failures, malfunctioning or errors for instance, do not mostly cause things to go wrong. Instead, the daily performance variabilities sum up or combine in an unforeseen way (i.e., the principle of functional resonance) causing something to fail. On one hand, normal performance variabilities hardly lead to possible safety concerns or failures since many of them are rarely significant to be the cause of mishaps or breakdowns, but on the other hand, despite actions</p><table-wrap id="table7" ><label><xref ref-type="table" rid="table7">Table 7</xref></label><caption><title> Alternative risk assessment techniques compared to FRAM (Source: own representation). (Abbreviation in the <xref ref-type="table" rid="table7">Table 7</xref>: QL: Qualitative approach. QT: Quantitative. P: Proactive approach. R: Reactive approach)</title></caption><table><tbody><thead><tr><th align="center" valign="middle" >Methods</th><th align="center" valign="middle" >Description</th><th align="center" valign="middle" >Application</th><th align="center" valign="middle" >QL/QT</th><th align="center" valign="middle" >P/R</th></tr></thead><tr><td align="center" valign="middle" >The functional resonance analysis method (FRAM)</td><td align="center" valign="middle" >The FRAM investigates how occupational activities occur retrospectively (“analyses of accidents or events”) or prospectively (“analyses of current work domain or envisioned scenarios for risk management”, etc.) by examining work activities with the purpose of understanding how work is accomplished everyday and how things turned wrong or right (Hollnagel, 2012; Patriarca et al., 2020) . &#183; It is relevant for modelling and interpreting complex systems. It highlights complexity in the functions, and various circumstantial changes that may influence system performance. It offers better understanding of the system as a whole. &#183; However, this method lacks numerical aspects involved in the methodology utilized to build the model. It is not appropriate for use in particular areas such as sensitivity analysis. The couplings between the functions can be complex. The FRAM is a time-consuming process. &#183; In some case, FRAM could be combined with other methods such as FMEA to be useful (Melanson &amp; Nadeau, 2019) .</td><td align="center" valign="middle" >Various high-risk fields such as: &#183; Nuclear Power &#183; Aircraft De-icing &#183; Air Traffic Management Safety Assessment &#183; Health Care &#183; Railway Traffic &#183; Maritime Mining &#183; Maritime Transportation &#183; etc. For e.g., Hollnagel, 2012; Hollnagel, Woods, &amp; Leveson, 2012; Hollnagel, 2018; Hollnagel et al., 2014; Hounsgaard, 2016; Huang et al., 2019; Lee &amp; Chung, 2018; Macchi, 2010; Nemeth &amp; Hollnagel, 2016; Slater et al., 2022; Slim, 2020 .</td><td align="center" valign="middle" >QL</td><td align="center" valign="middle" >P, R</td></tr><tr><td align="center" valign="middle" >Systems-Theoretic Accident Model and Processes (STAMP)</td><td align="center" valign="middle" >The STAMP is an accident causality model proposed by Leveson (2016) . &#183; It is a systemic approach to safety analysis (Allison et al., 2017; Leveson, 2004) , centered on negative effects and countermeasures (Patriarca et al., 2020; Ferjencik, 2011) . For e.g., Ferjencik, 2011; Ouyang et al., 2010 . The STAMP method describes “how complex systems are dynamic and migrate towards accidents due to physical, social and economic pressures, rather than sudden loss of control capacity” (Salmon et al., 2012) . The STAMP encompasses an analytical risk assessment method, namely: the System-Theoretic Process Analysis (STPA). &#183; However, Leveson (2016) indicates that this method is not designed for one looking for someone to blame (Leveson, 2016; Allison et al., 2017) , nevertheless, it can offer, at a system level, information about the adjustment considered necessary to avoid, or reduce the effect of mishaps in the future.</td><td align="center" valign="middle" >Appropriate for complex systems such as: &#183; Software &#183; Space, Aviation &#183; Human Factors &#183; Organizational Design &#183; Medical &#183; Defense, &#183; Nuclear, &#183; etc. For e.g., Allison et al., 2017 .</td><td align="center" valign="middle" >QL</td><td align="center" valign="middle" >P, R</td></tr><tr><td align="center" valign="middle" >Failure Mode and Effect (Criticality) Analysis (FMEA / FMECA):</td><td align="center" valign="middle" >FMECA is an extension of the inductive analytical method FMEA by incorporating a criticality assessment. These bottom-up processes help identify, prioritize, then act on likely failure modes. They offer a listing of all potential failure modes and causes. Each breakdown mode is assessed for its criticality then interpreted in term of risk (Dai et al., 2011) . &#183; It is relevant for identifying hazards and circumstances that can be used as drivers for system changes, in contrast to the FRAM which is more appropriate to model and understand complex systems or processes (Patriarca et al., 2020; Das et al., 2018) . &#183; However, the FMEA process is simply as good as the subject matter experts behind the analysis in question. Many failure modes might be missed. It is a time-consuming process; it should be consistently revised as new prospective failure modes are identified. &#183; It does not consider combined failures and human concerns. Combining FMEA with FRAM or used in conjunction with other methods may possibly be beneficial (Melanson &amp; Nadeau, 2019; Das et al., 2018; Sujan &amp; Felici, 2012) .</td><td align="center" valign="middle" >Various fields such as: &#183; Manufacturing sector &#183; Military applications &#183; Space applications &#183; Healthcare sector &#183; Construction industry &#183; etc. For e.g., Melanson &amp; Nadeau, 2019; Das et al., 2018; Sujan &amp; Felici, 2012; Rausand &amp; Hoyland, 2004; Chiozza &amp; Ponzetti, 2009; Abdelgawad &amp; Fayek, 2010 .</td><td align="center" valign="middle" >QL, QT</td><td align="center" valign="middle" >P</td></tr><tr><td align="center" valign="middle" >Root-Cause Analysis (RCA)</td><td align="center" valign="middle" >This method helps identify the set of multiple causes (underlying root causes) of a failure in order to identify suitable solutions to prevent the problem from arising again. &#183; For e.g., Management Oversight and Risk Tree (MORT) analysis (an analytical method for defining causes and contributing factors.) (Rasmussen et al., 1994; Johnson, 1973) . &#183; However, in contrast to the FRAM, The RCA does not offer a better insight of the complexity in the processes and the couplings contained by the work settings; it might exist more than one root cause to a malfunction (Patriarca et al., 2020; Alm &amp; Woltjer, 2010; Nakajima, 2017) .</td><td align="center" valign="middle" >Numerous fields such as: &#183; risk management tool in nuclear industry &#183; IT &#183; Industrial process control &#183; Accident analysis &#183; Telecommunications &#183; etc. For e.g., Appicharla, 2011; Alm &amp; Woltjer, 2010; Nakajima, 2017 .</td><td align="center" valign="middle" >QL</td><td align="center" valign="middle" >P</td></tr><tr><td align="center" valign="middle" >Fault Tree Analysis (FTA)</td><td align="center" valign="middle" >This top-down method, based on deductive reasoning (deductive logic), help analyze undesired state of a system (failures, malfunctions) utilizing Boolean logic. &#183; It supports effective decision-making in identifying root failure modes and identify likely failure causes for the root failure modes (Dai et al., 2011) . &#183; It might be useful to combine the FTA and the FRAM process (Toroody et al., 2016) . However, the FTA may not be suitable for some complex and dynamic socio-technical systems such as human-centric maritime operations (Patriarca et al., 2020; Toroody et al., 2016; Praetorius &amp; Kataria, 2016) .</td><td align="center" valign="middle" >Various high-hazard industries such as: &#183; Nuclear power &#183; Chemical and process &#183; Aerospace &#183; Petrochemical &#183; Software engineering &#183; Pharmaceutical For e.g., Toroody et al., 2016; Praetorius &amp; Kataria, 2016; Goldberg et al., 1994; Center for Chemical Process Safety, 2008; Center for Chemical Process Safety, 1999; U.S. Department of Labor Occupational Safety and Health Administration Process, 1994; Lacey, 2011 .</td><td align="center" valign="middle" >QL, QT</td><td align="center" valign="middle" >P</td></tr><tr><td align="center" valign="middle" >Human Reliability Assessment (HRA)</td><td align="center" valign="middle" >(1st generation of HRA methodology) It is represented by methods such as Human Cognitive Reliability Correlation (HCR) and the Technique for Human Error-Rate Prediction (THERP); both intend to evaluate the probability of human error arising throughout the accomplishment of a particular task. &#183; It can help for error identification, error quantification and error reduction. &#183; Combining HRA with FRAM or other methods may possibly be valuable. However, this method is not appropriate for use in particular areas such as sensitivity study and comparative model.</td><td align="center" valign="middle" >Numerous fields such as: &#183; Manufacturing &#183; Medicine &#183; Nuclear power &#183; etc.</td><td align="center" valign="middle" >QT</td><td align="center" valign="middle" >P, R</td></tr><tr><td align="center" valign="middle" >A Technique for Human Event Analysis (ATHENA)</td><td align="center" valign="middle" >(2nd generation of HRA methodology). It aims to evaluate the likelihood of human error arising while performing a specific task. &#183; It is applied in the wake of the occurrence of an incident and can operate as a diagnostic modelling tool. &#183; However, it lacks numerical aspects involved in the methodology utilized to build the model, also it is not predictive, and does not consider the Human Error Probability (HEP) as an output (compared to the 1st generation HRA methodologies). It is not appropriate for use in particular areas such as sensitivity analysis.</td><td align="center" valign="middle" >Various fields such as: &#183; Healthcare &#183; Engineering &#183; Nuclear &#183; Transportation &#183; etc.</td><td align="center" valign="middle" >QT, QL</td><td align="center" valign="middle" >R</td></tr><tr><td align="center" valign="middle" >The Cognitive Reliability and Error Analysis Method (CREAM)</td><td align="center" valign="middle" >(2nd generation of HRA) It describes an “error taxonomy which integrates individual, technological and organizational factors based on cognitive engineering principles” (Hollnagel, 1998) . It can help to (Hollnagel, 1998) : &#183; “Identify tasks that require human cognition and therefore depend on cognitive reliability”, &#183; “Determine the conditions where cognitive reliability and ensuing risk may be reduced”, &#183; “Provide an appraisal of the consequences of human performance on system safety which can be used in probabilistic safety assessment (PSA)”. &#183; However, this process is complex and intimidating, it is not employed widely. The CREAM is a time-consuming process.</td><td align="center" valign="middle" >Fields such as: &#183; Healthcare &#183; Manufacturing &#183; Transportation &#183; etc.</td><td align="center" valign="middle" >QL</td><td align="center" valign="middle" >P</td></tr><tr><td align="center" valign="middle" >The AcciMap approach</td><td align="center" valign="middle" >It is “a system-based technique for accident analysis, specifically for analysing the causes of accidents and incidents that occur in complex sociotechnical systems” (Rasmussen, 1997) . It is not a domain-specific approach. The AcciMap approach can supports effective decision-making in addressing systemic accident analysis and formulate safety recommendations. It might be useful to combine the AcciMap, the FRAM process and STAMP (Yousefi et al., 2019) .</td><td align="center" valign="middle" >To assess accident in various sectors such as: &#183; Mining &#183; Bushfire &#183; Transportation &#183; etc.</td><td align="center" valign="middle" >QL</td><td align="center" valign="middle" >R</td></tr><tr><td align="center" valign="middle" >The Human Factors Analysis and Classification System (HFACS)</td><td align="center" valign="middle" >It is a taxonomy-based aviation accident analysis method that can help identify the human causes of an accident (Salmon et al., 2012) . The HFACS is based on the “Swiss Cheese” model of human error by Reason (1990) . It may help investigate four human failure stages, namely: unsafe acts, preconditions for unsafe acts, unsafe supervision, and organizational influences. However, it is only as good as the subject matter experts behind the analysis in question.</td><td align="center" valign="middle" >To examine and assess human factors aspects such as: &#183; Aerospace &#183; Aviation &#183; etc.</td><td align="center" valign="middle" >QL</td><td align="center" valign="middle" >R</td></tr></tbody></table></table-wrap><p>taken up to now, countless tragedies and human lives losses still occur every single day. For instance, recent disasters such as the deadly explosion in 2020, during test operations of Fortesa’s Gadiaga-2 Gas Field located in the village of Gadiaga, north of Dakar in Senegal, actualize the issue of onshore and offshore safety. A vicious fire broke out at one of the wells of the gas field operated by Fortesa International (AODL: Africa Onshore Drilling LTD). Likewise, for e.g., the MV Le Joola disaster, the second-worst non-military tragedy in maritime history. This roll-on/roll-off ferry was belonging to the Senegalese government. It capsized off in 2002 with 1863 losses in human life and 64 survivors.</p><p>These consequences can be explained by the combination in unexpected manners of multiple functions performance variability. Indeed, both normal performance and failures are emergent instead of the outcome of events or phenomena (i.e., the principle of emergence). In fact, risk should be seen as a developing attribute of complex and dynamic socio-technical systems. Therefore, it is urgent to investigate thoroughly at these kinds of disturbance to fully grasp all the connotations and ascertain the real needs that call for a response at strategic level.</p></sec><sec id="s4_2"><title>4.2. Other Assessment Approaches as an Alternative or Complementary Method to the FRAM Process</title><p>This section carries out an evaluation of some of the most established methods used for risk assessment and management that may constitute an alternative or a complementary method to the FRAM process namely, the AcciMap, the Systems-Theoretic Accident Model and Processes (STAMP), the Management Oversight and Risk Tree (MORT), the Failure Mode and Effect Analysis (FMEA), the Root-Cause Analysis (RCA), the Human Reliability Assessment (HRA). <xref ref-type="table" rid="table7">Table 7</xref> depicts these non-exhaustive assessment processes.</p></sec></sec><sec id="s5"><title>5. Conclusion and Future Research</title><p>The unstable economic context is forcing organizations to adapt their economic models to contend with the challenges inflicted by the fierce competition of international markets (Diop et al., 2019). Companies that fully understand and grasp the value of the benefits that emanate from digital maturity including industry 4.0 technologies will be best positioned to meet the challenges of the future (Diop et al., 2021). However, over the last decades, occupational environment has become progressively more complex due to the arrival of the four industrial revolutions, namely industry 4.0. These organizations face significant uncertainties and dreaded risks of all kinds such occupational health and safety in safety critical domains.</p><p>Both scholars and practitioners have been interested in the application of the functional resonance analysis method (FRAM) in support of the assessment of performance variability in complex and dynamic socio-technical systems. A growing trend of publications on this subject matter is obvious in our bibliometric literature review. Hence, the metrics show a substantial increase of the number of scholars and countries involved in this area of research. The outcomes of this survey showed the usefulness of the FRAM methodology for systemic safety assessment to explain performance variability. There are many challenging projects in this research area calling for responses, for e.g., supply chain sustainability in the context of COVID-19 pandemic, the challenges of onshore and offshore safety, the challenges for healthcare in a context of pandemic response, aviation safety, electrical utilities such as transmission and distribution which are considered as capital-intensive assets and complex adaptive system of systems (in line with theme 3 of the Hydro-Qu&#233;bec asset management chair)<sup>17</sup>. For e.g., Hydro-Qu&#233;bec has substantial asset portfolios. Abdul-Nour et al. (2021) noted that “in every step of the chain of production, electrical utilities must know the condition, location and availability of their assets to maximize productivity, reduce service interruptions and ensure the safety of operations and users”. Therefore, it is crucial to look thoroughly at this methodology to grasp all the recommendations and identify the real demands that call for an answer at the strategic level. Abdul-Nour et al. (2021) proposed a resilience management framework designed for complex systems as sown in <xref ref-type="fig" rid="fig1">Figure 1</xref>9. In this regard, five components, namely: 1) “scientific evidence, 2) knowledge bases, 3) global assessment of risks, 4) review and judgment of management, and 5) decision making”, form the decision-making process in relation to risks.</p><p>The outcome of this review contributes to legitimize and validate the FRAM process for describing sociotechnical work inside the immense discipline of safety assessment and physical asset management. It also emphasises some pros and cons of this process. Accordingly, other assessment approaches were presented as a complement or an alternative to the FRAM process.</p></sec><sec id="s6"><title>Acknowledgements</title><p>The authors acknowledge the anonymous reviewers, whose critiques and suggestions improved the quality of this manuscript.</p></sec><sec id="s7"><title>Conflicts of Interest</title><p>The authors declare no conflicts of interest regarding the publication of this paper.</p></sec><sec id="s8"><title>Cite this paper</title><p>Diop, I., Abdul-Nour, G., &amp; Komljenovic, D. (2022). The Functional Resonance Analysis Method: A Performance Appraisal Tool for Risk Assessment and Accident Investigation in Complex and Dynamic Socio-Technical Systems. American Journal of Industrial and Business Management, 12, 195-230. https://doi.org/10.4236/ajibm.2022.122013</p></sec><sec id="s9"><title>Appendices</title>Appendix 1—Three-Fields Plot<p>FigureA1 illustrates the Three-Fields Plot: Country (AU_CO), Authors (AU), Keywords Plus (ID).</p></sec><sec id="s10"><title>NOTES</title></sec></body><back><ref-list><title>References</title><ref id="scirp.115572-ref1"><label>1</label><mixed-citation publication-type="other" xlink:type="simple">Abdelgawad, M., &amp; Fayek, A. R. (2010). Risk Management in the Construction Industry Using Combined Fuzzy FMEA and Fuzzy AHP. Journal of Construction Engineering and Management, 136, 1028-1036. https://doi.org/10.1061/(ASCE)CO.1943-7862.0000210</mixed-citation></ref><ref id="scirp.115572-ref2"><label>2</label><mixed-citation publication-type="book" xlink:type="simple">Abdul-Nour, G., Gauthier, F., Diallo, I., Komljenovic, D., Vaillancourt, R., &amp; C&amp;#244t&amp;#233, A. (2021). Development of a Resilience Management Framework Adapted to Complex Asset Systems: Hydro-Qu&amp;#233bec Research Chair on Asset Management. In A. Crespo Marquez, D. Komljenovic, &amp; J. Amadi-Echendu (Eds.), 14th World Congress on Engineering Asset Management (pp. 126-136). Springer Science and Business Media Deutschland GmbH. https://doi.org/10.1007/978-3-030-64228-0_12</mixed-citation></ref><ref id="scirp.115572-ref3"><label>3</label><mixed-citation publication-type="other" xlink:type="simple">Adriaensen, A., Patriarca, R., Smoker, A., &amp; Bergstr&amp;#246m, J. (2019). A Socio-Technical Analysis of Functional Properties in a Joint Cognitive System: A Case Study in an Aircraft Cockpit. Ergonomics, 62, 1598-1616. https://doi.org/10.1080/00140139.2019.1661527</mixed-citation></ref><ref id="scirp.115572-ref4"><label>4</label><mixed-citation publication-type="other" xlink:type="simple">Afuye, G. A., Kalumba, A. M., Busayo, E. T., &amp; Orimoloye, I. R. (2021). A Bibliometric Review of Vegetation Response to Climate Change. Environmental Science and Pollution Research, 28, 1-13. https://doi.org/10.1007/s11356-021-16319-7</mixed-citation></ref><ref id="scirp.115572-ref5"><label>5</label><mixed-citation publication-type="other" xlink:type="simple">Aguilera, M. V. C., da Fonseca, B. B., Ferris, T. K., Vidal, M. C. R., &amp; de Carvalho, P. V. R. (2016). Modelling Performance Variabilities in Oil Spill Response to Improve System Resilience. Journal of Loss Prevention in the Process Industries, 41, 18-30. https://doi.org/10.1016/j.jlp.2016.02.018</mixed-citation></ref><ref id="scirp.115572-ref6"><label>6</label><mixed-citation publication-type="other" xlink:type="simple">Albery, S., Borys, D., &amp; Tepe, S. (2016). Advantages for Risk Assessment: Evaluating Learnings from Question Sets Inspired by the FRAM and the Risk Matrix in a Manufacturing Environment. Safety Science, 89, 180-189. https://doi.org/10.1016/j.ssci.2016.06.005</mixed-citation></ref><ref id="scirp.115572-ref7"><label>7</label><mixed-citation publication-type="other" xlink:type="simple">Allison, C. K., Revell, K. M., Sears, R., &amp; Stanton, N. A. (2017). Systems Theoretic Accident Model and Process (STAMP) Safety Modelling Applied to an Aircraft Rapid Decompression Event. Safety Science, 98, 159-166. https://doi.org/10.1016/j.ssci.2017.06.011https://www.sciencedirect.com/science/article/pii/S0925753516304945</mixed-citation></ref><ref id="scirp.115572-ref8"><label>8</label><mixed-citation publication-type="other" xlink:type="simple">Alm, H., &amp; Woltjer, R. (2010). Patient Safety Investigation through the Lens of FRAM. In Human Factors: A System View of Human, Technology and Organisation (pp. 53-65). Shaker Publishing.</mixed-citation></ref><ref id="scirp.115572-ref9"><label>9</label><mixed-citation publication-type="other" xlink:type="simple">Anvarifar, F., Voorendt, M. Z., Zevenbergen, C., &amp; Thissen, W. (2017). An Application of the Functional Resonance Analysis Method (FRAM) to Risk Analysis of Multifunctional Flood Defences in the Netherlands. Reliability Engineering &amp; System Safety, 158, 130-141. https://doi.org/10.1016/j.ress.2016.10.004</mixed-citation></ref><ref id="scirp.115572-ref10"><label>10</label><mixed-citation publication-type="other" xlink:type="simple">Appicharla, S. (2011). Modelling and Analysis of Herefordshire Level Crossing Accident Using Management Oversight and Risk Tree (MORT). In 6th IET International Conference on System Safety 2011 (pp. 1-10). Institution of Engineering and Technology. https://doi.org/10.1049/cp.2011.0259</mixed-citation></ref><ref id="scirp.115572-ref11"><label>11</label><mixed-citation publication-type="other" xlink:type="simple">Aria, M., &amp; Cuccurullo, C. (2017). Bibliometrix: An R-Tool for Comprehensive Science Mapping Analysis. Journal of Informetrics, 11, 959-975. https://doi.org/10.1016/j.joi.2017.08.007</mixed-citation></ref><ref id="scirp.115572-ref12"><label>12</label><mixed-citation publication-type="other" xlink:type="simple">Bellini, E., Coconea, L., &amp; Nesi, P. (2020). A Functional Resonance Analysis Method Driven Resilience Quantification for Socio-Technical Systems. IEEE Systems Journal, 14, 1234-1244. https://doi.org/10.1109/JSYST.2019.2905713</mixed-citation></ref><ref id="scirp.115572-ref13"><label>13</label><mixed-citation publication-type="other" xlink:type="simple">Bellini, E., Nesi, P., Pantaleo, G., &amp; Venturi, A. (2016). Functional Resonance Analysis Method Based-Decision Support Tool for Urban Transport System Resilience Management. In 2nd IEEE International Smart Cities Conference, ISC2 2016 (pp. 1-7). Institute of Electrical and Electronics Engineers Inc. https://doi.org/10.1109/ISC2.2016.7580833</mixed-citation></ref><ref id="scirp.115572-ref14"><label>14</label><mixed-citation publication-type="other" xlink:type="simple">Belmonte, F., Sch&amp;#246n, W., Heurley, L., &amp; Capel, R. (2011). Interdisciplinary Safety Analysis of Complex Socio-Technological Systems Based on the Functional Resonance Accident Model: An Application to Railway Traffic Supervision. Reliability Engineering &amp; System Safety, 96, 237-249. https://doi.org/10.1016/j.ress.2010.09.006</mixed-citation></ref><ref id="scirp.115572-ref15"><label>15</label><mixed-citation publication-type="other" xlink:type="simple">Bjerga, T., Aven, T., &amp; Zio, E. (2016). Uncertainty Treatment in Risk Analysis of Complex Systems: The Cases of STAMP and FRAM. Reliability Engineering &amp; System Safety, 156, 203-209. https://doi.org/10.1016/j.ress.2016.08.004</mixed-citation></ref><ref id="scirp.115572-ref16"><label>16</label><mixed-citation publication-type="other" xlink:type="simple">Buikstra, E., Strivens, E., &amp; Clay-Williams, R. (2020). Understanding Variability in Discharge Planning Processes for the Older Person. Safety Science, 121, 137-146. https://doi.org/10.1016/j.ssci.2019.08.026</mixed-citation></ref><ref id="scirp.115572-ref17"><label>17</label><mixed-citation publication-type="other" xlink:type="simple">Cabrera, M. V., Vidal, M. C. R., Ferris, T. K., &amp; De Carvalho, P. V. R. (2014). Modeling Oil Spill Defense System Using Functional Resonance Analysis Method. In Process Safety Spotlights 2014—Topical Conference at the 2014 AIChE Spring Meeting and 10th Global Congress on Process Safety (pp. 1-8). AICE. ISBN: 978-0-8169-1083-0.</mixed-citation></ref><ref id="scirp.115572-ref18"><label>18</label><mixed-citation publication-type="other" xlink:type="simple">Center for Chemical Process Safety (1999). Guidelines for Chemical Process Quantitative Risk Analysis (2nd ed.). American Institute of Chemical Engineers.</mixed-citation></ref><ref id="scirp.115572-ref19"><label>19</label><mixed-citation publication-type="other" xlink:type="simple">Center for Chemical Process Safety (2008). Guidelines for Hazard Evaluation Procedures (3rd ed.). Wiley.</mixed-citation></ref><ref id="scirp.115572-ref20"><label>20</label><mixed-citation publication-type="other" xlink:type="simple">Chiozza, M. L., &amp; Ponzetti, C. (2009). FMEA: A Model for Reducing Medical Errors. Clinica Chimica Acta, 404, 75-78. https://doi.org/10.1016/j.cca.2009.03.015</mixed-citation></ref><ref id="scirp.115572-ref21"><label>21</label><mixed-citation publication-type="other" xlink:type="simple">Clay-Williams, R., Hounsgaard, J., &amp; Hollnagel, E. (2015). Where the Rubber Meets the Road: Using FRAM to Align Work-as-Imagined with Work-as-Done When Implementing Clinical Guidelines. Implementation Science, 10, 1-8. https://doi.org/10.1186/s13012-015-0317-y</mixed-citation></ref><ref id="scirp.115572-ref22"><label>22</label><mixed-citation publication-type="other" xlink:type="simple">Cobo, M. J., L&amp;#243pez-Herrera, A. G., Herrera-Viedma, E., &amp; Herrera, F. (2011). An Approach for Detecting, Quantifying, and Visualizing the Evolution of a Research Field: A Practical Application to the Fuzzy Sets Theory Field. Journal of Informetrics, 5, 146-166. https://doi.org/10.1016/j.joi.2010.10.002</mixed-citation></ref><ref id="scirp.115572-ref23"><label>23</label><mixed-citation publication-type="other" xlink:type="simple">Costantino, F., Di Gravio, G., &amp; Tronci, M. (2018). Environmental Audit Improvements in Industrial Systems through FRAM. IFAC-PapersOnLine, 51, 1155-1161. https://doi.org/10.1016/j.ifacol.2018.08.434</mixed-citation></ref><ref id="scirp.115572-ref24"><label>24</label><mixed-citation publication-type="other" xlink:type="simple">Dai, W., Maropoulos, P. G., Cheung, W. M., &amp; Tang, X. (2011). Decision-Making in Product Quality Based on Failure Knowledge. International Journal of Product Lifecycle Management, 5, 143-163. https://doi.org/10.1504/IJPLM.2011.043185</mixed-citation></ref><ref id="scirp.115572-ref25"><label>25</label><mixed-citation publication-type="other" xlink:type="simple">Das, P., Benneyan, J., Powers, L., Carmody, M., Kerwin, J., &amp; Singer, S. (2018). Engineering Safer Care Coordination from Hospital to Home: Lessons from the USA. Future Healthcare Journal, 5, 164. https://doi.org/10.7861/futurehosp.5-3-164</mixed-citation></ref><ref id="scirp.115572-ref26"><label>26</label><mixed-citation publication-type="other" xlink:type="simple">De Carvalho, P. V. R. (2011). The Use of Functional Resonance Analysis Method (FRAM) in a Mid-Air Collision to Understand Some Characteristics of the Air Traffic Management System Resilience. Reliability Engineering and System Safety, 96, 1482-1498. https://doi.org/10.1016/j.ress.2011.05.009</mixed-citation></ref><ref id="scirp.115572-ref27"><label>27</label><mixed-citation publication-type="other" xlink:type="simple">de Vries, L. (2017). Work as Done? Understanding the Practice of Sociotechnical Work in the Maritime Domain. Journal of Cognitive Engineering and Decision Making, 11, 270-295. https://doi.org/10.1177/1555343417707664</mixed-citation></ref><ref id="scirp.115572-ref28"><label>28</label><mixed-citation publication-type="journal" xlink:type="simple"><name name-style="western"><surname>Diop</surname><given-names> I.</given-names></name>,<name name-style="western"><surname> AbdulNour</surname><given-names> G.</given-names></name>,<name name-style="western"><surname> &amp; Komljenovic</surname><given-names> D. </given-names></name>,<etal>et al</etal>. (<year>2021</year>)<article-title>. Overview of Strategic Approach to Asset Management and Decision-Making</article-title><source> International Journal of Engineering and Technical Research (IJERT)</source><volume> 10</volume>,<fpage> 64</fpage>-<lpage>89</lpage>.<pub-id pub-id-type="doi"></pub-id></mixed-citation></ref><ref id="scirp.115572-ref29"><label>29</label><mixed-citation publication-type="other" xlink:type="simple">Diop, I., Nadeau, S., &amp; Emami-Mehrgani, B. (2019). A Mathematical Model: A Flexible Manufacturing System, Prone to Error, Making Two Products Each with Stochastic Demand Schedules. American Journal of Industrial and Business Management, 9, 139-168. https://doi.org/10.4236/ajibm.2019.91011</mixed-citation></ref><ref id="scirp.115572-ref30"><label>30</label><mixed-citation publication-type="other" xlink:type="simple">Duan, G., Tian, J., &amp; Wu, J. (2015). Extended FRAM by Integrating with Model Checking to Effectively Explore Hazard Evolution. Mathematical Problems in Engineering, 2015, Article ID: 196107. https://doi.org/10.1155/2015/196107</mixed-citation></ref><ref id="scirp.115572-ref31"><label>31</label><mixed-citation publication-type="other" xlink:type="simple">Ellegaard, O., &amp; Wallin, J. A. (2015). The Bibliometric Analysis of Scholarly Production: How Great Is the Impact? Scientometrics, 105, 1809-1831. https://doi.org/10.1007/s11192-015-1645-z</mixed-citation></ref><ref id="scirp.115572-ref32"><label>32</label><mixed-citation publication-type="other" xlink:type="simple">Falegnami, A., Costantino, F., Di Gravio, G., &amp; Patriarca, R. (2019). Unveil Key Functions in Socio-Technical Systems: Mapping FRAM into a Multilayer Network. Cognition, Technology &amp; Work, 22, 877-899. https://doi.org/10.1007/s10111-019-00612-0</mixed-citation></ref><ref id="scirp.115572-ref33"><label>33</label><mixed-citation publication-type="other" xlink:type="simple">Ferjencik, M. (2011). An Integrated Approach to the Analysis of Incident Causes. Safety Science, 49, 886-905. https://doi.org/10.1016/j.ssci.2011.02.005</mixed-citation></ref><ref id="scirp.115572-ref34"><label>34</label><mixed-citation publication-type="other" xlink:type="simple">Ferreira, P. N., &amp; Ca&amp;#241as, J. J. (2019). Assessing Operational Impacts of Automation Using Functional Resonance Analysis Method. Cognition, Technology &amp; Work, 21, 535-552. https://doi.org/10.1007/s10111-019-00540-z</mixed-citation></ref><ref id="scirp.115572-ref35"><label>35</label><mixed-citation publication-type="other" xlink:type="simple">Fran&amp;#231a, J. E. M., Hollnagel, E., dos Santos, I. J. A. L., &amp; Haddad, A. N. (2021). Analysing Human Factors and Non-Technical Skills in Offshore Drilling Operations Using FRAM (Functional Resonance Analysis Method). Cognition, Technology and Work, 23, 553-566. https://doi.org/10.1007/s10111-020-00638-9</mixed-citation></ref><ref id="scirp.115572-ref36"><label>36</label><mixed-citation publication-type="other" xlink:type="simple">Fran&amp;#231a, J. E., Hollnagel, E., dos Santos, I. J. L., &amp; Haddad, A. N. (2019). FRAM AHP Approach to Analyse Offshore Oil Well Drilling and Construction Focused on Human Factors. Cognition, Technology &amp; Work, 22, 653-665. https://doi.org/10.1007/s10111-019-00594-z</mixed-citation></ref><ref id="scirp.115572-ref37"><label>37</label><mixed-citation publication-type="other" xlink:type="simple">Furniss, D., Curzon, P., &amp; Blandford, A. (2016). Using FRAM beyond Safety: A Case Study to Explore How Sociotechnical Systems Can Flourish or Stall. Theoretical Issues in Ergonomics Science, 17, 507-532. https://doi.org/10.1080/1463922X.2016.1155238</mixed-citation></ref><ref id="scirp.115572-ref38"><label>38</label><mixed-citation publication-type="other" xlink:type="simple">Gao, Y., Fan, Y., Wang, J., &amp; Duan, Z. (2019). Evaluation of Governmental Safety Regulatory Functions in Preventing Major Accidents in China. Safety Science, 120, 299-311. https://doi.org/10.1016/j.ssci.2019.07.002</mixed-citation></ref><ref id="scirp.115572-ref39"><label>39</label><mixed-citation publication-type="other" xlink:type="simple">Gattola, V., Patriarca, R., Tomasi, G., &amp; Tronci, M. (2018). Functional Resonance in Industrial Operations: A Case Study in a Manufacturing Plant. IFAC-PapersOnLine, 51, 927-932. https://doi.org/10.1016/j.ifacol.2018.08.489</mixed-citation></ref><ref id="scirp.115572-ref40"><label>40</label><mixed-citation publication-type="other" xlink:type="simple">Goldberg, B. E., Everhart, K., Stevens, R., Babbitt III, N., Clemens, P., &amp; Stout, L. (1994). System Engineering Toolbox for Design-Oriented Engineers. No. NAS 1.61: 1358.</mixed-citation></ref><ref id="scirp.115572-ref41"><label>41</label><mixed-citation publication-type="other" xlink:type="simple">Herrera, I. A., &amp; Woltjer, R. (2010). Comparing a Multi-Linear (STEP) and Systemic (FRAM) Method for Accident Analysis. Reliability Engineering &amp; System Safety, 95, 1269-1275. https://doi.org/10.1016/j.ress.2010.06.003</mixed-citation></ref><ref id="scirp.115572-ref42"><label>42</label><mixed-citation publication-type="other" xlink:type="simple">Hirsch, J. E. (2005). An Index to Quantify an Individual’s Scientific Research Output. Proceedings of the National Academy of Sciences, 102, 16569-16572. https://doi.org/10.1073/pnas.0507655102</mixed-citation></ref><ref id="scirp.115572-ref43"><label>43</label><mixed-citation publication-type="other" xlink:type="simple">Hollnagel, E. (1998). Cognitive Reliability and Error Analysis Method (CREAM). Elsevier.</mixed-citation></ref><ref id="scirp.115572-ref44"><label>44</label><mixed-citation publication-type="other" xlink:type="simple">Hollnagel, E. (2004). Barriers and Accident Prevention. Ashgate.</mixed-citation></ref><ref id="scirp.115572-ref45"><label>45</label><mixed-citation publication-type="other" xlink:type="simple">Hollnagel, E. (2012). FRAM: The Functional Resonance Analysis Method: Modelling Complex Socio-Technical Systems (pp. 1-142). Ashgate Publishing Ltd.</mixed-citation></ref><ref id="scirp.115572-ref46"><label>46</label><mixed-citation publication-type="other" xlink:type="simple">Hollnagel, E. (2013). Resilience Engineering in Practice: A Guidebook. Ashgate Publishing, Ltd.</mixed-citation></ref><ref id="scirp.115572-ref47"><label>47</label><mixed-citation publication-type="other" xlink:type="simple">Hollnagel, E. (2014). Safety-I and Safety-II. The Past and Future of Safety Management. Ashgate.</mixed-citation></ref><ref id="scirp.115572-ref48"><label>48</label><mixed-citation publication-type="other" xlink:type="simple">Hollnagel, E. (2016). A FRAM Glossary. https://www.functionalresonance.com</mixed-citation></ref><ref id="scirp.115572-ref49"><label>49</label><mixed-citation publication-type="other" xlink:type="simple">Hollnagel, E. (2018). Safety-I and Safety-II: The Past and Future of Safety Management. CRC Press. https://doi.org/10.1201/9781315607511</mixed-citation></ref><ref id="scirp.115572-ref50"><label>50</label><mixed-citation publication-type="other" xlink:type="simple">Hollnagel, E., Hounsgaard, J., &amp; Colligan, L. (2014). FRAM-the Functional Resonance Analysis Method: A Handbook for the Practical Use of the Method. Centre for Quality, Region of Southern Denmark.</mixed-citation></ref><ref id="scirp.115572-ref51"><label>51</label><mixed-citation publication-type="other" xlink:type="simple">Hollnagel, E., Pruchnicki, S., Woltjer, R., &amp; Etcher, S. (2008). Analysis of Comair Flight 5191 with the Functional Resonance Accident Model. In 8th International Symposium of the Australian Aviation Psychology Association (pp. 1-8). Hal Open Science.</mixed-citation></ref><ref id="scirp.115572-ref52"><label>52</label><mixed-citation publication-type="other" xlink:type="simple">Hollnagel, E., Woods, D. D., &amp; Leveson, N. (2012). Resilience Engineering: Concepts and Precepts (pp. 1-397). Ashgate Publishing Ltd.</mixed-citation></ref><ref id="scirp.115572-ref53"><label>53</label><mixed-citation publication-type="other" xlink:type="simple">Hounsgaard, J. (2016). Patient Safety in Everyday Work: Learning from Things That Go Right. Master’s Thesis, Syddansk Universitet.</mixed-citation></ref><ref id="scirp.115572-ref54"><label>54</label><mixed-citation publication-type="other" xlink:type="simple">Huang, W., Shuai, B., Zuo, B., Xu, Y., &amp; Antwi, E. (2019). A Systematic Railway Dangerous Goods Transportation System Risk Analysis Approach: The 24 Model. Journal of Loss Prevention in the Process Industries, 61, 94-103. https://doi.org/10.1016/j.jlp.2019.05.021</mixed-citation></ref><ref id="scirp.115572-ref55"><label>55</label><mixed-citation publication-type="other" xlink:type="simple">Jensen, A., &amp; Aven, T. (2017). Hazard/Threat Identification: Using Functional Resonance Analysis Method in Conjunction with the Anticipatory Failure Determination Method. Proceedings of the Institution of Mechanical Engineers, Part O: Journal of Risk and Reliability, 231, 383-389. https://doi.org/10.1177/1748006X17698067</mixed-citation></ref><ref id="scirp.115572-ref56"><label>56</label><mixed-citation publication-type="journal" xlink:type="simple"><name name-style="western"><surname>Johnson</surname><given-names> W. G. </given-names></name>,<etal>et al</etal>. (<year>1973</year>)<article-title>. The Management Oversight and Risk Tree (MORT)</article-title><source> Journal of Safety Research</source><volume> 7</volume>,<fpage> 4</fpage>-<lpage>15</lpage>.<pub-id pub-id-type="doi"></pub-id></mixed-citation></ref><ref id="scirp.115572-ref57"><label>57</label><mixed-citation publication-type="other" xlink:type="simple">Kaya, G. K., &amp; Hocaoglu, M. F. (2020). Semi-Quantitative Application to the Functional Resonance Analysis Method for Supporting Safety Management in a Complex Health-Care Process. Reliability Engineering and System Safety, 202, Article ID: 106970. https://doi.org/10.1016/j.ress.2020.106970</mixed-citation></ref><ref id="scirp.115572-ref58"><label>58</label><mixed-citation publication-type="other" xlink:type="simple">Kaya, G. K., Ovali, H. F., &amp; Ozturk, F. (2019). Using the Functional Resonance Analysis Method on the Drug Administration Process to Assess Performance Variability. Safety Science, 118, 835-840. https://doi.org/10.1016/j.ssci.2019.06.020</mixed-citation></ref><ref id="scirp.115572-ref59"><label>59</label><mixed-citation publication-type="other" xlink:type="simple">Kaya, G. K., Ozturk, F., &amp; Sariguzel, E. E. (2021). System-Based Risk Analysis in a Tram Operating System: Integrating Monte Carlo Simulation with the Functional Resonance Analysis Method. Reliability Engineering and System Safety, 215, Article ID: 107835. https://doi.org/10.1016/j.ress.2021.107835</mixed-citation></ref><ref id="scirp.115572-ref60"><label>60</label><mixed-citation publication-type="other" xlink:type="simple">Lacey, P. (2011). An Application of Fault Tree Analysis to the Identification and Management of Risks in Government Funded Human Service Delivery. In Proceedings of the 2nd International Conference on Public Policy and Social Sciences (pp. 1-15). SSRN (Social Science Research Network).</mixed-citation></ref><ref id="scirp.115572-ref61"><label>61</label><mixed-citation publication-type="other" xlink:type="simple">Lee, J., &amp; Chung, H. (2018). A New Methodology for Accident Analysis with Human and System Interaction Based on FRAM: Case Studies in Maritime Domain. Safety Science, 109, 57-66. https://doi.org/10.1016/j.ssci.2018.05.011</mixed-citation></ref><ref id="scirp.115572-ref62"><label>62</label><mixed-citation publication-type="other" xlink:type="simple">Leveson, N. (2004). A New Accident Model for Engineering Safer Systems. Safety Science, 42, 237-270. https://doi.org/10.1016/S0925-7535(03)00047-X</mixed-citation></ref><ref id="scirp.115572-ref63"><label>63</label><mixed-citation publication-type="other" xlink:type="simple">Leveson, N. G. (2016). Engineering a Safer World: Systems Thinking Applied to Safety (p. 560). The MIT Press.</mixed-citation></ref><ref id="scirp.115572-ref64"><label>64</label><mixed-citation publication-type="journal" xlink:type="simple"><name name-style="western"><surname>Lotka</surname><given-names> A. J. </given-names></name>,<etal>et al</etal>. (<year>1926</year>)<article-title>. The Frequency Distribution of Scientific Productivity</article-title><source> Journal of the Washington Academy of Sciences</source><volume> 16</volume>,<fpage> 317</fpage>-<lpage>323</lpage>.<pub-id pub-id-type="doi"></pub-id></mixed-citation></ref><ref id="scirp.115572-ref65"><label>65</label><mixed-citation publication-type="other" xlink:type="simple">Lundblad, K., Speziali, J., Woltjer, R., &amp; Lundberg, J. (2008). FRAM as a Risk Assessment Method for Nuclear Fuel Transportation. In Proceedings of the 4th International Conference Working on Safety (pp. 1-8).</mixed-citation></ref><ref id="scirp.115572-ref66"><label>66</label><mixed-citation publication-type="other" xlink:type="simple">Macchi, L. (2010). A Resilience Engineering Approach for the Evaluation of Performance Variability: Development and Application of the Functional Resonance Analysis Method for Air Traffic Management Safety Assessment. Ph.D. Thesis, &amp;#201cole Nationale Sup&amp;#233rieure des Mines de Paris.</mixed-citation></ref><ref id="scirp.115572-ref67"><label>67</label><mixed-citation publication-type="other" xlink:type="simple">Martyn, J. (1964). Bibliographic Coupling. Journal of Documentation, 20, 236-236. https://doi.org/10.1108/eb026352</mixed-citation></ref><ref id="scirp.115572-ref68"><label>68</label><mixed-citation publication-type="other" xlink:type="simple">McGill, A., Smith, D., McCloskey, R., Morris, P., Goudreau, A., &amp; Veitch, B. (2021). The Functional Resonance Analysis Method as a Healthcare Research Methodology: A Scoping Review Protocol. JBI Evidence Synthesis, 19, 734-740. https://doi.org/10.11124/JBIES-20-00237</mixed-citation></ref><ref id="scirp.115572-ref69"><label>69</label><mixed-citation publication-type="other" xlink:type="simple">Melanson, A., &amp; Nadeau, S. (2019). Resilience Engineering for Sustainable Prevention in the Manufacturing Sector: A Comparative Study of Two Methods of Risk Analysis. American Journal of Industrial and Business Management, 9, 267-281. https://doi.org/10.4236/ajibm.2019.91017</mixed-citation></ref><ref id="scirp.115572-ref70"><label>70</label><mixed-citation publication-type="other" xlink:type="simple">Moher, D., Liberati, A., Tetzlaff, J., Altman, D. G., &amp; Prisma Group (2009). Preferred Reporting Items for Systematic Reviews and Meta-Analyses: The PRISMA Statement. PLoS Medicine, 6, e1000097. https://doi.org/10.1371/journal.pmed.1000097</mixed-citation></ref><ref id="scirp.115572-ref71"><label>71</label><mixed-citation publication-type="other" xlink:type="simple">Nakajima, K. (2017). Blood Transfusion with Health Information Technology in Emergency Settings from a Safety-II Perspective. In Resilient Health Care (Volume 2, pp. 129-144). CRC Press. https://doi.org/10.1201/9781315605739-14</mixed-citation></ref><ref id="scirp.115572-ref72"><label>72</label><mixed-citation publication-type="other" xlink:type="simple">Nemeth, C. P., &amp; Hollnagel, E. (2016). Resilience Engineering in Practice, Volume 2: Becoming Resilient. CRC Press. https://doi.org/10.1201/9781315605708</mixed-citation></ref><ref id="scirp.115572-ref73"><label>73</label><mixed-citation publication-type="other" xlink:type="simple">Ouyang, M., Hong, L., Yu, M.-H., &amp; Fei, Q. (2010). STAMP-Based Analysis on the Railway Accident and Accident Spreading: Taking the China-Jiaoji Railway Accident for Example. Safety Science, 48, 544-555. https://doi.org/10.1016/j.ssci.2010.01.002</mixed-citation></ref><ref id="scirp.115572-ref74"><label>74</label><mixed-citation publication-type="other" xlink:type="simple">Pardo-Ferreira, M. C., Martínez-Rojas, M., Salguero-Caparr&amp;#243s, F., &amp; Rubio-Romero, J. C. (2019). Evolution of the Functional Resonance Analysis Method (FRAM) through the Combination with Other Methods. Direccion y Organizacion, 68, 41-50. https://doi.org/10.37610/dyo.v0i68.550</mixed-citation></ref><ref id="scirp.115572-ref75"><label>75</label><mixed-citation publication-type="other" xlink:type="simple">Patriarca, R., Di Gravio, G., &amp; Costantino, F. (2017a). A Monte Carlo Evolution of the Functional Resonance Analysis Method (FRAM) to Assess Performance Variability in Complex Systems. Safety Science, 91, 49-60. https://doi.org/10.1016/j.ssci.2016.07.016</mixed-citation></ref><ref id="scirp.115572-ref76"><label>76</label><mixed-citation publication-type="other" xlink:type="simple">Patriarca, R., Di Gravio, G., &amp; Costantino, F. (2018). MyFRAM: An Open Tool Support for the Functional Resonance Analysis Method. In 2nd International Conference on System Reliability and Safety, ICSRS 2017 (pp. 1-5). Institute of Electrical and Electronics Engineers Inc. https://doi.org/10.1109/ICSRS.2017.8272861</mixed-citation></ref><ref id="scirp.115572-ref77"><label>77</label><mixed-citation publication-type="other" xlink:type="simple">Patriarca, R., Di Gravio, G., Costantino, F., &amp; Tronci, M. (2017b). The Functional Resonance Analysis Method for a Systemic Risk Based Environmental Auditing in a Sinter Plant: A Semi-Quantitative Approach. Environmental Impact Assessment Review, 63, 72-86. https://doi.org/10.1016/j.eiar.2016.12.002</mixed-citation></ref><ref id="scirp.115572-ref78"><label>78</label><mixed-citation publication-type="other" xlink:type="simple">Patriarca, R., Di Gravio, G., Woltjer, R., Costantino, F., Praetorius, G., Ferreira, P., &amp; Hollnagel, E. (2020). Framing the FRAM: A Literature Review on the Functional Resonance Analysis Method. Safety Science, 129, Article ID: 104827. https://doi.org/10.1016/j.ssci.2020.104827</mixed-citation></ref><ref id="scirp.115572-ref79"><label>79</label><mixed-citation publication-type="book" xlink:type="simple">Praetorius, G., &amp; Kataria, A. (2016). Chapter 8. Resilience and Complexity in a Maritime Service Supply Chain’s Everyday Operation. In T.-M. Choi (Ed.), Service Supply Chain Systems: A Systems Engineering Approach (pp. 121-137). CRC Press. https://doi.org/10.1201/b20894-16</mixed-citation></ref><ref id="scirp.115572-ref80"><label>80</label><mixed-citation publication-type="other" xlink:type="simple">Praetorius, G., Hollnagel, E., &amp; Dahlman, J. (2015). Modelling Vessel Traffic Service to Understand Resilience in Everyday Operations. Reliability Engineering &amp; System Safety, 141, 10-21. https://doi.org/10.1016/j.ress.2015.03.020</mixed-citation></ref><ref id="scirp.115572-ref81"><label>81</label><mixed-citation publication-type="other" xlink:type="simple">Raben, D. C., Viskum, B., Mikkelsen, K. L., Hounsgaard, J., Bogh, S. B., &amp; Hollnagel, E. (2018). Application of a Non-Linear Model to Understand Healthcare Processes: Using the Functional Resonance Analysis Method on a Case Study of the Early Detection of Sepsis. Reliability Engineering and System Safety, 177, 1-11. https://doi.org/10.1016/j.ress.2018.04.023</mixed-citation></ref><ref id="scirp.115572-ref82"><label>82</label><mixed-citation publication-type="other" xlink:type="simple">Rasmussen, J. (1997). Risk Management in a Dynamic Society: A Modelling Problem. Safety Science, 27, 183-213. https://doi.org/10.1016/S0925-7535(97)00052-0</mixed-citation></ref><ref id="scirp.115572-ref83"><label>83</label><mixed-citation publication-type="other" xlink:type="simple">Rasmussen, J., Pejtersen, A., &amp; Goodstein, L. (1994). Cognitive Systems Engineering. John Wiley &amp; Sons.</mixed-citation></ref><ref id="scirp.115572-ref84"><label>84</label><mixed-citation publication-type="other" xlink:type="simple">Rausand, M., &amp; Hoyland, A. (2004). System Reliability Theory: Models, Statistical Methods, and Applications (2nd ed., Volume 396, p. 88). John Wiley &amp; Sons.</mixed-citation></ref><ref id="scirp.115572-ref85"><label>85</label><mixed-citation publication-type="other" xlink:type="simple">Reason, J. (1990). Human Error. Cambridge University Press. https://doi.org/10.1017/CBO9781139062367</mixed-citation></ref><ref id="scirp.115572-ref86"><label>86</label><mixed-citation publication-type="other" xlink:type="simple">Ropohl, G. (1999). Philosophy of Socio-Technical Systems. Society for Philosophy and Technology Quarterly Electronic Journal, 4, 186-194. https://doi.org/10.5840/techne19994311</mixed-citation></ref><ref id="scirp.115572-ref87"><label>87</label><mixed-citation publication-type="other" xlink:type="simple">Rosa, L. V., Haddad, A. N., &amp; de Carvalho, P. V. R. (2015). Assessing Risk in Sustainable Construction Using the Functional Resonance Analysis Method (FRAM). Cognition, Technology and Work, 17, 559-573. https://doi.org/10.1007/s10111-015-0337-z</mixed-citation></ref><ref id="scirp.115572-ref88"><label>88</label><mixed-citation publication-type="other" xlink:type="simple">Salehi, V., Hanson, N., Smith, D., McCloskey, R., Jarrett, P., &amp; Veitch, B. (2021). Modeling and Analyzing Hospital to Home Transition Processes of Frail Older Adults Using the Functional Resonance Analysis Method (FRAM). Applied Ergonomics, 93, Article ID: 103392. https://doi.org/10.1016/j.apergo.2021.103392</mixed-citation></ref><ref id="scirp.115572-ref89"><label>89</label><mixed-citation publication-type="other" xlink:type="simple">Salmon, P. M., Cornelissen, M., &amp; Trotter, M. J. (2012). Systems-Based Accident Analysis Methods: A Comparison of Accimap, HFACS, and STAMP. Safety Science, 50, 1158-1170. https://doi.org/10.1016/j.ssci.2011.11.009</mixed-citation></ref><ref id="scirp.115572-ref90"><label>90</label><mixed-citation publication-type="other" xlink:type="simple">Sawaragi, T., Horiguchi, Y., &amp; Hina, A. (2006). Safety Analysis of Systemic Accidents Triggered by Performance Deviation. In 2006 SICE-ICASE International Joint Conference (pp. 1778-1781). IEEE. https://doi.org/10.1109/SICE.2006.315635</mixed-citation></ref><ref id="scirp.115572-ref91"><label>91</label><mixed-citation publication-type="other" xlink:type="simple">Slater, D., Hollnagel, E., MacKinnon, R., Sujan, M., Carson-Stevens, A., Ross, A., &amp; Bowie, P. (2022). A Systems Analysis of the COVID-19 Pandemic Response in the United Kingdom—Part 1—The Overall Context. Safety Science, 146, Article ID: 105525. https://doi.org/10.1016/j.ssci.2021.105525</mixed-citation></ref><ref id="scirp.115572-ref92"><label>92</label><mixed-citation publication-type="other" xlink:type="simple">Slim, H. (2020). A Proposal of a Mixed Fuzzy Logic/Rough Sets FRAM Model for Complex Systemic Analyses of Sociotechnical Systems. Ph.D. Thesis, &amp;#201cole de technologie sup&amp;#233rieure de Montr&amp;#233al.</mixed-citation></ref><ref id="scirp.115572-ref93"><label>93</label><mixed-citation publication-type="other" xlink:type="simple">Smith, D., Veitch, B., Khan, F., &amp; Taylor, R. (2020). Integration of Resilience and FRAM for Safety Management. ASCE-ASME Journal of Risk and Uncertainty in Engineering Systems, Part A: Civil Engineering, 6, Article ID: 04020008. https://doi.org/10.1061/AJRUA6.0001044</mixed-citation></ref><ref id="scirp.115572-ref94"><label>94</label><mixed-citation publication-type="other" xlink:type="simple">Smoczy&amp;#324ski, P., Kadzi&amp;#324ski, A., &amp; Gill, A. (2018a). Simulating the World Described with the Functional Resonance Analysis Method. In 28th International European Safety and Reliability Conference, ESREL (pp. 1247-1252). CRC Press/Balkema. https://doi.org/10.1201/9781351174664-157</mixed-citation></ref><ref id="scirp.115572-ref95"><label>95</label><mixed-citation publication-type="other" xlink:type="simple">Smoczy&amp;#324ski, P., Kadzi&amp;#324ski, A., Gill, A., &amp; Anna, K. T. (2018b). Applicability of the Functional Resonance Analysis Method in Urban Transport. MATEC Web of Conferences, 231, Article No. 05006. https://doi.org/10.1051/matecconf/201823105006</mixed-citation></ref><ref id="scirp.115572-ref96"><label>96</label><mixed-citation publication-type="other" xlink:type="simple">Sujan, M.-A., &amp; Felici, M. (2012). Combining Failure Mode and Functional Resonance Analyses in Healthcare Settings. In International Conference on Computer Safety, Reliability, and Security (pp. 364-375). Springer. https://doi.org/10.1007/978-3-642-33678-2_31</mixed-citation></ref><ref id="scirp.115572-ref97"><label>97</label><mixed-citation publication-type="other" xlink:type="simple">Toroody, A. B., Abaei, M. M., &amp; Gholamnia, R. (2016). Conceptual Compression Discussion on a Multi-Linear (FTA) and Systematic (FRAM) Method in an Offshore Operation’s Accident Modeling. International Journal of Occupational Safety and Ergonomics, 22, 532-540. https://doi.org/10.1080/10803548.2016.1157399</mixed-citation></ref><ref id="scirp.115572-ref98"><label>98</label><mixed-citation publication-type="other" xlink:type="simple">U.S. Department of Labor Occupational Safety and Health Administration Process (1994). Safety Management Guidelines for Compliance. U.S. Government Printing Office. OSHA 3133.</mixed-citation></ref><ref id="scirp.115572-ref99"><label>99</label><mixed-citation publication-type="other" xlink:type="simple">Van Eck, N. J., &amp; Waltman, L. (2013). VOSviewer Manual. Leiden: Univeristeit Leiden, 1-53.</mixed-citation></ref><ref id="scirp.115572-ref100"><label>100</label><mixed-citation publication-type="other" xlink:type="simple">Woltjer, R., &amp; Hollnagel, E. (2007). The Alaska Airlines Flight 261 Accident: A Systemic Analysis of Functional Resonance. In 2007 International Symposium on Aviation Psychology (pp. 763-768). CORE Scholar. https://corescholar.libraries.wright.edu/isap_2007/4</mixed-citation></ref><ref id="scirp.115572-ref101"><label>101</label><mixed-citation publication-type="other" xlink:type="simple">Yousefi, A., Rodriguez Hernandez, M., &amp; Lopez Pe&amp;#241a, V. (2019). Systemic Accident Analysis Models: A Comparison Study between AcciMap, FRAM, and STAMP. Process Safety Progress, 38, e12002. https://doi.org/10.1002/prs.12002</mixed-citation></ref><ref id="scirp.115572-ref102"><label>102</label><mixed-citation publication-type="other" xlink:type="simple">Zhang, J., Yu, Q., Zheng, F., Long, C., Lu, Z., &amp; Duan, Z. (2016). Comparing Keywords plus of WOS and Author Keywords: A Case Study of Patient Adherence Research. Journal of the Association for Information Science and Technology, 67, 967-972. https://doi.org/10.1002/asi.23437</mixed-citation></ref></ref-list></back></article>