<?xml version="1.0" encoding="UTF-8"?><!DOCTYPE article  PUBLIC "-//NLM//DTD Journal Publishing DTD v3.0 20080202//EN" "http://dtd.nlm.nih.gov/publishing/3.0/journalpublishing3.dtd"><article xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink" dtd-version="3.0" xml:lang="en" article-type="research article"><front><journal-meta><journal-id journal-id-type="publisher-id">JSEA</journal-id><journal-title-group><journal-title>Journal of Software Engineering and Applications</journal-title></journal-title-group><issn pub-type="epub">1945-3116</issn><publisher><publisher-name>Scientific Research Publishing</publisher-name></publisher></journal-meta><article-meta><article-id pub-id-type="doi">10.4236/jsea.2024.175013</article-id><article-id pub-id-type="publisher-id">JSEA-133291</article-id><article-categories><subj-group subj-group-type="heading"><subject>Articles</subject></subj-group><subj-group subj-group-type="Discipline-v2"><subject>Computer Science&amp;Communications</subject></subj-group></article-categories><title-group><article-title>
 
 
  A Proposed Approach for Measuring Maturity Level of Software Delivery
 
</article-title></title-group><contrib-group><contrib contrib-type="author" xlink:type="simple"><name name-style="western"><surname>Osama</surname><given-names>Hassan Mansour</given-names></name><xref ref-type="aff" rid="aff1"><sup>1</sup></xref></contrib><contrib contrib-type="author" xlink:type="simple"><name name-style="western"><surname>Atef</surname><given-names>Raslan</given-names></name><xref ref-type="aff" rid="aff1"><sup>1</sup></xref></contrib><contrib contrib-type="author" xlink:type="simple"><name name-style="western"><surname>Nagy</surname><given-names>Ramadan</given-names></name><xref ref-type="aff" rid="aff1"><sup>1</sup></xref></contrib></contrib-group><aff id="aff1"><addr-line>Faculty of Postgraduate Studies for Statistical Research, Cairo University, Cairo, Egypt</addr-line></aff><pub-date pub-type="epub"><day>20</day><month>05</month><year>2024</year></pub-date><volume>17</volume><issue>05</issue><fpage>228</fpage><lpage>245</lpage><history><date date-type="received"><day>3,</day>	<month>April</month>	<year>2024</year></date><date date-type="rev-recd"><day>24,</day>	<month>May</month>	<year>2024</year>	</date><date date-type="accepted"><day>27,</day>	<month>May</month>	<year>2024</year></date></history><permissions><copyright-statement>&#169; Copyright  2014 by authors and Scientific Research Publishing Inc. </copyright-statement><copyright-year>2014</copyright-year><license><license-p>This work is licensed under the Creative Commons Attribution International License (CC BY). http://creativecommons.org/licenses/by/4.0/</license-p></license></permissions><abstract><p>
 
 
  Software delivery is vital for modern organizations, driving innovation and competitiveness. Measuring an organization&amp;#8217;s maturity in software delivery is crucial for efficiency and quality. The Capability Maturity Model (CMM) framework provides a roadmap for improvement but assessing an organization&amp;#8217;s CMM Level is challenging. This paper offers a quantitative approach tailored to the CMM framework, using Goal-Question-Metric (GQM) frame-works for each key process area (KPA). These frameworks include metrics and questions to compute maturity scores effectively. The study also refines practices into questions for a thorough assessment. The result is an Analysis Matrix that calculates weighted scores and an overall maturity score. This approach helps organizations assess and enhance their software delivery processes systematically, aiming for improved practices and growth.
 
</p></abstract><kwd-group><kwd>CMM</kwd><kwd> CMMI</kwd><kwd> Software Delivery</kwd><kwd> Maturity</kwd><kwd> KPAs</kwd><kwd> GQM</kwd><kwd> Practices</kwd></kwd-group></article-meta></front><body><sec id="s1"><title>1. Introduction</title><p>Software delivery is a critical aspect of modern businesses and organizations, serving as the conduit through which software products and services reach end-users. The efficiency and effectiveness of this process can significantly impact an organization’s competitiveness, customer satisfaction, and overall success [<xref ref-type="bibr" rid="scirp.133291-ref1">1</xref>] . However, achieving a mature software delivery process is a complex endeavor, fraught with challenges that must be addressed to ensure optimal outcomes [<xref ref-type="bibr" rid="scirp.133291-ref2">2</xref>] . Numerous challenges plague the software delivery landscape, ranging from delays in project timelines and cost overruns to quality issues and stakeholder dissatisfaction. These challenges often stem from inadequate processes, unclear objectives, and a lack of standardized approaches to measure and improve software delivery maturity [<xref ref-type="bibr" rid="scirp.133291-ref3">3</xref>] . In the quest for a mature software delivery process, several fundamental questions emerge. Organizations seek to define and measure the maturity of their software delivery practices, understand the key metrics and indicators of maturity, leverage existing frameworks like the Capability Maturity Model “CMM” to enhance maturity levels, and identify actionable steps for process improvement [<xref ref-type="bibr" rid="scirp.133291-ref4">4</xref>] .</p><p>This research aims to address these questions comprehensively. It begins by providing an overview of the challenges within software delivery, shedding light on the multifaceted issues faced by organizations in this domain. It then delves into the Capability Maturity Model “CMM” and its significance in this context [<xref ref-type="bibr" rid="scirp.133291-ref5">5</xref>] . Central to this research is the proposed method as a structured approach to measuring and enhancing software delivery maturity. The method consists of four layers: Refinement, Iteration, Development, and Knowledge. These layers work in tandem to guide organizations through the process of defining, measuring, and improving software delivery maturity.</p></sec><sec id="s2"><title>2. Background</title><sec id="s2_1"><title>2.1. Capability Maturity Model</title><p>The Capability Maturity Model (CMM) is a framework initially developed to assess the maturity of the software development processes within an organization. It was created by the Software Engineering Institute (SEI) at Carnegie Mellon University in the late 1980s. The primary objective of CMM is to improve and optimize software development processes to enhance the quality of software products and the efficiency of development efforts [<xref ref-type="bibr" rid="scirp.133291-ref6">6</xref>] .</p><p>CMM originated from the need to address the challenges of inconsistency and unpredictability in software development. Organizations were struggling to consistently produce high-quality software within time and budget constraints. The CMM framework aimed to provide a structured approach for organizations to assess and improve their software development practices systematically [<xref ref-type="bibr" rid="scirp.133291-ref7">7</xref>] .</p><p>The history of CMM can be traced back to the late 1980s when the SEI was commissioned by the United States Department of Defense to address the quality and reliability issues in software development for defense projects. The initial version, CMM Level 1, focused on defining ad-hoc processes and aimed to bring stability to chaotic development environments.</p><p>In the realm of software development, the Capability Maturity Model (CMM) stands as a guiding framework, as described by Paulk et al. (1993) [<xref ref-type="bibr" rid="scirp.133291-ref6">6</xref>] . This model serves as a structured pathway for organizations to evaluate and enhance their software development processes. Comprising five distinct levels of maturity, the CMM offers progressive steps towards refined and well-defined processes [<xref ref-type="bibr" rid="scirp.133291-ref7">7</xref>] .</p><p>Level 1, known as the Initial level, organizations often find themselves amidst ad hoc and unpredictable processes. Standard procedures are lacking, and reliance on individual efforts is prevalent.</p><p>Level 2, the Managed level, organizations begin to lay the groundwork with basic project management practices. Here, processes become more structured, with a focus on planning, tracking, and ensuring requirements are met.</p><p>Level 3, the Defined level, signifies a significant leap forward. Organizations at this stage have established well-defined and standardized processes. These processes are documented, understood, and consistently applied throughout the organization.</p><p>Level 4, the Quantitatively Managed level, organizations delve into the realm of measurement and control. Quantitative techniques are utilized to gain insights into processes, aiming for predictability and continual improvement.</p><p>Level 5, the Optimizing level, represents the pinnacle of maturity. Organizations here are in a constant state of refinement, always seeking ways to optimize and enhance their processes. They actively seek feedback, innovate, and base decisions on data to achieve maximum efficiency and quality [<xref ref-type="bibr" rid="scirp.133291-ref7">7</xref>] .</p><p>In <xref ref-type="fig" rid="fig1">Figure 1</xref>, the more the framework is enforced on the process, the higher the maturity level of the organization as well as the outcomes resulting from the process. There are some fundamental concepts used in suing CMM described in <xref ref-type="fig" rid="fig2">Figure 2</xref> [<xref ref-type="bibr" rid="scirp.133291-ref8">8</xref>] .</p><p>In <xref ref-type="fig" rid="fig2">Figure 2</xref>, the software process reflects many activities that are responsible for delivering the final product or software. There is an expected service or product that should result from those activities. The capability of the process refers to the expected product from the software process, while the process performance refers to the actual result or what really resulted from the software process.</p><p>Comparing the actual and expected results to determine the variance between them, or defining the extent to which they are equal, is the maturity of the process. So, the maturity level is usually high when the actual software delivered is close in nature and functionality to the expected result or product, while the maturity level is low when they are very different.</p><p>Maturity level is a number showing how well an organization is achieving the goals of the process, whether it is software or any other business process, as well as how well it is implementing the predefined practices set to achieve those goals.</p></sec><sec id="s2_2"><title>2.2. Standard CMM Appraisal Method for Process Improvement</title><p>In the context of process improvement, the Standard CMM Appraisal Method “SCAMPI” emerges as a comprehensive and methodical approach. This method is deployed to evaluate and enhance the maturity of an organization’s processes, specifically within the framework of the Capability Maturity Model Integration (CMMI) [<xref ref-type="bibr" rid="scirp.133291-ref9">9</xref>] .</p><p>Moreover, SCAMPI serves as a structured framework, aligning an organization’s processes with the defined goals and practices of the CMMI model.</p><p>The SCAMPI process unfolds through distinct stages, each integral to its efficacy. Beginning with meticulous planning, the appraisal team delineates the scope, objectives, and assessment criteria [<xref ref-type="bibr" rid="scirp.133291-ref10">10</xref>] .</p><p>Subsequently, the appraisal phase ensues, involving the meticulous collection and analysis of evidence such as interviews, documentation, and observations. These efforts culminate in determining the maturity level of the organization’s processes.</p><p>Following the assessment, the SCAMPI team generates a comprehensive report delineating the organization’s process landscape. This report meticulously outlines strengths, weaknesses, and areas ripe for improvement. Serving as a strategic roadmap, it guides the organization towards implementing changes and enhancements, facilitating a progression towards heightened process maturity [<xref ref-type="bibr" rid="scirp.133291-ref9">9</xref>] .</p></sec><sec id="s2_3"><title>2.3. GQM</title><p>The Goal-Question-Metric (GQM) approach is a structured method used to define and measure goals in software engineering and other domains [<xref ref-type="bibr" rid="scirp.133291-ref1">1</xref>] . It establishes a hierarchy of goals, questions, and metrics, providing a systematic way to link an organization’s goals to the metrics that can measure their achievement [<xref ref-type="bibr" rid="scirp.133291-ref10">10</xref>] . GQM emphasizes the importance of understanding what an organization wants to achieve, what questions need to be answered to achieve those goals, and what metrics can provide the necessary data [<xref ref-type="bibr" rid="scirp.133291-ref10">10</xref>] .</p><p>The GQM method provides a framework for defining and measuring software quality.</p><p>The method is discussed as a practical guide for quality improvement in software development. It is designed to establish a set of goals and questions, which are then used to define metrics for measuring various aspects of the software development process. This includes measuring the quality of the product (software), the efficiency of the development process, and the utilization of resources [<xref ref-type="bibr" rid="scirp.133291-ref10">10</xref>] .</p><p>In <xref ref-type="fig" rid="fig3">Figure 3</xref>, GQM can measure product, process, and resources as follows:</p><p>Product:</p><p>Goal: Improve the reliability of the software product.</p><p>Question: How reliable is the software product?</p><p>Metric: Defect Density (number of defects per line of code).</p><p>Process:</p><p>Goal: Enhance the efficiency of the development process.</p><p>Question: How long does it take to complete each development phase?</p><p>Metric: Cycle Time (average time to complete a phase).</p><p>Resources:</p><p>Goal: Optimize resource allocation for project tasks.</p><p>Question: How are resources allocated across different project tasks?</p><p>Metric: Resource Utilization Rate (percentage of time resources are utilized) [<xref ref-type="bibr" rid="scirp.133291-ref10">10</xref>] .</p></sec></sec><sec id="s3"><title>3. The Proposed Maturity Measurement Approach</title><p>The proposed approach is outlining a structured approach to measuring maturity in an organization, potentially using the Capability Maturity Model (CMM) framework along with its defined KPAs [<xref ref-type="bibr" rid="scirp.133291-ref11">11</xref>] . This approach aims to provide a systematic and structured method to assess and improve an organization’s maturity across various KPAs. It combines elements of CMM, GQM, and a weighted scoring system to provide a comprehensive view of maturity [<xref ref-type="bibr" rid="scirp.133291-ref12">12</xref>] .</p><sec id="s3_1"><title>3.1. Introducing the Proposed Approach</title><p>The proposed approach in <xref ref-type="fig" rid="fig4">Figure 4</xref> consists of four layers. The Refinement Layer is foundational, identifying, and refining goals with prioritization for effective strategies. The Iteration Layer then translates these goals into the GQM framework, creating metrics and computing maturity scores for tracking. Moving to the Development Layer, organization-wide maturity is calculated by weighting KPAs and combining their scores. The Knowledge Layer interprets data to craft a management report, offering insights for continuous improvement.</p></sec><sec id="s3_2"><title>3.2. Refinement Layer</title><p>The “Refinement Layer” within the proposed approach serves as the initial step in the overall process, focusing on the meticulous enhancement of (KPAs). Through a systematic approach, this layer aims to clarify, prioritize, and refine the core processes that drive an organization’s success.</p><p>This layer involves refining the (KPAs) at CMM Level 2.</p><sec id="s3_2_1"><title>3.2.1. Fetch CMM Level 2 KPAs</title><p>In this step all KPAs of CMM Level 2 will be prepared for prioritization, according to [<xref ref-type="bibr" rid="scirp.133291-ref1">1</xref>] . The Level contains the KPAs show below.</p><p>Requirements Management: Involves identifying, documenting, tracking, and verifying requirements and changes throughout the project lifecycle.</p><p>Project Planning: Creating and maintaining a project plan that defines project activities, including scope, schedules, resources, and budget, to guide project execution.</p><p>Project Monitoring and Control: Tracks project performance against the plan, identifies issues, and takes corrective actions to keep the project on track, ensuring progress aligns with expectations.</p><p>Supplier Agreement Management: Involves selecting suppliers, establishing agreements, and ensuring acquired products meet specified requirements, managing the acquisition of products from suppliers.</p><p>Measurement and Analysis: Developing and sustaining a measurement capability to support management information needs by collecting and analyzing measurements for decision-making.</p><p>Process and Product Quality Assurance: Performing audits and reviews to provide objective insight into processes and work products, ensuring they meet specified quality standards.</p><p>Configuration Management: Establishes and maintains work product integrity using configuration identification, control, status accounting, and audits, managing configuration items and changes while ensuring integrity and traceability throughout the project.</p></sec><sec id="s3_2_2"><title>3.2.2. Refine Goals of KPAs</title><p>Refining goals of collected KPAs is a process that is subject to clarify the goals associated with each KPA of the CMM framework. In <xref ref-type="table" rid="table1">Table 1</xref>, each KPA is listed along with its goal as defined [<xref ref-type="bibr" rid="scirp.133291-ref4">4</xref>] .</p></sec><sec id="s3_2_3"><title>3.2.3. KPAs Prioritization</title><p>Prioritize the KPAs based on their applicability, importance, or impact on the organization. Begin with the foundational KPAs that are essential for establishing a baseline of project management, KPAs that Address Risk and Quality Early, Project Monitoring and Control, Measurement, and analysis finally agreements with suppliers as shown below:</p><p>1) Project Planning (PP)—Establishes project baseline.</p><p>2) Configuration Management (CM)—Ensures work product integrity.</p><p>3) Requirements Management (RM)—Reduces misunderstandings.</p><p>4) Process and Product Quality Assurance (PPQA)—Ensures early quality.</p><p>5) Project Monitoring and Control (PMC)—Tracks project progress.</p><p>6) Measurement and Analysis (MA)—Provides data-driven insights.</p><p>7) Supplier Agreement Management (SAM)—Manages supplier relationships.</p><p>These are the KPAs we need to iterate through in the next layer to build the</p><table-wrap id="table1" ><label><xref ref-type="table" rid="table1">Table 1</xref></label><caption><title> Goals of each key process area with CMM level 2 [<xref ref-type="bibr" rid="scirp.133291-ref8">8</xref>] </title></caption><table><tbody><thead><tr><th align="center" valign="middle" >Key Process Area “KPA”</th><th align="center" valign="middle" >KPA Goal</th></tr></thead><tr><td align="center" valign="middle" >Requirements Management (RM)</td><td align="center" valign="middle" >To manage requirements of products and product components and to identify inconsistencies.</td></tr><tr><td align="center" valign="middle" >Project Planning (PP)</td><td align="center" valign="middle" >To establish and maintain plans that defines project activities.</td></tr><tr><td align="center" valign="middle" >Project Monitoring and Control (PMC)</td><td align="center" valign="middle" >To provide an understanding of the project’s progress for taking corrective actions.</td></tr><tr><td align="center" valign="middle" >Supplier Agreement Management (SAM)</td><td align="center" valign="middle" >To manage the acquisition of products from suppliers.</td></tr><tr><td align="center" valign="middle" >Measurement and Analysis (MA)</td><td align="center" valign="middle" >To develop and sustain a measurement capability to support management information needs.</td></tr><tr><td align="center" valign="middle" >Process and Product Quality Assurance (PPQA)</td><td align="center" valign="middle" >To provide staff and management with objective insight into processes and work products.</td></tr><tr><td align="center" valign="middle" >Configuration Management (CM)</td><td align="center" valign="middle" >To establish and maintain the integrity of work products using configuration management.</td></tr></tbody></table></table-wrap><p>analysis matrix. Each GQM overall result “KPA Score” will be presented as row in the analysis matrix [<xref ref-type="bibr" rid="scirp.133291-ref1">1</xref>] .</p></sec></sec><sec id="s3_3"><title>3.3. Iteration Layer</title><p>This layer focuses on translating the goals of each KPA into specific objectives, converting “Practices” into questions, and defining quantitative metrics to answer these questions as part of GQM approach. In a real-world scenario or when implementing this approach, we should follow the steps outlined from 3.3.1 to 3.3.6 for each KPA. However, for simplicity, we will conduct a measurement the first KPA “Project Planning” to illustrate the approach. The same steps can be followed in a similar manner but within a different context or in other words on the reset of KPAs.</p><sec id="s3_3_1"><title>3.3.1. Mapping KPA Goal into GQM Goal</title><p>Translate the goals of each KPA into corresponding goals in the GQM framework.</p><p>As we have mentioned earlier in the background part GQM goal should contains essential properties, thus we need to reproduce each KPA goal in proper GQM goal.</p><p>KPA Goal: The goal of Project Planning (PP) is to establish and maintain plans that define project activities. This includes outlining the scope, activities, schedules, resources, and budget for the project.</p><p>GQM Goal: Improve project planning accuracy and efficiency.</p><p>Explanation: The GQM goal for Project Planning (PP) is to enhance the accuracy and efficiency of project planning processes. This involves ensuring that project plans are comprehensive, realistic, and well-structured to guide project execution effectively.</p><p>GQM Goal Information:</p><p>- Purpose: The reason for creating the GQM Goal, which is to assess the maturity level of the KPA.</p><p>- Issue: The problem or challenge being addressed, which is the challenge of defining KPA maturity.</p><p>- Object: The entity or subject of the measurement, which is the Key Process Area.</p><p>- Viewpoint: The perspective from which the assessment is made, in this case, the viewpoint of the Project Manager [<xref ref-type="bibr" rid="scirp.133291-ref13">13</xref>] .</p></sec><sec id="s3_3_2"><title>3.3.2. Transform KPA Features into GQM Questions</title><p>Define specific questions (related to the GQM goals) that will be used to assess the achievement of KPA goals. This step is essential because KPA features will be transformed into questions that can have measurable metrics [<xref ref-type="bibr" rid="scirp.133291-ref10">10</xref>] . For instance the feature (Establish project scope) can be transformed into the question (Are project plans aligned with the defined project scope?).</p><p>In <xref ref-type="table" rid="table2">Table 2</xref>, GQM questions are designed to assess the key features of Project Planning (PP) and ensure that they contribute to the overall goal of improving project planning accuracy and efficiency. Each question targets a specific aspect of project planning that is essential for successful project execution.</p><table-wrap id="table2" ><label><xref ref-type="table" rid="table2">Table 2</xref></label><caption><title> KPA Features transformed into GQM Questions [<xref ref-type="bibr" rid="scirp.133291-ref8">8</xref>] </title></caption><table><tbody><thead><tr><th align="center" valign="middle" >KPA Feature</th><th align="center" valign="middle" >GQM Question</th></tr></thead><tr><td align="center" valign="middle" >Establish project scope</td><td align="center" valign="middle" >Are project plans aligned with the defined project scope?</td></tr><tr><td align="center" valign="middle" >Define project activities and tasks</td><td align="center" valign="middle" >Are project tasks and activities clearly defined in the plan?</td></tr><tr><td align="center" valign="middle" >Create project schedules</td><td align="center" valign="middle" >Is the project schedule realistic and achievable?</td></tr><tr><td align="center" valign="middle" >Allocate resources appropriately</td><td align="center" valign="middle" >Are resources allocated optimally based on project requirements?</td></tr><tr><td align="center" valign="middle" >Define project budget</td><td align="center" valign="middle" >Is the project budget accurately reflected in the plan?</td></tr><tr><td align="center" valign="middle" >Identify project risks and mitigation plans</td><td align="center" valign="middle" >Are project risks identified and mitigation plans in place?</td></tr><tr><td align="center" valign="middle" >Develop communication and reporting processes</td><td align="center" valign="middle" >Are communication channels and reporting processes well-defined?</td></tr><tr><td align="center" valign="middle" >Establish project milestones</td><td align="center" valign="middle" >Are project milestones clearly defined and tracked in the plan?</td></tr></tbody></table></table-wrap></sec><sec id="s3_3_3"><title>3.3.3. Build GQM Metrics</title><p>Specific metrics should be created to answer all GQM Questions as shown in <xref ref-type="table" rid="table3">Table 3</xref> [<xref ref-type="bibr" rid="scirp.133291-ref11">11</xref>] .</p><table-wrap id="table3" ><label><xref ref-type="table" rid="table3">Table 3</xref></label><caption><title> GQM Questions and related metrics for project planning KPA [<xref ref-type="bibr" rid="scirp.133291-ref10">10</xref>] </title></caption><table><tbody><thead><tr><th align="center" valign="middle" >GQM Question</th><th align="center" valign="middle" >GQM Metrics</th></tr></thead><tr><td align="center" valign="middle" >Are project plans aligned with the defined project scope?</td><td align="center" valign="middle" >- Percentage of project scope defined in the plan.</td></tr><tr><td align="center" valign="middle" >Are project tasks and activities clearly defined in the plan?</td><td align="center" valign="middle" >- Number of undefined or ambiguous tasks.</td></tr><tr><td align="center" valign="middle" >Is the project schedule realistic and achievable?</td><td align="center" valign="middle" >- Deviation from Planned Timeline (in days or percentage).</td></tr><tr><td align="center" valign="middle" >Are resources allocated optimally based on project requirements?</td><td align="center" valign="middle" >- Accuracy of Resource Allocation (percentage of tasks with correct resource allocation).</td></tr><tr><td align="center" valign="middle" >Is the project budget accurately reflected in the plan?</td><td align="center" valign="middle" >- Percentage of project budget allocated to tasks.</td></tr><tr><td align="center" valign="middle" >Are project risks identified and mitigation plans in place?</td><td align="center" valign="middle" >- Number of identified risks.</td></tr><tr><td align="center" valign="middle" >Are communication channels and reporting processes well-defined?</td><td align="center" valign="middle" >- Number of communication channels established.</td></tr><tr><td align="center" valign="middle" >Are project milestones clearly defined and tracked in the plan?</td><td align="center" valign="middle" >- Percentage of completed activities on schedule.</td></tr></tbody></table></table-wrap></sec><sec id="s3_3_4"><title>3.3.4. Set Metrics Values (Collect Data)</title><p>Collected Data should reflect the actual organization status about each metric that can be achieved through onsite visits to the organization, interviewing, observation, and documentation audit or reviewing relevant documents such as reports, records, policies, and procedures offers a comprehensive view of how metrics are being recorded and utilized. It helps in cross-referencing data obtained from other methods and ensures consistency in information. By employing these diverse data collection methods, a more holistic and accurate understanding of the organization’s status in relation to each metric is achieved. This detailed approach enables informed decision-making and the identification of areas for improvement within the organization’s processes.</p></sec><sec id="s3_3_5"><title>3.3.5. Compute KPA Maturity Score</title><p>After collecting metrics answers we can calculate the maturity score for the KPA.</p><p>Below is the full GQM along with KPA features, Questions, Metrics, unit of each metric, metric value collected and scale from 0 to 5 where 0 is not achieved at all and 5 is fully achieved [<xref ref-type="bibr" rid="scirp.133291-ref12">12</xref>] .</p><p>In <xref ref-type="table" rid="table4">Table 4</xref>, the components of the KPA are then analyzed with their associated questions, metrics, units, values, and points of practice or feature [<xref ref-type="bibr" rid="scirp.133291-ref10">10</xref>] . For example the Feature (Practice) Define Project Scope has the following details:</p><p>o Question: Is the project scope clearly defined?</p><table-wrap id="table4" ><label><xref ref-type="table" rid="table4">Table 4</xref></label><caption><title> GQM for project planning KPA [<xref ref-type="bibr" rid="scirp.133291-ref10">10</xref>] </title></caption><table><tbody><thead><tr><th align="center" valign="middle"  colspan="7"  >KPA: Project Planning. KPA Goal: To establish and maintain plans that defines project activities. This includes outlining the scope, activities, schedules, resources, and budget for the project. GQM Goal: Improve project planning accuracy and efficiency.</th></tr></thead><tr><td align="center" valign="middle" >Goal</td><td align="center" valign="middle"  colspan="6"  >Purpose: The reason for creating the GQM, assess maturity level of the KPA. Issue: The problem being addressed, defining KPA maturity. Object: The entity or subject of the measurement (Key Process Area). Viewpoint: Project Manager.</td></tr><tr><td align="center" valign="middle" >KPA Feature</td><td align="center" valign="middle" >Question</td><td align="center" valign="middle" >Metric</td><td align="center" valign="middle" >U</td><td align="center" valign="middle" >V</td><td align="center" valign="middle" >P</td><td align="center" valign="middle" >Level</td></tr><tr><td align="center" valign="middle" >Define Project Scope</td><td align="center" valign="middle" >Is the project scope clearly defined?</td><td align="center" valign="middle" >Clarity of Project Scope</td><td align="center" valign="middle" >%</td><td align="center" valign="middle" >30</td><td align="center" valign="middle" >2</td><td align="center" valign="middle" >Repeated</td></tr><tr><td align="center" valign="middle" >Establish Project Schedule</td><td align="center" valign="middle" >Is there a detailed project schedule?</td><td align="center" valign="middle" >Completeness of Project Schedule</td><td align="center" valign="middle" >%</td><td align="center" valign="middle" >10</td><td align="center" valign="middle" >1</td><td align="center" valign="middle" >Initial</td></tr><tr><td align="center" valign="middle" >Define Work Breakdown Structure</td><td align="center" valign="middle" >Is there a work breakdown structure (WBS)?</td><td align="center" valign="middle" >WBS Completion</td><td align="center" valign="middle" >Num</td><td align="center" valign="middle" >2</td><td align="center" valign="middle" >2</td><td align="center" valign="middle" >Repeated</td></tr><tr><td align="center" valign="middle" >Estimate Effort and Resources</td><td align="center" valign="middle" >Are effort and resources estimated?</td><td align="center" valign="middle" >Accuracy of Effort and Resource Estimates</td><td align="center" valign="middle" >Num</td><td align="center" valign="middle" >1</td><td align="center" valign="middle" >1</td><td align="center" valign="middle" >Initial</td></tr><tr><td align="center" valign="middle" >Identify Dependencies</td><td align="center" valign="middle" >Are project dependencies identified?</td><td align="center" valign="middle" >Completeness of Dependency Identification</td><td align="center" valign="middle" >Num</td><td align="center" valign="middle" >2</td><td align="center" valign="middle" >2</td><td align="center" valign="middle" >Repeated</td></tr><tr><td align="center" valign="middle" >Establish Risk Management Plan</td><td align="center" valign="middle" >Is there a risk management plan?</td><td align="center" valign="middle" >Existence of Risk Management Plan</td><td align="center" valign="middle" >Num</td><td align="center" valign="middle" >4</td><td align="center" valign="middle" >4</td><td align="center" valign="middle" >Managed</td></tr><tr><td align="center" valign="middle" >Allocate Responsibilities</td><td align="center" valign="middle" >Are responsibilities clearly assigned?</td><td align="center" valign="middle" >Clarity of Responsibility Allocation</td><td align="center" valign="middle" >Num</td><td align="center" valign="middle" >3</td><td align="center" valign="middle" >3</td><td align="center" valign="middle" >Defined</td></tr><tr><td align="center" valign="middle" >Define Quality Plan</td><td align="center" valign="middle" >Is there a quality plan for the project?</td><td align="center" valign="middle" >Existence of Quality Plan</td><td align="center" valign="middle" >Num</td><td align="center" valign="middle" >5</td><td align="center" valign="middle" >5</td><td align="center" valign="middle" >Optimized</td></tr><tr><td align="center" valign="middle" >KPA Score</td><td align="center" valign="middle"  colspan="4"  ></td><td align="center" valign="middle" >2.5</td><td align="center" valign="middle" >Repeated</td></tr></tbody></table></table-wrap><p>o Metric: Clarity of Project Scope.</p><p>o Unit (U): Percentage (%) of clear and well organized and documented projects.</p><p>o Value (V): 30%.</p><p>o Point (P): Scale from 0 to 5 (2).</p><p>o Level: Repeated, the commentary column can present directly which practice needs improvement.</p><p>The final KPA Score, in this case 2.5, represents the overall maturity level of the Project Planning KPA, derived from the assessment of its individual features. This score falls between the categories of “Repeated” and “Defined”, indicating the current maturity level of the KPA in terms of accuracy and efficiency. Organizations usually fall into this rank, has achieved basic project management processes. These processes are defined, documented, and followed consistently across projects [<xref ref-type="bibr" rid="scirp.133291-ref8">8</xref>] . This value will be appended to the analysis matrix in the next step for further computations so that we can find out the company accumulated score [<xref ref-type="bibr" rid="scirp.133291-ref14">14</xref>] .</p></sec><sec id="s3_3_6"><title>3.3.6. Append KPA Maturity Score to the Analysis Matrix</title><p>Add the computed maturity scores to an analysis matrix, which likely tracks all KPAs and their respective scores [<xref ref-type="bibr" rid="scirp.133291-ref14">14</xref>] . As result of iterating through key process area of CMM level 2, the analysis matrix will be completed at the end. The targeted KPAs are Project Planning, configuration Management, Requirement Management, Product and Process Quality Assurance, Project Control Management, Supplier Agreement Management Finally Measurement and Analysis.</p></sec><sec id="s3_3_7"><title>3.3.7. Assign Weight of KPAs</title><p>Weighted scores are typically calculated based on the relative importance or significance of each Key Process Area (KPA) within the context of the assessment or project. There isn’t a universal standard for assigning weights, as it largely depends on the specific criteria, objectives, and priorities of the project or assessment.</p></sec></sec><sec id="s3_4"><title>3.4. Knowledge Layer</title><p>The Knowledge Layer is where the raw data transforms into actionable knowledge. It involves interpreting the analysis matrix, deriving business insights, visualizing data for clarity, organizing through classification, and utilizing GQMs for strategic alignment. This layer bridges the gap between data and decision-making, empowering businesses with informed choices and strategic directions.</p>Create Maturity Report<p>The Maturity Report is not just a numerical representation; it’s a roadmap to organizational excellence. It leverages the analysis matrix, GQM insights, and CMM framework to provide a comprehensive view of where the organization stands and where it can go.</p><p>Interpret the data in the analysis matrix to understand the strengths and weaknesses of the organization’s maturity in each KPA [<xref ref-type="bibr" rid="scirp.133291-ref14">14</xref>] . In <xref ref-type="table" rid="table5">Table 5</xref> Project Planning the Weight is 0.15 refer to the applicability rate set by the organization for project planning KPA, Score is 4 this score is received from GQM of project planning, Weighted Score is the product of Weight (0.15) * score (4) = 0.6. Now let us sum up all weighted scores to compute the overall maturity score of the organization against the requirements of CMM framework level 2. So, the total CMM Level 2 Maturity Score is 2.17.</p><p>Ultimately, a comprehensive analysis of KPA maturity provides a roadmap for strategic growth and optimization, guiding organizations towards enhanced processes and better outcomes [<xref ref-type="bibr" rid="scirp.133291-ref14">14</xref>] . For instance understanding the maturity of KPA is paramount to illuminate the strengths and weaknesses of an organization’s maturity across various KPAs. The chart below is extracted from the data within the analysis matrix; it is presenting how each KPA contribution in the overall organization’s maturity towards achieving improved processes and matches the requirements of CMM framework.</p><table-wrap id="table5" ><label><xref ref-type="table" rid="table5">Table 5</xref></label><caption><title> CMM Level 2 KPAs analysis matrix [<xref ref-type="bibr" rid="scirp.133291-ref14">14</xref>] </title></caption><table><tbody><thead><tr><th align="center" valign="middle" >ID</th><th align="center" valign="middle" >KPA</th><th align="center" valign="middle" >Weight</th><th align="center" valign="middle" >Score</th><th align="center" valign="middle" >Weighted score</th></tr></thead><tr><td align="center" valign="middle" >1</td><td align="center" valign="middle" >Project Planning (PP)</td><td align="center" valign="middle" >0.15</td><td align="center" valign="middle" >4</td><td align="center" valign="middle" >0.6</td></tr><tr><td align="center" valign="middle" >2</td><td align="center" valign="middle" >Configuration Management</td><td align="center" valign="middle" >0.1</td><td align="center" valign="middle" >3.6</td><td align="center" valign="middle" >0.3625</td></tr><tr><td align="center" valign="middle" >3</td><td align="center" valign="middle" >Requirement Management</td><td align="center" valign="middle" >0.12</td><td align="center" valign="middle" >1.7</td><td align="center" valign="middle" >0.204</td></tr><tr><td align="center" valign="middle" >4</td><td align="center" valign="middle" >Product and Process Quality Assurance</td><td align="center" valign="middle" >0.08</td><td align="center" valign="middle" >3.7</td><td align="center" valign="middle" >0.296</td></tr><tr><td align="center" valign="middle" >5</td><td align="center" valign="middle" >Project Control Management</td><td align="center" valign="middle" >0.13</td><td align="center" valign="middle" >1.7</td><td align="center" valign="middle" >0.221</td></tr><tr><td align="center" valign="middle" >6</td><td align="center" valign="middle" >Measurement And Analysis</td><td align="center" valign="middle" >0.11</td><td align="center" valign="middle" >0.5</td><td align="center" valign="middle" >0.055</td></tr><tr><td align="center" valign="middle" >7</td><td align="center" valign="middle" >Supplier Agreement Management</td><td align="center" valign="middle" >0.09</td><td align="center" valign="middle" >4.8</td><td align="center" valign="middle" >0.432</td></tr><tr><td align="center" valign="middle" ></td><td align="center" valign="middle" >Total CMM Level 2 Maturity Score</td><td align="center" valign="middle"  colspan="2"  ></td><td align="center" valign="middle" >2.17</td></tr></tbody></table></table-wrap><p><xref ref-type="fig" rid="fig5">Figure 5</xref> provides a visual snapshot of the CMM Level 2 Maturity Scores for each KPA, allowing stakeholders to quickly identify areas of strength and potential improvement within the software delivery process. Supplier Agreement Management has the highest Weighted Score of 0.432, indicating it is a strong area within the CMM Level 2 assessment. Project Planning (PP) follows closely with a Weighted Score of 0.6, showing good maturity in this area. Configuration Management and Product and Process QA are also relatively strong with scores of 0.3625 and 0.296, respectively. Requirement Management and Project Control Management have moderate scores, indicating there may be some room for improvement in these areas. Measurement And Analysis has the lowest Weighted Score at 0.055, indicating it may be a weaker area that needs attention. Frequency table may be developed to discover the state of practices within the organization against the different CMM levels as show below:</p><p>In <xref ref-type="fig" rid="fig6">Figure 6</xref> we graphically resent the data in <xref ref-type="table" rid="table6">Table 6</xref>. The ratios provided in the table, which indicate the distribution of practices within each Capability Maturity Model (CMM) level, hold significance for businesses. They offer insights into how resources and efforts are allocated at different stages of process maturity. For instance, the ratio of 24% for Initial indicates that out of the total practices identified, 24% are dedicated to ad hoc processes without much formalization or consistency. This suggests that at this stage, a significant portion of the organization’s efforts may be focused on reacting to immediate needs rather than following structured, standardized processes. Moving to the Defined level with an 11% ratio, businesses allocate fewer resources to documentation and standardization compared to the Initial stage. This suggests a shift towards more formalized processes with less emphasis on the sheer volume of practices and more on ensuring they are well-documented and standardized. The Managed level, with a ratio of 19.5%, indicates an increased focus on collecting process metrics to manage and control operations. Businesses at this stage are investing resources in data-driven decision-making and process control, which can lead to improved efficiency and quality. At the Repeated level, the ratio jumps to 26%,</p><table-wrap id="table6" ><label><xref ref-type="table" rid="table6">Table 6</xref></label><caption><title> Organization’s rates in among CMM Levels [<xref ref-type="bibr" rid="scirp.133291-ref13">13</xref>] </title></caption><table><tbody><thead><tr><th align="center" valign="middle" >CMM Level</th><th align="center" valign="middle" >Practices</th><th align="center" valign="middle" >Ratio</th></tr></thead><tr><td align="center" valign="middle" >Initial: Ad hoc processes without much formalization or consistency.</td><td align="center" valign="middle" >13</td><td align="center" valign="middle" >24.5%</td></tr><tr><td align="center" valign="middle" >Defined: Processes are documented and standardized throughout the organization.</td><td align="center" valign="middle" >6</td><td align="center" valign="middle" >11.3%</td></tr><tr><td align="center" valign="middle" >Managed: Process metrics are collected and used to manage and control processes.</td><td align="center" valign="middle" >10</td><td align="center" valign="middle" >18.9%</td></tr><tr><td align="center" valign="middle" >Repeated: Processes are consistently executed with a focus on quality and efficiency.</td><td align="center" valign="middle" >14</td><td align="center" valign="middle" >26.4%</td></tr><tr><td align="center" valign="middle" >Optimized: Continuous process improvement is ingrained in the organization’s culture.</td><td align="center" valign="middle" >10</td><td align="center" valign="middle" >18.9%</td></tr></tbody></table></table-wrap><p>showing a significant portion of practices dedicated to consistent execution with a focus on quality and efficiency. This suggests that businesses are prioritizing the refinement and optimization of their processes to achieve reliable results. Finally, the 19.5% ratio for the Optimized level indicates that despite the lower number of practices compared to Repeated, businesses are dedicating a substantial portion of their efforts to continuous process improvement ingrained in the organizational culture. This signifies a shift towards innovation, adaptability, and ongoing optimization, leading to sustained success and competitive advantage.</p></sec></sec><sec id="s4"><title>4. Limitations</title><p>The method outlined in the article appears comprehensive and structured, but like any approach, it may have limitations. Below are some potential issues and suggestions on how to address them.</p><sec id="s4_1"><title>4.1. Subjectivity in Prioritization</title><p>The prioritization of KPAs may involve subjective judgment, which can vary among evaluation team. To mitigate this, ensure that the prioritization process involves input from diverse stakeholders representing different perspectives within the organization. Additionally, consider incorporating objective criteria, such as impact on business objectives or alignment with strategic goals, to guide prioritization decisions [<xref ref-type="bibr" rid="scirp.133291-ref15">15</xref>] .</p></sec><sec id="s4_2"><title>4.2. Reliance on Self-Assessment</title><p>The method relies on self-assessment, which may introduce biases or inaccuracies in the evaluation process. To avoid this, consider supplementing self-assessment with external validation mechanisms, such as independent audits or third-party reviews, to provide a more objective perspective on the organization’s maturity level.</p></sec><sec id="s4_3"><title>4.3. Limited Scope of KPAs</title><p>The method primarily focuses on KPAs defined within the CMM framework, [<xref ref-type="bibr" rid="scirp.133291-ref16">16</xref>] , which may not fully capture all relevant aspects of organizational maturity, particularly in rapidly evolving domains such as software development. To address this, consider complementing the CMM framework with additional maturity models or frameworks that address specific areas of concern or emerging trends in the industry [<xref ref-type="bibr" rid="scirp.133291-ref17">17</xref>] .</p></sec><sec id="s4_4"><title>4.4. Difficulty in Sustaining Improvement</title><p>Sustaining long-term improvement efforts may be challenging. It is possible to establish mechanisms for continuous monitoring and review of maturity levels, set realistic improvement targets, and integrate maturity assessment into regular business processes to ensure ongoing focus and commitment to improvement [<xref ref-type="bibr" rid="scirp.133291-ref18">18</xref>] .</p></sec><sec id="s4_5"><title>4.5. Difficulty in Assigning Weight of KPAs in Analysis Matrix</title><p>A notable limitation of the evaluation process lies in the challenge of accurately defining the weight or importance rate assigned to each Key Process Area (KPA) by the evaluation team and stakeholders. To address this issue, organizations can enhance the maturity assessment process through stakeholder engagement, data-driven decision-making, and transparency in documentation, in addition ensure that the weighting criteria accurately reflect organizational priorities and facilitate meaningful insights for continuous improvement [<xref ref-type="bibr" rid="scirp.133291-ref15">15</xref>] .</p></sec></sec><sec id="s5"><title>5. Effect of Applying the Approach</title><p>Let us delve deeper into the significant effect of applying the proposed method across multiple organizations to create a competitor evaluation matrix, which showcases the position of each firm in terms of software delivery maturity:</p><p>1) Standardized Assessment Framework: The method offers a structured and standardized approach to assessing software delivery maturity across various organizations.</p><p>2) Comparative Analysis: By implementing this method across multiple organizations within the same industry or market segment, it becomes possible to conduct a comparative analysis of their software delivery maturity levels.</p><p>3) Competitor Evaluation Matrix Creation: The collected data can then be used to construct a competitor evaluation matrix, which visually represents the position of each firm in terms of software delivery maturity [<xref ref-type="bibr" rid="scirp.133291-ref15">15</xref>] .</p><p>4) Identification of Strengths and Weaknesses: By examining the maturity scores within the competitor evaluation matrix, organizations can identify their strengths and weaknesses compared to competitors across different KPAs. This insight enables them to focus on leveraging their strengths and addressing areas of improvement to enhance overall software delivery maturity [<xref ref-type="bibr" rid="scirp.133291-ref15">15</xref>] .</p><p>5) Benchmarking: The competitor evaluation matrix facilitates benchmarking exercises, allowing organizations to compare their performance against industry standards and leading competitors.</p><p>6) Strategic Decision-Making: Armed with insights from the competitor evaluation matrix, organizations can make more informed strategic decisions regarding resource allocation, process optimization, and technology investments [<xref ref-type="bibr" rid="scirp.133291-ref15">15</xref>] .</p></sec><sec id="s6"><title>6. Conclusions</title><p>In closing, the main findings of this approach revolve around understanding the organization’s current maturity level, identifying areas for improvement, and providing actionable insights for continuous growth and optimization. The paper has introduced a maturity measurement method for assessing the software delivery process within organizations, and quantitatively defined its maturity level as well as the different maturity across KPAs.</p><p>The significance of this approach lies in its ability to provide organizations with a structured, objective, and data-driven method for assessing and improving organizational maturity. By leveraging established frameworks and methodologies, organizations can optimize their processes, drive efficiency, and achieve long-term success. It provides researchers and practitioners with a structured framework for assessing, analyzing, and enhancing organizational capabilities of software delivery.</p><p>The proposed approach integrates established framework CMM and GQM approach. This integration contributes to the advancement of organizational maturity theory by providing a structured and systematic method for assessing and improving maturity of software delivery. It highlights the importance of aligning organizational practices with industry standards and best practices for better governance. Policymakers can encourage the adoption of recognized frameworks like CMM to promote consistency and quality in organizational processes.</p><p>However, some limitations for instance subjectivity in prioritizing KPAs, self-assessment reliance may introduce biases, focusing primarily on CMM-defined KPAs may miss crucial aspects finally assigning weights to KPAs in the analysis matrix is not easy.</p><p>It is evident that implementing this approach on rest of CMM levels that are not involved in this paper would also be an interesting area for future research. In addition, assessing software delivery maturity across multiple organizations by implementing the approach to facilitate the creation of a competitor evaluation matrix in context of software delivery or even in any other context is a possible future research area and holds promise for advancing organizational excellence in software delivery and beyond.</p></sec><sec id="s7"><title>Acknowledgements</title><p>R. B. G. thanks Dr. Atef Raslan and Prof. Dr. Nagy Ramadan for their invaluable guidance, insightful feedback, and continuous encouragement throughout this research. Their expertise and mentorship have been instrumental in shaping this work.</p></sec><sec id="s8"><title>Conflicts of Interest</title><p>The authors declare no conflicts of interest regarding the publication of this paper.</p></sec><sec id="s9"><title>Cite this paper</title><p>Mansour, O.H., Raslan, A. and Ramadan, N. (2024) A Proposed Approach for Measuring Maturity Level of Software Delivery. Journal of Software Engineering and Applications, 17, 228-245. https://doi.org/10.4236/jsea.2024.175013</p></sec></body><back><ref-list><title>References</title><ref id="scirp.133291-ref1"><label>1</label><mixed-citation publication-type="other" xlink:type="simple">Lu, K. (2021) Modern Software Delivery Maturity Matrix. Digital Service Start-Ups. &lt;br&gt;https://medium.com/digital-service-start-ups/modern-software-delivery-maturity-matrix-2be5e840f0c4 </mixed-citation></ref><ref id="scirp.133291-ref2"><label>2</label><mixed-citation publication-type="other" xlink:type="simple">CMMI Product Team (2023) CMMI V2.0: Advanced Topics in Process Improvement. Carnegie Mellon University Software Engineering Institute.</mixed-citation></ref><ref id="scirp.133291-ref3"><label>3</label><mixed-citation publication-type="journal" xlink:type="simple"><name name-style="western"><surname>Khraiwesh</surname><given-names> M. </given-names></name>,<etal>et al</etal>. (<year>2017</year>)<article-title>Configuration Management Measures in CMMI</article-title><source>&lt;i&gt; Intern&lt;/i&gt;&lt;i&gt;a&lt;/i&gt;&lt;i&gt;tional Journal of Applied Engineering Research&lt;/i&gt;</source><volume> 12</volume>,<fpage> 7546</fpage>-<lpage>7557</lpage>.<pub-id pub-id-type="doi"></pub-id></mixed-citation></ref><ref id="scirp.133291-ref4"><label>4</label><mixed-citation publication-type="other" xlink:type="simple">Giray, G. (2021) A Software Engineering Perspective on Engineering Machine Learning Systems: State of the Art and Challenges. &lt;br&gt;https://www.researchgate.net/publication/346405023_A_Software_Engineering_Perspective_on_Engineering_Machine_Learning_Systems_State_of_the_Art_and_Challenges</mixed-citation></ref><ref id="scirp.133291-ref5"><label>5</label><mixed-citation publication-type="other" xlink:type="simple">Klein, J., Konrad, M.D. and Stoddard, R.W. (2020) Beyond Process Improvement: Leveraging CMMI for Business Excellence. Springer, Berlin.</mixed-citation></ref><ref id="scirp.133291-ref6"><label>6</label><mixed-citation publication-type="other" xlink:type="simple">Frisina, L. (2022) Software Delivery Metrics You Cannot Afford to Miss! DEVOPS. &lt;br&gt;https://www.adaptavist.com/blog/delivery-metrics-you-cant-miss  </mixed-citation></ref><ref id="scirp.133291-ref7"><label>7</label><mixed-citation publication-type="other" xlink:type="simple">Dogaru, M. and Chira, R. (2013) Analysis of Internal Environment. &lt;i&gt;Social Econo&lt;/i&gt;&lt;i&gt;m&lt;/i&gt;&lt;i&gt;ic Debates&lt;/i&gt;, 2, 10-15.&lt;br&gt;https://www.economic-debates.ro/nr2-2013/art2-dogaru.pdf  </mixed-citation></ref><ref id="scirp.133291-ref8"><label>8</label><mixed-citation publication-type="other" xlink:type="simple">Irigoyen, A. and Montoni, M. (2020) Capability Counts Series: Reaching CMMI Engineering Practices with DevOps. &lt;br&gt;https://cmmiinstitute.com/news/blog/capability-counts-series-reaching-cmmi-engineering </mixed-citation></ref><ref id="scirp.133291-ref9"><label>9</label><mixed-citation publication-type="other" xlink:type="simple">Yamfashije, J. (2017) Capability Maturity Model Integration. &lt;br&gt;https://www.researchgate.net/publication/327557963_Capability_Maturity_Model_Integration   </mixed-citation></ref><ref id="scirp.133291-ref10"><label>10</label><mixed-citation publication-type="other" xlink:type="simple">Van Veenendaal, E., and van der Zwan, M. (2001) GQM Based Inspection. &lt;br&gt;https://www.researchgate.net/publication/2537262_GQM_based_Inspection </mixed-citation></ref><ref id="scirp.133291-ref11"><label>11</label><mixed-citation publication-type="book" xlink:type="simple">Yahya, F., Walters, R.J. and Wills, G.B. (2017) Using Goal-Question-Metric (GQM) Approach to Assess Security in Cloud Storage. In Chang, V., &lt;i&gt;et al.&lt;/i&gt; (Eds.), &lt;i&gt;Enterprise Security&lt;/i&gt;, Springer, Berlin, 223-240. </mixed-citation></ref><ref id="scirp.133291-ref12"><label>12</label><mixed-citation publication-type="other" xlink:type="simple">Basili, V.R., &lt;i&gt;et al.&lt;/i&gt; (1994) Goal Question Metric Paradigm. &lt;i&gt;Encyclopedia of Software Engineering&lt;/i&gt;, 2, 2. &lt;br&gt;https://www.cs.umd.edu/users/mvz/handouts/gqm.pdf </mixed-citation></ref><ref id="scirp.133291-ref13"><label>13</label><mixed-citation publication-type="other" xlink:type="simple">Braungarten, R. (2007) The SMPI Model: A Stepwise Process Model to Facilitate Software Measurement Process Improvement along the Measurement Paradigms. Doctor&amp;#8217;s Thesis, Otto von Guericke University, Magdeburg. &lt;br&gt;https://d-nb.info/985144955/34 </mixed-citation></ref><ref id="scirp.133291-ref14"><label>14</label><mixed-citation publication-type="other" xlink:type="simple">SCAMPI Upgrade Team (2011) Standard CMMI Appraisal Method for Process Improvement (SCAMPISM). Software Engineering Process Management.</mixed-citation></ref><ref id="scirp.133291-ref15"><label>15</label><mixed-citation publication-type="other" xlink:type="simple">Weber, C.V., Paulk, M.C., Wise, C.J. and Withey, J.V. (1991) Key Practices of the Capability Maturity Model. Software Engineering Institute, CMU/SEI-91-TR-25, ADA240604.</mixed-citation></ref><ref id="scirp.133291-ref16"><label>16</label><mixed-citation publication-type="other" xlink:type="simple">Watts, S. (2020) CMMI: An Introduction to Capability Maturity Model Integration. BMC. &lt;br&gt;https://www.bmc.com/blogs/cmmi-capability-maturity-model-integration/  </mixed-citation></ref><ref id="scirp.133291-ref17"><label>17</label><mixed-citation publication-type="other" xlink:type="simple">Paulk, M.C., Weber, C.V., Garcia, S., Chrissis, M.B. and Bush, M. (1993) Key Practices of the Capability Maturity Model, Version 1.1. Software Engineering Institute, CMU/SEI-93-TR-25. &lt;br&gt;https://insights.sei.cmu.edu/documents/1093/1993_005_001_16214.pdf  </mixed-citation></ref><ref id="scirp.133291-ref18"><label>18</label><mixed-citation publication-type="other" xlink:type="simple">Stelzer, D. (2005) Software Process Improvement with CMM. Springer Science &amp; Business Media, Berlin.</mixed-citation></ref></ref-list></back></article>