<?xml version="1.0" encoding="UTF-8"?><!DOCTYPE article  PUBLIC "-//NLM//DTD Journal Publishing DTD v3.0 20080202//EN" "http://dtd.nlm.nih.gov/publishing/3.0/journalpublishing3.dtd"><article xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink" dtd-version="3.0" xml:lang="en" article-type="research article"><front><journal-meta><journal-id journal-id-type="publisher-id">JCC</journal-id><journal-title-group><journal-title>Journal of Computer and Communications</journal-title></journal-title-group><issn pub-type="epub">2327-5219</issn><publisher><publisher-name>Scientific Research Publishing</publisher-name></publisher></journal-meta><article-meta><article-id pub-id-type="doi">10.4236/jcc.2015.39004</article-id><article-id pub-id-type="publisher-id">JCC-59601</article-id><article-categories><subj-group subj-group-type="heading"><subject>Articles</subject></subj-group><subj-group subj-group-type="Discipline-v2"><subject>Computer Science&amp;Communications</subject></subj-group></article-categories><title-group><article-title>
 
 
  Systematic Review of Web Application Security Vulnerabilities Detection Methods
 
</article-title></title-group><contrib-group><contrib contrib-type="author" xlink:type="simple"><name name-style="western"><surname>ajjad</surname><given-names>Rafique</given-names></name><xref ref-type="aff" rid="aff1"><sup>1</sup></xref><xref ref-type="corresp" rid="cor1"><sup>*</sup></xref></contrib><contrib contrib-type="author" xlink:type="simple"><name name-style="western"><surname>Mamoona</surname><given-names>Humayun</given-names></name><xref ref-type="aff" rid="aff1"><sup>1</sup></xref><xref ref-type="corresp" rid="cor1"><sup>*</sup></xref></contrib><contrib contrib-type="author" xlink:type="simple"><name name-style="western"><surname>Zartasha</surname><given-names>Gul</given-names></name><xref ref-type="aff" rid="aff1"><sup>1</sup></xref></contrib><contrib contrib-type="author" xlink:type="simple"><name name-style="western"><surname>Ansar</surname><given-names>Abbas</given-names></name><xref ref-type="aff" rid="aff1"><sup>1</sup></xref></contrib><contrib contrib-type="author" xlink:type="simple"><name name-style="western"><surname>Hasan</surname><given-names>Javed</given-names></name><xref ref-type="aff" rid="aff1"><sup>1</sup></xref></contrib></contrib-group><aff id="aff1"><addr-line>Department of Computer Science, University Institute of Information Technology, PMAS-Arid Agriculture 
University, Rawalpindi, Pakistan</addr-line></aff><author-notes><corresp id="cor1">* E-mail:<email>sajjad394@gmail.com(AR)</email>;<email>mamoona@uaar.edu.pk(MH)</email>;</corresp></author-notes><pub-date pub-type="epub"><day>01</day><month>09</month><year>2015</year></pub-date><volume>03</volume><issue>09</issue><fpage>28</fpage><lpage>40</lpage><history><date date-type="received"><day>28</day>	<month>July</month>	<year>2015</year></date><date date-type="rev-recd"><day>accepted</day>	<month>12</month>	<year>September</year>	</date><date date-type="accepted"><day>15</day>	<month>September</month>	<year>2015</year></date></history><permissions><copyright-statement>&#169; Copyright  2014 by authors and Scientific Research Publishing Inc. </copyright-statement><copyright-year>2014</copyright-year><license><license-p>This work is licensed under the Creative Commons Attribution International License (CC BY). http://creativecommons.org/licenses/by/4.0/</license-p></license></permissions><abstract><p>
 
 
  In recent years, web security has been viewed in the context of securing the web application layer from attacks by unauthorized users. The vulnerabilities existing in the web application layer have been attributed either to using an inappropriate software development model to guide the development process, or the use of a software development model that does not consider security as a key factor. Therefore, this systematic literature review is conducted to investigate the various security vulnerabilities used to secure the web application layer, the security approaches or techniques used in the process, the stages in the software development in which the approaches or techniques are emphasized, and the tools and mechanisms used to detect vulnerabilities. The study extracted 519 publications from respectable scientific sources, i.e. the IEEE Computer Society, ACM Digital Library, Science Direct, Springer Link. After detailed review process, only 56 key primary studies were considered for this review based on defined inclusion and exclusion criteria. From the review, it appears that no one software is referred to as a standard or preferred software product for web application development. In our SLR, we have performed a deep analysis on web application security vulnerabilities detection methods which help us to identify the scope of SLR for comprehensively investigation in the future research. Further in this SLR considering OWASP Top 10 web application vulnerabilities discovered in 2012, we will attempt to categories the accessible vulnerabilities. OWASP is major source to construct and validate web security processes and standards.
 
</p></abstract><kwd-group><kwd>Software Development Lifecycle</kwd><kwd> Web Applications</kwd><kwd> Security Vulnerabilities</kwd><kwd> Systematic Literature Review</kwd></kwd-group></article-meta></front><body><sec id="s1"><title>1. Introduction</title><p>Due to more customer data going online by adapting to online banking or fund transfer practices, users’ accounts and other information have become vulnerable to fraud and other attacks. Also, hackers in recent years are increasingly targeting web applications, since most networks are closely monitored through Intrusion Detec- tion Systems (IDS) and firewalls. Therefore, the web application layer needs to be secured from unauthorized users by building across the software development lifecycle security mechanism [<xref ref-type="bibr" rid="scirp.59601-ref1">1</xref>] . This ensures that it is not an afterthought issue, only considered in the end [<xref ref-type="bibr" rid="scirp.59601-ref2">2</xref>] as in many software development processes, where as a result, attackers continue to explore areas of vulnerability to undermine the integrity of applications. In recog- nition of this problem, developers have to incorporate security during the development in order to produce vulnerability free software systems, since the existence of flaws at the design or coding phase of the deve- lopment lifecycle can open web applications to a wide range of attacks [<xref ref-type="bibr" rid="scirp.59601-ref3">3</xref>] .</p><p>However, many studies have been conducted by both practitioners and researchers on the mechanism of building security in web applications, but few studies have been carried out on security development models that guide the development process [<xref ref-type="bibr" rid="scirp.59601-ref4">4</xref>] .</p><p>Therefore, there is a need to investigate the available development phases of software lifecycle, as well as the security mechanism, to determine what the most appropriate approach or technique is for securing the web applications layer, and for what vulnerability. This SLR uses [<xref ref-type="bibr" rid="scirp.59601-ref5">5</xref>] guidelines to investigate the different studies available on security development models within the web application layer. Details addressed include the approach or technique used, the vulnerability addressed and the stage in the development life cycle where the approach or technique is emphasized.</p><p>The SLR attempts to answer the question of what the most security vulnerability harm the web application. It also addresses the question of under what circumstance the security approach or technique is most efficient in addressing the inherent vulnerabilities. Section 2 describes in detail what a systematic literature review is all about and the procedure followed by this review. Section 3 describes the result obtained from the review and Section 4 discusses the results of Section 3 and makes recommendations.</p></sec><sec id="s2"><title>2. Related Work</title><p>Some of the previous systematic literature review such as “Empirical Analysis of System-Level Vulnerability Metrics through Actual Attacks” [<xref ref-type="bibr" rid="scirp.59601-ref6">6</xref>] has highlighted the benefits, shortcomings and strengths of agile methods. It has further explored the implication of the review as imitating a need for better empirical study of agile software development. The review has neither strictly covered the aspect of security surrounding the vulnerability detection method, nor has it addressed the circumstances where the development tool is efficient with regard to security mitigation.</p><p>Also, another literature review conducted by [<xref ref-type="bibr" rid="scirp.59601-ref7">7</xref>] , they have stressed on security requirement engineering. The review chooses studies that have assimilated security only at the requirement stage of information system construction without paying much attention to security across the development lifecycle.</p><p>All the reviews mentioned has not sufficiently address the issue of building security across the entire lifecycle of web application security development.</p><p>Similarly, there other systematic reviews conducted on other aspects of web applications area which has no association with the current systematic review on building security in development lifecycle. For instance, [<xref ref-type="bibr" rid="scirp.59601-ref8">8</xref>] conducted systematic review to identify and discuss the existing vulnerabilities and tools used by small and medium web companies and to propose new software vulnerability detection methods in order to measure the company’s success. Also Blanco et al. used systematic view to identify, extract and analyze the main plans for security ontologies. None of these reviews have addressed the question of the most appropriate security tools and techniques for mitigating vulnerability in the web applications.</p></sec><sec id="s3"><title>3. Systematic Review Process</title><p>The construction of this review is based on kitchenham guiding principle [<xref ref-type="bibr" rid="scirp.59601-ref9">9</xref>] , while also being channeled by other systematic literature review articles in the area of software development, such as [<xref ref-type="bibr" rid="scirp.59601-ref10">10</xref>] and [<xref ref-type="bibr" rid="scirp.59601-ref11">11</xref>] . A wide- ranging search is carried out into a number of respected science sources, i.e. the IEEE Computer Society, ACM Digital Library, Google Scholar, Science Direct, and Springer Link. A total of 623 published papers in the domain were extracted. After a careful synthesis, and based on inclusion or exclusion criteria, 56 papers that are primarily centered on security in the web application vulnerabilities were considered. Hence a thorough picture of the state of the art in different web application vulnerabilities security approaches is investigated, and other issues surrounding the research question are also brought to light with worthwhile directions for future investigations.</p><p>This section shows how the review process was conducted including activities such as question formularization, source selection, study selection process, information extraction and extraction execution.</p></sec><sec id="s4"><title>4. Question Formulization</title><p>Based on the (Kitchenham 2007) guidelines for systematic literature reviews, research questions are the most important aspect of review since they guide the entire process by ensuring that primary study selection and aggregation relate directly to the question. Therefore, asking the appropriate questions is critical to finding an appropriate research dimension in SLR. Hence this review has drawn up the research question thus: “Researchers have employed which methods to detect security vulnerabilities of web application”.</p><p>The research question follows the PICO paradigm mentioned in the (Kitchenham 2007) guideline for SLR.</p><p>Population: It is consist on set of studies and articles indicating the empirical studies for detection of the security vulnerabilities of web applications.</p><p>Intervention: Solutions mentioned in the studies for detecting security vulnerabilities of web applications.</p><p>Outcome: Measure and form of evidence linked to the detection of security vulnerabilities in web applications.</p><p>Context: Covering the domain of web applications focusing on empirical studies.</p><p>The above question is further refined to the following important questions:</p><p>RQ1. What are the methods adopted by researchers and practitioners in order to detect web application security vulnerabilities.</p><p>The research question RQ1. Is enhanced into following sub questions?</p><p>1) Enlist and elaborate the stage(s) of web application in which the vulnerability detection methods (VDMs) are functional.</p><p>The aim of this question is to highlight the phases of web development process in which VDMs are applied in number of times, what kind of web security vulnerabilities that are extracted during the web development stages are analyzed, and in what way these methods are combined during the process of web development.</p><p>2) Which web application vulnerability(es) have been frequently detected during empirical analysis?</p><p>During the analysis different security vulnerabilities are described which affect the web application severely and occur frequently while some are not very common and not occur so many times. The aim of this research is to detect most severe and dangerous vulnerabilities in web applications.</p><p>3) Enlist data characteristics used for web application security vulnerabilities detection?</p><p>This question will answer about single, cross-company and student/commercial projects data sets used for evaluation.</p><p>RQ2. Can OWASP Top 10 help to categories these vulnerabilities?</p><p>The OWASP Top 10 is widely used by the researchers in case of web application vulnerabilities detection. There is broad consensus regarding OWASP Top 10 for detection of most critical web application vulnerabilities. It is consulted in all over the world by the security experts to contribute in OWASP Top 10 [<xref ref-type="bibr" rid="scirp.59601-ref5">5</xref>] -[<xref ref-type="bibr" rid="scirp.59601-ref7">7</xref>] [<xref ref-type="bibr" rid="scirp.59601-ref9">9</xref>] , and [<xref ref-type="bibr" rid="scirp.59601-ref12">12</xref>] .</p><p>The research question RQ1 is expected to identify the different techniques used by researchers or practitioners when developing secure web applications. These tools and techniques could be well-known software engineering tools with built-in security, or a new security paradigm purposely designed for web application security development.</p><p>Similarly, research question RQ2 is expected to identify the most of the vulnerabilities that are detected within the security development lifecycle, such as Cross site scripting, SQL Injection and Insecure direct object.</p></sec><sec id="s5"><title>5. Source Selection</title><p>In the way to identify as many primary studies as possible that are related to these research questions, the study carried a pilot search on some trustworthy database sources. A pilot search on these sources has discovered that some similar publications are indexed in two different sources, and therefore, the search selection is limited to the following database sources:</p><p>・ IEEE Explorer;</p><p>・ ACM Digital Library;</p><p>・ Springer Link;</p><p>・ Science Direct.</p><p>At first the search keywords were extracted from Population, Intervention, Context and Outcome paradigm (PICO), as claimed in the earlier section. After a steer assessment, the recommended keywords from the sources were combined to the list of keywords during live-run searches.</p><p><xref ref-type="table" rid="table1">Table 1</xref> shows the primary strongly matched search keywords based on the following derivation:</p><p>・ Population: web application;</p><p>・ Intervention: security vulnerability;</p><p>・ Context: domain of web applications;</p><p>・ Outcome: quantity and type appropriate vulnerability.</p><p>Therefore, keywords are concatenated using Boolean “AND” and “OR” to come up with various query strings such as those shown in <xref ref-type="table" rid="table2">Table 2</xref>.</p><p>In the search keyword combination using “AND” and “OR” even though a sole query string might construct higher results in a particular data source than other sources, the query string that created the on the whole best result was:</p><p>“Web AND security AND web development OR web development vulnerabilities OR development procedure OR software lifecycle”.</p><p>The search results were purified based on applicability to the search keyword since the date of publication is irrelevant to the research questions.</p></sec><sec id="s6"><title>6. Study Selection</title><p>Before the extraction of articles from the identified sources was done, the method of inclusion and exclusion of articles based on the research questions was explained. The following are the criteria used in excluding or including a publication:</p><p>Initial selection for inclusion was based on whether the article title, abstract or introduction has a clear connection with the study.</p><p>The second stage excluded all articles that do not consider security issues in the software development, since the major concern of this study is security vulnerabilities.</p><p>The third stage excluded those articles that, although security related, do not directly involve the web application layer. The articles in this case might be related to security on web services such as browsers, mash ups, and other services.</p><p>The fourth and final stage included all primary studies related to the two research questions.</p><p>The first author of this study applied the inclusion/exclusion criteria to the publications regained using the search keywords. The second author used a quantitative valuation.</p><p>Checklist to assess the quality of the individual publication.</p><sec id="s6_1"><title>6.1. Study Assessment Checklist</title><p>The study assessment checklist is designed mostly to avoid publication bias that can lead to bias in systematic reviews. The checklist provide for the selected publications to be assessed using an unbiased strategy based on whether they actually supposed to be included. It minimizes bias and maximizes validity by including questions aimed at assessing the degree to which articles have addressed bias and validity.</p><p>The scoring modalities for the qualitative assessment checklist were done as follows: The possible answer to quality assessment questions are: “Very related (+1)”, “Related (0)”, and “Not so related (−1)”.</p><p>The checklist is shown in <xref ref-type="table" rid="table3">Table 3</xref>.</p></sec><sec id="s6_2"><title>6.2. Quality Evaluation Results</title><p>In <xref ref-type="table" rid="table4">Table 4</xref> shows the number of studies selected in each year.</p></sec><sec id="s6_3"><title>6.3. Selection Execution</title><p>A total of 579 papers were extracted based on the first step inclusion and exclusion criteria.</p><p>The second step of the process excluded 71 papers from the total number, while the third step excluded 309 papers. Therefore, from the 415 extracted studies, only a total of 56 publications were taken in this systematic review after removing the duplicates.</p></sec><sec id="s6_4"><title>6.4. Information Extraction</title><p>The data extraction form as shown in <xref ref-type="table" rid="table5">Table 5</xref> included information about the primary study itself as well as the information required to address the research questions. In order to gather the required information to address the objective of the study a data extraction form is designed. The full paper was read to collect the required data, and</p><table-wrap id="table1" ><label><xref ref-type="table" rid="table1">Table 1</xref></label><caption><title> Closely matched keywords</title></caption><table><tbody><thead><tr><th align="center" valign="middle" >Keywords</th><th align="center" valign="middle" >Initially Matched Keywords</th></tr></thead><tr><td align="center" valign="middle" >Web</td><td align="center" valign="middle" >web, internet, world wide web, net-centric, web hypermedia, web-enabled application, e-commerce, e-banking, e-business, e-transaction-trade</td></tr><tr><td align="center" valign="middle" >Application</td><td align="center" valign="middle" >web application, web service, internet application, web-based application, software, system</td></tr><tr><td align="center" valign="middle" >Security</td><td align="center" valign="middle" >security, secure, insecurity, vulnerabilities, robust, safety, secure</td></tr><tr><td align="center" valign="middle" >Vulnerability</td><td align="center" valign="middle" >vulnerability, threat, attack, risk</td></tr><tr><td align="center" valign="middle" >Method</td><td align="center" valign="middle" >methods, processes, techniques, system, practice, procedures, models</td></tr></tbody></table></table-wrap><table-wrap id="table2" ><label><xref ref-type="table" rid="table2">Table 2</xref></label><caption><title> The search keyword combination using “AND” and “OR”</title></caption><table><tbody><thead><tr><th align="center" valign="middle" >S. No</th><th align="center" valign="middle" >Combination using AND/OR</th></tr></thead><tr><td align="center" valign="middle" >1</td><td align="center" valign="middle" >“web AND security AND development vulnerability OR software lifecycle”</td></tr><tr><td align="center" valign="middle" >2</td><td align="center" valign="middle" >“Internet AND security AND development vulnerability OR development lifecycle”</td></tr><tr><td align="center" valign="middle" >3</td><td align="center" valign="middle" >“www AND security AND development vulnerability OR development lifecycle”</td></tr><tr><td align="center" valign="middle" >4</td><td align="center" valign="middle" >“online AND security AND development vulnerability OR development lifecycle”</td></tr><tr><td align="center" valign="middle" >5</td><td align="center" valign="middle" >“world wide web AND security AND development vulnerability OR development lifecycle”</td></tr><tr><td align="center" valign="middle" >6</td><td align="center" valign="middle" >“e-commerce AND security AND development vulnerability OR development lifecycle”</td></tr><tr><td align="center" valign="middle" >7</td><td align="center" valign="middle" >“e-commerce AND security AND development vulnerability OR development lifecycle”</td></tr><tr><td align="center" valign="middle" >8</td><td align="center" valign="middle" >“e-banking AND security AND development vulnerability OR development lifecycle”</td></tr><tr><td align="center" valign="middle" >9</td><td align="center" valign="middle" >“e-business AND security AND development vulnerability OR development lifecycle”</td></tr><tr><td align="center" valign="middle" >10</td><td align="center" valign="middle" >“e-transaction AND security AND development vulnerability OR development lifecycle”</td></tr><tr><td align="center" valign="middle" >11</td><td align="center" valign="middle" >“e-trade AND security AND development vulnerability OR development lifecycle”</td></tr><tr><td align="center" valign="middle" >12</td><td align="center" valign="middle" >“electronic banking AND security AND development vulnerability OR development lifecycle”</td></tr><tr><td align="center" valign="middle" >13</td><td align="center" valign="middle" >“electronic web AND security AND development vulnerability OR development lifecycle”</td></tr><tr><td align="center" valign="middle" >14</td><td align="center" valign="middle" >“electronic business AND security AND development vulnerability OR development lifecycle”</td></tr><tr><td align="center" valign="middle" >15</td><td align="center" valign="middle" >“electronic transaction AND security AND development vulnerability OR development lifecycle”</td></tr><tr><td align="center" valign="middle" >16</td><td align="center" valign="middle" >“electronic trade AND security AND development vulnerability OR development lifecycle”</td></tr></tbody></table></table-wrap><table-wrap id="table3" ><label><xref ref-type="table" rid="table3">Table 3</xref></label><caption><title> Quality evaluation checklist</title></caption><table><tbody><thead><tr><th align="center" valign="middle" >No.</th><th align="center" valign="middle" >Question</th><th align="center" valign="middle"  colspan="3"  >Possible Answers</th></tr></thead><tr><td align="center" valign="middle" >Q.1</td><td align="center" valign="middle" >VDMs are described in detail in the study?</td><td align="center" valign="middle" >+1</td><td align="center" valign="middle" >0</td><td align="center" valign="middle" >−1</td></tr><tr><td align="center" valign="middle" >Q.2</td><td align="center" valign="middle" >The guidelines are provided in the given study for the application of VDMs?</td><td align="center" valign="middle" >+1</td><td align="center" valign="middle" >0</td><td align="center" valign="middle" >−1</td></tr><tr><td align="center" valign="middle" >Q.3</td><td align="center" valign="middle" >The clear results are obtained after the application of VDM?</td><td align="center" valign="middle" >+1</td><td align="center" valign="middle" >0</td><td align="center" valign="middle" >−1</td></tr><tr><td align="center" valign="middle" >Q.4</td><td align="center" valign="middle" >The study under observation has been published in a relevant journal/conference?</td><td align="center" valign="middle" >+1</td><td align="center" valign="middle" >0</td><td align="center" valign="middle" >−1</td></tr><tr><td align="center" valign="middle" >Q.5</td><td align="center" valign="middle" >The other authors also cited the given study?</td><td align="center" valign="middle" >+1</td><td align="center" valign="middle" >0</td><td align="center" valign="middle" >−1</td></tr></tbody></table></table-wrap><table-wrap id="table4" ><label><xref ref-type="table" rid="table4">Table 4</xref></label><caption><title> Studies with percentage according to year</title></caption><table><tbody><thead><tr><th align="center" valign="middle" >Years</th><th align="center" valign="middle" >Relevant Studies</th><th align="center" valign="middle" >Selected Studies</th><th align="center" valign="middle" >Percentage</th></tr></thead><tr><td align="center" valign="middle" >2002</td><td align="center" valign="middle" >4</td><td align="center" valign="middle" >1</td><td align="center" valign="middle" >1.8</td></tr><tr><td align="center" valign="middle" >2003</td><td align="center" valign="middle" >5</td><td align="center" valign="middle" >2</td><td align="center" valign="middle" >3.5</td></tr><tr><td align="center" valign="middle" >2004</td><td align="center" valign="middle" >3</td><td align="center" valign="middle" >2</td><td align="center" valign="middle" >3.5</td></tr><tr><td align="center" valign="middle" >2005</td><td align="center" valign="middle" >11</td><td align="center" valign="middle" >3</td><td align="center" valign="middle" >8.9</td></tr><tr><td align="center" valign="middle" >2006</td><td align="center" valign="middle" >3</td><td align="center" valign="middle" >1</td><td align="center" valign="middle" >1.8</td></tr><tr><td align="center" valign="middle" >2007</td><td align="center" valign="middle" >7</td><td align="center" valign="middle" >4</td><td align="center" valign="middle" >7.1</td></tr><tr><td align="center" valign="middle" >2008</td><td align="center" valign="middle" >6</td><td align="center" valign="middle" >4</td><td align="center" valign="middle" >7.1</td></tr><tr><td align="center" valign="middle" >2009</td><td align="center" valign="middle" >22</td><td align="center" valign="middle" >4</td><td align="center" valign="middle" >7.1</td></tr><tr><td align="center" valign="middle" >2010</td><td align="center" valign="middle" >32</td><td align="center" valign="middle" >7</td><td align="center" valign="middle" >17.8</td></tr><tr><td align="center" valign="middle" >2011</td><td align="center" valign="middle" >14</td><td align="center" valign="middle" >4</td><td align="center" valign="middle" >7.1</td></tr><tr><td align="center" valign="middle" >2012</td><td align="center" valign="middle" >23</td><td align="center" valign="middle" >5</td><td align="center" valign="middle" >8.9</td></tr><tr><td align="center" valign="middle" >2013</td><td align="center" valign="middle" >18</td><td align="center" valign="middle" >6</td><td align="center" valign="middle" >10.7</td></tr><tr><td align="center" valign="middle" >2014</td><td align="center" valign="middle" >14</td><td align="center" valign="middle" >6</td><td align="center" valign="middle" >10.7</td></tr><tr><td align="center" valign="middle" >2015</td><td align="center" valign="middle" >12</td><td align="center" valign="middle" >7</td><td align="center" valign="middle" >17.8</td></tr><tr><td align="center" valign="middle" >Total</td><td align="center" valign="middle" >162</td><td align="center" valign="middle" >56</td><td align="center" valign="middle" ></td></tr></tbody></table></table-wrap><table-wrap id="table5" ><label><xref ref-type="table" rid="table5">Table 5</xref></label><caption><title> Form for data extraction</title></caption><table><tbody><thead><tr><th align="center" valign="middle"  colspan="2"  >Paper Title</th></tr></thead><tr><td align="center" valign="middle" >Authors</td><td align="center" valign="middle" >Publication Year</td></tr><tr><td align="center" valign="middle" >Source</td><td align="center" valign="middle" >Evaluator</td></tr><tr><td align="center" valign="middle" >Assessment of Quality</td><td align="center" valign="middle" >1 0 −1</td></tr><tr><td align="center" valign="middle" >WAS risk evaluation is provided in detail in the study?</td><td align="center" valign="middle" ></td></tr><tr><td align="center" valign="middle" >The clear guidelines are provided in the study to apply the WAS risk evaluation risk method?</td><td align="center" valign="middle" ></td></tr><tr><td align="center" valign="middle" >The clear results are provided after application of the WAS risk evaluation methods?</td><td align="center" valign="middle" ></td></tr><tr><td align="center" valign="middle" >The study under observation has been published in a relevant journal/conference?</td><td align="center" valign="middle" ></td></tr><tr><td align="center" valign="middle" >The other authors also cited the study?</td><td align="center" valign="middle" ></td></tr><tr><td align="center" valign="middle" >Extraction of Data for Questions</td><td align="center" valign="middle" >Answers</td></tr><tr><td align="center" valign="middle" >Which journals/conferences include papers on web application security?</td><td align="center" valign="middle" >Journal/Conf Name</td></tr><tr><td align="center" valign="middle" >What risks in web application security are addressed?</td><td align="center" valign="middle" >Risk Name</td></tr><tr><td align="center" valign="middle" >Which risk from OWASP Top 10 web application security risks is addressed?</td><td align="center" valign="middle" >From OWASP Top 10</td></tr><tr><td align="center" valign="middle" >Which solutions of web application security have been proposed for web application development?</td><td align="center" valign="middle" ></td></tr><tr><td align="center" valign="middle" >Which type WAS method employed?</td><td align="center" valign="middle" >1. Testing 2. Inspection 3.Inquiry Analytical 4. Modeling Simulation</td></tr><tr><td align="center" valign="middle" >Which type of evaluation is performed by the WAS risk evaluation methods employed?</td><td align="center" valign="middle" >1. Automated 2. Manual</td></tr><tr><td align="center" valign="middle" >WAS risk evaluation methods is applied in which phase(s) and web artifacts?</td><td align="center" valign="middle" >1. Requirement 2. Design 3. implementation</td></tr><tr><td align="center" valign="middle" >Any feedback provided by the WAS evaluation methods?</td><td align="center" valign="middle" >1. Yes 2. No</td></tr><tr><td align="center" valign="middle" >There is empirical validation of web application security issue(s)?</td><td align="center" valign="middle" >1. Case study 2. Experiment 3. Survey 4. No</td></tr></tbody></table></table-wrap><p>the following information have been extracted from each paper: source, authors, title, publication year and research question answers; and information required to classify the study using used facets.</p><p>Also important in the data extraction form are:</p><p>・ Application used to build security;</p><p>・ Security approach or technique;</p><p>・ Stage in the lifecycle where security is incorporated;</p><p>・ Vulnerability it addresses;</p><p>・ Tool used to identify vulnerabilities;</p><p>・ Mechanism being adopted.</p><p>To answer research questions the data characteristics are also described, so that the validity of data can be ensured and detailed information can be provided. These data characteristics are highlighted in <xref ref-type="table" rid="table6">Table 6</xref>. The two main sources of data includes from academia and industry which indicate high percentage as compared to other sources.</p></sec></sec><sec id="s7"><title>7. Results</title><p>There are three major categories of primary studies identified from the extracted publications:</p><p>・ Studies involving validation methods;</p><p>・ Studies involving development stages or a lifecycle where security is emphasized;</p><p>・ Studies involving security tools and mechanisms for detecting vulnerabilities.</p><p><xref ref-type="table" rid="table7">Table 7</xref> shows the various methods and strategies used to validate the given studies. The graphical representation of <xref ref-type="table" rid="table7">Table 7</xref> is also shown in <xref ref-type="fig" rid="fig1">Figure 1</xref>. Similarly, <xref ref-type="table" rid="table8">Table 8</xref> shows the category of studies that consider security at various development phases [<xref ref-type="bibr" rid="scirp.59601-ref13">13</xref>] .</p><p>Some of the studies consider placing security checks during requirements and design, while others consider the security checks through implementation and testing phase.</p><p><xref ref-type="table" rid="table9">Table 9</xref> depicts the security vulnerabilities identified by the OWASP Top 10 during software development. These Top 10 vulnerabilities are documented in the list of OWASP Top 10. <xref ref-type="fig" rid="fig2">Figure 2</xref> is also representing the percentage of listed vulnerabilities. <xref ref-type="table" rid="table1">Table 1</xref>0 indicates the data characteristics from different fields, the tools used to assess vulnerabilities and the mechanism used such as code vulnerability analysis, run-time check and others</p><table-wrap id="table6" ><label><xref ref-type="table" rid="table6">Table 6</xref></label><caption><title> Data characteristics</title></caption><table><tbody><thead><tr><th align="center" valign="middle" >Data Field</th><th align="center" valign="middle" >Responses</th><th align="center" valign="middle" >Resp. %age</th></tr></thead><tr><td align="center" valign="middle" >Academia</td><td align="center" valign="middle" >21</td><td align="center" valign="middle" >52</td></tr><tr><td align="center" valign="middle" >Mixed</td><td align="center" valign="middle" >5</td><td align="center" valign="middle" >12</td></tr><tr><td align="center" valign="middle" >Industrial</td><td align="center" valign="middle" >15</td><td align="center" valign="middle" >36</td></tr><tr><td align="center" valign="middle" >Government</td><td align="center" valign="middle" >2</td><td align="center" valign="middle" >5</td></tr><tr><td align="center" valign="middle" >Others</td><td align="center" valign="middle" >10</td><td align="center" valign="middle" >23</td></tr><tr><td align="center" valign="middle" >Mean: 3.268</td><td align="center" valign="middle" >Std. Deviation: 1.672</td><td align="center" valign="middle" >Satisfaction Rate: 38.208</td></tr></tbody></table></table-wrap><table-wrap id="table7" ><label><xref ref-type="table" rid="table7">Table 7</xref></label><caption><title> Methods used for validation</title></caption><table><tbody><thead><tr><th align="center" valign="middle" >Validation Method</th><th align="center" valign="middle" >Responses</th><th align="center" valign="middle" >Response %age</th></tr></thead><tr><td align="center" valign="middle" >Case study</td><td align="center" valign="middle" >10</td><td align="center" valign="middle" >24</td></tr><tr><td align="center" valign="middle" >Experiment</td><td align="center" valign="middle" >25</td><td align="center" valign="middle" >62</td></tr><tr><td align="center" valign="middle" >Survey</td><td align="center" valign="middle" >2</td><td align="center" valign="middle" >5</td></tr><tr><td align="center" valign="middle" >Experience Report</td><td align="center" valign="middle" >4</td><td align="center" valign="middle" >12</td></tr><tr><td align="center" valign="middle" >Observational Study</td><td align="center" valign="middle" >3</td><td align="center" valign="middle" >7</td></tr><tr><td align="center" valign="middle" >Action Research</td><td align="center" valign="middle" >1</td><td align="center" valign="middle" >2</td></tr><tr><td align="center" valign="middle" >Others</td><td align="center" valign="middle" >3</td><td align="center" valign="middle" >8</td></tr><tr><td align="center" valign="middle" >Mean: 3.122</td><td align="center" valign="middle" >Satisfaction Rate: 26.871</td><td align="center" valign="middle" >Std. Deviation: 1.716</td></tr><tr><td align="center" valign="middle" >Variance: 2.946</td><td align="center" valign="middle"  colspan="2"  >Std. Error: 0.245</td></tr></tbody></table></table-wrap><table-wrap id="table8" ><label><xref ref-type="table" rid="table8">Table 8</xref></label><caption><title> Research type and software development phases</title></caption><table><tbody><thead><tr><th align="center" valign="middle" >Phases</th><th align="center" valign="middle" >Responses</th><th align="center" valign="middle" >Response %age</th></tr></thead><tr><td align="center" valign="middle" >Requirement</td><td align="center" valign="middle" >4</td><td align="center" valign="middle" >7</td></tr><tr><td align="center" valign="middle" >Design</td><td align="center" valign="middle" >6</td><td align="center" valign="middle" >17</td></tr><tr><td align="center" valign="middle" >Implementation</td><td align="center" valign="middle" >26</td><td align="center" valign="middle" >66</td></tr><tr><td align="center" valign="middle" >Testing</td><td align="center" valign="middle" >20</td><td align="center" valign="middle" >51</td></tr><tr><td align="center" valign="middle" >Maintenance</td><td align="center" valign="middle" >0</td><td align="center" valign="middle" >0</td></tr><tr><td align="center" valign="middle"  colspan="2"  >Mean: 4.439</td><td align="center" valign="middle" >St. Deviation: 1.537</td></tr><tr><td align="center" valign="middle" >Satisfaction Rate: 53.448</td><td align="center" valign="middle" >Variance: 2.363</td><td align="center" valign="middle" >Std. Error: 0.202</td></tr></tbody></table></table-wrap><table-wrap id="table9" ><label><xref ref-type="table" rid="table9">Table 9</xref></label><caption><title> Detection of security vulnerabilities from OWASP Top 10</title></caption><table><tbody><thead><tr><th align="center" valign="middle" >Vulnerability Name</th><th align="center" valign="middle" >Responses</th><th align="center" valign="middle" >Resp. %age</th></tr></thead><tr><td align="center" valign="middle" >Injection vulnerability</td><td align="center" valign="middle" >27</td><td align="center" valign="middle" >68</td></tr><tr><td align="center" valign="middle" >Cross site scripting (xss)</td><td align="center" valign="middle" >21</td><td align="center" valign="middle" >49</td></tr><tr><td align="center" valign="middle" >Broken authentication and session management</td><td align="center" valign="middle" >4</td><td align="center" valign="middle" >10</td></tr><tr><td align="center" valign="middle" >Insecure direct object references</td><td align="center" valign="middle" >1</td><td align="center" valign="middle" >2</td></tr><tr><td align="center" valign="middle" >Cross site request forgery (csrf)</td><td align="center" valign="middle" >5</td><td align="center" valign="middle" >12</td></tr><tr><td align="center" valign="middle" >Security misconfiguration</td><td align="center" valign="middle" >1</td><td align="center" valign="middle" >2</td></tr><tr><td align="center" valign="middle" >Failure to restrict url access</td><td align="center" valign="middle" >2</td><td align="center" valign="middle" >4</td></tr><tr><td align="center" valign="middle" >Invalidated redirects and forwards</td><td align="center" valign="middle" >1</td><td align="center" valign="middle" >2</td></tr><tr><td align="center" valign="middle" >Insecure cryptographic storage</td><td align="center" valign="middle" >2</td><td align="center" valign="middle" >5</td></tr><tr><td align="center" valign="middle" >Insufficient transport layer protection</td><td align="center" valign="middle" >0</td><td align="center" valign="middle" >0</td></tr><tr><td align="center" valign="middle" >Others</td><td align="center" valign="middle" >22</td><td align="center" valign="middle" >54</td></tr><tr><td align="center" valign="middle" >Mean: 9.31</td><td align="center" valign="middle" >Std. Deviation: 6.33</td><td align="center" valign="middle" >Satisfaction Rate: 35.47</td></tr></tbody></table></table-wrap><fig id="fig1"  position="float"><label><xref ref-type="fig" rid="fig1">Figure 1</xref></label><caption><title> Frequency distribution of approaches</title></caption><graphic mimetype="image"   position="float"  xlink:type="simple"  xlink:href="http://html.scirp.org/file/4-1730251x5.png"/></fig><p>are depicted in <xref ref-type="table" rid="table1">Table 1</xref>0.</p></sec><sec id="s8"><title>8. Discussion</title><p>This section is intended to discuss and analyze the result presented in the previous section and provide significant suggestions that may lead to an in-depth understanding of the domain.</p><p>Therefore, our discussion is based on the following result.</p><fig id="fig2"  position="float"><label><xref ref-type="fig" rid="fig2">Figure 2</xref></label><caption><title> Vulnerability detected by VDM</title></caption><graphic mimetype="image"   position="float"  xlink:type="simple"  xlink:href="http://html.scirp.org/file/4-1730251x6.png"/></fig><table-wrap id="table10" ><label><xref ref-type="table" rid="table1">Table 1</xref>0</label><caption><title> Studies with tools and security mechanism</title></caption><table><tbody><thead><tr><th align="center" valign="middle" >Author</th><th align="center" valign="middle" >Year of publications</th><th align="center" valign="middle" >Methodology for evaluating security</th><th align="center" valign="middle" >Mechanism for assessing security vulnerability</th><th align="center" valign="middle" >Phases</th></tr></thead><tr><td align="center" valign="middle" >P. Salini1 et al.</td><td align="center" valign="middle" >2012</td><td align="center" valign="middle" >Model-Oriented Security Requirement Engineering (MOSRE)</td><td align="center" valign="middle" >E-voting(Run time)</td><td align="center" valign="middle" >Requirement</td></tr><tr><td align="center" valign="middle" >Anshika Pandey et al.</td><td align="center" valign="middle" >2014</td><td align="center" valign="middle" >H2S Application framework</td><td align="center" valign="middle" >Run time</td><td align="center" valign="middle" >Implementation</td></tr><tr><td align="center" valign="middle" >Mattia Monga et al.</td><td align="center" valign="middle" >2008</td><td align="center" valign="middle" >Phan (PHP Hybrid Analyzer)</td><td align="center" valign="middle" >Run time</td><td align="center" valign="middle" >Testing</td></tr><tr><td align="center" valign="middle" >Romaric Ludinard et al.</td><td align="center" valign="middle" >2012</td><td align="center" valign="middle" >RRABIDS (Ruby on Rails Anomaly Based Intrusion Detection System)</td><td align="center" valign="middle" >Code analysis</td><td align="center" valign="middle" >Requirement</td></tr><tr><td align="center" valign="middle" >Theodoor Scholte et al.</td><td align="center" valign="middle" >2013</td><td align="center" valign="middle" >IPAAS (Input Parameter Analysis System)</td><td align="center" valign="middle" >Code analysis</td><td align="center" valign="middle" >Testing</td></tr><tr><td align="center" valign="middle" >Lwin Khin Shar et al.</td><td align="center" valign="middle" >2012</td><td align="center" valign="middle" >Safer XSS</td><td align="center" valign="middle" >Run time</td><td align="center" valign="middle" >Testing</td></tr><tr><td align="center" valign="middle" >Li et al.</td><td align="center" valign="middle" >2010</td><td align="center" valign="middle" >Perturbation based Interactive UIV Testing (PIUIVT)</td><td align="center" valign="middle" >Code analysis</td><td align="center" valign="middle" >Implementation</td></tr><tr><td align="center" valign="middle" >Mei Junjin</td><td align="center" valign="middle" >2009</td><td align="center" valign="middle" >SQL Injection Gen</td><td align="center" valign="middle" >Run time checks</td><td align="center" valign="middle" >Testing</td></tr><tr><td align="center" valign="middle" >Davide Balzarotti et al.</td><td align="center" valign="middle" >2008</td><td align="center" valign="middle" >Saner</td><td align="center" valign="middle" >Run time</td><td align="center" valign="middle" >Implementation</td></tr><tr><td align="center" valign="middle" >Abdelkader Lahmadiet al.</td><td align="center" valign="middle" >2012</td><td align="center" valign="middle" >Sec SIP framework</td><td align="center" valign="middle" >Code analysis</td><td align="center" valign="middle" >Testing</td></tr><tr><td align="center" valign="middle" >Michael D. Bond et al.</td><td align="center" valign="middle" >2010</td><td align="center" valign="middle" >PECAN (Precise, Efficient, Context-sensitive Anomaly detection)</td><td align="center" valign="middle" >Code analysis</td><td align="center" valign="middle" >Implementation</td></tr><tr><td align="center" valign="middle" >Viktoria Felmetsger et al.</td><td align="center" valign="middle" >2010</td><td align="center" valign="middle" >Waler’s architecture.</td><td align="center" valign="middle" >Run time</td><td align="center" valign="middle" >Testing</td></tr><tr><td align="center" valign="middle" >Santa Barbara</td><td align="center" valign="middle" >2007</td><td align="center" valign="middle" >MiMoSA</td><td align="center" valign="middle" >Code analysis</td><td align="center" valign="middle" >Implementation</td></tr><tr><td align="center" valign="middle" >Yao-Wen Huang et al.</td><td align="center" valign="middle" >2004</td><td align="center" valign="middle" >Web SSARI (Web Application Security by Static Analysis and Runtime Inspection)</td><td align="center" valign="middle" >Code analysis</td><td align="center" valign="middle" >Testing</td></tr><tr><td align="center" valign="middle" >Ib&#233;ria Medeiros et al.</td><td align="center" valign="middle" >2013</td><td align="center" valign="middle" >Web Application Protection (WAP) tool</td><td align="center" valign="middle" >Taint analysis</td><td align="center" valign="middle" >Testing</td></tr><tr><td align="center" valign="middle" >Yao-Wen Huang et al.</td><td align="center" valign="middle" >2003</td><td align="center" valign="middle" >Web Application Vulnerability and Error Scanner (WAVES)</td><td align="center" valign="middle" >Code analysis</td><td align="center" valign="middle" >Testing</td></tr><tr><td align="center" valign="middle" >Trevor Jim et al.</td><td align="center" valign="middle" >2007</td><td align="center" valign="middle" >Browser-Enforced Embedded Policies (BEEP)</td><td align="center" valign="middle" >Run time</td><td align="center" valign="middle" >Implementation</td></tr><tr><td align="center" valign="middle" >Prithvi Bisht</td><td align="center" valign="middle" >2010</td><td align="center" valign="middle" >NOTAMPER tool</td><td align="center" valign="middle" >Code analysis</td><td align="center" valign="middle" >Testing</td></tr></tbody></table></table-wrap><sec id="s8_1"><title>8.1. Security Approach Used</title><p>Security approaches are mechanism or procedures that are integrated during the development of a secure web application using some systematic and well defined methods such as OWASP Top 10 that is fused in web application development [<xref ref-type="bibr" rid="scirp.59601-ref14">14</xref>] . There are some degrees of similarity among the different studies in terms of detection of vulnerabilities.</p><p>OWASP Top 10 is aimed at analyzing the security of a system by identifying the vulnerabilities of web applications. It complements security review process by building security at the start of software development life cycle. <xref ref-type="table" rid="table8">Table 8</xref> shows the security vulnerabilities from OWASP Top 10. According to OWASP Top 10 Injection vulnerability and Cross site scripting are most common with high frequency of 27 and 21 respectively. Beside this, the vulnerabilities falling in other category are also yielding frequency of 22. The one ought to be conscious about the nature stored data or information, its position and its entrance control strategy. Similarly Cross site request forgery (CSRF) (frequency = 5) is damaging vulnerability in web applications. Broken Authentication and Session management (frequency = 4) is security flaw. Insecure Cryptographic Storage is detected with (frequency = 2) security gap. While some of the vulnerabilities like Insecure Direct Object References, Security Misconfiguration, and Failure to Restrict URL Access are shown with (frequency = 1) security threats. From the list of OWASP Top 10 the vulnerabilities such as Invalidated Redirects and Forwards and Insufficient Transport Layer Protection are not addressed in any study under our observations.</p><p>As reflected in the data shown in <xref ref-type="table" rid="table8">Table 8</xref>, we found many single vulnerability that effects the web application in more times.</p></sec><sec id="s8_2"><title>8.2. Lifecycle Stage</title><p>The stage in the development lifecycle where a security approach or technique is emphasized varies with different studies. <xref ref-type="table" rid="table8">Table 8</xref> shows the distribution of research type of the selected studies. The results of this classification are also represented by <xref ref-type="fig" rid="fig3">Figure 3</xref>. We also classified the studies on the basis of different stages of software development. Specifically, we assembled the software development stages into: requirements, design, implementation, testing, and maintenance. The breakdown of the classification of the selected studies is given in <xref ref-type="table" rid="table8">Table 8</xref>. The majority of selected primary studies addressed the (51%), while some of the studies were classified under the Requirement and Design phase respectively (7% &amp; 17%). We did not find any study related to software maintenance stage.</p><p>It may be noted that vulnerabilities detected in requirement phase are very less in percentage. Which may create more problems in next stages of development? Similarly the design phase However, applying security checks across the entire lifecycle has received less attention. Similarly, there has not been an empirical study to the best of our knowledge that assesses whether concentrating security around maintenance is sufficient or not.</p><fig id="fig3"  position="float"><label><xref ref-type="fig" rid="fig3">Figure 3</xref></label><caption><title> Phases of web applications in which VDMs are applied</title></caption><graphic mimetype="image"   position="float"  xlink:type="simple"  xlink:href="http://html.scirp.org/file/4-1730251x7.png"/></fig><p>However, putting security checks across the entire lifecycle, which also includes all phases, can guarantee more assurances than if they are only introduced during the testing phase.</p></sec><sec id="s8_3"><title>8.3. Assessment Mechanism</title><p>It is clearly represented in <xref ref-type="table" rid="table1">Table 1</xref>0 that most approaches focus on code vulnerabilities using code vulnerability assessment mechanisms to uncover gapes that attackers can exploit [<xref ref-type="bibr" rid="scirp.59601-ref15">15</xref>] - [<xref ref-type="bibr" rid="scirp.59601-ref18">18</xref>] . However, some works use the runtime checks (8 out of 18 papers) or testing (10 out of 18 papers) as a mechanism for detecting vulnerability. This does not prove that they are not useful, but it could be that it is more efficient to assess any errors during the coding which may include those vulnerabilities that revealed during requirement and design. Perhaps, coupling two or more would intensify the assessment and could yield a better result.</p></sec><sec id="s8_4"><title>8.4. Tools</title><p>Different tools are deployed to ease and automate the task of catching errors or vulnerabilities. Some of these tools are meant to test leakages in coding such as the Auto Inspect tool for black box testing, web application vulnerability and error scanner (WAVES) and so on, other tools such as web SSARI [<xref ref-type="bibr" rid="scirp.59601-ref19">19</xref>] , MIMOSA and BEEP [<xref ref-type="bibr" rid="scirp.59601-ref20">20</xref>] are meant to discover vulnerabilities [<xref ref-type="bibr" rid="scirp.59601-ref21">21</xref>] . There is no tool that can be considered as a standard and each tool has different functionalities.</p></sec><sec id="s8_5"><title>8.5. Conclusion and Recommendation</title><p>After discussing the results of this systematic literature review, the review has benefited the practitioners, researchers and policy makers of web application development projects. The unavailability of a standardized security techniques to guide the development of secure web applications suggests that more research needs to be done to determine what the appropriate development technique is, and what process is required. Similarly, the consistent reference to the OWASP Top 10 or risk assessment in the different studies under this review suggests to both practitioners and researchers that tightening security around the development lifecycle using different tools and techniques can be effective or easier to adopt than other methodology. However, other approaches such as security patterns and digital signatures are also crucial. Furthermore, policy makers and practitioners need to institutionalize, in their various projects, the culture of considering security at early phases and throughout the entire development lifecycle, with emphasis on requirement vulnerabilities. Therefore, this may suggest the need for further research on whether or not building security checks around requirement and coding is adequate. It is also important for developers and practitioners to be aware of the fact that automated tools for scanning vulnerabilities during development are not enough to have a bullet proof product, since errors sometimes are not perceived simply because they appear at certain times. Therefore, the grouping of manual and automated tools is necessary, especially requirement vulnerability analysis, runtime checks, and other tools. Therefore, this SLR has been conducted based on systematic literature review (Kitchenham 2007) guidelines. The review aims to determine what development tools are available for security mitigation in web applications, what approach or technique is used, and what security problems these approaches or techniques have addressed. Based on these objectives, we extract 623 papers from 4 reputable scientific sources and then exclude 567 papers based on an initially defined inclusion and exclusion criteria. Hence, we consider 56 key papers for in-depth review. The review results suggest that different papers use different security development techniques to develop secure web applications. For this reason, it shows that there is no standard or preferred development technique for web application security. However, OWASP Top 10 seems to have gained more attention, probably due to the involvement of multiple stakeholders when discussing security viewpoints. This ensures proper understanding of security requirements rather than enforcing it on a few members of the development team. Similarly, many papers studied in this review use different techniques to tighten security during the phases of development. This may suggest the universality, effectiveness or ease of use of tools and techniques in dealing with different kinds of vulnerabilities in the web application. Furthermore, applying security checks across the entire life cycle of the development process has gotten little attention, even though it is the right thing to do when it comes to security assurances on the web. This points to the need for more work that will consider security across the whole process of software development. Finally, the result of this review has shown that many studies emphasize vulnerability assessment using various kinds of tools to detect gapes that attackers can exploit when an application is subjected to internet. There is a lack of study which represents current state-of-the-art of empirically supported work in this area. To tie this gap, this paper presents the plan for conducting a systematic literature review in order to present the current position of the field, possible gaps and directions for future research. This study will help researchers and practitioners in the area of web applications to find out more established practices and techniques, and to know the problems that need more empirical assessment.</p></sec></sec><sec id="s9"><title>Acknowledgements</title><p>We want to pay special thanks to Ms. Mamoona Humayun for her supporting role in conducting this research work and spent her precious time to help as a supervisor. We also thank anonymous reviewers who gave us very valuable feedback to improve this work.</p></sec><sec id="s10"><title>Cite this paper</title><p>SajjadRafique,MamoonaHumayun,ZartashaGul,AnsarAbbas,HasanJaved, (2015) Systematic Review of Web Application Security Vulnerabilities Detection Methods. Journal of Computer and Communications,03,28-40. doi: 10.4236/jcc.2015.39004</p></sec></body><back><ref-list><title>References</title><ref id="scirp.59601-ref1"><label>1</label><mixed-citation publication-type="other" xlink:type="simple">Ge, X., Paige, R.F., Polack, F.A., Chivers, H. and Brooke, P.J. (2006) Agile Development of Secure Web Applications. Proceedings of the 6th International Conference on Web Engineering. Palo Alto, 11-14 July 2006, 305-312.</mixed-citation></ref><ref id="scirp.59601-ref2"><label>2</label><mixed-citation publication-type="other" xlink:type="simple">Norwawi, N.M. and Selamat, M.H. (2011) Secure E-Commerce Web Development Framework. Infor-mation Technology Journal, 10, 769-778.</mixed-citation></ref><ref id="scirp.59601-ref3"><label>3</label><mixed-citation publication-type="other" xlink:type="simple">McGraw, G. and Viega, J. (2002) Building Secure Software. In RTO/NATO Real-Time Intrusion Detection Symp.</mixed-citation></ref><ref id="scirp.59601-ref4"><label>4</label><mixed-citation publication-type="other" xlink:type="simple">Mouratidis, H., Jürjens, J. and Fox, J. (2006) Towards a Comprehensive Framework for Secure Systems Development. Advanced Information Systems Engineering. Springer, Berlin Heidelberg, 48-62.http://dx.doi.org/10.1007/11767138_5</mixed-citation></ref><ref id="scirp.59601-ref5"><label>5</label><mixed-citation publication-type="other" xlink:type="simple">Keele, S. (2007) Guidelines for Performing Systematic Literature Reviews in Software Engineering. Technical Report, EBSE Technical Report EBSE-2007-01, 1-57.</mixed-citation></ref><ref id="scirp.59601-ref6"><label>6</label><mixed-citation publication-type="other" xlink:type="simple">Cachia, E. and Micallef, M. (2007) A Multi-Tier, Multi-Role Security Framework for E-Commerce Systems. 14th Annual IEEE International Conference and Workshops on the Engineering of Compu-ter-Based Systems, Tucson, 26-29 March 2007, 422-432.</mixed-citation></ref><ref id="scirp.59601-ref7"><label>7</label><mixed-citation publication-type="other" xlink:type="simple">Lipner, S. (2004) The Trustworthy Computing Security Development Lifecycle. 20th Annual Computer Security Applications Conference, Washington, 6-10 December 2004, 2-13. http://dx.doi.org/10.1109/csac.2004.41</mixed-citation></ref><ref id="scirp.59601-ref8"><label>8</label><mixed-citation publication-type="other" xlink:type="simple">Sulayman, M. and Mendes, E. (2009) A Systematic Literature Review of Software Process Improvement in Small and Medium Web Companies. Advances in Software Engineering. Springer, Berlin Heidelberg, 1-8.http://dx.doi.org/10.1007/978-3-642-10619-4_1</mixed-citation></ref><ref id="scirp.59601-ref9"><label>9</label><mixed-citation publication-type="other" xlink:type="simple">Shar, L.K. and Tan, H.B.K. (2012) Automated Removal of Cross Site Scripting Vulnerabilities in Web Applications. Information and Software Technology, 54, 467-478. http://dx.doi.org/10.1016/j.infsof.2011.12.006</mixed-citation></ref><ref id="scirp.59601-ref10"><label>10</label><mixed-citation publication-type="other" xlink:type="simple">Avancini, A. and Ceccato, M. (2013) Comparison and Integration of Genetic Algorithms and Dynamic Symbolic Execution for Security Testing of Cross-Site Scripting Vulnerabilities. Information and Software Technology, 55, 2209-2222. http://dx.doi.org/10.1016/j.infsof.2013.08.001</mixed-citation></ref><ref id="scirp.59601-ref11"><label>11</label><mixed-citation publication-type="other" xlink:type="simple">Jang, Y.S. and Choi, J.Y. (2014) Detecting SQL Injection Attacks Using Query Result Size. Computers &amp; Security, 44, 104-118. http://dx.doi.org/10.1016/j.cose.2014.04.007</mixed-citation></ref><ref id="scirp.59601-ref12"><label>12</label><mixed-citation publication-type="other" xlink:type="simple">Goseva-Popstojanova, K., Anastasovski, G., Dimitrijevikj, A., Pantev, R. and Miller, B. (2014) Characterization and Classification of Malicious Web Traffic. Computers &amp; Security, 42, 92-115.http://dx.doi.org/10.1016/j.cose.2014.01.006</mixed-citation></ref><ref id="scirp.59601-ref13"><label>13</label><mixed-citation publication-type="other" xlink:type="simple">Shahriar, H., Weldemariam, K., Zulkernine, M. and Lutellier, T. (2014) Effective Detection of Vulnerable and Malicious Browser Extensions. Computers &amp; Security, 47, 66-84. http://dx.doi.org/10.1016/j.cose.2014.06.005</mixed-citation></ref><ref id="scirp.59601-ref14"><label>14</label><mixed-citation publication-type="other" xlink:type="simple">Scholte, T., Balzarotti, D. and Kirda, E. (2012) Have Things Changed Now? An Empirical Study on Input Validation Vulnerabilities in Web Applications. Computers &amp; Security, 31, 344-356. http://dx.doi.org/10.1016/j.cose.2011.12.013</mixed-citation></ref><ref id="scirp.59601-ref15"><label>15</label><mixed-citation publication-type="other" xlink:type="simple">Woo, S.W., Joh, H., Alhazmi, O.H. and Malaiya, Y.K. (2011) Modeling Vulnerability Discovery Process in Apache and IIS HTTP Servers. Computers &amp; Security, 30, 50-62. http://dx.doi.org/10.1016/j.cose.2010.10.007</mixed-citation></ref><ref id="scirp.59601-ref16"><label>16</label><mixed-citation publication-type="other" xlink:type="simple">Awoleye, O.M., Ojuloge, B. and Ilori, M.O. (2014) Web Application Vulnerability Assessment and Policy Direction towards a Secure Smart Government. Government Information Quarterly, 31, S118-S125.http://dx.doi.org/10.1016/j.giq.2014.01.012</mixed-citation></ref><ref id="scirp.59601-ref17"><label>17</label><mixed-citation publication-type="other" xlink:type="simple">Buja, G., Bin Abd Jalil, K., Bt Hj Mohd Ali, F. and Rahman, T.F.A. (2014) Detection Model for SQL Injection Attack: An Approach for Preventing a Web Application from the SQL Injection Attack. Proceedings of the 2014 IEEE Symposium on Computer Applications and Industrial Electronics (ISCAIE), Penang, 7-8 April 2014, 60-64.</mixed-citation></ref><ref id="scirp.59601-ref18"><label>18</label><mixed-citation publication-type="other" xlink:type="simple">Salas, M.I.P. and Martins, E. (2014) Security Testing Methodology for Vulnerabilities Detection of XSS in Web Services and WS-Security. Electronic Notes in Theoretical Computer Science, 302, 133-154.http://dx.doi.org/10.1016/j.entcs.2014.01.024</mixed-citation></ref><ref id="scirp.59601-ref19"><label>19</label><mixed-citation publication-type="other" xlink:type="simple">Shar, L.K. and Tan, H.B.K. (2013) Predicting SQL Injection and Cross Site Scripting Vulnerabilities through Mining Input Sanitization Patterns. Information and Software Technology, 55, 1767-1780.http://dx.doi.org/10.1016/j.infsof.2013.04.002</mixed-citation></ref><ref id="scirp.59601-ref20"><label>20</label><mixed-citation publication-type="other" xlink:type="simple">Katkar Anjali, S. and Kulkarni Raj, B. (2012) Web Vulnerability Detection and Security Mechanism. International Journal of Soft Computing and Engineering (IJSCE), 2, 237-241.</mixed-citation></ref><ref id="scirp.59601-ref21"><label>21</label><mixed-citation publication-type="other" xlink:type="simple">Wang, S., Gong, Y., Chen, G., Sun, Q. and Yang, F. (2013) Service Vulnerability Scanning Based on Service-Oriented Architecture in Web Service Environments. Journal of Systems Architecture, 59, 731-739.http://dx.doi.org/10.1016/j.sysarc.2013.01.002</mixed-citation></ref></ref-list></back></article>