<?xml version="1.0" encoding="UTF-8"?><!DOCTYPE article  PUBLIC "-//NLM//DTD Journal Publishing DTD v3.0 20080202//EN" "http://dtd.nlm.nih.gov/publishing/3.0/journalpublishing3.dtd"><article xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink" dtd-version="3.0" xml:lang="en" article-type="research article"><front><journal-meta><journal-id journal-id-type="publisher-id">OJAppS</journal-id><journal-title-group><journal-title>Open Journal of Applied Sciences</journal-title></journal-title-group><issn pub-type="epub">2165-3917</issn><publisher><publisher-name>Scientific Research Publishing</publisher-name></publisher></journal-meta><article-meta><article-id pub-id-type="doi">10.4236/ojapps.2024.143043</article-id><article-id pub-id-type="publisher-id">OJAppS-131694</article-id><article-categories><subj-group subj-group-type="heading"><subject>Articles</subject></subj-group><subj-group subj-group-type="Discipline-v2"><subject>Biomedical&amp;Life Sciences</subject><subject> Chemistry&amp;Materials Science</subject><subject> Computer Science&amp;Communications</subject><subject> Engineering</subject><subject> Physics&amp;Mathematics</subject></subj-group></article-categories><title-group><article-title>
 
 
  Photographs and Cartoons: Differences in Interpretation of the Visual Semiotics
 
</article-title></title-group><contrib-group><contrib contrib-type="author" xlink:type="simple"><name name-style="western"><surname>Bashayir</surname><given-names>Al Zahrani</given-names></name><xref ref-type="aff" rid="aff1"><sup>1</sup></xref></contrib><contrib contrib-type="author" xlink:type="simple"><name name-style="western"><surname>Mohammed</surname><given-names>Alhuthali</given-names></name><xref ref-type="aff" rid="aff2"><sup>2</sup></xref><xref ref-type="corresp" rid="cor1"><sup>*</sup></xref></contrib></contrib-group><aff id="aff2"><addr-line>Foreign Languages Department, Taif University, Taif, Saudi Arabia</addr-line></aff><aff id="aff1"><addr-line>Strategic Planning and Performance Management Department in the Armed Forces Hospitals, Taif, Saudi Arabia</addr-line></aff><pub-date pub-type="epub"><day>12</day><month>03</month><year>2024</year></pub-date><volume>14</volume><issue>03</issue><fpage>609</fpage><lpage>625</lpage><history><date date-type="received"><day>23,</day>	<month>January</month>	<year>2024</year></date><date date-type="rev-recd"><day>10,</day>	<month>March</month>	<year>2024</year>	</date><date date-type="accepted"><day>13,</day>	<month>March</month>	<year>2024</year></date></history><permissions><copyright-statement>&#169; Copyright  2014 by authors and Scientific Research Publishing Inc. </copyright-statement><copyright-year>2014</copyright-year><license><license-p>This work is licensed under the Creative Commons Attribution International License (CC BY). http://creativecommons.org/licenses/by/4.0/</license-p></license></permissions><abstract><p>
 
 
  This study looks at the interaction between the process of intersemiosis and resemiosis in multimodality. The importance of both phases is widely acknowledged as part of the meaning making process but many practical studies focus on the first rather than the second. In particular this study looks at two groups of images about gender relations in Saudi Arabia following the post-2017 reforms of the male guardianship laws. One group are mostly made up of photographs and the second group of cartoons and posters. One important finding is that the latter tend to be less ambiguous in their semiotic structure than the former. In particular, there are instances in the first group where a standard study of intersemiosis indicates low modality but the image may be seen as inherently plausible by many observers. This suggests that while resemiosis can be applied to a single image it may be more appropriate as a tool when applied to an overall news article or set of images. In the same way that not all individual semiotic modes are complementary in how they build meaning, then it is possible for different images to be supportive, contradictory or unclear when studied in isolation.
 
</p></abstract><kwd-group><kwd>Visual Grammar</kwd><kwd> Intersemiosis</kwd><kwd> Multimodality</kwd><kwd> Meaning-Making</kwd><kwd> Cartoons</kwd></kwd-group></article-meta></front><body><sec id="s1"><title>1. Introduction</title><p>The news media is now both inherently multi-modal and most often accessed on-line. This means that images (both still and moving) are now a key part to the interpretation of what is being said as much as, possibly now even more than, any actual text. This has implications both for the construction of each individual item within an image, how these are combined and, equally importantly, how they are interpreted by the viewer (and possibly a lack of clarity as to how they were meant to be interpreted by the original creator). Multimodality [<xref ref-type="bibr" rid="scirp.131694-ref1">1</xref>] [<xref ref-type="bibr" rid="scirp.131694-ref2">2</xref>] provides an analytic framework that works across these three different levels. At one level are the individual semiotic modes (text, image, background colour, sound and so on) and then how these are combined to build up the system of meaning embodied in an image or video [<xref ref-type="bibr" rid="scirp.131694-ref3">3</xref>] [<xref ref-type="bibr" rid="scirp.131694-ref4">4</xref>] [<xref ref-type="bibr" rid="scirp.131694-ref5">5</xref>] . This process of analysing how they are combined (intersemiosis) follows carefully structured approaches [<xref ref-type="bibr" rid="scirp.131694-ref6">6</xref>] [<xref ref-type="bibr" rid="scirp.131694-ref7">7</xref>] and is key to building meaning. Intersemiosis is thus critical in the creation of understanding as meaning should “not [be] analysed in terms of discrete building blocks or structures, but in terms of socially meaningful tensions and oppositions which could be instantiated in one or more ways” ( [<xref ref-type="bibr" rid="scirp.131694-ref5">5</xref>] , p. 31). In effect, we rarely will base interpretation on a single semiotic mode (whether textual or visual) and instead it is the interaction of two or more such modes that underpin meaning making.</p><p>The focus of this study is the portrayal of women in Saudi Arabia following from the recent changes to the male Guardianship laws [<xref ref-type="bibr" rid="scirp.131694-ref8">8</xref>] . As with many social issues in the Kingdom, these have been contentious and interpreted in very different ways. The stated goal is to reduce the extent that women need the permission of male family members to travel and interact outside the home. Part of this has been to lift the previous ban on women driving cars. Those who support the reforms note how much this changes practical life and removes long standing restrictions. On the other hand, critics note the extent that gender-based discrimination remains and the attitudes that restrict women’s practical freedoms remain in place.</p><p>To explore these themes this study considers the content of two groups of images. Some were produced to explain the recent social changes to their readership, some were generated by organisations arguing that, at best, the changes are superficial. Most of the first group are photographs and all of the second group are some forms of cartoon style images. This distinction is useful as the former may be less clear as to the wider interpretation (resemiosis) while the latter were designed for a very particular role. In effect, in one group the challenge is to consider how meaning making is managed within the image and the extent that interpretation by the observer is clear or not. The expectation in the second group is of less ambiguity of interpretation, even if different observers may agree or disagree with the intended message. By combining photographs (which may be more complex) with cartoons (which are usually designed to carry a very specific message) this study allows an exploration of whether the internal structure of the image alters the process of resemiosis.</p></sec><sec id="s2"><title>2. Literature Review</title><sec id="s2_1"><title>2.1. Media Portrayals of Women in Saudi Arabia</title><p>The representation of the Middle East generally, Islam and the role of women in the Western Media has often been challenged due to the underlying orientation and assumptions. In the Saudi context, the focus has been on the substantial restrictions facing women in public life but with this analysis often takes little note of how women have always been able to run their own businesses [<xref ref-type="bibr" rid="scirp.131694-ref9">9</xref>] or access higher education. Issues such as a ban on driving, restrictions on travel and exclusion from many public spaces have all been regularly raised by critics of the Saudi regime. The legal changes since 2017 have sought to change this in particular in terms of male guardianship rules, the right to drive and more freedom to travel. In turn this has attracted attention both in the Western press [<xref ref-type="bibr" rid="scirp.131694-ref10">10</xref>] and across the Arabic speaking world [<xref ref-type="bibr" rid="scirp.131694-ref11">11</xref>] . More widely these changes are promoted by their supporters as a radical reset of social relations in Saudi Arabia and by others as far too limited and possibly cosmetic in nature [<xref ref-type="bibr" rid="scirp.131694-ref12">12</xref>] . In addition to the legal aspect of the changes, the Saudi state has started to produce public information material calling for a reduction in domestic violence and generally greater rights for women.</p></sec><sec id="s2_2"><title>2.2. Visual Grammar</title><p>While much of this narrative has been created and sustained in the form of print, increasingly visual images are important as tools to transmit information and claim the attention of potential readers. In this respect, in the same way that grammar both structures the format and reading of text, visual grammar is an important tool for reading images [<xref ref-type="bibr" rid="scirp.131694-ref13">13</xref>] [<xref ref-type="bibr" rid="scirp.131694-ref14">14</xref>] . Chen and Gao (2014) note how this approach allows for consideration of the various visual modes in the image, the relationship of the image to surrounding material (text, other images, headlines), the intended interpretation by the creator and the possible range of interpretations by the readers [<xref ref-type="bibr" rid="scirp.131694-ref15">15</xref>] .</p><p>As noted above, the presentation of the role of women in Saudi society is contested (both before and after the recent reforms) and this combination of being able to study the process by which meaning is built up, and to consider issues of variable interpretation makes Kress and van Leeuwen’s approach valuable.</p><p>Their model makes use of different analytic concepts to reflect how meaning is created within the image by the interactive participants using four main systems: contact; social distance; perspective; and, modality [<xref ref-type="bibr" rid="scirp.131694-ref13">13</xref>] . Contact depends on how the represented characters interact with the viewer, if they are looking directly at the viewer this can be seen as “demand” in that some form of direct response is expected (ranging from empathy to disgust). If this is lacking then the image is an “offer” with a degree of passivity [<xref ref-type="bibr" rid="scirp.131694-ref16">16</xref>] . In terms of demand, facial expressions are an important part of structuring the desired response. Social distancing relies both on the composition within the image (how close the represented participants are, technical issues such as camera view (close up or long range) and how much of the participants is shown [<xref ref-type="bibr" rid="scirp.131694-ref17">17</xref>] . Camera view also builds up the perspective in the sense of looking down at the participants, up at them or at eye level. As with other social interactions these positions are often held to reflect the relative power and importance between the participants.</p><p>While these three are, to some extent, matters of technical image composition, modality [<xref ref-type="bibr" rid="scirp.131694-ref18">18</xref>] captures the viewpoints of those who constructed the image, how it was used and also, to a lesser extent, the interpretations of the viewers. Initially [<xref ref-type="bibr" rid="scirp.131694-ref13">13</xref>] this focused on issues of truthfulness and credibility (which, of course, capture different criteria). Traditionally it was possible to make a-priori assumptions about truthfulness from the image composition. It was technically easier to fake an image that had little or no colour, limited background or other internal information. However, recent developments in terms of image manipulation make these rules of less value [<xref ref-type="bibr" rid="scirp.131694-ref19">19</xref>] suggesting both a need for greater digital literacy among the wider population and that credibility (and how this is built up) becomes a critical part of the interpretation process [<xref ref-type="bibr" rid="scirp.131694-ref20">20</xref>] [<xref ref-type="bibr" rid="scirp.131694-ref21">21</xref>] [<xref ref-type="bibr" rid="scirp.131694-ref22">22</xref>] .</p><p>These different modes are summarised in <xref ref-type="fig" rid="fig1">Figure 1</xref> and used to analyse the chosen images. This captures the distinction above between technical composition and intended meaning. In effect the former should be clear, and thus open to clear description, the latter needs some degree of interpretation both from the semiotic resources used and the wider framing.</p></sec></sec><sec id="s3"><title>3. Research Methods</title><p>The way that Saudi women are represented in western media in the form of text has been analysed for some time both from the perspective of multimodality [<xref ref-type="bibr" rid="scirp.131694-ref10">10</xref>] and wider political, social and journalistic studies [<xref ref-type="bibr" rid="scirp.131694-ref23">23</xref>] . This study seeks to focus on non-verbal modes in part as this has been less studied and in part as, with the growing reliance on the internet for information, such modes become more important. This allows the study to both concentrate on the construction of meaning with the image using both interactive and compositional meaning. These capture ways in which meaning can be created within the provided image but there is also a need to consider how an image is interpreted by a viewer [<xref ref-type="bibr" rid="scirp.131694-ref15">15</xref>] . The latter captures both the original image maker (what meaning they might have wished to convey) and the various ways different viewers might respond. Functionally what is expected is the degree of clarity (in other words can the image be interpreted in many ways) and just how this meaning making is constructed.</p><p>The approach is qualitative [<xref ref-type="bibr" rid="scirp.131694-ref24">24</xref>] [<xref ref-type="bibr" rid="scirp.131694-ref25">25</xref>] , using a small number of images that in turn allows for in-depth study as to how meaning making is constructed. The sampling frame was derived from an advanced Google image search for direct semiotic reference to Saudi women and had been published on a western news website. All the images were from the English speaking media and span the period before and after the recent Saudi reforms.</p></sec><sec id="s4"><title>4. Findings</title><p>The first batch of images (Figures 2-11 below) are analysed in terms of how visual contact and social power is used to create meaning.</p><p>Source, respectively from Human Rights Watch videos, No Freedom to Travel [<xref ref-type="bibr" rid="scirp.131694-ref26">26</xref>] and Trapped with Abuse – End Male Guardianship in Saudi Arabia [<xref ref-type="bibr" rid="scirp.131694-ref27">27</xref>] .</p><p>Source respectively from the CNN article Saudi Women are Tweeting for their Freedom [<xref ref-type="bibr" rid="scirp.131694-ref28">28</xref>] and the CNN report on the arrest of the person who made the Mecca Girl music video [<xref ref-type="bibr" rid="scirp.131694-ref29">29</xref>] .</p><p>Source (<xref ref-type="fig" rid="fig6">Figure 6</xref> and <xref ref-type="fig" rid="fig7">Figure 7</xref>) respectively from the CNN article about a Saudi teenager given the right to stay in Thailand [<xref ref-type="bibr" rid="scirp.131694-ref30">30</xref>] and about al-Hathloul [<xref ref-type="bibr" rid="scirp.131694-ref31">31</xref>] .</p><p>Source (<xref ref-type="fig" rid="fig8">Figure 8</xref> and <xref ref-type="fig" rid="fig9">Figure 9</xref>) respectively from the CNN article about Maha Taibah, an advisor to Saudi Arabia’s Labour Minister [<xref ref-type="bibr" rid="scirp.131694-ref32">32</xref>] , and an article on the BBC about the “we drove” music video [<xref ref-type="bibr" rid="scirp.131694-ref33">33</xref>] .</p><p>Source (<xref ref-type="fig" rid="fig1">Figure 1</xref>0 and <xref ref-type="fig" rid="fig1">Figure 1</xref>1) respectively from the CNN article “Saudi Women are tweeting for their freedom” [<xref ref-type="bibr" rid="scirp.131694-ref28">28</xref>] and a CNN report on the King Khalid Foundation addressing the problem of domestic abuse [<xref ref-type="bibr" rid="scirp.131694-ref34">34</xref>] .</p><p>Source, a New York Times article about al-Sharif [<xref ref-type="bibr" rid="scirp.131694-ref35">35</xref>] .</p><p>The first step in the analysis takes the images as presented without the contextual information provided by the wider publication or article.</p><p>In Figures 4-11 the participant looks directly at the viewer. This creates a demand, in particular that the viewer identify with them and, to some extent, have an understanding of their world. However, there are important differences within this batch. For <xref ref-type="fig" rid="fig7">Figure 7</xref>, in particular, there is a very direct interaction with the viewer, no other context is present apart from the woman’s head.</p><p>Of those without direct eye contact, in <xref ref-type="fig" rid="fig2">Figure 2</xref> the woman is looking down without any contact which is usually a submissive pose asking for pity and empathy. In contrast in both 3 and 12, the woman is looking up but not at the viewer. <xref ref-type="fig" rid="fig1">Figure 1</xref>2 in particular shows someone at rest and ease in contrast to 5 where there is a direct demand on the attention of a viewer.</p><p>In terms of social distance and frame size, 2, 3, 4, 5, 8, 9 and 12 are all medium shots showing the individual from head to waist but at some distance to the subject. In 6, 7, 10 and 11, these are much closer images, showing just the head and shoulders, creating a closer intimacy between subject and viewer.</p><p>The angles of the images also vary substantially. In 2, 3, 4, 6, 8, 10 and 11, the subject is at the viewers eye level (suggesting equity) while in 5, 9 and 12 the image looks up at the subject (suggest superiority). The outlier is thus 7 where the represented participant is viewed from a high level and the viewer holds the power in this particular relationship.</p><p>As discussed, considerations of modality encompass consideration of plausibility of the image. Some of this comes from issues in the composition and layout of the image. Colour saturation is important and 2, 3, 10 and 11 are in black and white (which often indicates low modality) which also applies to 7 due to the full colour saturation. The balance uses natural colours suggesting higher modality. <xref ref-type="table" rid="table1">Table 1</xref> below summarises all the images in terms of their modality markers.</p><p>In effect, almost every image has a mix of high and low modality but the balance varies substantially. On one end of the scale 9 (showing a woman wearing a traditional Aqaba) scores as low modality for all the features and in contrast 5 and 6 only have one low modality score. Both of these show women fairly directly demanding the attention of the viewer, either by direction of gaze and composition (6) or actions (5).</p><p>The second batch of images are also used to explore the construction of salience. Note that these are all cartoon style drawings so in one sense are very much produced for a particular purpose.</p><p>Sources (<xref ref-type="fig" rid="fig1">Figure 1</xref>3 and <xref ref-type="fig" rid="fig1">Figure 1</xref>4), both [<xref ref-type="bibr" rid="scirp.131694-ref36">36</xref>] [<xref ref-type="bibr" rid="scirp.131694-ref37">37</xref>] from a New York Times article about Saudi Women driving [<xref ref-type="bibr" rid="scirp.131694-ref38">38</xref>] .</p><p>Source (<xref ref-type="fig" rid="fig1">Figure 1</xref>5 and <xref ref-type="fig" rid="fig1">Figure 1</xref>6) from the Human Rights Watch videos “No freedom to travel” [<xref ref-type="bibr" rid="scirp.131694-ref26">26</xref>] and “trapped with abuse – the Male Guardianship system” [<xref ref-type="bibr" rid="scirp.131694-ref27">27</xref>] respectively.</p><p>Source (<xref ref-type="fig" rid="fig1">Figure 1</xref>7 and <xref ref-type="fig" rid="fig1">Figure 1</xref>8) from the Human Rights Watch videos “No freedom to travel” [<xref ref-type="bibr" rid="scirp.131694-ref26">26</xref>] and “trapped with abuse – the Male Guardianship system” [<xref ref-type="bibr" rid="scirp.131694-ref27">27</xref>] respectively.</p><p>Sourced (<xref ref-type="fig" rid="fig1">Figure 1</xref>9 and <xref ref-type="fig" rid="fig2">Figure 2</xref>0) from the video “trapped with abuse – the Male Guardianship system” [<xref ref-type="bibr" rid="scirp.131694-ref27">27</xref>] and a CNN image entitled “veiled Saudi woman football fan” [<xref ref-type="bibr" rid="scirp.131694-ref39">39</xref>] .</p><p>Given that these are all constructed images, as opposed to photographs being used to supplement a wider argument, the focus is on the visual elements used to attract a viewer’s attention.</p><p><xref ref-type="fig" rid="fig1">Figure 1</xref>3 uses two narrative approaches, the obvious being of a Saudi man holding a Saudi woman (with a car) in his hands. The less obvious is whether this indicates care giving and safeguarding or an attempt to control female access to the new (and limited) right to drive on their own. The relative size of the participants (and the direction of gaze) very much emphasises the relative power relations between the man and the woman. The yellow background is designed to attract and hold attention, in part it may reflect the concept of desert widely associated with Saudi Arabia but it gives the image high visual appeal. <xref ref-type="fig" rid="fig1">Figure 1</xref>4 uses some similar concepts, in particular that of a small female figure underneath a much larger hand with a car very much obscured as a background shadow. Again, this is ambiguous in that it may suggest that access to driving is emerging as a possibility or, instead, remains very much under patriarchal control.</p><p>The rest of the images use colours to form salience. Figures 15-17 show a Saudi woman wearing an abaya but the Arabic text (that draws attention due to its colour) says “together to end the male guardianship system”. In particular <xref ref-type="fig" rid="fig1">Figure 1</xref>6 is taken from a video about domestic violence and the red text can be seen as stressing either fear of violence or empowerment to end violence. By contrast 15 is from a video about the changes to travel restrictions using green text to emphasise hope. The blue text for <xref ref-type="fig" rid="fig1">Figure 1</xref>7 is chosen to emphasise a need (and some hope) for greater freedom and liberty.</p><p>Figures 18-20 all make use of red, suggesting the violence inherent in the old guardianship system. <xref ref-type="fig" rid="fig2">Figure 2</xref>0 has a woman wearing a niqab and holding a Saudi flag, again suggesting the risks in the old system and need to change. This sequence of images was designed to identify existing problems and support the planned changes to the guardianship rules.</p></sec><sec id="s5"><title>5. Discussion</title><p>The discussion above reflects the relative difficulties of using intersemiosis to explore how an image is constructed compared to resemiosis for how it is interpreted (and how the original producer intended for it to be interpreted). As noted, the images selected above can be split into two broad groups. While the first set includes both photographs and cartoon style images the second set are all structured as cartoon images. The result is some difference in the type and volume of semiotic modes and their interaction.</p><p>The first set could be seen as being richer in their semiotic construction (<xref ref-type="table" rid="table1">Table 1</xref>) even if their overall modality varies substantially. Many of the first group are framed with the subject looking directly at the viewer, in effect a demand for a response. The second set are usually simpler reflecting their design as seeking to explain the need for the recent social reforms.</p><p>In terms of intersemiosis, both batches are relatively straightforward. The various images (and text where it is used) are being used to support a central message. What is less clear is what this message is (the process of resemiosis). Here there is a relatively clear break between the two groups. Those in the second batch can mostly be seen as non-ambiguous in this regard. Even <xref ref-type="fig" rid="fig1">Figure 1</xref>4 which might be construed as the old guardianship model as one of caring rather than social restrictions, is relatively easy to interpret. The final group (18 - 20) are all designed to indicate the problems of the guardianship model and the need for significant change.</p><table-wrap id="table1" ><label><xref ref-type="table" rid="table1">Table 1</xref></label><caption><title> Modality markers [<xref ref-type="bibr" rid="scirp.131694-ref13">13</xref>] , p. 160</title></caption><table><tbody><thead><tr><th align="center" valign="middle"  rowspan="2"  >Figure</th><th align="center" valign="middle"  colspan="8"  >Modality</th></tr></thead><tr><td align="center" valign="middle" >Color Saturation</td><td align="center" valign="middle" >Color Differentiation</td><td align="center" valign="middle" >Color Modulation</td><td align="center" valign="middle" >Contextualization</td><td align="center" valign="middle" >Representation</td><td align="center" valign="middle" >Depth</td><td align="center" valign="middle" >Illumination</td><td align="center" valign="middle" >Brightness</td></tr><tr><td align="center" valign="middle" >1</td><td align="center" valign="middle" >Low Modality</td><td align="center" valign="middle" >High Modality</td><td align="center" valign="middle" >High Modality</td><td align="center" valign="middle" >Low Modality</td><td align="center" valign="middle" >Low Modality</td><td align="center" valign="middle" >High Modality</td><td align="center" valign="middle" >High Modality</td><td align="center" valign="middle" >High Modality</td></tr><tr><td align="center" valign="middle" >2</td><td align="center" valign="middle" >Low Modality</td><td align="center" valign="middle" >High Modality</td><td align="center" valign="middle" >High Modality</td><td align="center" valign="middle" >Low Modality</td><td align="center" valign="middle" >Low Modality</td><td align="center" valign="middle" >High Modality</td><td align="center" valign="middle" >High Modality</td><td align="center" valign="middle" >High Modality</td></tr><tr><td align="center" valign="middle" >3</td><td align="center" valign="middle" >High Modality</td><td align="center" valign="middle" >Low Modality</td><td align="center" valign="middle" >High Modality</td><td align="center" valign="middle" >Low Modality</td><td align="center" valign="middle" >High Modality</td><td align="center" valign="middle" >High Modality</td><td align="center" valign="middle" >High Modality</td><td align="center" valign="middle" >High Modality</td></tr><tr><td align="center" valign="middle" >4</td><td align="center" valign="middle" >High Modality</td><td align="center" valign="middle" >Low Modality</td><td align="center" valign="middle" >High Modality</td><td align="center" valign="middle" >High Modality</td><td align="center" valign="middle" >High Modality</td><td align="center" valign="middle" >High Modality</td><td align="center" valign="middle" >High Modality</td><td align="center" valign="middle" >High Modality</td></tr><tr><td align="center" valign="middle" >5</td><td align="center" valign="middle" >High Modality</td><td align="center" valign="middle" >Low Modality</td><td align="center" valign="middle" >High Modality</td><td align="center" valign="middle" >High Modality</td><td align="center" valign="middle" >High Modality</td><td align="center" valign="middle" >High Modality</td><td align="center" valign="middle" >High Modality</td><td align="center" valign="middle" >High Modality</td></tr><tr><td align="center" valign="middle" >6</td><td align="center" valign="middle" >Low Modality</td><td align="center" valign="middle" >High Modality</td><td align="center" valign="middle" >High Modality</td><td align="center" valign="middle" >High Modality</td><td align="center" valign="middle" >High Modality</td><td align="center" valign="middle" >High Modality</td><td align="center" valign="middle" >High Modality</td><td align="center" valign="middle" >Low Modality</td></tr><tr><td align="center" valign="middle" >7</td><td align="center" valign="middle" >High Modality</td><td align="center" valign="middle" >Low Modality</td><td align="center" valign="middle" >High Modality</td><td align="center" valign="middle" >Low Modality</td><td align="center" valign="middle" >High Modality</td><td align="center" valign="middle" >High Modality</td><td align="center" valign="middle" >High Modality</td><td align="center" valign="middle" >Low Modality</td></tr><tr><td align="center" valign="middle" >8</td><td align="center" valign="middle" >High Modality</td><td align="center" valign="middle" >Low Modality</td><td align="center" valign="middle" >High Modality</td><td align="center" valign="middle" >High Modality</td><td align="center" valign="middle" >High Modality</td><td align="center" valign="middle" >High Modality</td><td align="center" valign="middle" >High Modality</td><td align="center" valign="middle" >High Modality</td></tr><tr><td align="center" valign="middle" >9</td><td align="center" valign="middle" >Low Modality</td><td align="center" valign="middle" >Low Modality</td><td align="center" valign="middle" >Low Modality</td><td align="center" valign="middle" >Low Modality</td><td align="center" valign="middle" >Low Modality</td><td align="center" valign="middle" >Low Modality</td><td align="center" valign="middle" >Low Modality</td><td align="center" valign="middle" >Low Modality</td></tr><tr><td align="center" valign="middle" >10</td><td align="center" valign="middle" >Low Modality</td><td align="center" valign="middle" >Low Modality</td><td align="center" valign="middle" >Low Modality</td><td align="center" valign="middle" >Low Modality</td><td align="center" valign="middle" >Low Modality</td><td align="center" valign="middle" >Low Modality</td><td align="center" valign="middle" >Low Modality</td><td align="center" valign="middle" >Low Modality</td></tr><tr><td align="center" valign="middle" >11</td><td align="center" valign="middle" >High Modality</td><td align="center" valign="middle" >Low Modality</td><td align="center" valign="middle" >High Modality</td><td align="center" valign="middle" >Low Modality</td><td align="center" valign="middle" >High Modality</td><td align="center" valign="middle" >High Modality</td><td align="center" valign="middle" >High Modality</td><td align="center" valign="middle" >Low Modality</td></tr></tbody></table></table-wrap><p>In this respect, that the second batch are clearly constructed around a position simplifies part of the problem with resemiosis. The intent of the designer is clear and each has a single message. For the viewer, the remaining ambiguity stems from their degree of understanding of the much wider context, and, perhaps more pertinent, whether they see the images as basically positive (a direction of change away from the old system) or indicative of just how substantial the degree of change is that is really needed.</p><p>For the first batch, there is not just the issue of the viewer/interpreter but also of what is being represented. Consequently, <xref ref-type="fig" rid="fig1">Figure 1</xref>0 and <xref ref-type="fig" rid="fig1">Figure 1</xref>1 could be seen as relatively traditional representations of Saudi women, but notably both score very low in terms of modality in every category. However, this points to a fundamental issue with moving from intersemiosis as the focus of a study to resemiosis. To many potential observers, those would be readily seen as very plausible images of Saudi women, perhaps even typical. Of course, other observers may see them as somewhat outdated and stereotypical representations and argue that Figures 5-9 are more credible representations of Saudi women after the recent reforms (and those images score more highly in terms of high modality).</p><p>If the process of interpretation was simply a consequence of analysis of the image the low modality of <xref ref-type="fig" rid="fig1">Figure 1</xref>0 and <xref ref-type="fig" rid="fig1">Figure 1</xref>1 should be critical in terms of their perceived plausibility. Accepting there is a disconnect starts to address some of the wider process of resemiosis. The core value of intersemiosis is that it combines all the presented semiotic modes into a coherent whole accepting that this or that mode may be contradictory.</p><p>Resemiosis may be about how we interpret a single image but the logic of that interpretation is not just bounded by the presented image. Even laying aside, individual biases and preconceived ideas, to interpret the validity of an image may well involve combining a wider set of information. In this case, the surrounding text may be important as may the headline for the article. Equally how the image was accessed maybe important. If the image was found running an internet search routine, then the framing of that enquiry will influence what is presented, as well as the likely interpretation framework of the observer. In that respect simply knowing the headline of the wider report is informative. That <xref ref-type="fig" rid="fig8">Figure 8</xref> is of a government adviser and <xref ref-type="fig" rid="fig1">Figure 1</xref>2 is of an activist in many ways is more important for wider meaning making than the specific framing of the image. In this case they are broadly similar in that respect but clearly reflect very different personal situations.</p></sec><sec id="s6"><title>6. Conclusions</title><p>In summary this study points to the value of Kress &amp; van Leeuwen’s (2006) interpretative approach to combining the semiotic modes in an image. However, it also points to the problem of how the observer will interpret this information, especially in an area that is contested with sometimes strongly held opinions and a lack of contextual knowledge. The strength of intersemiosis is that it moves from studying semiotic modes in relative isolation to bringing them together in a coherent whole. The weakness of current approaches to resemiosis is that this might be how the observer then places their understanding on the presented image (and some of this, inevitably, will draw on understanding and information outside the current frame of reference), however, in other cases it will involve the observer drawing on different components of the wider article to inform their interpretation. In effect, combining the various modes in images results from more than one instance of intersemiosis.</p><p>The difference between the photographs and the cartoons is marked especially in terms of how Interactive Meaning is constructed. As is to be expected the cartoons use less semiotic modes and have no secondary aspects such as background imagery that does not support the main focus. In turn the cartoons are more obvious in terms of both Representational and Compositional Meaning again reflecting their relative clarity of purpose. Having noted this, the wider framing (the title of the video or article) is still critical to any understanding.</p><p>In this case this is partly linguistic. Unless the reader can understand Arabic script, the full intent of the cartoon images will be lost. In effect, knowing the nature of the publication and being provided with a translation both compensate for what might otherwise be a missing semiotic resource.</p><p>The challenge for researchers is to accept this broadening of frame of reference and to consider how this more holistic view may be at variance to the implications of a study of an individual image. Thus, intersemiosis allows for the idea that not all the semiotic modes are complementary and that some may carry different messages or even competing messages (such as words and the presented image). In turn resemiosis becomes a process not just of building up meaning from mutually reinforcing semiotic structures but also of balancing potentially contradictory or even competing meaning systems.</p></sec><sec id="s7"><title>Conflicts of Interest</title><p>The authors declare no conflicts of interest regarding the publication of this paper.</p></sec><sec id="s8"><title>Cite this paper</title><p>Al Zahrani, B. and Alhuthali, M. (2024) Photographs and Cartoons: Differences in Interpretation of the Visual Semiotics. Open Journal of Applied Sciences, 14, 609-625. https://doi.org/10.4236/ojapps.2024.143043</p></sec></body><back><ref-list><title>References</title><ref id="scirp.131694-ref1"><label>1</label><mixed-citation publication-type="book" xlink:type="simple">O’Halloran, K.L. (2011) Multimodal Analysis and Digital Technology. In: Baldry, A. and Montagna, E., Eds., Interdisciplinary Approaches on Multimodality: Theory and Practice, Palladino, Campobasso, 21-34.</mixed-citation></ref><ref id="scirp.131694-ref2"><label>2</label><mixed-citation publication-type="other" xlink:type="simple">O’Halloran, K.L. (2008) Systemic Functional-Multimodal Discourse Analysis (SF-MDA): Constructing Ideational Meaning Using Language and Visual Imagery. Visual Communication, 7, 443-475. https://doi.org/10.1177/1470357208096210</mixed-citation></ref><ref id="scirp.131694-ref3"><label>3</label><mixed-citation publication-type="other" xlink:type="simple">Jewitt, C. (2005) Multimodality, “Reading”, and “Writing” for the 21st Century. Discourse: Studies in the Cultural Politics of Education, 26, 315-333. https://doi.org/10.1080/01596300500200011</mixed-citation></ref><ref id="scirp.131694-ref4"><label>4</label><mixed-citation publication-type="other" xlink:type="simple">Martin, J.R. and White, P.R. (2005) The Language of Evaluation: Appraisal in English. Palgrave MacMillan, Basingstoke.</mixed-citation></ref><ref id="scirp.131694-ref5"><label>5</label><mixed-citation publication-type="other" xlink:type="simple">Iedema, R. (2003) Multimodality, Resemiotization: Extending the Analysis of Discourse as Multi-Semiotic Practice. Visual Communication, 2, 29-57. https://doi.org/10.1177/1470357203002001751</mixed-citation></ref><ref id="scirp.131694-ref6"><label>6</label><mixed-citation publication-type="other" xlink:type="simple">O’Halloran, K.L., Tan, S. and Wignell, P. (2016) Intersemiotic Translation as Resemiotisation: A Multimodal Perspective. Signata, 7, 199-229. https://doi.org/10.4000/signata.1223</mixed-citation></ref><ref id="scirp.131694-ref7"><label>7</label><mixed-citation publication-type="other" xlink:type="simple">Lim, F.V. (2021) Investigating Intersemiosis: A Systemic Functional Multimodal Discourse Analysis of the Relationship between Language and Gesture in Classroom Discourse. Visual Communication, 20, 34-58. https://doi.org/10.1177/1470357218820695</mixed-citation></ref><ref id="scirp.131694-ref8"><label>8</label><mixed-citation publication-type="other" xlink:type="simple">Cannataci, J. (2019) Steps Taken to End Saudi ‘Guardianship’ System for Women, ‘Encouraging’ Start. UN News, Geneva.</mixed-citation></ref><ref id="scirp.131694-ref9"><label>9</label><mixed-citation publication-type="other" xlink:type="simple">Al-Asfour, A., Tlaiss, H.A., Khan, S.A. and Rajasekar, J. (2017) Saudi Women’s Work Challenges and Barriers to Career Advancement. Career Development International, 22, 184-199. https://doi.org/10.1108/CDI-11-2016-0200</mixed-citation></ref><ref id="scirp.131694-ref10"><label>10</label><mixed-citation publication-type="other" xlink:type="simple">Elyas, T. and Aljabri, A. (2020) Representations of Saudi Male’s Guardianship System and Women’s Freedom to Travel in Western Newspapers: A Critical Discourse Analysis. Contemporary Review of the Middle East, 7, 339-357. https://doi.org/10.1177/2347798920921977</mixed-citation></ref><ref id="scirp.131694-ref11"><label>11</label><mixed-citation publication-type="journal" xlink:type="simple"><name name-style="western"><surname>Adel</surname><given-names> M. </given-names></name>,<etal>et al</etal>. (<year>2019</year>)<article-title>The Image of Saudi Women in the Arab Press after the Launch of Vision 2030: An Analytic Study on the Sites of the Egyptian, Jordanian and Tunisian Arab Newspapers</article-title><source> The Scientific Journal of Media Research and Communications Technology</source><volume> 5</volume>,<fpage> 1</fpage>-<lpage>34</lpage>.<pub-id pub-id-type="doi"></pub-id></mixed-citation></ref><ref id="scirp.131694-ref12"><label>12</label><mixed-citation publication-type="other" xlink:type="simple">Boghani, P. (2019) The Paradox of Saudi Arabia’s Social Reforms. https://www.pbs.org/wgbh/frontline/article/the-paradox-of-saudi-arabias-social-reforms/</mixed-citation></ref><ref id="scirp.131694-ref13"><label>13</label><mixed-citation publication-type="other" xlink:type="simple">Kress, G. and van Leeuwen, T. (2006) Reading Images: The Grammar of Visual Design. Routledge, London. https://doi.org/10.4324/9780203619728</mixed-citation></ref><ref id="scirp.131694-ref14"><label>14</label><mixed-citation publication-type="other" xlink:type="simple">Chen, Y. and Gao, X. (2014) Interpretation of Movie Posters from the Perspective of Multimodal Discourse Analysis. GSTF Journal on Education, 1, 76-99. https://doi.org/10.5176/2345-7163_1.1.11</mixed-citation></ref><ref id="scirp.131694-ref15"><label>15</label><mixed-citation publication-type="other" xlink:type="simple">Alhuthali, M. (2018) Interpreting Stereotypes: Images and Text. International Journal of Linguistics, 10, 113-123. https://doi.org/10.5296/ijl.v10i4.13577</mixed-citation></ref><ref id="scirp.131694-ref16"><label>16</label><mixed-citation publication-type="other" xlink:type="simple">Peng, Z. (2022) A Multimodal Discourse Analysis of Movie Posters from the Perspective of Visual Grammar—A Case Study of “Hi, Mom”. Theory and Practice in Language Studies, 12, 605-609. https://doi.org/10.17507/tpls.1203.22</mixed-citation></ref><ref id="scirp.131694-ref17"><label>17</label><mixed-citation publication-type="other" xlink:type="simple">Padilla, J.E. and Padilla, C.A. (2022) Multimodal Discourse Analysis of COVID-19 Vaccination Campaign Posters: Visual Grammar Approach. Silliman Journal, 63, 95-120.</mixed-citation></ref><ref id="scirp.131694-ref18"><label>18</label><mixed-citation publication-type="other" xlink:type="simple">Ravelli, L.J. and Van Leeuwen, T. (2018) Modality in the Digital Age. Visual Communication, 17, 277-297. https://doi.org/10.1177/1470357218764436</mixed-citation></ref><ref id="scirp.131694-ref19"><label>19</label><mixed-citation publication-type="other" xlink:type="simple">Grothaus, M. (2021) Trust No One: Inside the World of Deepfakes. Hodder and Straughton, London.</mixed-citation></ref><ref id="scirp.131694-ref20"><label>20</label><mixed-citation publication-type="other" xlink:type="simple">Haslanger, S. (2019) Cognition as a Social Skill. Australasian Philosophical Review, 3, 5-25. https://doi.org/10.1080/24740500.2019.1705229</mixed-citation></ref><ref id="scirp.131694-ref21"><label>21</label><mixed-citation publication-type="other" xlink:type="simple">Luo, M., Hancock, J.T. and Markowitz, D.M. (2022) Credibility Perceptions and Detection Accuracy of Fake News Headlines on Social Media: Effects of Truth-Bias and Endorsement Cues. Communication Research, 49, 171-195. https://doi.org/10.1177/0093650220921321</mixed-citation></ref><ref id="scirp.131694-ref22"><label>22</label><mixed-citation publication-type="book" xlink:type="simple">Tewksbury, D. and Scheufele, D.A. (2019) News Framing Theory and Research. In: Oliver, M.B., Raney, A.A. and Bryant, J., Eds., Media Effects, Routledge, New York, 51-68. https://doi.org/10.4324/9780429491146-4</mixed-citation></ref><ref id="scirp.131694-ref23"><label>23</label><mixed-citation publication-type="other" xlink:type="simple">Said, E.W. (1997) Covering Islam: How the Media and the Experts Determine How We See the Rest of the World. 2nd Edition, Vintage, London.</mixed-citation></ref><ref id="scirp.131694-ref24"><label>24</label><mixed-citation publication-type="other" xlink:type="simple">Braun, V. and Clarke, V. (2013) Successful Qualitative Research. Sage, London.</mixed-citation></ref><ref id="scirp.131694-ref25"><label>25</label><mixed-citation publication-type="book" xlink:type="simple">Symon, G. and Cassell, C. (2012) Assessing Qualitative Research. In: Symon, G. and Cassell, C., Eds., Organizational Qualitative Research: Core Methods and Current Challenges, Sage, London, 204-223. https://doi.org/10.4135/9781526435620</mixed-citation></ref><ref id="scirp.131694-ref26"><label>26</label><mixed-citation publication-type="other" xlink:type="simple">Human Rights Watch (2016) No Freedom to Travel—End Male Guardianship. https://www.youtube.com/watch?v=-goe4zON-XE</mixed-citation></ref><ref id="scirp.131694-ref27"><label>27</label><mixed-citation publication-type="other" xlink:type="simple">Human Rights Watch (2016) Trapped with Abuse—End Male Guardianship in Saudi Arabia. https://www.youtube.com/watch?v=hPht8rM_GaQ</mixed-citation></ref><ref id="scirp.131694-ref28"><label>28</label><mixed-citation publication-type="other" xlink:type="simple">CNN (2016) Saudi Women Are Tweeting for Their Freedom. https://edition.cnn.com/2016/09/16/world/saudi-arabia-male-guardianship-campaign/index.html</mixed-citation></ref><ref id="scirp.131694-ref29"><label>29</label><mixed-citation publication-type="other" xlink:type="simple">Tawfeeq, M. and Kottasova, I. (2020) Saudi Officials Order Arrest of Female Rapper for ‘Mecca Girl’ Music Video. https://edition.cnn.com/2020/02/26/middleeast/saudi-arabia-rapper-woman-arrest-intl/index.html</mixed-citation></ref><ref id="scirp.131694-ref30"><label>30</label><mixed-citation publication-type="other" xlink:type="simple">CNN (2019) Saudi Teen Granted Stay in Thailand. https://edition.cnn.com/videos/world/2019/01/07/saudi-woman-held-thai-airport-vpx.cnn</mixed-citation></ref><ref id="scirp.131694-ref31"><label>31</label><mixed-citation publication-type="other" xlink:type="simple">Al-Hathloul, W. (2019) Jailed Saudi Activist Loujain Al-Hathloul. https://edition.cnn.com/2019/03/13/middleeast/hathloul-trial-saudi-intl/index.html</mixed-citation></ref><ref id="scirp.131694-ref32"><label>32</label><mixed-citation publication-type="other" xlink:type="simple">Alcock, E. (2014) A Conundrum for Saudi Women at Work. https://www.nytimes.com/2014/11/29/business/a-conundrum-for-saudis-women-at-work.html</mixed-citation></ref><ref id="scirp.131694-ref33"><label>33</label><mixed-citation publication-type="other" xlink:type="simple">BBC (2018) I Can’t Believe I’m Driving in Saudi Arabia. https://www.bbc.co.uk/news/world-middle-east-44592186</mixed-citation></ref><ref id="scirp.131694-ref34"><label>34</label><mixed-citation publication-type="other" xlink:type="simple">Carrington, D. (2013) Can Saudi Arabia’s First Anti-Domestic Violence Advert Make a Difference? https://edition.cnn.com/2013/05/12/world/meast/saudi-arabia-anti-domestic-abuse-campaign/index.html</mixed-citation></ref><ref id="scirp.131694-ref35"><label>35</label><mixed-citation publication-type="other" xlink:type="simple">Bajar, N. (2017) Manal Al-Sharif, an Activist for Women’s Rights in Saudi Arabia. https://www.nytimes.com/2017/06/16/world/middleeast/saudi-womens-rights.html</mixed-citation></ref><ref id="scirp.131694-ref36"><label>36</label><mixed-citation publication-type="other" xlink:type="simple">Steinberg, J. (2018) Saudi Women Driving Ban. https://www.nytimes.com/2018/05/25/opinion/saudi-arabia-salman-womens-rights.html</mixed-citation></ref><ref id="scirp.131694-ref37"><label>37</label><mixed-citation publication-type="other" xlink:type="simple">Lannes, L. (2018) Saudi Women Driving. https://lauralannes.format.com/nyt-saudi-women-can-drive-now</mixed-citation></ref><ref id="scirp.131694-ref38"><label>38</label><mixed-citation publication-type="other" xlink:type="simple">Aldosari, H. (2018) Saudi Women Can Drive Now. Will That Hurt Saudi Women? https://www.nytimes.com/2018/06/22/opinion/saudi-arabia-salman-women-driving.html</mixed-citation></ref><ref id="scirp.131694-ref39"><label>39</label><mixed-citation publication-type="other" xlink:type="simple">CNN (2012) Veiled Saudi Woman Football Fan. https://edition.cnn.com/2012/03/23/sport/saudi-women-olympics/index.html</mixed-citation></ref></ref-list></back></article>