<?xml version="1.0" encoding="UTF-8"?><!DOCTYPE article  PUBLIC "-//NLM//DTD Journal Publishing DTD v3.0 20080202//EN" "http://dtd.nlm.nih.gov/publishing/3.0/journalpublishing3.dtd"><article xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink" dtd-version="3.0" xml:lang="en" article-type="research article"><front><journal-meta><journal-id journal-id-type="publisher-id">ICA</journal-id><journal-title-group><journal-title>Intelligent Control and Automation</journal-title></journal-title-group><issn pub-type="epub">2153-0653</issn><publisher><publisher-name>Scientific Research Publishing</publisher-name></publisher></journal-meta><article-meta><article-id pub-id-type="doi">10.4236/ica.2013.42020</article-id><article-id pub-id-type="publisher-id">ICA-31737</article-id><article-categories><subj-group subj-group-type="heading"><subject>Articles</subject></subj-group><subj-group subj-group-type="Discipline-v2"><subject>Computer Science&amp;Communications</subject></subj-group></article-categories><title-group><article-title>
 
 
  A Tree-Type Memory Formation by Sensorimotor Feedback: A Possible Approach to the Development of Robotic Cognition
 
</article-title></title-group><contrib-group><contrib contrib-type="author" xlink:type="simple"><name name-style="western"><surname>ady</surname><given-names>Alnajjar</given-names></name><xref ref-type="aff" rid="aff1"><sup>1</sup></xref><xref ref-type="corresp" rid="cor1"><sup>*</sup></xref></contrib><contrib contrib-type="author" xlink:type="simple"><name name-style="western"><surname>Indra</surname><given-names>M. Zin</given-names></name><xref ref-type="aff" rid="aff2"><sup>2</sup></xref><xref ref-type="corresp" rid="cor1"><sup>*</sup></xref></contrib><contrib contrib-type="author" xlink:type="simple"><name name-style="western"><surname>Abdl</surname><given-names>R. Hafiz</given-names></name><xref ref-type="aff" rid="aff2"><sup>2</sup></xref><xref ref-type="corresp" rid="cor1"><sup>*</sup></xref></contrib><contrib contrib-type="author" xlink:type="simple"><name name-style="western"><surname>Kazuyuki</surname><given-names>Murase</given-names></name><xref ref-type="aff" rid="aff2"><sup>2</sup></xref><xref ref-type="corresp" rid="cor1"><sup>*</sup></xref></contrib></contrib-group><aff id="aff2"><addr-line>Department of Human and Artificial Intelligence Systems, Fukui, Japan</addr-line></aff><aff id="aff1"><addr-line>Brain Science Institute, RIKEN, Nagoya, Japan</addr-line></aff><author-notes><corresp id="cor1">* E-mail:<email>fady@synapse.his.u-fukui.ac.jp(AA)</email>;<email>fady@synapse.his.u-fukui.ac.jp(IMZ)</email>;<email>fady@synapse.his.u-fukui.ac.jp(ARH)</email>;<email>fady@synapse.his.u-fukui.ac.jp(KM)</email>;</corresp></author-notes><pub-date pub-type="epub"><day>24</day><month>05</month><year>2013</year></pub-date><volume>04</volume><issue>02</issue><fpage>154</fpage><lpage>165</lpage><history><date date-type="received"><day>August</day>	<month>6,</month>	<year>2012</year></date><date date-type="rev-recd"><day>January</day>	<month>28,</month>	<year>2013</year>	</date><date date-type="accepted"><day>February</day>	<month>7,</month>	<year>2013</year></date></history><permissions><copyright-statement>&#169; Copyright  2014 by authors and Scientific Research Publishing Inc. </copyright-statement><copyright-year>2014</copyright-year><license><license-p>This work is licensed under the Creative Commons Attribution International License (CC BY). http://creativecommons.org/licenses/by/4.0/</license-p></license></permissions><abstract><p>
 
 
  Based on indications from neuroscience and psychology, both perception and action can be internally simulated in or
  - 
  ganisms by activating sensory and/or motor areas in the brain without actual external sensory input and/or without any resulting behavior (a phenomenon called Thinking). This phenomenon is usually used by the organisms to cope with missing external inputs. Applying such phenomenon in a real robot recently has taken the attention of many researchers. Although some work has been reported on this issue, none of this work has so far consider
  ed
   the potential of the robot’s vision at the sensorimotor abstraction level, where extracting data from the environment takes place. In this study, a novel visiomotor abstraction is presented into a physical robot through a memory-based learning algorithm. Experi
  - 
  mental results indicate that our robot with its vision could develop a kind of simple anticipation mechanism into its tree-type memory structure through interacting with the environment which would guide its behavior in the absence of external inputs.
  
 
</p></abstract><kwd-group><kwd>Visiomotor Abstraction; Memory Based Learning; Artificial Cognition; Internal Representation</kwd></kwd-group></article-meta></front><body><sec id="s1"><title>1. Introduction</title><p>Real world applications are usually subject to change and very difficult to be predicted. Any sudden changes in the environment can possibly cause temporary lose in communication with the external world. Some organisms, those that have the ability of cognition or thinking, can cope with such situations by replacing the external missing or corrupted sensory data with their own internal representation (or experience).</p><p>In recent decades, a branch of science called cognitive neuroscience, an interdisciplinary link between cognitive psychology and neuroscience, has been established to introduce such phenomena to the mobile robot [<xref ref-type="bibr" rid="scirp.31737-ref1">1</xref>]. It was hoped that adding this feature to the robot would move autonomous robots closer to interfacing with real world applications.</p><p>Cognitive Roboticsis concerned with endowing robots with mammalian and human-like cognitive capabilities to enable them to accomplish complex tasks in complex environments. Cognitive ability is the ability to understand and try to make sense of the world. In [<xref ref-type="bibr" rid="scirp.31737-ref2">2</xref>], the authors have argued that all living creatures are cognitive to some degree. Several authors have argued in recent years that cognition and consciousness can be achieved to some extent on the mobile robots [3-5]. We believe that the level of or how much the robot could be conscious of the surrounding environment depends on how much the robot knows about this environment. Cognition in robots includes perception processing, attention allocation, anticipation, etc. One of the possible approaches to measuring these capabilities in the robot is by examining its ability to cope with missing external sensory data during performance of a specific task. Said in a different and operational way, it is the ability of a robot to perform blindfolded navigation, where the robot navigates within a known environment using only its internal representation.</p><p>In recent years, building a complete blindfolded navigation system in a mobile robot has been a challenging task for many robotic researchers [6-9]. For instance, some initial experiments were presented in [<xref ref-type="bibr" rid="scirp.31737-ref7">7</xref>] that aim to contribute toward building a robot that navigates completely blindfolded in a simple environment using a two-level network architecture; 1) low-level abstraction from sensorimotor values to a limited number of simple abstract “concepts”, following the work done by Linker and Niklasson [6,10], and 2) higher-level prediction/ representation of the agent’s interaction with the environment, inspired by the work done by Nolfi and Tani [<xref ref-type="bibr" rid="scirp.31737-ref11">11</xref>]. These efforts have to some degree succeeded in allowing the robot to anticipate long chains of future situations. However, they have failed to support a completely blindfolded navigation [<xref ref-type="bibr" rid="scirp.31737-ref8">8</xref>], in which the robot repeatedly uses its own internal representation values instead of the real sensory inputs for a certain number of times for its navigation. The failure partly seems to be due to the short range of the robot’s proximity sensors that they used, which limits the amount of data that could be abstracted from the environment. The consequence of this limitation is that the robot does not have enough sensitivity about the environment. We argue here that improving the robot’s sensorimotor abstraction level, therefore, could possibly overcome this problem. For instance, instead of relying only on the limited data provided by the robot proximity sensors, let the robot see the environment using its camera, abstract enough data, and arrange it well in its memory to aid in building its internal representation.</p><p>To support our argument, we have done psychological experiments, similar to the one introduced by Lee and Thompson [<xref ref-type="bibr" rid="scirp.31737-ref12">12</xref>] with a little change. In a series of two experiments, we demonstrated the accuracy with which humans can guide their behavior based only on their internally sensory experiences. Two subjects were asked to do the same task under different conditions. The first subject X was asked to “look” around in a given room and locate a specific target (<xref ref-type="fig" rid="fig1">Figure 1</xref>(a)). He was then blindfolded and asked to locate the target again. The subject performed the task accurately with closed eyes, in the same manner as when he was free to “look” (<xref ref-type="fig" rid="fig1">Figure 1</xref>(b)). However, he could not predict the exact time needed to turn to the target and this caused the two hits with the obstacle (the empty circles in <xref ref-type="fig" rid="fig1">Figure 1</xref>(b)). The second subject Y was not allowed to explore the room with his eyes (no vision input). Instead, he was blindfolded and walked around the room touching things around him until he found the target (<xref ref-type="fig" rid="fig1">Figure 1</xref>(c)). He was then asked to seek the target again blindfolded from the initial position. Though successful in reaching the target, he took more time than that needed by subject X. In addition, the number of times that he hit the wall or touched it to correct or locate his direction was greater (<xref ref-type="fig" rid="fig1">Figure 1</xref>(d)).</p><p>From the above experiment we can conclude that subject X had collected a sufficient amount of data from the environment during his first “eyes open” navigation. This data could be various dimensions in the room which the</p><p>subject related to times and distances that helped him to build internally—in his inner world where sensory experiences and consequences of different behaviors may be anticipated—his own internal image. In contrast, the amount of data that subject (Y) had collected was limited to the objects that his hand touched during his first blindfolded navigation and their relation to his moving steps. This data, however, was not good enough to accurately perform the task.</p><p>In the above experiment, subject Y could be a demonstration of the results of the most recently reported works (e.g., [<xref ref-type="bibr" rid="scirp.31737-ref7">7</xref>]), since they used the short-range proximity sensors for building the sensorimotor abstraction level.</p><p>We also tried to demonstrate the inner world that was automatically built inside both subjects’ memory by giving each of them a sheet of white paper and asking them to draw the outline of the room that they trained in (note that subject Y had never seen the room). It was not surprising to find out that subject X could draw almost all the details of the room (<xref ref-type="fig" rid="fig2">Figure 2</xref>(a)). However, subject Y could hardly draw the layout of just the objects that he touched during his movement (<xref ref-type="fig" rid="fig2">Figure 2</xref>(b)).</p><p>The work presented in this paper was motivated by the problems described above. Here we explore the inner world of a real mobile robot that has a chance to explore the surrounding environment with its camera before it was told to navigate blindfolded in it. In this study, the robot used two network architectures. The first was used to control its navigation, while the second, to build its internal representation.</p></sec></body><back><ref-list><title>References</title><ref id="scirp.31737-ref1"><label>1</label><mixed-citation publication-type="other" xlink:type="simple">M. S. Gazzaniga, “The Cognitive Neurosciences III,” MIT Press, Cambridge, 2004.</mixed-citation></ref><ref id="scirp.31737-ref2"><label>2</label><mixed-citation publication-type="other" xlink:type="simple">F. J. Varela, E. Thompson and E. Rosch, “The Embodied Mind: Cognitive Science and Human Experience,” MIT Press, Cambridge, 1991.</mixed-citation></ref><ref id="scirp.31737-ref3"><label>3</label><mixed-citation publication-type="other" xlink:type="simple">A. Clark and R. Grush, “Towards a Cognitive Robotics,” Adaptive Behavior, Vol. 7, No. 1, 1999, pp. 5-16.  
doi:10.1177/105971239900700101</mixed-citation></ref><ref id="scirp.31737-ref4"><label>4</label><mixed-citation publication-type="other" xlink:type="simple">R. Grush, “The Emulation Theory of Representation: Motor Control, Imagery, and Perception,” Behavioral and Brain Sciences, Vol. 27, No. 3, 2004, pp. 377-435.  
doi:10.1017/S0140525X04000093</mixed-citation></ref><ref id="scirp.31737-ref5"><label>5</label><mixed-citation publication-type="other" xlink:type="simple">G. Hesslow, “Conscious Thought as Simulation of Behaviour and Perception,” Trends in Cognitive Science, Vol. 6, No. 6, 2002, pp. 242-247.  
doi:10.1016/S1364-6613(02)01913-7</mixed-citation></ref><ref id="scirp.31737-ref6"><label>6</label><mixed-citation publication-type="other" xlink:type="simple">F. Lin?ker and L. Niklasson, “Extraction and Inversion of Abstract Sensory Flow Representations,” Proceedings of the 6th International Conference on Simulation of Adaptive Behavior, from Animals to Animates, Vol. 6, MIT Press, Cambridge, 2000, pp. 199-208. </mixed-citation></ref><ref id="scirp.31737-ref7"><label>7</label><mixed-citation publication-type="other" xlink:type="simple">J. Stening, H. Jacobsson and T. Ziemke, “Imagination and Abstraction of Sensorimotor Flow: Towards a Robot Model,” In: R. Chrisley, R. Clowes and S. Torrance, Eds., Proceedings of the Symposium on Next Generation Approaches to Machine Consciousness, Hatfield, 2005, pp. 50-58.</mixed-citation></ref><ref id="scirp.31737-ref8"><label>8</label><mixed-citation publication-type="other" xlink:type="simple">J. Stening, “Exploring Internal Simulations of Perception in a Mobile Robot Using Abstractions,” Masters Thesis, School of Humanities and Informatics, University of Sk?vde, Sweden, 2004. </mixed-citation></ref><ref id="scirp.31737-ref9"><label>9</label><mixed-citation publication-type="other" xlink:type="simple">T. Ziemke, D. A. Jirenhed and G. Hesslow, “Internal Simulation of Perception: A Minimal Neuro-Robotic Model,” Neurocoputing, Vol. 68, 2005, pp. 85-104.  
doi:10.1016/j.neucom.2004.12.005</mixed-citation></ref><ref id="scirp.31737-ref10"><label>10</label><mixed-citation publication-type="other" xlink:type="simple">F. Lin?ker and L. Niklasson, “Time Series Segmentation Using an Adaptive Resource Allocating Vector Quantization Network Based on Change Detection,” Proceedings of the International Joint Conference on Neural Networks, IEEE Computer Society, Vol. 6, 24-27 July 2000, pp. 323328. </mixed-citation></ref><ref id="scirp.31737-ref11"><label>11</label><mixed-citation publication-type="other" xlink:type="simple">D. S. Nolfi and J. Tani, “Extracting Regularities in Space and Time through a Cascade of Prediction Networks: The Case of a Mobile Robot Navigating in a Structured Environment,” Connection Science, Vol. 11, No. 2, 1999, pp. 125-148. doi:10.1080/095400999116313</mixed-citation></ref><ref id="scirp.31737-ref12"><label>12</label><mixed-citation publication-type="other" xlink:type="simple">D. N. Lee and J. A. I. Thompson, “Vision in Action: The Control of Locomotion,” In: D. Ingle, M. A. Goodale and R. J. W. Mansfield, Eds., Analysis of Visual Behavior, MIT Press, Cambridge, 1982, pp. 411-433.</mixed-citation></ref><ref id="scirp.31737-ref13"><label>13</label><mixed-citation publication-type="other" xlink:type="simple">G. Hesslow, “Will Neuroscience Explain Consciousness?” Journal of Theoretical Biology, Vol. 171, No. 1, 1994, pp. 29-39. doi:10.1006/jtbi.1994.1209</mixed-citation></ref><ref id="scirp.31737-ref14"><label>14</label><mixed-citation publication-type="other" xlink:type="simple">D. A. Jirenhed, G. Hesslow and T. Ziemke, “Exploring Internal Simulation of Perception in Mobile Robots,” In: K. Arras, C. Balkenius, A. Baerfeldt, W. Burgard and R. Siegwart, Eds., The 4th European Workshop on Advanced Mobile Robotics, Lund University Cognitive Studies, Vol. 86, Lund, 2001, pp. 107-113.</mixed-citation></ref><ref id="scirp.31737-ref15"><label>15</label><mixed-citation publication-type="other" xlink:type="simple">T. Ziemke, D. A. Jirenhed and G. Hesslow, “Blind Adaptive Behavior Based on Internal Simulation of Perception,” Department of Computer Science, University of Sk?vde, Sweden, 2002. </mixed-citation></ref><ref id="scirp.31737-ref16"><label>16</label><mixed-citation publication-type="other" xlink:type="simple">N. Jakobi, P. Husbands and I. Harvey, “Noise and the Reality Gap: The Use of Simulation in Evolutionary Robotics,” Proceedings of the Third European Conference on Advances in Artificial Life, Lecture Notes in Computer Science, Vol. 929, Springer Verlag, London, 1995, pp. 702-720.</mixed-citation></ref><ref id="scirp.31737-ref17"><label>17</label><mixed-citation publication-type="other" xlink:type="simple">T. Taylor, S. Geva and W. W. Boles, “Monocular Vision as a Range Sensor,” In: M. Mohammadian, Ed., Proceedings of International Conference on Computational Intelligence for Modeling, Control and Automation, 2004, pp. 566-575.</mixed-citation></ref><ref id="scirp.31737-ref18"><label>18</label><mixed-citation publication-type="other" xlink:type="simple">S. Schaal and C. G. Atkenson, “Robot Juggling: An Implementation of Memory-Based Learning,” Control System Magazine, Vol. 14, No. 1, 1994, pp. 57-71.  
doi:10.1109/37.257895</mixed-citation></ref><ref id="scirp.31737-ref19"><label>19</label><mixed-citation publication-type="other" xlink:type="simple">F. Alnajjar, I. MohdZin and K. Murase, “A Spiking Neural Network with Dynamic Memory for a Real Autonomous Mobile Robot in Dynamic Environment,” Proceedings of International Joint Conference on Neural Networks, Hong Kong, 1-6 June 2008, pp. 2207-2213.</mixed-citation></ref><ref id="scirp.31737-ref20"><label>20</label><mixed-citation publication-type="other" xlink:type="simple">F. Alnajjar and K. Murase, “Self Organization of Spiking Neural Network that Generates Autonomous Behavior in a Real Mobile Robot,” International Journal of Neural Systems, Vol. 16, No. 4, 2006, pp. 229-239.  
doi:10.1142/S0129065706000640</mixed-citation></ref><ref id="scirp.31737-ref21"><label>21</label><mixed-citation publication-type="other" xlink:type="simple">R. Vaughan and M. Zuluaga, “Use Your Illusion Sensorimotor Self-Simulation Allows Complex Agents to Plan with Incomplete Self-Knowledge,” Proceedings of Ninth International Conference on Simulation of Adaptive Behavior, Rome, 2006, pp. 298-309.</mixed-citation></ref></ref-list></back></article>