<?xml version="1.0" encoding="UTF-8"?><!DOCTYPE article  PUBLIC "-//NLM//DTD Journal Publishing DTD v3.0 20080202//EN" "http://dtd.nlm.nih.gov/publishing/3.0/journalpublishing3.dtd"><article xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink" dtd-version="3.0" xml:lang="en" article-type="research article"><front><journal-meta><journal-id journal-id-type="publisher-id">ETSN</journal-id><journal-title-group><journal-title>E-Health Telecommunication Systems and Networks</journal-title></journal-title-group><issn pub-type="epub">2167-9517</issn><publisher><publisher-name>Scientific Research Publishing</publisher-name></publisher></journal-meta><article-meta><article-id pub-id-type="doi">10.4236/etsn.2012.11001</article-id><article-id pub-id-type="publisher-id">ETSN-18069</article-id><article-categories><subj-group subj-group-type="heading"><subject>Articles</subject></subj-group><subj-group subj-group-type="Discipline-v2"><subject>Computer Science&amp;Communications</subject></subj-group></article-categories><title-group><article-title>
 
 
  Falling-Incident Detection and Alarm by Smartphone with Multimedia Messaging Service (MMS)
 
</article-title></title-group><contrib-group><contrib contrib-type="author" xlink:type="simple"><name name-style="western"><surname>i</surname><given-names>He</given-names></name><xref ref-type="aff" rid="aff1"><sup>1</sup></xref><xref ref-type="corresp" rid="cor1"><sup>*</sup></xref></contrib><contrib contrib-type="author" xlink:type="simple"><name name-style="western"><surname>Ye</surname><given-names>Li</given-names></name><xref ref-type="aff" rid="aff2"><sup>2</sup></xref></contrib><contrib contrib-type="author" xlink:type="simple"><name name-style="western"><surname>Chuan</surname><given-names>Yin</given-names></name><xref ref-type="aff" rid="aff2"><sup>2</sup></xref></contrib></contrib-group><aff id="aff2"><addr-line>Shenzhen Institutes of Advanced Technology, Chinese Academy of Sciences, Shenzhen, China</addr-line></aff><aff id="aff1"><addr-line>Shenzhen Institutes of Advanced Technology, Chinese Academy of Sciences, ShenZhen, China</addr-line></aff><author-notes><corresp id="cor1">* E-mail:<email>ye.li@siat.ac.cn(IH)</email>;</corresp></author-notes><pub-date pub-type="epub"><day>26</day><month>03</month><year>2012</year></pub-date><volume>01</volume><issue>01</issue><fpage>1</fpage><lpage>5</lpage><history><date date-type="received"><day>March</day>	<month>5,</month>	<year>2012</year></date><date date-type="rev-recd"><day>March</day>	<month>24,</month>	<year>2012</year>	</date><date date-type="accepted"><day>March</day>	<month>30,</month>	<year>2012</year></date></history><permissions><copyright-statement>&#169; Copyright  2014 by authors and Scientific Research Publishing Inc. </copyright-statement><copyright-year>2014</copyright-year><license><license-p>This work is licensed under the Creative Commons Attribution International License (CC BY). http://creativecommons.org/licenses/by/4.0/</license-p></license></permissions><abstract><p>
 
 
  This paper presents a system with real-time classification of human movements based on smartphone mounted on the waist. The built-in tri-accelerometer was utilized to collect the information of body motion. At the same time, the smartphone is able to classify the data for activity recognition. By our algorithm, body motion can be classified into five different patterns: vertical activity, lying, sitting or static standing, horizontal activity and fall. It alarms falling by Multimedia Messaging Service (MMS) with map of suspected fall location, GPS coordinate and time 
  etc. If a fall was suspected, an automatic MMS would be sent to preset people. The major advantage of the proposed system is the novel application of smartphone which already have the necessary sensors and can monitor fall ubiquitously without any additional devices.
 
</p></abstract><kwd-group><kwd>Multimedia Messaging Service (MMS); Smartphone; Tri-Accelerometer; Falling-Incident Detection</kwd></kwd-group></article-meta></front><body><sec id="s1"><title>1. Introduction</title><p>Falls are the second leading cause of accidental or unintentional injury deaths world-widely. According to Centers for Disease Control and Prevention (CDC) of American, unintentional falls are a common occurrence among older adults, affecting approximately 30% of persons aged &gt; 65 years each year [<xref ref-type="bibr" rid="scirp.18069-ref1">1</xref>]. Older people have the highest risk of death or serious injury arising from a fall and the risk increases with age [<xref ref-type="bibr" rid="scirp.18069-ref2">2</xref>]. A “long lie” may result in negative psychological (fear of falling, which can lead to further limitation of functional activities) and physical (muscle damage, dehydration, pressure sores, hypothermia, pneumonia, and mortality) outcomes [<xref ref-type="bibr" rid="scirp.18069-ref3">3</xref>].</p><p>Falling-incident detection systems can be classified into computer vision [4-7] and worn devices [8-12] according to methods. For the method of computer vision, the one can be tracked by using cameras in home or other places. When the subject becomes inactive for a long time, he or she may fall. However, there are restrictions on not enough cameras in outdoor environments. On the other hand, one of the main drawbacks of current worn device solutions is that the subject has to wear an accelerometer and many elder people forget to put on or refuse such devices [<xref ref-type="bibr" rid="scirp.18069-ref4">4</xref>].</p><p>Falling-incident detection using a mobilephone is a feasible and highly attractive technology for elder adults, especially those living alone [<xref ref-type="bibr" rid="scirp.18069-ref13">13</xref>]. According to International Telecommunication Union (ITU), the number of mobile phone subscriptions worldwide has reached 4.6 billion by the end of 2009. Mobile phone is one fast growing device which becomes indispensable to people almost every moment, whereas users may forget to wear special micro sensors. Using off-the-shelf mobile phones, not only reduces the cost, also exploits skilled hardware and ubiquitous monitor.</p><p>Previous studies have also demonstrated the effectiveness of using mobile phone to detect fall. For example, T. Zhang et al. [<xref ref-type="bibr" rid="scirp.18069-ref14">14</xref>] proposed an application to detect falls by embedding an accelerometer in cell phone and using KFD algorithm. J. Yang [<xref ref-type="bibr" rid="scirp.18069-ref15">15</xref>] performed physical motion recognition using mobile phones, i.e. Nokia N95, with built-in accelerometer sensors. T. Saponas et al. [<xref ref-type="bibr" rid="scirp.18069-ref16">16</xref>] classified human activities in real time using three-axis accelerometer of the Apple iPhone and the Nike + iPod Sport Kit. R. Y. W. Lee et al. [<xref ref-type="bibr" rid="scirp.18069-ref13">13</xref>] used two devices, i.e. a mobile phone and an independent accelerometer, attached to the waist of the participants to study the sensitivity and specificity of falling-incident detection. All of above sent Short Messaging Service (SMS) with fall time and fall location. However, this paper warns fall using Multimedia Messaging Service (MMS) included with time, map of suspected fall location and GPS coordinate etc. And this paper presents an implementation of a real-time classification of human movement based on smart phone mounted on the waist.</p><p>The remainder of this paper is as follows. In Section 2,</p><p>the methods of data collection and data preprocessing are introduced, followed by the feature extraction and classification algorithm. And then the fall location and alarm with MMS are described. The experimental results are given in Section 3. We conclude the work in Section 4 with suggestions to future work.</p></sec><sec id="s2"><title>2. Methods</title><p>Lenovo Le-Phone is a smartphone which carrys Android operating system. Le-Phone packs a 1GHz Snapdragon CPU, a 3.7” AMOLED capacitive touch screen with WVGA resolution. As illustrated in <xref ref-type="fig" rid="fig1">Figure 1</xref>,</p><p>Le-phone with built-in tri-accelerometer was utilized to collect the signal which represents the body movement. At the same time, the smart phone classifies the data to recognize fall. If a fall was suspected, an automatic MMS would be sent to guardian with information including the time, GPS coordinate, the map of suspected fall location.</p><sec id="s2_1"><title>2.1. Data Collection</title><p>Head and waist are relevant sites for accelerometer detection of falls, using simple thresholds and posture detection [<xref ref-type="bibr" rid="scirp.18069-ref17">17</xref>]. So phone in this system is worn on the waist, as show in <xref ref-type="fig" rid="fig2">Figure 2</xref>.</p><p>Because essentially all measured body movements are contained with in frequency components below 20 Hz (indeed, even in gait, 99% of the energy is contained below 15 Hz) [<xref ref-type="bibr" rid="scirp.18069-ref8">8</xref>]. Lenovo Le-phone with Android operating system is used to acquire tri-accelerometer signals sampled at 40 Hz. As displayed in<xref ref-type="fig" rid="fig3">Figure 3</xref>,</p><p>X-axis, Y-axis and Z-axis data of accelerometer were collected by the Le-phone.</p></sec><sec id="s2_2"><title>2.2. Data Preprocessing</title><p>The output of an ideal accelerometer worn on the human body originates from several sources: 1) acceleration due to body motion; 2) gravitational acceleration; 3) external vibrations, not produced by the body itself (e.g., resulting from vehicles); 4) accelerations due to bouncing of the sensor against other objects, eventually resulting in mechanical resonance [<xref ref-type="bibr" rid="scirp.18069-ref18">18</xref>]. Sources 1 and 2 are directly related to intentional movement of the body. However, sources 3 and 4, which may add “noise” to the accelerometer output, should be attenuated by adequate filtering techniques. The median filter with n = 3 is applied to the raw data to attenuate the noise. As Indicated in <xref ref-type="fig" rid="fig4">Figure 4</xref>,</p><p>median filter has played a nice smoothing effect.<img src="1-2370002\53e16a7c-622a-4bff-b364-537d640d41fc.jpg" />, <img src="1-2370002\c610be08-9f4b-4ec6-86ba-2b48a1f4a2d2.jpg" />are mean and standard deviation of raw Z-axis data from the static phone on the desk respectively.</p><disp-formula id="scirp.18069-formula4575"><label>(1)</label><graphic position="anchor" xlink:href="1-2370002\be9d0a63-329a-482d-8cfb-299c7743caec.jpg"  xlink:type="simple"/></disp-formula><p>while<img src="1-2370002\96530f67-e25e-46f8-bdfa-a241d911dbd8.jpg" />, <img src="1-2370002\24ad90e1-73af-47de-b997-d1b4ca95cdc0.jpg" />are mean and standard deviation of raw Z-axis data after median filter respectively.</p><disp-formula id="scirp.18069-formula4576"><label>(2)</label><graphic position="anchor" xlink:href="1-2370002\e44b8a95-2747-446d-b33c-875f88b198f3.jpg"  xlink:type="simple"/></disp-formula></sec><sec id="s2_3"><title>2.3. Feature Extraction</title><p>1) Signal Magnitude Area (SMA) [<xref ref-type="bibr" rid="scirp.18069-ref18">18</xref>]</p><p>SMA [defined in (3)] is utilized to distinguish between periods of user activity and rest [<xref ref-type="bibr" rid="scirp.18069-ref8">8</xref>]. SMA characterizes the degree of change of human movement, the greater the value that the more violent motion state changes.</p><disp-formula id="scirp.18069-formula4577"><label>(3)</label><graphic position="anchor" xlink:href="1-2370002\2bdd1368-2c82-45fc-ba82-6961dc11edfd.jpg"  xlink:type="simple"/></disp-formula><p>where x(t), y(t), and z(t) refer to the tri-accelerometer signals of the x-, y-, and z-axis samples, respectively.</p><p>2) Signal Magnitude Vector (SVM)</p><disp-formula id="scirp.18069-formula4578"><label>(4)</label><graphic position="anchor" xlink:href="1-2370002\0584b285-bebf-4155-bb4b-94ea47e2ceb3.jpg"  xlink:type="simple"/></disp-formula><p>where x<sub>i</sub> is the ith sample of the x-axis signal (similarly for y<sub>i</sub> and z<sub>i</sub>). The test results identified the most suitable parameter to be SVM at a threshold of 2.5 g (as shown in <xref ref-type="fig" rid="fig7">Figure 7</xref>). When an SVM value was above the threshold, fall could be deemed to have occurred.</p><p>3) Tilt Angle (TA)</p><p>Postural orientation refers to the relative tilt of the body in space. As indicated in (5), the tilt angle of user was defined as the angle between the positive y-axis and the gravitational vector g by the relation:</p><disp-formula id="scirp.18069-formula4579"><label>(5)</label><graphic position="anchor" xlink:href="1-2370002\a6e23302-6db6-4f04-8fb4-0449a5d3d2c7.jpg"  xlink:type="simple"/></disp-formula><p>If TA was below the threshold 40 degree (as shown in <xref ref-type="fig" rid="fig7">Figure 7</xref>), it was classified as fall or lie.</p></sec><sec id="s2_4"><title>2.4. Classification Algorithm</title><p>This flowchart (as shown in <xref ref-type="fig" rid="fig5">Figure 5</xref>)</p><p>displays the major steps of the algorithm embedded into Le-phone. Body motion was successfully recognized as five different patterns: vertical active, lying, sitting or static standing, horizontal active and fall.</p></sec><sec id="s2_5"><title>2.5. Location and Alarm</title><p>As illustrated in <xref ref-type="fig" rid="fig6">Figure 6</xref>, Map of suspected fall location</p><p>was acquired and a part of MMS would be sent to pre-set guardian. In the map, the blue point represents the suspected fall location. And at the bottom of the map, the fall address was displayed.</p></sec></sec><sec id="s3"><title>3. Results</title><p>As indicated in <xref ref-type="fig" rid="fig7">Figure 7</xref>,</p><p>when SMA, SVM and TA are above the respective threshold, a fall was suspected. In addition, MMS included with map of suspected fall location, GPS coordinate and time was sent to pre-selected guardian.</p></sec><sec id="s4"><title>4. Conclusions</title><p>The falling-incident detection system based on the data acquired from a waist-mounted smartphone was developed for use in a real-time environment. By our algorithm, body motion can be classified into five different patterns: vertical activity, lying, sitting or static standing, horizontal activity and fall. The major advantage of the proposed solution is that smartphone is readily available to most people and users may forget to wear other special micro sensors but not smartphone. In addition, the MMS of positioning the fall location automatically encourages the elderly to exercise outdoors.</p><p>However, there are two problems we need to further study to make the solution more feasible. One is the problem of adaptation to daily wear. The system requests the smart phone to be worn on the waist. However, normally people wear phones in the pocket of shirts or pants, which would cause loose attachment between the body and smartphone, resulting in mechanical movement eventually. Another problem is to detect falls anytime. The system would be working only when the smartphone is mounted on the waist. Assume that the user falls when he is making a phone call or message reading, the system would not be able to detect falls in such scenarios.</p></sec><sec id="s5"><title>5. Acknowledgements</title><p>This work was supported in part by Shenzhen Basic Research Funds for Distinguished Young Scientists (No.JC 201005270306A), Guangdong Province &amp; Chinese Academy of Sciences Comprehensive Strategic Cooperation Project (No.2011A090100025) and Shenzhen Basic Research Project (No. JC201005270258A).</p></sec><sec id="s6"><title>REFERENCES</title></sec><sec id="s7"><title>NOTES</title></sec></body><back><ref-list><title>References</title><ref id="scirp.18069-ref1"><label>1</label><mixed-citation publication-type="other" xlink:type="simple">J. M. Hausdorff, D. A. Rios, and H. K. Edelberg, "Gait variability and fall risk in community-living older adults: A 1-year prospective study," Archives of Physical Medicine and Rehabilitation, vol. 82, pp. 1050-1056, 2001.</mixed-citation></ref><ref id="scirp.18069-ref2"><label>2</label><mixed-citation publication-type="other" xlink:type="simple">W. H. O. Ageing and L. C. Unit, WHO global report on falls prevention in older age: World Health Organization, 2008.</mixed-citation></ref><ref id="scirp.18069-ref3"><label>3</label><mixed-citation publication-type="other" xlink:type="simple">S. R. Lord, C. Sherrington, and H. B. Menz, Falls in older people: risk factors and strategies for prevention. Cambridge: Cambridge Univ Pr, 2007.</mixed-citation></ref><ref id="scirp.18069-ref4"><label>4</label><mixed-citation publication-type="other" xlink:type="simple">B. Schulze, M. Floeck, and L. Litz, "Concept and Design of a Video Monitoring System for Activity Recognition and Fall Detection," Ambient Assistive Health and Wellness Management in the Heart of the City, pp. 182-189, 2009.</mixed-citation></ref><ref id="scirp.18069-ref5"><label>5</label><mixed-citation publication-type="other" xlink:type="simple">A. Sixsmith and N. Johnson, "A smart sensor to detect the falls of the elderly," IEEE Pervasive Computing, pp. 42-47, 2004.</mixed-citation></ref><ref id="scirp.18069-ref6"><label>6</label><mixed-citation publication-type="other" xlink:type="simple">M. Yu, S. M. Naqvi, A. Rhuma, and J. Chambers, "Fall Detection in a Smart Room by Using a Fuzzy One Class Support Vector Machine and Imperfect Training Data," in Acoustics, Speech and Signal Processing (ICASSP), 2011, pp. 1833-1836.</mixed-citation></ref><ref id="scirp.18069-ref7"><label>7</label><mixed-citation publication-type="other" xlink:type="simple">J. Ben-Arie, Z. Wang, P. Pandit, and S. Rajaram, "Human activity recognition using multidimensional indexing," IEEE Transactions on Pattern Analysis and Machine Intelligence, pp. 1091-1104, 2002.</mixed-citation></ref><ref id="scirp.18069-ref8"><label>8</label><mixed-citation publication-type="other" xlink:type="simple">D. M. Karantonis, M. R. Narayanan, M. Mathie, N. H. Lovell, and B. G. Celler, "Implementation of a real-time human movement classifier using a triaxial accelerometer for ambulatory monitoring," Information Technology in Biomedicine, IEEE Transactions on, vol. 10, pp. 156-167, 2006.</mixed-citation></ref><ref id="scirp.18069-ref9"><label>9</label><mixed-citation publication-type="other" xlink:type="simple">T. Choudhury, G. Borriello, S. Consolvo, D. Haehnel, B. Harrison, B. Hemingway, and J. Hightower, "The mobile sensing platform: An embedded activity recognition system," IEEE Pervasive Computing, pp. 32-41, 2008.</mixed-citation></ref><ref id="scirp.18069-ref10"><label>10</label><mixed-citation publication-type="other" xlink:type="simple">H. Ghasemzadeh, R. Jafari, and B. Prabhakaran, "A body sensor network with electromyogram and inertial sensors: multimodal interpretation of muscular activities," Information Technology in Biomedicine, IEEE Transactions on, vol. 14, pp. 198-206, 2010.</mixed-citation></ref><ref id="scirp.18069-ref11"><label>11</label><mixed-citation publication-type="other" xlink:type="simple">I. Maglogiannis and C. Doukas, "Emergency Fall Incidents Detection in Assisted Living Environments Utilizing Motion, Sound and Visual Perceptual Components," Information Technology in Biomedicine, IEEE Transactions on, pp. 1-1, 2011.</mixed-citation></ref><ref id="scirp.18069-ref12"><label>12</label><mixed-citation publication-type="other" xlink:type="simple">E. M. Tapia, S. S. Intille, W. Haskell, K. Larson, J. Wright, A. King, and R. Friedman, "Real-time recognition of physical activities and their intensities using wireless accelerometers and a heart rate monitor," in Wearable Computers, 2007 11th IEEE International Symposium on, 2007, pp. 37-40.</mixed-citation></ref><ref id="scirp.18069-ref13"><label>13</label><mixed-citation publication-type="other" xlink:type="simple">R. Y. W. Lee and A. J. Carlisle, "Detection of falls using accelerometers and mobile phone technology," Age and Ageing, pp. 1-7, 2011.</mixed-citation></ref><ref id="scirp.18069-ref14"><label>14</label><mixed-citation publication-type="other" xlink:type="simple">T. Zhang, J. Wang, P. Liu, and J. Hou, "Fall detection by embedding an accelerometer in cellphone and using KFD algorithm," IJCSNS International Journal of Computer Science and Network Security, vol. 6, pp. 277-284, 3 2006.</mixed-citation></ref><ref id="scirp.18069-ref15"><label>15</label><mixed-citation publication-type="other" xlink:type="simple">J. Yang, "Toward physical activity diary: motion recognition using simple acceleration features with mobile phones," in IMCE '09 Proceedings of the 1st international workshop on Interactive multimedia for consumer electronics 2009, pp. 1-10.</mixed-citation></ref><ref id="scirp.18069-ref16"><label>16</label><mixed-citation publication-type="other" xlink:type="simple">T. Saponas, J. Lester, J. Froehlich, J. Fogarty, and J. Landay, "ilearn on the iphone: Real-time human activity classification on commodity mobile phones," University of Washington CSE Tech Report UW-CSE-08-04-02, 2008.</mixed-citation></ref><ref id="scirp.18069-ref17"><label>17</label><mixed-citation publication-type="other" xlink:type="simple">M. Kangas, A. Konttila, I. Winblad, and T. Jamsa, "Determination of simple thresholds for accelerometry-based parameters for fall detection," in Proceedings of the 29th Annual International Conference of the IEEE EMBS, Lyon, France, 2007, pp. 1367-1370.</mixed-citation></ref><ref id="scirp.18069-ref18"><label>18</label><mixed-citation publication-type="other" xlink:type="simple">C. V. C. Bouten, K. T. M. Koekkoek, M. Verduin, R. Kodde, and J. D. Janssen, "A triaxial accelerometer and portable data processing unit for the assessment of daily physical activity," Biomedical Engineering, IEEE Transactions on, vol. 44, pp. 136-147, 1997.</mixed-citation></ref></ref-list></back></article>