<?xml version="1.0" encoding="UTF-8"?><!DOCTYPE article  PUBLIC "-//NLM//DTD Journal Publishing DTD v3.0 20080202//EN" "http://dtd.nlm.nih.gov/publishing/3.0/journalpublishing3.dtd"><article xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink" dtd-version="3.0" xml:lang="en" article-type="research article"><front><journal-meta><journal-id journal-id-type="publisher-id">IIM</journal-id><journal-title-group><journal-title>Intelligent Information Management</journal-title></journal-title-group><issn pub-type="epub">2160-5912</issn><publisher><publisher-name>Scientific Research Publishing</publisher-name></publisher></journal-meta><article-meta><article-id pub-id-type="doi">10.4236/iim.2016.86012</article-id><article-id pub-id-type="publisher-id">IIM-72201</article-id><article-categories><subj-group subj-group-type="heading"><subject>Articles</subject></subj-group><subj-group subj-group-type="Discipline-v2"><subject>Computer Science&amp;Communications</subject></subj-group></article-categories><title-group><article-title>
 
 
  Usability Factors Assessment in Health Information System
 
</article-title></title-group><contrib-group><contrib contrib-type="author" xlink:type="simple"><name name-style="western"><surname>Majed</surname><given-names>Alshamari</given-names></name><xref ref-type="aff" rid="aff1"><sub>1</sub></xref></contrib></contrib-group><aff id="aff1"><label>1</label><addr-line>Department of Information Systems, College of Computer Sciences and Information Technology, King Faisal University, Al-Ahsa, 
Kingdom of Saudi Arabia</addr-line></aff><author-notes><corresp id="cor1">* E-mail:</corresp></author-notes><pub-date pub-type="epub"><day>09</day><month>11</month><year>2016</year></pub-date><volume>08</volume><issue>06</issue><fpage>170</fpage><lpage>180</lpage><history><date date-type="received"><day>May</day>	<month>15,</month>	<year>2016</year></date><date date-type="rev-recd"><day>Accepted:</day>	<month>July</month>	<year>3,</year>	</date><date date-type="accepted"><day>November</day>	<month>23,</month>	<year>2016</year></date></history><permissions><copyright-statement>&#169; Copyright  2014 by authors and Scientific Research Publishing Inc. </copyright-statement><copyright-year>2014</copyright-year><license><license-p>This work is licensed under the Creative Commons Attribution International License (CC BY). http://creativecommons.org/licenses/by/4.0/</license-p></license></permissions><abstract><p>
 
 
  Systems’ usability is one of the critical attribute of any system’s quality. Medical prac-titioners usually encounter usability difficulties while using a health information system like other systems. There are different usability factors, which are expected to influence systems’ usability. Errors preventions, patient safety and privacy are vital usability factors and should not be ignored while developing a health information system. This study is based on a comprehensive analysis of published academic and industrial literature to provide the current status of health information systems’ usability. It also identifies different usability factors such as privacy, errors, design and efficiency. Usability factors are then assessed. Those factors are further examined through a questionnaire to study the priorities of them from medical practitioners’ point of view in Saudi Arabia. The statistical analysis shows that the privacy and errors are very critical than the other usability factors. The study results further revealed that availability and response time are the main challenges faced by the medical practitioners when using the HIS. However, flexibility and customizability were claimed to ease the use of the HIS. In addition, a number of statistical correlations were established. Overall, the study findings seemed helpful to designers and implementers to consider these factors for successful implementation of HIS.
 
</p></abstract><kwd-group><kwd>Usability</kwd><kwd> Privacy</kwd><kwd> Safety</kwd><kwd> Error</kwd><kwd> Information System</kwd></kwd-group></article-meta></front><body><sec id="s1"><title>1. Introduction</title><p>Presently, usability is considered as one of the main topics in the field of Human Computer Interaction (HCI). Due to its significance and justification, the trend of research has been shifted to this area. Recently, usability is considered as a key quality attribute in the critical systems which is not limited only to e-commerce, games and health information systems. The wide range distribution of health information systems is expected to receive extensive investigations with respect to its assessment, application and adoption. Besides, financial aspect is a key factor should always be considered seriously while assessing a health information system [<xref ref-type="bibr" rid="scirp.72201-ref1">1</xref>] , because 10% - 15% of governments’ annual health budget can be saved by adopting the HIS [<xref ref-type="bibr" rid="scirp.72201-ref2">2</xref>] . Recently the research focused on the usability of HIS from users’ point of view such as doctors, nurses, technicians or even patient [<xref ref-type="bibr" rid="scirp.72201-ref3">3</xref>] . Different usability factors should be considered when focusing on the usability of HIS. Actually, usability questions the level of safety, privacy and error tolerance. [<xref ref-type="bibr" rid="scirp.72201-ref4">4</xref>] predicted that in 20 years from 2002 around half a million new usability professionals might be required. It is well known that usability is not just a single element or characteristic, but there are multiple factors that are responsible for overall usability of a software system [<xref ref-type="bibr" rid="scirp.72201-ref5">5</xref>] [<xref ref-type="bibr" rid="scirp.72201-ref6">6</xref>] . The relationship between certain factors also makes them more or less important in specific applications. For example, data availability has an effect on usability, because when it is analyzed with relation to privacy then it might not have that much importance. Furthermore, usability is more or less dependent on many factors such as efficiency, effectiveness, user’s satisfaction, ease of use and learnability etc. [<xref ref-type="bibr" rid="scirp.72201-ref5">5</xref>] [<xref ref-type="bibr" rid="scirp.72201-ref6">6</xref>] . The importance of usability factors never remain the same for each software system. Like, significance of privacy factors will never be same in a social media website and gaming website. In Healthcare Information Systems (HIS), different elements like time limit of patient visit, availability of patient’s history, analysis of medical reports etc. demand specific factors of usability.</p></sec><sec id="s2"><title>2. Current Issues of HIS Usability</title><p>Usability task force, based on Healthcare Information and Management Systems Society (HIMSS) and the Electronic Health Record (EHR) information has specified usability principles for healthcare applications [<xref ref-type="bibr" rid="scirp.72201-ref7">7</xref>] . Among the principles defined by them Simplicity, Naturalness, Consistency, Minimizing Cognitive Load and Effective Information Presentation are significant. Preservation of context, effective use of language, forgiveness and feedback and effective interactions are the other principles that are considered most important by HIMSS for healthcare usability. In a study [<xref ref-type="bibr" rid="scirp.72201-ref8">8</xref>] found that privacy, quality, security and the implementation of electronic medical records are the top IT critical factors that influence Turkish health care systems.</p><p>In Saudi Arabia, recent years have shown tremendous increase in number of internet and mobile users. According to a report by Communications and Information Technology Commission [<xref ref-type="bibr" rid="scirp.72201-ref9">9</xref>] , there are 51 million mobile subscribers and more than 16.4 million internet users are in the Kingdom of Saudi Arabia (KSA). The numbers are continuously growing due to easy access and availability of network facilities. [<xref ref-type="bibr" rid="scirp.72201-ref10">10</xref>] conducted a study and showed that, complexity is one of the most significant factors restricting the Saudi Arabian population from adopting an online service. Privacy and compatibility are the other important factors affecting adoption of online services (where compatibility was perceived as similarity with existing values, past experiences and needs). In a similar study, [<xref ref-type="bibr" rid="scirp.72201-ref11">11</xref>] sated that privacy, security, trust, culture and information literacy were the top factors affecting adoption of e-Government services. Generally, practitioners are usually mobile and move frequently inside the hospital. They usually talk to each other and to the patient [<xref ref-type="bibr" rid="scirp.72201-ref7">7</xref>] [<xref ref-type="bibr" rid="scirp.72201-ref12">12</xref>] discussed the usability of labor portal in Saudi Arabia and found that more than 70% of the participants support the argument that the portal is usable. However, the results are mainly from user’s point of view, it needs more experts’ inspection and the usability term needs to be broken down into more reliable attributes. [<xref ref-type="bibr" rid="scirp.72201-ref13">13</xref>] claimed that the usability of a tested mobile application was not satisfactory in Saudi Arabia. [<xref ref-type="bibr" rid="scirp.72201-ref14">14</xref>] found that the digital library interface was not acceptable in terms of its usability based on a sample of 22 undergraduate students. However, this study only investigated the issues related to dynamic web-based systems such as labor portal, digital library interface. However, they clearly stated a number of usability issues such as usability factors that should be taken into consideration. It was found that there is a need to have standards for the electronic health records in various countries such as England, Canada and</p><p>Australia. This was found after analyzing the national electronic health records in the above-mentioned countries [<xref ref-type="bibr" rid="scirp.72201-ref15">15</xref>] . However, [<xref ref-type="bibr" rid="scirp.72201-ref16">16</xref>] implies the lack of “Fundamental attributes” to have successful HIS.</p><p>In Saudi Arabia, Healthcare Information Technology (HIT) is at the initial stage of adopting the state of the art technologies for this domain. A number of hospitals started using Electronic Health Records (EHR) systems to provide better health services to patients. Moreover, EHRs help HIT professionals in their work [<xref ref-type="bibr" rid="scirp.72201-ref17">17</xref>] and tend to provide assistance in information processing as well [<xref ref-type="bibr" rid="scirp.72201-ref18">18</xref>] . In [<xref ref-type="bibr" rid="scirp.72201-ref19">19</xref>] concluded that, health sector in Saudi Arabia was not ready for implementing successful HIS. In another study, [<xref ref-type="bibr" rid="scirp.72201-ref20">20</xref>] found that 18 factors were seriously influencing the adoption of HIS in Saudi Arabia such as external pressure, network externalities, cost and standards characteristics including the industrial technical standards such as usability and quality.</p><p>In [<xref ref-type="bibr" rid="scirp.72201-ref21">21</xref>] identified some factors such as lack of computer skills and technical support that limit the usability and adoption of EHR systems in Saudi Arabia. Recently, [<xref ref-type="bibr" rid="scirp.72201-ref22">22</xref>] studied the rates and levels of EHR adoption in Riyadh, KSA. The study focused on getting feedback from 22 hospitals regarding EHR adoption. The rates and levels were measured from three aspects of EHR adoption i.e., implementation, maintenance and improvement. The results showed that out of 22 hospitals, 11 hospitals were fully implementing the EHR system, while the system adoption was in progress in 8 hospitals and the remaining 3 hospitals did not adopted any system. Factors having relationship with healthcare system adoption are hospital size (positively related), ownership of hospital (private or government) and somewhat type of development team. In [<xref ref-type="bibr" rid="scirp.72201-ref23">23</xref>] , it has been identified and presented six barriers such as human barriers, professional, technical, organizational, financial and legal barriers for the adoption of healthcare systems in Saudi Arabia. This research clearly identified that human factors were at top of the list of barriers in adoption of healthcare systems in KSA. Usability of health information system is a critical factor for patient safety. Having a usable system can significantly help the clinicians to spend extra time with their patents [<xref ref-type="bibr" rid="scirp.72201-ref24">24</xref>] . Error number can also be reduced if the usability of the HIT is maximized.</p></sec><sec id="s3"><title>3. Study Objectives</title><p>Unfortunately, not much has been done to improve the usability of healthcare systems in Saudi Arabia. Many studies have investigated the barriers in adopting latest healthcare software systems. However, it is important that an investigation should be carried out specifically from usability viewpoint. This study focused mainly on assessing usability factors for KSA’s HIT domain, according to preferences and feedback of healthcare professionals. It also attempted to reveal how those factors are prioritized from practitioners point of view. It is expected that this study will help the development industry to provide more usable and adoptable HIT systems for Saudi Arabia in terms of recommendations and investigations. Therefore, this study aims to explore the current study related to usability of HIS in Saudi Arabia. It also aimed to identify the usability factors in HIS and their priorities from practitioners point of view. It also will identify a number of challenges which are likely to be faced by the practitioners while using HIS.</p></sec><sec id="s4"><title>4. Research Methodology</title><p>A quantitative research approach was adopted in this study. A questionnaire was developed as the research methodology. The questionnaire was designed by following the usability factors described by many investigators [<xref ref-type="bibr" rid="scirp.72201-ref7">7</xref>] [<xref ref-type="bibr" rid="scirp.72201-ref25">25</xref>] [<xref ref-type="bibr" rid="scirp.72201-ref26">26</xref>] to achieve the study objectives. However, the literature review was the main source for building the usability factors. The questionnaire for the survey was distributed manually to 250 practitioners in 5 different hospitals in Saudi Arabia. The answers to the questionnaire were based on a five-point scale for assessing the usability factors, where the users rated the importance of the usability factors from a ten-point scale. A pilot study was conducted using the preliminary research questionnaire on a small number of professionals in health care sector in Saudi Arabia. In addition to that, two usability experts were consulted in order to avoid any misunderstanding or ambiguity or vagueness in the survey. The pilot study helped the researcher to receive constructive feedback in order to better formulate the questions. Then, the final questionnaire was distributed after taking into account all the comments from the professionals and the experts. The analysis of collected data from the final questionnaire was presented. The data was divided into three sections namely survey response background, assessing and prioritizing the usability factors and the qualitative analysis with respect the importance of the usability factors. The various statistical techniques such as ANOVA and regression were applied for data analysis according to procedures given by [<xref ref-type="bibr" rid="scirp.72201-ref27">27</xref>] .</p></sec><sec id="s5"><title>5. Results and Discussion</title><p>The data collected from the respondents during the survey was analyzed and presented in <xref ref-type="table" rid="table1">Table 1</xref>. The total response was around 57%. Out of a total of 250 questionnaires, only 143 completed questionnaires were received which corresponds to 65 (45%) male</p><table-wrap id="table1" ><label><xref ref-type="table" rid="table1">Table 1</xref></label><caption><title> Respondents background and details</title></caption><table><tbody><thead><tr><th align="center" valign="middle" >Data type and values</th><th align="center" valign="middle" >Frequency</th><th align="center" valign="middle" >Percentage (%)</th></tr></thead><tr><td align="center" valign="middle" >Gender</td><td align="center" valign="middle" ></td><td align="center" valign="middle" ></td></tr><tr><td align="center" valign="middle" >Male</td><td align="center" valign="middle" >65</td><td align="center" valign="middle" >45</td></tr><tr><td align="center" valign="middle" >Female</td><td align="center" valign="middle" >78</td><td align="center" valign="middle" >55</td></tr><tr><td align="center" valign="middle" >Age</td><td align="center" valign="middle" ></td><td align="center" valign="middle" ></td></tr><tr><td align="center" valign="middle" >20 - 30</td><td align="center" valign="middle" >37</td><td align="center" valign="middle" >25.9</td></tr><tr><td align="center" valign="middle" >31 - 40</td><td align="center" valign="middle" >55</td><td align="center" valign="middle" >38.4</td></tr><tr><td align="center" valign="middle" >41 - 50</td><td align="center" valign="middle" >32</td><td align="center" valign="middle" >22.3</td></tr><tr><td align="center" valign="middle" >51 - 60</td><td align="center" valign="middle" >11</td><td align="center" valign="middle" >0.07</td></tr><tr><td align="center" valign="middle" >60+</td><td align="center" valign="middle" >8</td><td align="center" valign="middle" >0.05</td></tr><tr><td align="center" valign="middle" >System experience</td><td align="center" valign="middle" ></td><td align="center" valign="middle" ></td></tr><tr><td align="center" valign="middle" >Less than a year</td><td align="center" valign="middle" >18</td><td align="center" valign="middle" >12</td></tr><tr><td align="center" valign="middle" >2-Jan</td><td align="center" valign="middle" >41</td><td align="center" valign="middle" >28</td></tr><tr><td align="center" valign="middle" >5-Feb</td><td align="center" valign="middle" >54</td><td align="center" valign="middle" >37.7</td></tr><tr><td align="center" valign="middle" >5+</td><td align="center" valign="middle" >30</td><td align="center" valign="middle" >20.9</td></tr><tr><td align="center" valign="middle" >Role</td><td align="center" valign="middle" ></td><td align="center" valign="middle" ></td></tr><tr><td align="center" valign="middle" >Doctor</td><td align="center" valign="middle" >41</td><td align="center" valign="middle" >28.6</td></tr><tr><td align="center" valign="middle" >Nurse</td><td align="center" valign="middle" >72</td><td align="center" valign="middle" >50.5</td></tr><tr><td align="center" valign="middle" >Technician</td><td align="center" valign="middle" >30</td><td align="center" valign="middle" >20.9</td></tr></tbody></table></table-wrap><p>and 78 (55%) female. The high participation from the female side was expected as the health care is one of the main issues that attracts female in Saudi Arabia. The age of 25.9% of the respondents ranged between 20 and 30 years. Actually, majority of the participants (more than 64%) were from the two middle age groups between 20 and 40 years, 5 of the participants were 60 years old and above, 37.7% of the respondents had 2 - 5 years’ experience in their system. About 50% of the participants were nurses, 28.6% doctors and the rest 20.9% technicians. A detail about the background of the correspondents is presented in <xref ref-type="table" rid="table1">Table 1</xref>. Data were entered manually into SPSS where data checking and verification were performed. The descriptive statistics were carried out as shown in <xref ref-type="table" rid="table1">Table 1</xref>. The reliability of the survey data was examined using Cronbach’s Alpha in the SPSS software as shown in <xref ref-type="table" rid="table2">Table 2</xref>. All the factors were examined and the score was above the acceptance level of 0.70 according to [<xref ref-type="bibr" rid="scirp.72201-ref28">28</xref>] . This indicated that the data are reliable and consistent except satisfaction factor. Usually, people preferences and satisfactions vary and this can be the justification of why it scored 0.690 which is almost close to 0.70. <xref ref-type="table" rid="table3">Table 3</xref> presents the descriptive statistics for all the items used for usability factors priorities. It can be seen clearly that all the items were important as none of these items scored less than 6 out of 10. This was indicated by all the participants who felt that the usability factors are important in health information systems. Four items ranked the top important items namely doctors want to learn how to use the</p><table-wrap id="table2" ><label><xref ref-type="table" rid="table2">Table 2</xref></label><caption><title> Usability factors and reliability tests</title></caption><table><tbody><thead><tr><th align="center" valign="middle" >Usability factor</th><th align="center" valign="middle" >No. of items</th><th align="center" valign="middle" >Cronbach’s alpha*</th><th align="center" valign="middle" >Cronbach’s alpha**</th></tr></thead><tr><td align="center" valign="middle" >Learnability</td><td align="center" valign="middle" >4</td><td align="center" valign="middle" >0.775</td><td align="center" valign="middle" >0.811</td></tr><tr><td align="center" valign="middle" >Efficiency</td><td align="center" valign="middle" >6</td><td align="center" valign="middle" >0.872</td><td align="center" valign="middle" >0.772</td></tr><tr><td align="center" valign="middle" >Effectiveness</td><td align="center" valign="middle" >4</td><td align="center" valign="middle" >0.857</td><td align="center" valign="middle" >0.778</td></tr><tr><td align="center" valign="middle" >Satisfaction</td><td align="center" valign="middle" >2</td><td align="center" valign="middle" >0.677</td><td align="center" valign="middle" >0.690</td></tr><tr><td align="center" valign="middle" >Errors</td><td align="center" valign="middle" >2</td><td align="center" valign="middle" >0.740</td><td align="center" valign="middle" >0.706</td></tr><tr><td align="center" valign="middle" >Privacy</td><td align="center" valign="middle" >2</td><td align="center" valign="middle" >0.771</td><td align="center" valign="middle" >0.737</td></tr><tr><td align="center" valign="middle" >Design</td><td align="center" valign="middle" >2</td><td align="center" valign="middle" >0.702</td><td align="center" valign="middle" >0.712</td></tr></tbody></table></table-wrap><p>*Reliability for usability factors assessment; **Reliability for usability factors priorities.</p><table-wrap id="table3" ><label><xref ref-type="table" rid="table3">Table 3</xref></label><caption><title> Descriptive analysis for all the items</title></caption><table><tbody><thead><tr><th align="center" valign="middle" >Items</th><th align="center" valign="middle" >Min.</th><th align="center" valign="middle" >Max.</th><th align="center" valign="middle" >Statistic</th><th align="center" valign="middle" >SE</th></tr></thead><tr><td align="center" valign="middle" >I learnt the system very quickly</td><td align="center" valign="middle" >4.00</td><td align="center" valign="middle" >10.00</td><td align="center" valign="middle" >7.8671</td><td align="center" valign="middle" >0.13544</td></tr><tr><td align="center" valign="middle" >I require sufficient technical support while using the system</td><td align="center" valign="middle" >1.00</td><td align="center" valign="middle" >10.00</td><td align="center" valign="middle" >7.1469</td><td align="center" valign="middle" >0.15690</td></tr><tr><td align="center" valign="middle" >The system matches the workflow of real life scenarios and tasks</td><td align="center" valign="middle" >2.00</td><td align="center" valign="middle" >10.00</td><td align="center" valign="middle" >7.1678</td><td align="center" valign="middle" >0.14853</td></tr><tr><td align="center" valign="middle" >The system uses appropriate and familiar medical terms</td><td align="center" valign="middle" >3.00</td><td align="center" valign="middle" >10.00</td><td align="center" valign="middle" >6.9930</td><td align="center" valign="middle" >0.14837</td></tr><tr><td align="center" valign="middle" >By using the system I perform my tasks more quickly</td><td align="center" valign="middle" >3.00</td><td align="center" valign="middle" >10.00</td><td align="center" valign="middle" >6.9371</td><td align="center" valign="middle" >0.15604</td></tr><tr><td align="center" valign="middle" >It is easy to use the system while interacting with a patient</td><td align="center" valign="middle" >2.00</td><td align="center" valign="middle" >10.00</td><td align="center" valign="middle" >7.1049</td><td align="center" valign="middle" >0.16116</td></tr><tr><td align="center" valign="middle" >The system provides shortcuts for performing tasks more quickly</td><td align="center" valign="middle" >3.00</td><td align="center" valign="middle" >10.00</td><td align="center" valign="middle" >6.9720</td><td align="center" valign="middle" >0.14752</td></tr><tr><td align="center" valign="middle" >My efficiency has been improved after using the system</td><td align="center" valign="middle" >2.00</td><td align="center" valign="middle" >10.00</td><td align="center" valign="middle" >6.8881</td><td align="center" valign="middle" >0.15282</td></tr><tr><td align="center" valign="middle" >I do not have to enter a lot of data to perform my tasks</td><td align="center" valign="middle" >2.00</td><td align="center" valign="middle" >10.00</td><td align="center" valign="middle" >7.3357</td><td align="center" valign="middle" >0.13750</td></tr><tr><td align="center" valign="middle" >I do not have to remember a lot of things while performing my tasks</td><td align="center" valign="middle" >1.00</td><td align="center" valign="middle" >10.00</td><td align="center" valign="middle" >6.8741</td><td align="center" valign="middle" >0.17554</td></tr><tr><td align="center" valign="middle" >The system fulfills all my requirements and i do not have to work manually anymore</td><td align="center" valign="middle" >2.00</td><td align="center" valign="middle" >10.00</td><td align="center" valign="middle" >7.0280</td><td align="center" valign="middle" >0.16062</td></tr><tr><td align="center" valign="middle" >Any required data is always available when required</td><td align="center" valign="middle" >2.00</td><td align="center" valign="middle" >10.00</td><td align="center" valign="middle" >7.0979</td><td align="center" valign="middle" >0.16135</td></tr><tr><td align="center" valign="middle" >The system provides worthy analysis on the basis of patient data</td><td align="center" valign="middle" >2.00</td><td align="center" valign="middle" >10.00</td><td align="center" valign="middle" >7.1329</td><td align="center" valign="middle" >0.17139</td></tr><tr><td align="center" valign="middle" >I never leave a task undone</td><td align="center" valign="middle" >2.00</td><td align="center" valign="middle" >10.00</td><td align="center" valign="middle" >7.3217</td><td align="center" valign="middle" >0.15990</td></tr><tr><td align="center" valign="middle" >Overall, i am satisfied with the system</td><td align="center" valign="middle" >2.00</td><td align="center" valign="middle" >10.00</td><td align="center" valign="middle" >7.0490</td><td align="center" valign="middle" >0.15982</td></tr><tr><td align="center" valign="middle" >Frequent improvements should be made in the system</td><td align="center" valign="middle" >2.00</td><td align="center" valign="middle" >10.00</td><td align="center" valign="middle" >7.6364</td><td align="center" valign="middle" >0.16593</td></tr><tr><td align="center" valign="middle" >The system restricts me from making mistakes that affect my patient(s)</td><td align="center" valign="middle" >5.00</td><td align="center" valign="middle" >10.00</td><td align="center" valign="middle" >7.9371</td><td align="center" valign="middle" >0.13212</td></tr><tr><td align="center" valign="middle" >Once i have made a mistake, the system allows me to recover from it</td><td align="center" valign="middle" >4.00</td><td align="center" valign="middle" >10.00</td><td align="center" valign="middle" >7.8531</td><td align="center" valign="middle" >0.13570</td></tr><tr><td align="center" valign="middle" >I believe that my patient’s information is kept confidential</td><td align="center" valign="middle" >4.00</td><td align="center" valign="middle" >10.00</td><td align="center" valign="middle" >7.9021</td><td align="center" valign="middle" >0.11963</td></tr><tr><td align="center" valign="middle" >I can access/view only that information which is related to my job role</td><td align="center" valign="middle" >4.00</td><td align="center" valign="middle" >10.00</td><td align="center" valign="middle" >8.1119</td><td align="center" valign="middle" >0.10694</td></tr><tr><td align="center" valign="middle" >It feels pleasurable to use the system</td><td align="center" valign="middle" >2.00</td><td align="center" valign="middle" >10.00</td><td align="center" valign="middle" >7.2517</td><td align="center" valign="middle" >0.15581</td></tr><tr><td align="center" valign="middle" >I believe that significant screen design changes should be made to improve the system</td><td align="center" valign="middle" >3.00</td><td align="center" valign="middle" >10.00</td><td align="center" valign="middle" >7.3636</td><td align="center" valign="middle" >0.16172</td></tr></tbody></table></table-wrap><p>Min: Minimum, Max: Maximum, SE: Standard error.</p><p>system quickly, preventing doctors from making mistakes, patient data privacy and the privilege to browse the data with total score of 7.8, 7.9, 7.9 and 8.1, respectively. However, the less important items in this study were related more to efficiency such as performing the task more quickly, improving the efficiency of the users, the need to remember a lot of things while performing a task and using familiar medical terms with a total score of 6.9, 6.8, 6.8 and 6.9, respectively. Although, there is a slight difference between the top and the less important items, yet it was noticed that items related to privacy and errors received high importance than those related to efficiency. A strong relationship was found between privacy and errors elements using the Pearson correlation test with a p-value less than 0.05. Also, the correlation between learnability and efficiency elements was also statistically strong as the p-value was less than 0.05.</p><p><xref ref-type="fig" rid="fig1">Figure 1</xref> shows the ranking for the usability factors from the participants’ point of view. They ranked the privacy as the top important factor with a score more than 8. This finding is in line with other research in healthcare carried by [<xref ref-type="bibr" rid="scirp.72201-ref8">8</xref>] who stated that, the privacy factor scored the top position where the stakeholders have some concerns about. He also rated all the IT factors that may influence HIS in Turkey. Errors factor was also considered as a high important factor with a score value of 7.89. It was found that clear error messages are not available in the HIS when evaluated according to the findings of [<xref ref-type="bibr" rid="scirp.72201-ref24">24</xref>] . These results clearly conflict with the usability guidelines, in particular to heuristics, proposed by [<xref ref-type="bibr" rid="scirp.72201-ref4">4</xref>] . Errors and problems in the system or in the network were also ranked as one of the top technical issues in HIS in Saudi Arabia [<xref ref-type="bibr" rid="scirp.72201-ref23">23</xref>] . Although, he referred to more technical problems than usability problems as these issues affect the system usability either directly or indirectly. The practitioners did not rank design factor as a high important factor. These results agree with the finding of [<xref ref-type="bibr" rid="scirp.72201-ref29">29</xref>] , who reported that the practitioners did not consider design as an important factor because it is not important to them to see good UI design. Another interesting finding was reported by [<xref ref-type="bibr" rid="scirp.72201-ref26">26</xref>] who stated that all the physicians usually spent more time to enter the patient data. This finding endorsed the results of this study as the efficiency and effectiveness were evaluated as less important usability factors from their point of view with a score value of 7.02 and 7.15, respectively. It is difficult to argue that efficiency</p><fig id="fig1"  position="float"><label><xref ref-type="fig" rid="fig1">Figure 1</xref></label><caption><title> User’s rating of usability factors by different participants for the adoption of HIS in Saudi Arabia</title></caption><graphic mimetype="image"   position="float"  xlink:type="simple"  xlink:href="http://html.scirp.org/file/2-8701408x2.png"/></fig><p>and effectiveness are less important usability factors as they scored more than 7 out of 10. This can justify the importance of all the usability factors used in this research, whereas, data in <xref ref-type="fig" rid="fig2">Figure 2</xref> show the usability factors assessment by the different participants. It can be seen from the results in <xref ref-type="fig" rid="fig2">Figure 2</xref> that learnability and efficiency were the top ranked factors with a value of 3.8 and 3.72, respectively as judged by the participants. These were followed in descending order by privacy (3.63) &gt; satisfaction (3.56) &gt; design (3.56) &gt; effectiveness (3.5) &gt; errors (3.38).</p><p>Moreover, the participants had the opportunity to add more usability factors that are important and would like to see in the health information systems. Also, they might have been asked about the necessary modifications in order to have a usable health information system. They emphasized the importance of having a flexible and customise system as one of the participants strongly commented “The system should allow us to edit/modify a report that is saved” as they are not allowed to edit any data after they save it. They also mentioned that the importance should be simple so that they can interact easily with the system without any duplicate entries to go for a certain task or job. Besides, confirmation is needed by the system authority where duplicate data is required. The interesting finding in this study was that out of total participants, 5 participants clearly commented on the need for a specific functionality from the system such as medical reports, statistical reports and the specialties should be separated from each other to improve the usability of the system they usually use.</p><p>The critical problems that reduce the easy use of the system were also investigated in this research. A total of 8 participants stated that the response time is a critical problem for them. They mentioned that “The system is really slow”. This result was in line with those of [<xref ref-type="bibr" rid="scirp.72201-ref23">23</xref>] , who concluded that system slowness was one of the top technical issues. In another study, [<xref ref-type="bibr" rid="scirp.72201-ref29">29</xref>] mentioned that response time was an important finding where the practitioners do expect the system to response quickly [<xref ref-type="bibr" rid="scirp.72201-ref29">29</xref>] [<xref ref-type="bibr" rid="scirp.72201-ref30">30</xref>] .</p><p>It was clear that the availability is one of the critical problems faced by the participants. Moreover, it is not mainly a usability problem unless linked with a feature such as archiving or patient history data is stated clearly. In addition, error recovery and completeness were also among those critical usability problems. These prevent them</p><fig id="fig2"  position="float"><label><xref ref-type="fig" rid="fig2">Figure 2</xref></label><caption><title> User’s evaluation of usability factors by different participants for HIS adoption in Saudi Arabia</title></caption><graphic mimetype="image"   position="float"  xlink:type="simple"  xlink:href="http://html.scirp.org/file/2-8701408x3.png"/></fig><p>from undoing a mistake they made or if they wanted to view a patient record. Because, they do not prefer to have a paper file with the system as it delays the work and distributes them as they claimed. In his study [<xref ref-type="bibr" rid="scirp.72201-ref21">21</xref>] stated that, the HIS system was difficult to use due to its complexity. These results should help developers to overcome the above-mentioned issued and to address them in any proposed HIS. Taking into account such usability factors will lead to successful implementation in the future.</p></sec><sec id="s6"><title>6. Conclusion</title><p>Usability of health information system is a critical factor for patient safety. It can improve the effectiveness and efficiency of a system. Having a usable system can significantly help the practitioners to spend extra time with their patents. This study explored the current issues with respect to HIS with a focus on Saudi Arabia. The results of this study for assessment of usability factors can help designers and implementers for successful implementation of HIS. This study also showed as how the practitioners prioritize the usability factors. Privacy and errors were ranked as the top usability factors which should be considered while designing and implementing HIS. Response time and availability were also reported as additional critical factors and should be seriously considered. In addition to these findings, usability factors showed strong correlation among its elements such as privacy and errors. In conclusion, this study tried to convince the decision makers for adopting the HIS by realizing the importance of usability factors and to present as how the health professionals see the current HIS.</p></sec><sec id="s7"><title>Cite this paper</title><p>Alshamari, M. (2016) Usability Factors Assessment in Health Information System. Intelligent In- formation Management, 8, 170-180. http://dx.doi.org/10.4236/iim.2016.86012</p></sec></body><back><ref-list><title>References</title><ref id="scirp.72201-ref1"><label>1</label><mixed-citation publication-type="other" xlink:type="simple">Hamborg, K.C., Vehse, B. and Bludau, H.B. (2004) Questionnaire Based Usability Evaluation of Hospital Information Systems. Electron. J. Inform. Syst. Eval., 7, 21-30.</mixed-citation></ref><ref id="scirp.72201-ref2"><label>2</label><mixed-citation publication-type="other" xlink:type="simple">Alkraiji, A. (2011) Issues of the Adoption of HIT Related Standards at the Decision-Making Stage of Six Tertiary Healthcare Organizations in Saudi Arabia. Ph.D. Thesis, University of Loughborough, Loughborough.</mixed-citation></ref><ref id="scirp.72201-ref3"><label>3</label><mixed-citation publication-type="other" xlink:type="simple">Ozok, A.A., Wu, H., Garrido, M., Pronovost, P.J. and Gurses, A.P. (2014) Usability and Perceived Usefulness of Personal Health Records for Preventive Health Care: A Case Study Focusing on Patient’s and Primary Care Provider’s Perspectives. Applied Ergonomics, 45, 613-628. https:/doi.org/10.1016/j.apergo.2013.09.005</mixed-citation></ref><ref id="scirp.72201-ref4"><label>4</label><mixed-citation publication-type="other" xlink:type="simple">Nielsen, J. (2002) Becoming a Usability Professional.  
http://www.nngroup.com/articles/becoming-a-usability-professional/</mixed-citation></ref><ref id="scirp.72201-ref5"><label>5</label><mixed-citation publication-type="other" xlink:type="simple">ISO 9241-11 (1998) Ergonomic Requirements for Office Work with Visual Display Terminals (VDTs). Part 11: Guidance on Usability. International Organization for Standardization, Geneva.</mixed-citation></ref><ref id="scirp.72201-ref6"><label>6</label><mixed-citation publication-type="other" xlink:type="simple">Nielsen, J. (2003) Usability 101: Introduction to Usability.  
http://www.ingenieriasimple.com/usabilidad/IntroToUsability.pdf</mixed-citation></ref><ref id="scirp.72201-ref7"><label>7</label><mixed-citation publication-type="other" xlink:type="simple">Jeffery, L.B., Grayson, R. and Barnes, J. (2009) Defining and Testing EMR Usability: Principles and Proposed Methods of EMR Usability Evaluation and Rating. Technical Report, Healthcare Information and Management Systems Society (HIMSS), USA.</mixed-citation></ref><ref id="scirp.72201-ref8"><label>8</label><mixed-citation publication-type="other" xlink:type="simple">Turan, T.H. and Palvia, P.C. (2014) Critical Information Technology Issues in Turkish Healthcare. Information &amp; Management, 51, 57-68. https:/doi.org/10.1016/j.im.2013.09.007</mixed-citation></ref><ref id="scirp.72201-ref9"><label>9</label><mixed-citation publication-type="other" xlink:type="simple">CITC (2013) Communications and Information Technology Commission. Annual Report, Kingdom of Saudi Arabia.</mixed-citation></ref><ref id="scirp.72201-ref10"><label>10</label><mixed-citation publication-type="other" xlink:type="simple">Al-Ghaith, W.A., Sanzogni, L. and Sandhu, K. (2010) Factors Influencing the Adoption and Usage of Online Services in Saudi Arabia. Electron. J. Inform. Syst. Dev. Countries, 40, 1-32.</mixed-citation></ref><ref id="scirp.72201-ref11"><label>11</label><mixed-citation publication-type="other" xlink:type="simple">Alateyah, S.A., Crowder, R.M. and Wills, G.B. (2013) Factors Influencing Citizen Intention to Adopt Egovernment in Saudi Arabia. Proceedings of the International Conference on Information Society, Toronto, 24-26 June 2013, 250-255.</mixed-citation></ref><ref id="scirp.72201-ref12"><label>12</label><mixed-citation publication-type="other" xlink:type="simple">Al-Zuabi, H.F. and Al Shaikhli, I.F. (2013) Evaluation of Usability Problems of Labor Portal in Saudi Arabia. International Journal of Advanced Computer Science and Information Technology, 2, 14-25. https:/doi.org/10.2139/ssrn.2372783</mixed-citation></ref><ref id="scirp.72201-ref13"><label>13</label><mixed-citation publication-type="other" xlink:type="simple">Alqahtani, M.A., Alhadreti, O., AlRoobaea, R.S. and Mayhew, P.J. (2015) Investigation into the Impact of the Usability Factor on the Acceptance of Mobile Transactions: Empirical Study in Saudi Arabia. International Journal of Human–Computer Interaction, 6, 1-35.</mixed-citation></ref><ref id="scirp.72201-ref14"><label>14</label><mixed-citation publication-type="journal" xlink:type="simple"><name name-style="western"><surname>Alasem</surname><given-names> A.N. </given-names></name>,<etal>et al</etal>. (<year>2013</year>)<article-title>Evaluating the Usability of Saudi Digital Library’s Interface (SDL)</article-title><source> Proceedings of the World Congress on Engineering and Computer Science</source><volume> 1</volume>,<fpage> 178</fpage>-<lpage>181</lpage>.<pub-id pub-id-type="doi"></pub-id></mixed-citation></ref><ref id="scirp.72201-ref15"><label>15</label><mixed-citation publication-type="other" xlink:type="simple">Deutsch, E., Duftschmid, G. and Dorda, W. (2010) Critical Areas of National Electronic Health Record Programs: Is Our Focus Correct? International Journal of Medical Informatics, 79, 211-222. https:/doi.org/10.1016/j.ijmedinf.2009.12.002</mixed-citation></ref><ref id="scirp.72201-ref16"><label>16</label><mixed-citation publication-type="journal" xlink:type="simple"><name name-style="western"><surname>Altuwaijri</surname><given-names> M.M. </given-names></name>,<etal>et al</etal>. (<year>2008</year>)<article-title>Electronic-Health in Saudi Arabia</article-title><source> Just around the Corner? Saudi Medical Journal</source><volume> 29</volume>,<fpage> 171</fpage>-<lpage>178</lpage>.<pub-id pub-id-type="doi"></pub-id></mixed-citation></ref><ref id="scirp.72201-ref17"><label>17</label><mixed-citation publication-type="other" xlink:type="simple">Likourezos, A., Chalfin, D.B., Murphy, D.G., Sommer, B., Darcy, K. and Davidson, S.J. (2004) Physician and Nurse Satisfaction with an Electronic Medical Record System. Journal of Emergency Medicine, 27, 419-424. https:/doi.org/10.1016/j.jemermed.2004.03.019</mixed-citation></ref><ref id="scirp.72201-ref18"><label>18</label><mixed-citation publication-type="other" xlink:type="simple">Margalit, R.S., Roter, D., Dunevant, M.A., Larson, S. and Reis, S. (2006) Electronic Medical Record Use and Physician-Patient Communication: An Observational Study of Israeli Primary Care Encounters. Patient Education and Counseling, 61, 134-141.  
https:/doi.org/10.1016/j.pec.2005.03.004</mixed-citation></ref><ref id="scirp.72201-ref19"><label>19</label><mixed-citation publication-type="other" xlink:type="simple">Al-Solbi, A. and Mayhew, P. (2005) Measuring E-Readiness Assessment in Saudi Organisations Preliminary Results from a Survey Study. Proceedings of the 1st European Conference on Mobile Government, Brighton, 10-12 July 2005, 467-474.</mixed-citation></ref><ref id="scirp.72201-ref20"><label>20</label><mixed-citation publication-type="other" xlink:type="simple">Alkraiji, A., Jackson, T. and Murray, I. (2011) Health Data Standards and Adoption Process: Preliminary Findings of a Qualitative Study in Saudi Arabia. Campus-Wide Information Systems, 28, 345-359. https:/doi.org/10.1108/10650741111181616</mixed-citation></ref><ref id="scirp.72201-ref21"><label>21</label><mixed-citation publication-type="other" xlink:type="simple">Khudair, A.A. (2008) Electronic Health Records: Saudi Physician’s Perspective. Proceedings of the 5th IET International Seminar on Appropriate Healthcare Technologies for Developing Countries, London, 21-22 May 2008, 38-44. https:/doi.org/10.1049/ic:20080575</mixed-citation></ref><ref id="scirp.72201-ref22"><label>22</label><mixed-citation publication-type="other" xlink:type="simple">Aldosari, B. (2014) Rates, Levels and Determinants of Electronic Health Record System Adoption: A Study of Hospitals in Riyadh, Saudi Arabia. International Journal of Medical Informatics, 83, 330-342. https:/doi.org/10.1016/j.ijmedinf.2014.01.006</mixed-citation></ref><ref id="scirp.72201-ref23"><label>23</label><mixed-citation publication-type="other" xlink:type="simple">Khalifa, M. (2013) Barriers to Health Information Systems and Electronic Medical Records Implementation. A Field Study of Saudi Arabian Hospitals. Procedia Computer Science, 21, 335-342. https:/doi.org/10.1016/j.procs.2013.09.044</mixed-citation></ref><ref id="scirp.72201-ref24"><label>24</label><mixed-citation publication-type="other" xlink:type="simple">Pereira, R., Duarte, J., Salazar, M., Santos, M., Abelha, A. and Machado, J. (2012) Usability of an Electronic Health Record. Proceedings of the IEEE International Conference on Industrial Engineering and Engineering Management, Hong Kong, 10-13 December 2012, 1568-1572. https:/doi.org/10.1109/ieem.2012.6838010</mixed-citation></ref><ref id="scirp.72201-ref25"><label>25</label><mixed-citation publication-type="other" xlink:type="simple">Villa, L.B. and Cabezas, I. (2014) A Review on Usability Features for Designing Electronic Health Records. Proceedings of the IEEE 16th International Conference on E-Health Networking, Applications and Services, Natal, 15-18 October 2014, 49-54.  
https:/doi.org/10.1109/healthcom.2014.7001812</mixed-citation></ref><ref id="scirp.72201-ref26"><label>26</label><mixed-citation publication-type="other" xlink:type="simple">Goldberg, L., Lide, B., Lowry, S., Massett, H.A., O’Connell, T., et al. (2011) Usability and Accessibility in Consumer Health Informatics: Current Trends and Future Challenges. American Journal of Preventive Medicine, 40, S187-S197.  
https:/doi.org/10.1016/j.amepre.2011.01.009</mixed-citation></ref><ref id="scirp.72201-ref27"><label>27</label><mixed-citation publication-type="other" xlink:type="simple">SAS (2010) Base SAS 9.2 Procedures Guide: Statistical Procedures. 3rd Edition, SAS Institute Inc., Cary, 17-34.</mixed-citation></ref><ref id="scirp.72201-ref28"><label>28</label><mixed-citation publication-type="other" xlink:type="simple">Dewberry, C. (2004) Statistical Methods for Organizational Research: Theory and Practice. Routledge, New York, 364. https:/doi.org/10.4324/9780203414897</mixed-citation></ref><ref id="scirp.72201-ref29"><label>29</label><mixed-citation publication-type="journal" xlink:type="simple"><name name-style="western"><surname>Shabot</surname><given-names> M.M. </given-names></name>,<etal>et al</etal>. (<year>2004</year>)<article-title>Ten Commandments for Implementing Clinical Information Systems. Proceedings (Baylor University</article-title><source> Medical Center)</source><volume> 17</volume>,<fpage> 265</fpage>-<lpage>269</lpage>.<pub-id pub-id-type="doi"></pub-id></mixed-citation></ref><ref id="scirp.72201-ref30"><label>30</label><mixed-citation publication-type="other" xlink:type="simple">Boonstra, A. and Broekhuis, M. (2010) Barriers to the Acceptance of Electronic Medical Records by Physicians from Systematic Review to Taxonomy and Interventions. BMC Health Services Research, 10, 231. https:/doi.org/10.1186/1472-6963-10-231</mixed-citation></ref></ref-list></back></article>