Usability Evaluation of Ulite Web-Based Picture Archiving and communication Systems Software in Shiraz University of Medical Science Hospitals

Document Type : Articles

Authors

Abstract

Introduction: Health information systems have the potential of improving the quality of healthcare and treatment procedures and supporting the physicians in their clinical diagnoses. Nowadays, evaluating the usability is widely accepted as a crucial factor in the acceptance and success of the interactive healthcare systems. The present study aimed to evaluate the usability of Ulite Software based on the ISO 9241 model.Method: This analytical-empirical study was performed in 2014. The target population consisted of 50 Utile Software users. The data were collected througha valid and reliable questionnaire containing questions from 10 valid and reliable questionnaires on the related field. The content validity of the questionnaire was evaluated and confirmed by the scholars and experts in Picture Archiving and Communication Systems (PACS) and the reliability was estimated through statistical procedures using Chronbach’s alpha Test (α=0.958 ). Data were analyzed in SPSS 20 using descriptive statistics and Smart-PLS version 3, using Structural Equation Method and Partial Least Square Approach.Results:The obtained results of the simultaneous analysis of all constructs regarding ISO 9241 model indicated a positive effect of “effectiveness” (P-value= 0.05) and “satisfaction” (P-value= 0.00) on the usability of web-based PACS, while the effect of “efficiency” (P-value= 0.68) was not confirmed.Conclusion: Usability evaluation of Ulite software in the demo version was performed based on the ISO 9241 model. Based on the results, it seems that this software has the necessary effectiveness and user satisfaction has been somewhat successful, but since the evaluation in the demo version aimed to purchasethe system and eliminate initial problems,we should focus on the deficiencies that decrease the efficiency of the system.Keywords: Usability, Ulite, PACS, Evaluation, User, ISO 9241 model

  1. HU, G. and K.H. CHANG, Web sites usability, usability requirements specification & usability evaluation. Proceedings of the 44th annual Southeast regional conference.Melbourne, Florida: ACM., 2006.
  2. Griffiths KM, et al., Automated assessment of thequality of depression websites. J Med Internet Res, 2005. 7(5).
  3. Huang QR Creating informed consumers and achieving shared decision making. Aust Fam Physician, 2003. 32(5): p. 335–41.
  4. Bomba D, L.T., Constructing and validating a consumer health portal rating index. .Stud Health Technol Inform, 2004. 107(Pt2): p. 1123–7.
  5. Eysenbach G and Kohler C, How do consumers search for and appraise health information on the world wide web? Qualitative study using focus groups, usability tests6.
  6. Rianne Immink and v. Boven, The use, usability and persuasiveness of PAZIO, an online healthcare portal. Master Health Sciences Health Technology Assessment University of Twente (thesis ), August 2013.
  7. M. Maguire, Methods to support human-centered design. ,Int. J. Hum.-Comput. Stud, 2001. 55: p. 587–634.
  8. Preece J, et al., Human–computer interaction. New York: Addison-Wesley Publishing Company;, 1994.
  9. Preece J, Rogers Y, and S. H., interactiondesign: beyond human–computer interaction. . New York: Wiley, 2002.
  10. Hassan Shah NU . Adoption of Usability Evaluation Methods in Web Development School of Computing Blekinge Institute of Technology, 2009 ( thesis ).
  11. Agharezaei .Zh, et al., Usability Evaluation of a Laboratory Information System. Health Inf Manage ; . 10, 2013. 2: p. 213-24.[In Persian]
  12. Viitanen, J., et al., National questionnaire study on clinical ICT systems proofs: physicians suffer from poor usability. Int J Med Inform, 2011. 80(10): p. 708-25.
  13. Limayem M, Hirt SG, and Cheung CM How Habit Limits the Predictive Power of Intention: The Case of Information Systems Continuance. . MIS Quarterly 2007. 31(4): p. 705-37. .
  14. Chin WW, L. MK., and A proposed model and measurement instrument for the formation of is satisfaction: the case of end-user computing satisfaction [Online]. Available from: URL: http://dl.acm.org/citation.cfm?id=359813, 2000.
  15. Bevan N . Usability is Quality of Use. Proceedings of the 6th International Conference on Human Computer Interaction; 1995 Jul 9-14;, Yokohama, Japan; 1995. .
  16. Jorritsma, W., F. Cnossen, and P.M. van Ooijen, Merits of usability testing for PACS selection. Int J Med Inform, 2014. 83(1): p. 27-36.
  17. Kimiyafar K, et al., Views of Users Towards the Quality of Hospital Information System in Training Hospitals Affiliated to Mashhad University of Medical Sciences-2006. Health Inf Manage, 2006. 4(1): p. 43-50
  18. Kaipio J Usability in Healthcare: Overcoming the Mismatch between Information Systems and Clinical Work [Doctoral Thesis]. Helsinki: School of Computer Science and Engineering, Aalto University, 2011.
  19. Sadoughi F, Khoshkam M, and Farahi SR .Usability Evaluation of Hospital Information Systems in Hospitals Affiliated with Mashhad University of Medical Sciences, Iran. Health Information Management 2012. 9(3): p. 317.[In Persian]
  20. Kushniruk AW Evaluation in the design of information systems: applications of approaches from usability engineering. . Comput Biol Med 2002. 32(3): p. 141-9.
  21. McConnell S Rapid development: taming wild software schedules. Redmond, Washington: Microsoft Press, 1996.
  22. Friedman CP and W.J. . Evaluation methods in medical informatics. New York: Springer, 1997.
  23. MADAN, A. and S.K. DUBEY, USABILITY EVALUATION METHODS: A LITERATURE REVIEW. International Journal of Engineering Science and Technology, 2012.
  24. ISO, ISO 9241-11 Ergonomic requirements for office work with visual display terminals (VDTs) -- Part 11: Guidance on usability. 1994.
  25. M. Macleod Usability: Practical Methods for testing and Improvement, Proceedings of the Proceedings of the Norwegian Computer Society Software ‘94 Conference, Sandvika, Norway. 1994.
  26. N. Bevan Usability is quality of use, Proceedings of the Proceedings of the 6th International Conference on Human Computer Interaction, Elsevier. . 1995.
  27. Eelke Folmer . Engineering Human Computer Interaction and Interactive Systems - Software Architecture Analysis of Usability. Lecture Notes in Computer Science. 2004: Springer Berlin Heidelberg.
  28. Liljander, V., P. Polsa, and A. van Riel, Modelling consumer responses to an apparel store brand: Store image as a risk reducer. Journal of Retailing and Consumer Services, 2009. 16(4): p. 281-290.
  29. Wu and W. Wen, Linking Bayesian networks and PLS path modeling for causal analysis. Expert Systems with Applications, 2010. 37(1): p. 134-139.
  30. Wixom, B.H. and H.J. Watson, An empirical investigation of the factors affecting data warehousing success. MIS Q., 2001. 25(1): p. 17-32.
  31. Davari A and Rezazadeh A .Structural equation modeling with PLS. Tehran: Jahad University, 2013: p. 215. [In Persian]
  32. Saeed, M. and S. Ullah, . Usability Evaluation of a Health Web Portal, in School of Computing , Blekinge Institute of Technology 2009: SWEDEN.
  33. Soohyung Joo , Suyu Lin , and Kun Lu A Usability Evaluation Model for Academic Library Websites: Efficiency, Effectiveness and Learnability. Journal of Library and Information Studies, 2011. 9(2).
  34. Nouri, Z., Usability Evaluationof Hospital Information System in Hospitals Medical Universities in Iran , According to ISO9241/10 in 88 year. Proccedings of the National Congressrid of IT in Heathcare . 1388: p. 184 . [In Persian]
  35. Te’eni, D., J.M. Carey, and P. Zhang, Human-ComputerInteraction: Developing Effective Organizational Information Systems. 2005: John Wiley & Sons.
  36. Marty PF and Twidale MB, Usability@90mph: Presenting and Evaluating a New,High-Speed Method for Demonstrating User Testing in Front of an Audience. First Monday 2005. 10(7): p. 1-18.