Insook Cho; Won-Ja Choi; WoanHeui Choi; Misuk Hyun; Yeonok Park; Yoona Lee; Euiyoung Cho; Okhee Hwang

doi:10.4040/jkan.2015.45.4.523

Articles

Page Path: HOME > J Korean Acad Nurs > Volume 45(4); 2015 > Article

Original Article
Identifying Usability Level and Factors Affecting Electronic Nursing Record Systems: A Multi-institutional Time-motion Approach: Insook Cho, Won-Ja Choi, WoanHeui Choi, Misuk Hyun, Yeonok Park, Yoona Lee, Euiyoung Cho, Okhee Hwang; Journal of Korean Academy of Nursing 2015;45(4):523-532.
DOI: https://doi.org/10.4040/jkan.2015.45.4.523
Published online: August 31, 2015

¹Department of Nursing, Inha University, Incheon, Korea.

²Department of Nursing, SMG-SNU Boramae Medical Center, Seoul, Korea.

³Department of Nursing, Seoul National University Hospital, Seoul, Korea.

⁴Department of Nursing, Dongguk University Ilsan Hospital, Goyang, Korea.

⁵Department of Nursing, Ajou University Hospital, Suwon, Korea.

⁶Department of Nursing, Korea University Guro Hospital, Seoul, Korea.

⁷Department of Nursing, Pai Chai University, Daejeon, Korea.

⁸Department of Nursing, National Cancer Center, Goyang, Korea.

Address reprint requests to: Cho, Insook. Department of Nursing, Inha University, 100 Inha-ro, Nam-gu, Incheon 22212, Korea. Tel: +82-32-860-8201, Fax: +82-32-874-5880, insook.cho@inha.ac.kr

• Received: September 30, 2014 • Revised: October 19, 2014 • Accepted: April 22, 2015

This is an Open Access article distributed under the terms of the Creative Commons Attribution NoDerivs License. (http://creativecommons.org/licenses/by-nd/4.0/) If the original work is properly cited and retained without any modification or reproduction, it can be used and re-distributed in any format and medium.

22 Views
2 Download
3 Scopus

prev next

Full Article

Download PDF

Abstract
NOTES
REFERENCES

Abstract

Purpose
The usability, user satisfaction, and impact of electronic nursing record (ENR) systems were investigated.
Methods
This mixed-method research was performed as a time-motion (TM) study and a survey which were carried out at six hospitals between August and November 2013. The TM study involved 108 nurses from medical, surgical, and intensive care units at each hospital, plus an additional 48 nurses who served as nonparticipating observers. In the survey, 1879 volunteer nurses completed the Impact of ENR Systems Scale, the System Usability Scale, and a global satisfaction scale. Qualitative and quantitative analyses were performed.
Results
The mean scores for the ENR impact, system usability, and satisfaction were 4.28 (out of 6), 58.62 (out of 100), and 74.31 (out of 100), respectively, and they differed significantly between hospitals (F=43.43, p<.001, F=53.08 and p<.001, and F=29.13 and p<.001, respectively). A workflow fragmentation assessment revealed different patterns of ENR system use among the included hospitals. Three user characteristics-educational background, practice period, and experience of using paper records-significantly affected the system usability and satisfaction scores.
Conclusion
The system quality varied widely among the ENR systems. The generally low-to-moderate levels of system usability and user satisfaction suggest many opportunities for improvement.
Keywords: Electronic health records; Nursing records; Time and motion studies; User-computer interface; Work satisfaction

This study was supported by the Hospital Nurses Association of Korean Nurses Association in 2013.

This study was also supported by a grant from Inha University in 2014 (No. 50463-01).

REFERENCES

1. Zhou L, Soran CS, Jenter CA, Volk LA, Orav EJ, Bates DW, et al. The relationship between electronic health record use and quality of care over time. J Am Med Inform Assoc. 2009;16(4):457–464. Article PubMed PMC
2. Krist AH, Beasley JW, Crosson JC, Kibbe DC, Klinkman MS, Lehmann CU, et al. Electronic health record functionality needed to better support primary care. J Am Med Inform Assoc. 2014;21(5):764–771. Article PubMed PMC
3. Schumacher RM, Lowry SZ. NIST guide to the processes approach for improving the usability of electronic health records. Gaithersburg, MD: National Institute of Standards and Technology; 2010.11;Report No.: NISTIR 7741.
4. Middleton B, Bloomrosen M, Dente MA, Hashmat B, Koppel R, Overhage JM, et al. Enhancing patient safety and quality of care by improving the usability of electronic health record systems: Recommendations from AMIA. J Am Med Inform Assoc. 2013;20(e1):e2–e8. Article PubMed PMC
5. Stevenson JE, Nilsson GC, Petersson GI, Johansson PE. Nurses' experience of using electronic patient records in everyday practice in acute/inpatient ward settings: A literature review. Health Informatics J. 2010;16(1):63–72. Article PubMed PDF
6. Cho I, Choi WJ, Choi WH, Kim MK. The adoptions and use of electronic nursing records in Korean hospitals: Findings of a nationwide survey. J Korean Clin Nurs Res. 2013;19(3):345–356.
7. Zheng K, Guo MH, Hanauer DA. Using the time and motion method to study clinical work processes and workflow: Methodological inconsistencies and a call for standardized research. J Am Med Inform Assoc. 2011;18(5):704–710. Article PubMed PMC
8. International Organization for Standardization, International Electrotechnical Commission. Ergonomic requirements for office work with visual display terminals (VDTs) - Part 14: Menu dialogues [Internet]. Geneva, CH, Author. 1997;cited 2014 November 1. Available from: https://www.iso.org/obp/ui/#iso:std:16886:en
9. Dykes PC, Hurley A, Cashen M, Bakken S, Duffy ME. Development and psychometric evaluation of the impact of health information technology (I-HIT) scale. J Am Med Inform Assoc. 2007;14(4):507–514. Article PubMed PMC
10. Zhang J, Walji MF. TURF: Toward a unified framework of EHR usability. J Biomed Inform. 2011;44(6):1056–1067. Article PubMed
11. DesRoches CM, Miralles P, Buerhaus P, Hess R, Donelan K. Health information technology in the workplace: Findings from a 2010 national survey of registered nurses. J Nurs Adm. 2011;41(9):357–364. PubMed
12. Brooke J. SUS: A quick and dirty usability scale. In: Jordan PW, Thomas B, Weerdmeester BA, McClelland IL, editors. Usability evaluation in industry. London, UK: Taylor & Francis; 1996. p. 189–194.
13. Agency for Healthcare Research and Quality. Time and motion study tool: Ambulatory practice (TMS-AP) [Internet]. Rockville, MD, Author. 2007;cited 2014 November 1. Available from: http://healthit.ahrq.gov/sites/default/files/docs/page/AHRQ%20NRC%20Time-Motion%20Study%20Tool%20Guide_0.pdf
14. Song KJ, Kim EH, Yoo CS, Park HO, Park KO. Development of KPCS (Korean patient classification system for nurses) based on nursing needs. J Korean Clin Nurs Res. 2009;15(1):5–17.
15. Choi WH, Park IS, Shin HJ, Joo YH, Kim YA, Jung EH, et al. Comparison of direct and indirect nursing-care times between physician order entry system and electronic medical records. Stud Health Technol Inform. 2006;122:288–293.PubMed
16. Bangor A, Kortum P, Miller J. Determining what individual SUS scores mean: Adding an adjective rating scale. J Usability Stud. 2009;4(3):114–123.
17. Carrington JM, Effken JA. Strengths and limitations of the electronic health record for documenting clinical events. Comput Inform Nurs. 2011;29(6):360–367. Article PubMed
18. Trafton J, Martins S, Michel M, Lewis E, Wang D, Combs A, et al. Evaluation of the acceptability and usability of a decision support system to encourage safe and effective use of opioid therapy for chronic, noncancer pain by primary care providers. Pain Med. 2010;11(4):575–585. Article PubMed
19. Kim MS, Shapiro JS, Genes N, Aguilar MV, Mohrer D, Baumlin K, et al. A pilot study on usability analysis of emergency department information system by nurses. Appl Clin Inform. 2012;3(1):135–153. PubMed PMC
20. Jung JH, Myung GH, Kang KH, Park EH. Analysis of standard nursing statements recorded in an electronic nursing record system and user satisfaction. Perspect Nurs Sci. 2012;9(2):146–153.
21. Shin A, Park HJ, Jung SJ, Park MH, Yoon KI, Kim YN. Analysis survey of user satisfaction with electronic nursing record system in a general hospital in Daegu. J Korean Soc Health Inf Health Stat. 2009;34(1):29–39.
22. DesRoches CM, Campbell EG, Rao SR, Donelan K, Ferris TG, Jha A, et al. Electronic health records in ambulatory care-a national survey of physicians. N Engl J Med. 2008;359(1):50–60. Article PubMed
23. Hendrich A, Chow MP, Skierczynski BA, Lu Z. A 36-hospital time and motion study: How do medical-surgical nurses spend their time? Perm J. 2008;12(3):25–34.Article
24. Yee T, Needleman J, Pearson M, Parkerton P, Parkerton M, Wolstein J. The influence of integrated electronic medical records and computerized nursing notes on nurses' time spent in documentation. Comput Inform Nurs. 2012;30(6):287–292. Article PubMed
25. Kim DY, Park MH. Intermediate evaluation after the introduction of electronic nursing record system in a general hospital. J Korean Clin Nurs Res. 2010;16(3):133–144.
26. Allen B. Knowledge organization in an information retrieval task. Inf Process Manag. 1990;26(4):535–542. Article
27. Allen B. Cognitive abilities and information system usability. Inf Process Manag. 1994;30(2):177–191. Article

Figure 1

Research framework of clinical impact and usability of electronic nursing record systems.

Figure 2

Comparisons the scores of impact of the system, system usability, and overall satisfaction.

Figure 3

The 'timeline belt' visualization exhibiting nursing activity fragmentation of a medical nursing units.

Table 1

Characteristics of Nurses Participated in the Self-reporting Questionnaire

^{a, b, c}Group contrast by Tukey test; CI=Confidence interval; ENR=Electronic nursing records.

Table 2

Multiple Regression of Respondent's-characteristics-adjusted Impact of ENRs, Usability Score of ENR, and Overall Satisfaction on ENR

ENR=Electronic nursing record.

Figure & Data

REFERENCES

Citations

Citations to this article as recorded by

Cite

CITE: export Copy Download Format; Close

Download Citation

Download a citation file in RIS format that can be imported by all major citation management software, including EndNote, ProCite, RefWorks, and Reference Manager.

Format:

RIS — For EndNote, ProCite, RefWorks, and most other reference management software
BibTeX — For JabRef, BibDesk, and other BibTeX-specific software

Include:

Citation for the content below
Citation and abstract for the content below

Identifying Usability Level and Factors Affecting Electronic Nursing Record Systems: A Multi-institutional Time-motion Approach

J Korean Acad Nurs. 2015;45(4):523-532. Published online August 31, 2015

DOI: https://doi.org/10.4040/jkan.2015.45.4.523

XML Download

Figure

We recommend

Identifying Usability Level and Factors Affecting Electronic Nursing Record Systems: A Multi-institutional Time-motion Approach

Figure 1 Research framework of clinical impact and usability of electronic nursing record systems.

Figure 2 Comparisons the scores of impact of the system, system usability, and overall satisfaction.

Figure 3 The 'timeline belt' visualization exhibiting nursing activity fragmentation of a medical nursing units.

Figure 1

Figure 2

Figure 3

Identifying Usability Level and Factors Affecting Electronic Nursing Record Systems: A Multi-institutional Time-motion Approach

Table 1

Characteristics of Nurses Participated in the Self-reporting Questionnaire

^{a, b, c}Group contrast by Tukey test; CI=Confidence interval; ENR=Electronic nursing records.

Table 2

Multiple Regression of Respondent's-characteristics-adjusted Impact of ENRs, Usability Score of ENR, and Overall Satisfaction on ENR

ENR=Electronic nursing record.

Table 1 Characteristics of Nurses Participated in the Self-reporting Questionnaire

^{a, b, c}Group contrast by Tukey test; CI=Confidence interval; ENR=Electronic nursing records.

Table 2 Multiple Regression of Respondent's-characteristics-adjusted Impact of ENRs, Usability Score of ENR, and Overall Satisfaction on ENR

ENR=Electronic nursing record.