Health Information Technology Functionalities Research Articles

Incorporating health IT into primary care transformation.

To understand the role of health information technology (IT) vendors and health IT functionality in supporting advanced primary care. We synthesized multiple rounds of surveys and interviews (2017-2022) from a mixed-methods evaluation of Comprehensive Primary Care Plus (CPC+), a multipayer model developed by CMS. CPC+ was the first federal advanced primary care reform effort that formalized health IT vendors' roles in supporting health IT implementation and specified detailed health IT requirements for practices. We conducted content analysis to identify cross-cutting themes related to health IT for both practices and vendors, comparing similarities and differences across participants and (when possible) over time. Vendors and practices reported advances in registries and dashboards for improved information management within the practice as well as strengthened relationships between vendors and practices that supported health IT implementation. However, CPC+ practices noted several gaps or challenges using existing functionalities, and both vendors and practices reported broader challenges for more transformative health IT change, particularly the lack of interoperable health information exchange needed to support care management and care coordination. Key factors constraining vendors' investment in further advances included long product development schedules, making it difficult to respond to rapidly evolving model requirements. Vendors also shared that CPC+ practices represented a small fraction of their client base, so investing in developing new functionality was not strategic unless it was more broadly relevant outside CPC+. Continued collaboration among health IT vendors, practices, policy makers, and payers could support continued technological improvements, particularly related to information exchange and communication. Aligning requirements more closely with other federal and private models could also help mitigate the risk for vendors.

Internal and Environmental Predictors of Physician Practice Use of Screening and Medications for Opioid Use Disorders.

Medications for opioid use disorder (MOUD) remain highly inaccessible despite demonstrated effectiveness. We examine the extent of screening for opioid use and availability of MOUD in a national cross-section of multi-physician primary care and multispecialty practices. Drawing on an existing framework to characterize the internal and environmental context, we assess socio-technical, organizational-managerial, market-based, and state-regulation factors associated with the use of opioid screening and offering of MOUD in a practice. A total of 26.2% of practices offered MOUD, while 69.4% of practices screened for opioid use. Having advanced health information technology functionality was positively associated with both screening for opioid use and offering MOUD in a practice, while access to on-site behavioral clinicians was positively associated with offering MOUD in adjusted models. These results suggest that improving access to information and expertise may enable physician practices to respond more effectively to the nation's ongoing opioid epidemic.

Do Patient Engagement IT Functionalities Influence Patient Safety Outcomes? A Study of US Hospitals.

Patient engagement using health information technology (IT) functionalities can be a powerful tool in managing their own care for better health outcomes. Therefore, this study explores whether patient engagement IT functionalities and electronic health record (EHR) can affect patient safety outcomes. Using longitudinal study design for general acute care hospitals within the United States, we examine the interaction effects of EHR and patient engagement IT functionalities on patient safety outcomes (adverse incident rate) using a generalized estimating equation. Our national sample consisted of 9759 hospital-year observations from 2014 to 2018. Overall, we found a significant association between adverse incident rate and patient engagement level and EHR adoption level. On average, as the combined effects of patient engagement level and EHR adoption level increases, the adverse incident rate decreases by approximately 0.49 (P < .01). Incorporating patient engagement functionalities is becoming an essential tool to improve health outcomes and will play an instrumental role in meeting meaningful use standards. Our study provides insights into the potential synergy between a hospital's existing EHR maturity and patient engagement health IT functionalities in affecting organizational performance. Organizational culture and capabilities pertinent to adopting patient engagement health IT functionalities infrastructure should be established first to provide the impetus for this synergy.

Adoption of Patient Engagement Strategies by Physician Practices in the United States.

Patient engagement strategies can equip patients with tools to navigate treatment decisions and improve patient-centered outcomes. Despite increased recognition about the importance of patient engagement, little is known about the extent of physician practice adoption of patient engagement strategies nationally. We analyzed data collected from the National Survey of Healthcare Organizations and Systems (NSHOS) on physician practice adoption of patient engagement strategies. Stratified-cluster sampling was used to select physician practices operating under different organizational structures. Multivariable linear regression models estimated the association of practice ownership, health information technology functionality, use of screening activities, patient responsiveness, chronic care management processes, and the adoption of patient engagement strategies, including shared decision-making, motivational interviewing, and shared medical appointments. All regression models controlled for participation in payment reforms, practice size, Medicaid revenue percentage, and geographic region. We found modest and varied adoption of patient engagement strategies by practices of different ownership types, with health system-owned practices having the lowest adoption of ownership types. Practice capabilities, including chronic care management processes, routine screening of medical and social risks, and patient care dissemination strategies were associated with greater practice-level adoption of patient engagement strategies. This national study is the first to characterize the adoption of patient engagement strategies by US physician practices. We found modest adoption of shared decision-making and motivational interviewing, and low adoption of shared medical appointments. Risk-based payment reform has the potential to motivate greater practice-level patient engagement, but the extent to which it occurs may depend on internal practice capabilities.

Mammography and Decision Aid Use for Breast Cancer Screening in Older Women

Decision aids for breast cancer screening are increasingly being used by physicians, but the association between physician practice decision-aid use and mammography rates remains uncertain. Using national data, this study examines the association between practice-level decision-aid use and mammography use among older women. Physician practice responses to the 2017/2018 National Survey of Healthcare Organizations and Systems (n=1,236) were linked to 2016 and 2017 Medicare fee-for-service beneficiary data from eligible beneficiaries (n=439,684) aged 65-74 years. In 2021, multivariable generalized linear models estimated the association of practice decision-aid use for breast cancer screening and advanced health information technology functions with mammography use, controlling for practice and beneficiary characteristics. Overall, 60.1% of eligible beneficiaries had a screening mammogram, and 37.3% of physician practices routinely used decision aids for breast cancer screening. In adjusted analyses, advanced health information technology functions (OR=1.19, p=0.04) were associated with mammography use, but practice use of decision aids was not (OR=0.95, p=0.21). Beneficiary clinical and socioeconomic characteristics, including race, comorbidities, Medicare and Medicaid eligibility, and median household income were more strongly associated with mammography use than practice-level decision-aid use or advanced health information technology functions. Health information technology‒enabled automation of mammography reminders and other advanced health information technology functions may support mammography, whereas breast cancer decision aids may reduce patients' propensities to be screened through the alignment of their preferences and screening decision. More resources may be needed for decision aids to be routinely implemented to improve solicitation of patient preferences and targeting of mammography services.

Survey of Information Exchange and Advanced Use of Other Health Information Technology in Primary Care Settings: Capabilities In and Outside of the Safety Net.

Advanced use of health information technology (IT) functionalities can support more comprehensive, coordinated, and patient-centered primary care services. Safety net practices may benefit disproportionately from these investments, but it is unclear whether IT use in these settings has kept pace and what organizational factors are associated with varying use of these features. The aim was to estimate advanced use of health IT use in safety net versus nonsafety net primary care practices. We explore domains of patient engagement, population health management (decision support and registries), and electronic information exchange. We examine organizational characteristics that may differentially predict advanced use of IT across these settings, with a focus on health system ownership and/or membership in an independent practice network as key factors that may indicate available incentives and resources to support these efforts. We conduct cross-sectional analysis of a national survey of physician practices (n=1776). We use logistic regression to predict advanced IT use in each of our domains based on safety net status and other organizational characteristics. We then use interaction models to assess whether ownership or network membership moderate the relationship between safety net status and advanced use of health IT. Health IT use was common across primary care practices, but advanced use of health IT functionalities ranged only from 30% to 50% use. Safety net settings have kept pace with adoption of features for patient engagement and population management, yet lag in information exchange capabilities compared with nonsafety net practices (odds ratio=0.52 for federally qualified health centers, P<0.001; odds ratio=0.66 for other safety net, P=0.03). However, when safety net practices are members of a health system or practice network, health IT capabilities are comparable to nonsafety net sites. All outpatient settings would benefit from improved electronic health record usability and implementation support that facilitates advanced use of health IT. Safety net practices, particularly those without other sources of centralized support, need targeted resources to maintain equitable access to information exchange capabilities.

Exploring hospital-based health information technology functions for patients with Alzheimer's Disease and related Dementias.

This study investigated whether hospital-adopted health information technology (HIT) is associated with a reduction in the frequency of preventable emergency department (ED) visits for patients with Alzheimer's Disease and Related Dementias (ADRD). We used data from the 2015 State Emergency Department Databases, Area Health Resources File, and the American Hospital Association Annual Survey Information Technology Supplement. We employed multivariable logistic regression models to examine the variation of the likelihood of having preventable ED visits by hospitals' adoption of HIT functions and adjusted for patient, hospital, and county-level factors. We focused on hospital-HIT functions related to patient engagement, routine integration and availability of electronic clinical information, frequency of hospital reported use of electronic patient information, and the provision of electronic notification to the patient's primary care provider. Approximately 23% of ADRD patients went to a hospital that often used electronic records from outside providers, and 75% of ADRD patients went to a hospital that provided electronic notification to the patient's primary care provider. Regression results showed that hospital reported use of electronic patient health information from outside providers (OR=0.88; p<0.001), provision of electronic notification to the patient's primary care physician inside and outside of the system (OR=0.91; p=0.013), and hospital-HIT patient engagement functionalities (OR=0.90; p<0.001) were associated with significantly lower preventable ED visit rates. The results of our study suggest that certain types of HIT functionalities may be useful for reducing preventable ED visits for ADRD patients.

Exploring and Overcoming the Challenges Primary Care Practices Face with Care Management of High-Risk Patients in CPC+: a Mixed-Methods Study.

Longitudinal care management (LCM) for high-risk patients is a cornerstone of primary care models aiming to improve quality and reduce costs. Describe the extent to which LCM was implemented in the second year of Comprehensive Primary Care Plus (CPC+), and barriers to and facilitators of implementation. Mixed-methods. Quantitative: 2715 practices participating in CPC+ in 2018. Qualitative: Interviews with practitioners and staff in 23 representative CPC+ practices. Across all CPC+ practices, we report median percentages of empaneled patients placed in the highest-risk tiers and, of those, the median percentage receiving LCM. Across 23 CPC+ practices, we report qualitative findings on LCM implementation. While practices reported benefits of LCM, a small proportion of patients received LCM. Practices placed 2.4% (median) of patients in the highest-risk tier; of these, 30% (median) received LCM. Practices placed 10% (median) of patients in the second-highest-risk tier; of these, 7% (median) received LCM. Interviews revealed LCM uptake across tiers was low because of insufficient care manager staffing. Other challenges included lack of practitioner buy-in to using risk stratification to identify high-risk patients, patients' reluctance to engage in LCM or change behaviors, and limited health information technology functionality for developing, maintaining, and accessing high-risk patients' care plans. Facilitators included embedding care managers within practices and electronic health record functionalities that support LCM. Despite substantial financial and other supports, and practices' perceived benefits of LCM, insufficient care manager staffing and other barriers have limited its potential in CPC+ to date. To expand LCM's reach, practices need additional care managers, training to overcome barriers to patient engagement, better identification of patients who might benefit from LCM, improved information technology tools for risk stratification and care plans, and more practitioner buy-in to risk stratification.

Health information technology for ambulatory care in health systems.

The adoption and use of health information technology (IT) by health systems in ambulatory care can be an important driver of care quality. We examine recent trends in health IT adoption by health system-affiliated ambulatory clinics in the context of the federal government's Meaningful Use and Promoting Interoperability programs. We analyzed a national sample of 17,861 ambulatory clinics affiliated with 1711 health systems, using longitudinal data (2014-2016) from the HIMSS Analytics annual surveys. We used descriptive analyses and linear probability models to examine the adoption of electronic health records (EHRs), as well as 16 specific functionalities, at the clinic level and the system level. We compared the differential trends of adoption by various characteristics of health systems. We find that the adoption of an EHR certified by the Office of the National Coordinator for Health IT (ONC) increased from 73% to 91%. However, in 2016, only 38% of clinics reported having all 16 health IT functionalities included in this study. Small health systems lag behind large systems in ambulatory health IT adoption. Patient-facing functionalities were less likely to be adopted than those oriented toward physicians. Health information exchange capabilities are still low among ambulatory clinics, pointing to the importance of the ONC's recent Promoting Interoperability initiative. The relatively low uptake of health IT functionalities important to care improvement suggests substantial opportunities for further improving adoption of ambulatory health IT even among the current EHR users.

Development and piloting of a software tool to facilitate proactive hazard and risk analysis of Health Information Technology.

Health Information Technology is now widely promoted as a means for improving patient safety. The technology could also, under certain conditions, pose hazards to patient safety. However, current definitions of hazards are generic and hard to interpret, particularly for large Health Information Technology in complex socio-technical settings, that is, involving interacting clinical, organisational and technological factors. In this article, we develop a new conceptualisation for the notion of hazards and implement this conceptualisation in a tool-supported methodology called the Safety Modelling, Assurance and Reporting Toolset (SMART). The toolset aims to support clinicians and engineers in performing hazard identification and risk analysis and producing a safety case for Health Information Technology. Through a pilot study, we used and examined the toolset for developing a safety case for electronic prescribing in three acute hospitals. Our results demonstrate the ability of the approach to ensure that the safety evidence is generated based on explicit traceability between the clinical models and Health Information Technology functionality. They also highlight challenges concerning identifying hazards in a consistent way, with clear impact on patient safety in order to facilitate clinically meaningful risk analysis.

The role of accountable care organization affiliation and ownership in promoting physician practice participation in quality improvement collaboratives.

Quality improvement collaboratives (QICs) have emerged as an important strategy to improve processes and outcomes of clinical care through interorganizational learning. Little is known about the organizational factors that support or deter physician practice participation in QICs. The aim of this study was to examine organizational influences on physician practices' propensity to participate in QICs. We hypothesized that practice affiliation with an accountable care organization (ACO) and practice ownership by a system or community health center (CHC) would increase the propensity of physician practices to participate in a QIC. Data from the third wave of the National Study of Physician Organizations, a nationally representative sample of medical practices (n = 1,359), were analyzed. Weighted multivariate regression analyses were estimated to examine the association of ACO affiliation, ownership, and QIC participation, controlling for practice size, health information technology capacity, public reporting participation, and practice revenue from Medicaid and uninsured patients. The Sobel-Goodman Test was used to explore the extent to which practice use of quality improvement (QI) methods such as Lean, Six Sigma, and use of plan-do-study-act cycles mediates the relationship between ACO affiliation and QIC participation. Only 13.6% of practices surveyed in 2012-2013 participated in a QIC. In adjusted analyses, ACO affiliation (odds ratio [OR] = 1.51, p < .01), CHC ownership (OR = 6.57, p < .001), larger practice size (OR = 14.72, p < .001), and health information technology functionality (OR = 1.15, p < .001) were positively associated with QIC participation. Practice use of QI methods partially mediated (13.1%-46.7%) the association of ACO affiliation with QIC participation. ACO-affiliated practices are more likely than non-ACO practices to participate in QICs. Practice size rather than system ownership appears to influence QIC participation. QI methods often promoted and used by health care systems such as CHCs and ACOs may promote QIC participation.

Enhancing Health IT Functionality for Children: The 2015 Children's EHR Format.

Electronic health record (EHR) use throughout the United States has advanced considerably, but functionality to support the optimal care of children has been slower to develop and deploy. A previous team of experts systematically identified gaps in EHR functionality during collaborative work from 2010 to 2013 that produced the Children's EHR Format (Format), funded under the Children's Health Insurance Program Reauthorization Act of 2009, Public Law 111-3. After that, a team of practitioners, software developers, health policy leaders, and other stakeholders examined the Format's exhaustive list of 547 EHR functional requirements in 26 topic areas and found them to be valuable but in need of further refinement and prioritization. Work began in 2014 to develop a shortened high priority list of requirements and provide guidance to improve their use. Through a modified Delphi process that included key document review, selection criteria, multiple rounds of voting, and small group discussion, a multistakeholder work group identified and refined 47 items on the basis of earlier requirements to form the 2015 Children's EHR Format Priority List and developed 16 recommended uses of the Format. The full report of the Format enhancement activities is publicly available. In this article, we aim to promote awareness of these high priority EHR functional requirements for the care of children, sharpen industry focus on adopting these changes, and align all stakeholders in prioritizing specific health information technology functionalities including those essential for well-child preventive care, medication management, immunization tracking, and growth data for specific pediatric subgroups.

The Exnovation of Chronic Care Management Processes by Physician Organizations.

Policy Points The rate of adoption of chronic care management processes (CMPs) by physician organizations has been fairly slow in spite of demonstrated effectiveness of CMPs in improving outcomes of chronic care. Exnovation (ie, removal of innovations) by physician organizations largely explains the slow population-level increases in practice use of CMPs over time. Expanded health information technology functions may aid practices in retaining CMPs. Low provider reimbursement by Medicaid programs, however, may contribute to disinvestment in CMPs by physician organizations. Exnovation is the process of removal of innovations that are not effective in improving organizational performance, are too disruptive to routine operations, or do not fit well with the existing organizational strategy, incentives, structure, and/or culture. Exnovation may contribute to the low overall adoption of care management processes (CMPs) by US physician organizations over time. Three national surveys of US physician organizations, which included common questions about organizational characteristics, use of CMPs, and health information technology (HIT) capabilities for practices of all sizes, and Truven Health Insurance Coverage Estimates were integrated to assess organizational and market influences on the exnovation of CMPs in a longitudinal cohort of 1,048 physician organizations. CMPs included 5 strategies for each of 4 chronic conditions (diabetes, asthma, congestive heart failure, and depression): registry use, nurse care management, patient reminders for preventive and care management services to prevent exacerbations of chronic illness, use of nonphysician clinicians to provide patient education, and quality of care feedback to physicians. Over one-third (34.1%) of physician organizations exnovated CMPs on net. Quality of care data feedback to physicians and patient reminders for recommended preventive and chronic care were discontinued by over one-third of exnovators, while nurse care management and registries were largely retained. Greater proportions of baseline Medicaid practice revenue (incidence rate ratio [IRR] = 1.44, p < 0.001) and increasing proportions of revenue from Medicaid (IRR = 1.02, p < 0.05) were associated with greater CMP exnovation by physician organizations on net. Practices with greater expansion of HIT functionality exnovated fewer CMPs (IRR = 0.91, p < 0.001) compared to practices with less expansion of HIT functionality. Exnovation of CMPs is an important reason why the population-level adoption of CMPs by physician organizations has remained low. Expanded HIT functions and changes to Medicaid reimbursement and incentives may aid the retention of CMPs by physician organizations.

Increased Use of Care Management Processes and Expanded Health Information Technology Functions by Practice Ownership and Medicaid Revenue.

Practice ownership and Medicaid revenue may affect the use of care management processes (CMPs) for chronic conditions and expansion of health information technology (HIT). Using a national cohort of medical practices, we compared the use of CMPs and HIT from 2006/2008 to 2013 by practice ownership and level of Medicaid revenue. Poisson regression models estimated changes in CMP use, and linear regression estimated changes in HIT, by practice ownership and Medicaid patient revenue, controlling for other practice characteristics. Compared with physician-owned practices, system-owned practices adopted a greater number of CMPs and HIT functions over time (p < .001). High Medicaid revenue (≥30.0%) was associated with less adoption of CMPs (p < .001) and HIT (p < .01). System-owned practices (p < .001) and community health centers (p < .001) with high Medicaid revenue were more likely than physician-owned practices with high Medicaid revenue to adopt CMPs over time. System and community health center ownership appear to help high Medicaid practices overcome CMP adoption constraints.

Enabling patient-centered communication and care through health information technology

Advances in communication science and developments in health information technology coupled with recent health reform initiatives have created unique opportunities for progressing toward a patient-centered healthcare system in the US. We propose a conceptual framework to describe ways in which patient-centered communication may serve as a critical link in translating health information technology functionality into delivery of patient-centered care. In this context, health information technology may provide the infrastructure for patient-centered communication to enable delivery of patient-centered care. Key aspects of patient-centered communication and health information technology are reviewed and patient-centered care is described as emerging through health information technology-enabled patient-centered communication.

Health Information Technology: An Updated Systematic Review With a Focus on Meaningful Use

Incentives offered by the U.S. government have spurred marked increases in use of health information technology (IT). To update previous reviews and examine recent evidence that relates health IT functionalities prescribed in meaningful use regulations to key aspects of health care. English-language articles in PubMed from January 2010 to August 2013. 236 studies, including pre-post and time-series designs and clinical trials that related the use of health IT to quality, safety, or efficiency. Two independent reviewers extracted data on functionality, study outcomes, and context. Fifty-seven percent of the 236 studies evaluated clinical decision support and computerized provider order entry, whereas other meaningful use functionalities were rarely evaluated. Fifty-six percent of studies reported uniformly positive results, and an additional 21% reported mixed-positive effects. Reporting of context and implementation details was poor, and 61% of studies did not report any contextual details beyond basic information. Potential for publication bias, and evaluated health IT systems and outcomes were heterogeneous and incompletely described. Strong evidence supports the use of clinical decision support and computerized provider order entry. However, insufficient reporting of implementation and context of use makes it impossible to determine why some health IT implementations are successful and others are not. The most important improvement that can be made in health IT evaluations is increased reporting of the effects of implementation and context. Office of the National Coordinator.

Health Information Technology and Hospital Patient Safety: A Conceptual Model to Guide Research

The literature indicates that health information technology (IT) use may lead to some gains in the quality and safety of care in some situations but provides little insight into this variability in the results that has been found. The inconsistent findings point to the need for a conceptual model that will guide research in sorting out the complex relationships between health IT and the quality and safety of care. A conceptual model was developed that describes how specific health IT functions could affect different types of inpatient safety errors and that include contextual factors that influence successful health IT implementation. The model was applied to a readily available patient safety measure and nationwide data (2009 AHA Annual Survey Information Technology Supplement and 2009 Healthcare Cost and Utilization Project State Inpatient Databases). The model was difficult to operationalize because (1) available health IT adoption data did not characterize health IT features and extent of usage, and (2) patient safety measures did not elucidate the process failures leading to safety-related outcomes. The sample patient safety measure--Postoperative Physiologic and Metabolic Derangement Rate--was not significantly related to self-reported health IT capabilities when adjusted for hospital structural characteristics. These findings illustrate the critical need for collecting data that are germane to health IT and the possible mechanisms by which health IT may affect inpatient safety. Well-defined and sufficiently granular measures of provider's correct use of health IT functions, the contextual factors surrounding health IT use, and patient safety errors leading to health care-associated conditions are needed to illuminate the impact of health IT on patient safety.

Clinical Decision Support Tools

Clinical Decision Support Tools

Relationship between information technology functionalities and hospital-acquired injurious fall rates in US acute care hospitals

The purpose of this exploratory study was to determine health information technology functionalities in inpatient care units that were associated with reduced fall risk among adult patients aged 65 years or older in acute care hospitals in the United States. This study compared the differences in the hospital-acquired injurious fall rates for hospitals in California, Florida, and New York with and without fully implemented IT functionalities in their general medical and surgical inpatient units. It used publicly available 2007 datasets, the hospital was the unit of analysis, and teaching and non-teaching hospitals were analyzed separately. Hospital-acquired injurious falls were identified based on fall-related primary and secondary diagnoses and were flagged by the hospitals as not “present on admission” in the 2007 California, Florida, and New York State Inpatient Database data. The 4 health IT functionalities in general medical and surgical inpatient units were 1) electronic clinical documentation, 2) results viewing, 3) computerized provider order entry, and 4) decision support. The research question was What are the effective health IT functionalities in the general medical and surgical units for reducing fall risk among adult patients aged 65 years or older at their hospitals? Independent t tests were used. The results showed that no significant difference was found in the hospital-acquired injurious fall rates between hospitals with and without each of the 4 functionalities and between the teaching hospitals with and without each of the 4 functionalities. Significant differences were found in the injurious fall rates between non-teaching hospitals with and without electronic clinical documentation and result viewing. Future research may focus on assessing the clinicians’ use of the IT functionalities of electronic clinical documentation and results viewing, as well as the effect of the clinicians’ use patterns on patient outcomes.

The effects of health information technology change over time: a study of Tele-ICU functions.

Longitudinal studies exploring the evolution of health information technology functions provide valuable information about how technology systems are integrated and exploited in situ. This study reports changes in the distribution of functions for a specific health information technology, the tele-ICU, over time. The studied tele-ICU provided care to six remote ICUs within a local geographic region in the same state and had nursing staff around the clock. The intervention logs of tele-ICU nurses were collected during two discrete times and coded into nine emergent functional categories, who initiated the intervention and, if required, subsequent escalation. All coded functional categories were investigated for significant changes over time in the nursing logged interventions. A total of 1927 interventions were coded into the nine emergent functional categories. Seven of the nine categories (78%) were significantly different between 2005 and 2007. The functions of the tele-ICU system continue to change and develop over time. These findings suggest that the tele-ICU increased support when ICU nurses were off the unit, inter-hospital coordinating and adherence to best practices, while simultaneously decreasing real-time support for ICU nurses. This research suggests that sustaining safety features in a new technology over time have post-conditions after implementation.