Clinical Information Technology Research Articles

Challenges and opportunities in achieving secure hospital clinical mobility management: An illustrative use case

Objective: To qualitatively describe a use case at Yale New Haven Health System (YNHHS) illustrating the need for and effective deployment of innovative technologies to manage an enterprise-owned shared device (EOSD) management program. EOSD management provides clinicians with secure, rapid access to enterprise mobile devices and applications, maintains devices in functional, use ready condition for clinicians, and enables enterprise tracking and reduced loss of devices.Methods: Executive leaders in clinical information technology and informatics management at YNHHS were interviewed through written and telephonic communication. Qualitative data was gathered through communications between clinical and information technology executives and the implementation support team of a leading identity and access management (IAM) solutions and EOSD management solution provider. Use case information was gathered, integrated and shared with health system executives and health IT/informatics leaders to verify the description of unmet needs, solution objectives and impact/value delivered after implementation of the EOSD management solution.Results: Benefits realized from implementation of an enterprise-shared mobility management solution included establishment of a cohesive and comprehensive enterprise-owned, shared device management strategy. This included effective monitoring and dynamic management of the system’s mobile device fleet, and better IT resource management with reduced mobile device loss. The IT administrative burden was reduced. While not surveyed systematically, improved clinician experience and satisfaction were reported to IT leaders anecdotally. EOSD management solution deployment was rapid, as was the time to improved clinician mobile experience and clear demonstration of value.Conclusions: A leading US health system was able to rapidly deploy a shared mobile device management solution that enabled effective monitoring and dynamic management of the enterprise mobile device fleet, with easier and faster clinician device access and workflows, and reduced IT administrative demand and costs. While the complexities associated with increased clinical mobility in healthcare will likely continue to grow, issuing future device and mobile management challenges that require effective hospital system response, technologies have emerged that enable more effective, efficient and satisfactory organizational mobility performance.

Survey of Laboratory Medicine's national response to the HSE cyberattack in the Republic of Ireland.

On Friday 14 May 2021, the Health Service Executive (HSE) was subjected to a serious cyberattack on their information technology (IT) infrastructure. Healthcare workers lost access to HSE-provided clinical and non-clinical IT systems, including laboratory systems. The aim of this national survey was to capture Laboratory Medicine's response across the Republic of Ireland during the HSE cyberattack. An electronic survey developed using Microsoft Forms® was emailed on 24 September 2021 to 58 local representatives of the PeriAnalytic and Laboratory Medicine Society (PALMSoc). The survey was sent to 43 clinical laboratories across the Republic of Ireland. A total of 41 responses from 43 laboratories across all laboratory disciplines were received (95% response rate). From these, 55% did not have access to a functioning LIS, with 56% of these not having access to a LIS for greater than 2weeks. A decrease in specimen requests received during this period was reported by 74% of laboratories, with 32% experiencing a reduction that lasted in excess of one month. Over half of the laboratories (55%) experienced a reduction of > 30% in requests, indicating that clinicians stopped investigating patients (87% reduction in primary care), further escalating the disruption to healthcare. The cyberattack burdened the HSE and laboratories at a time when healthcare staffs were coming to terms with the impact of the COVID-19 pandemic. Despite this, the survey confirms the agility of laboratory staff in meeting the demands placed on it during this time.

21st Century Cures Act ONC Rule: Implications for Adolescent Care and Confidentiality Protections

Ensuring the confidentiality and protection of health information is the standard of care for adolescents. In 2023 and beyond, the protection of personal health information is more critical than ever. The 21st Century Cures Act Office of the National Coordinator for Health Information Technology Rule, with its requirements for the broad sharing of electronic health information and ban on "information blocking," poses serious concerns for confidentiality in adolescent health care delivery. The coronavirus disease 2019 pandemic has rapidly increased the use of telehealth and, thereby, patient portal use for adolescent health records, increasing risks for disclosure. Understanding the legal and clinical underpinnings for confidential adolescent health services and the clinical challenges and health information technology limitations presented by the Office of the National Coordinator for Health Information Technology Rule is key to providing quality adolescent health services while implementing the Rule. A framework is presented to facilitate decision-making in individual cases by clinicians.

Imaging in Healthcare: A Glance at the Present and a Glimpse Into the Future.

The utilization of artificial intelligence (AI) applications in medical imaging relies heavily on imaging informatics. That is a one-of-a-kind professional who works at the crossroads of clinical radiography, data science, and information technology. Imaging informaticians are becoming crucial players in expanding, assessing, and implementing AI in the medical setting. Teleradiology will continue to be a cost-effective healthcare facility that expands. Vendor neutral archive (VNA) isolates image presentation and storing systems, permitting platforms to develop quickly, and is a repository for organization-wide healthcare image data. Efforts are made to incorporate and integrate diagnostic facilities such as radiography and pathology to fulfill the needs and demands of targeted therapy. Developments in computer-aided medical object identification may alter the environment of patient services. Finally, interpreting and processing distinct complex healthcare data will create a data-rich context where evidence-based care and performance development may be driven.

Methodology for the development and application of clinical decisions support information technologies with consideration of civil-legal grounds

Currently, there are no clinical decision support information technologies (CDSIT) that would consider civil-legal grounds when forming a decision for clinicians. Therefore, the design, development, and implementation of CDSIT, which considers civil-legal grounds when forming decisions, are actual problems. Methodology for the development and application of knowledge-driven, rule-based, clinical decisions support information technologies with consideration of civil-legal grounds has been developed, which provides a theoretical basis for developing clinical decisions support information technology with consideration of civil-legal grounds and partial CDSITs regarding the possibility of providing medical services of a certain type. In addition to the conclusion about the possibility or impossibility of providing certain medical services, the developed methodology ensures the presence of all essential terms (from the viewpoint of civil law regulation) in the contract for the certain medical service's provision and/or the data on potential patients for the provision of such a service, as well as minimization of the influence of the human factor when making clinical decisions. It is advisable to evaluate the CDSITs with consideration of civil-legal grounds, developed according to the proposed methodology, from the viewpoint of the correctness of the decisions generated by them, as well as from the viewpoint of their usefulness for clinics. In this paper, experiments with the methodology-based CDSIT regarding the possibility of performing a surrogate motherhood procedure with consideration of civil-legal grounds were conducted. Such experiments showed the correctness of the generated decisions at the level of 97 %. Experiments also demonstrated the usefulness of such IT for clinics from the viewpoint of eliminating adverse legal consequences, as they might arise due to violation or disregard of legal, and moral and ethical norms.

Challenges of Integrating APOL1 Genetic Test Results into the Electronic Health Record.

Integrating genetic test results into the electronic health record (EHR) is essential for integrating genetic testing into clinical practice. This article describes the organizational challenges of integrating discrete apolipoprotein L1 (APOL1) genetic test results into the EHR for a research study on culturally sensitive genetic counseling for living kidney donors. We convened a multidisciplinary team across three institutions (Northwestern University, Northwestern Memorial HealthCare [NMHC], and OHSU Knight Diagnostic Laboratories [KDL]), including researchers, physicians, clinical information technology, and project management. Through a series of meetings over a year between the team and the genetic testing laboratory, we explored and adjusted our EHR integration plan based on regulatory and budgetary constraints. Our original proposal was to transmit results from KDL to NMHC as structured data sent via Health Level Seven (HL7) v2 message. This was ultimately deemed infeasible given the time and resources required to establish the interface, and the low number of samples to be processed for the study (n = 316). We next explored the use of Epic's Care Everywhere interoperability platform, but learned it was not possible as a laboratory test ordered for a research study; even though our intent was to study the APOL1 genetic test result's clinical use and impact, test results were still considered "research results." Faced with two remaining options-downloading a PDF from the KDL laboratory portal or scanning a faxed result from KDL-only a PDF of the APOL1 test result could be integrated into the EHR, reinforcing the status quo. Even with early and ongoing stakeholder engagement, dedicated project management, and funding, unanticipated implementation challenges-especially for research projects-can result in drastic design tradeoffs.

An evaluation of the risk factors associated with implementing projects of health information technology by fuzzy combined ANP-DEMATEL.

Application of a Clinical Information System (CIS) like Electronic Patient Record (EPR), PACS system and CPOE has turned into one of the most important criteria of priorities of health care systems. The aims of the clinical information system include improving the physicians' efficiency level, integrating the caring process, and expanding the fuzzy quality of the services offered to patients. Achievement of these benefits in reality is not an easy task, and there are lots of plans in this field which are doomed to failure. About 50% of the implementation plans of clinical information systems in health care organizations have failed, and this trend is significantly affecting industrial countries. Proper implementation of hospital information systems lies in identifying and assessing the relationships among the most important risk factors of fuzzy. The present study aimed to provide an applicable model for identifying, ranking and evaluating the risk factors associated with projects of clinical information technology in hospitals of Shiraz University of Medical Sciences. This is an applied study which evaluates the risk factors associated with implementation of clinical information technology projects in hospitals of Shiraz Medical Sciences University. The participants consisted of professionals and senior experts of clinical information technology. Fuzzy logic was used in this study. We also applied ANP-DEMATEL combined model with fuzzy procedure to provide the analytic model of the study. According to the study findings, lack of top-executive supports, and unstable organizational environment were the two most important risk factors, while the main organizational factors and technology were also highly important. In addition, the factors associated with technology had the highest influence on the other studied risk factors. Hospital authorities can benefit from this proposed model to reduce the risk of implementing the projects of clinical information technology and improve the success coefficient of the risk of such projects.

Clinical Supervision, Learning Management, and Information Technology on Teacher Performance

Learning innovations in schools occur in the school system, which includes existing components. Among them is the school education system, which consists of curriculum, rules, and organizational management of learning resource centers. Teacher performance can be seen and measured based on the specifications or competency criteria that every teacher must have. This research is included in the category of literature research, namely first, by noting all findings regarding consumption motivation in general in each research discussion obtained in the literature and sources. In the era of digital technology disruption, the idea of learning facilitated by teachers is more related to digital technology because most students are more interested in paying attention to the essential things, so information and communication technology-based learning is needed to support the professionalism of a teacher. The performance of clinical supervision is for the improvement and development of the teaching and learning process in total, such as improving the quality of teacher teaching, fostering the growth of the teaching profession in a broad sense, including the provision of facilities that support the smooth teaching and learning process, improving the quality of teacher knowledge and skills, providing guidance and coaching.

Transitioning EPMA applications in a large multisite teaching hospital

IntroductionUniversity Hospitals of Leicester (UHL) has co-developed and deployed a novel Electronic Prescribing and Medicines Administration (EPMA) application as part of the trust electronic patient record (EPR) programme that meets...

GENESISS 1—Generating Standards for In-Situ Simulation project: a scoping review and conceptual model

BackgroundIn-Situ Simulation (ISS) enables teams to rehearse and review practice in the clinical environment to facilitate knowledge transition, reflection and safe learning. There is increasing use of ISS in healthcare organisations for which patient safety and quality improvement are key drivers. However, the effectiveness of ISS interventions has not yet been fully demonstrated and requires further study to maximise impact. Cohesive programmatic implementation is lacking and efforts to standardise ISS terms and concepts, strengthen the evidence base and develop an integrated model of learning is required. The aim of this study was to explore the current evidence, theories and concepts associated with ISS across all areas of healthcare and develop a conceptual model to inform future ISS research and best practice guidance.MethodsA scoping review was undertaken with stakeholder feedback to develop a conceptual model for ISS. Medline, OpenGrey and Web of Science were searched in September 2018 and updated in December 2020. Data from the included scoping review studies were analysed descriptively and organised into categories based on the different motivations, concepts and theoretical approaches for ISS. Categories and concepts were further refined through accessing stakeholder feedback.ResultsThirty-eight papers were included in the scoping review. Papers reported the development and evaluation of ISS interventions. Stakeholder groups highlighted situations where ISS could be suitable to improve care and outcomes and identified contextual and practical factors for implementation. A conceptual model of ISS was developed which was organised into four themes: 1. To understand and explore why systematic events occur in complex settings; 2.To design and test new clinical spaces, equipment, information technologies and procedures; 3. To practice and develop capability in individual and team performance; 4. To assess competency in complex clinical settings.ConclusionsISS presents a promising approach to improve individual and team capabilities and system performance and address the ‘practice-theory gap’. However, there are limitations associated with ISS such as the impact on the clinical setting and service provision, the reliance of having an open learning culture and availability of relevant expertise. ISS should be introduced with due consideration of the specific objectives and learning needs it is proposed to address. Effectiveness of ISS has not yet been established and further research is required to evaluate and disseminate the findings of ISS interventions.

Innovating in a crisis: a qualitative evaluation of a hospital and Google partnership to implement a COVID-19 inpatient video monitoring program.

ObjectiveTo describe adaptations necessary for effective use of direct-to-consumer (DTC) cameras in an inpatient setting, from the perspective of health care workers.MethodsOur qualitative study included semi-structured interviews and focus groups with clinicians, information technology (IT) personnel, and health system leaders affiliated with the Mount Sinai Health System. All participants either worked in a coronavirus disease 2019 (COVID-19) unit with DTC cameras or participated in the camera implementation. Three researchers coded the transcripts independently and met weekly to discuss and resolve discrepancies. Abiding by inductive thematic analysis, coders revised the codebook until they reached saturation. All transcripts were coded in Dedoose using the final codebook.ResultsFrontline clinical staff, IT personnel, and health system leaders (N = 39) participated in individual interviews and focus groups in November 2020–April 2021. Our analysis identified 5 areas for effective DTC camera use: technology, patient monitoring, workflows, interpersonal relationships, and infrastructure. Participants described adaptations created to optimize camera use and opportunities for improvement necessary for sustained use. Non-COVID-19 patients tended to decline participation.DiscussionDeploying DTC cameras on inpatient units required adaptations in many routine processes. Addressing consent, 2-way communication issues, patient privacy, and messaging about video monitoring could help facilitate a nimble rollout. Implementation and dissemination of inpatient video monitoring using DTC cameras requires input from patients and frontline staff.ConclusionsGiven the resources and time it takes to implement a usable camera solution, other health systems might benefit from creating task forces to investigate their use before the next crisis.

The Effect of Nursing Internships on the Effectiveness of Implementing Information Technology Teaching.

In nursing education, the diversity of clinical scenarios is complex and dynamic, and it is a challenge for nursing students to learn this clinical knowledge in conventional teaching mechanisms. However, integrating information technology into teaching can promote diversity of learning environment. This study aimed to investigate the effectiveness of teaching mechanisms which combined clinical simulation scenario and Information Technology Integrated Instruction. This study applied innovative experimental teaching in medical–surgical and critical care nursing courses for nursing students in their fourth or fifth year at a five-year junior college. Instructional systems design was combined with clinical simulation scenarios and technology to develop multidimensional teaching strategies. Fifth-year students' overall OSCE mean score was considerably higher than that of fourth-year students; specifically, their scores on basic life support and care for subdural hemorrhage varied substantially. Compared with fourth-year students, fifth-year students performed considerably greater on situational awareness. The results of the present study can be used to develop nursing core competencies and improve the clinical care competency of nursing personnel.

Remote Health Monitoring in Clinical Trial using Machine Learning Techniques: A Conceptual Framework.

Monitoring any process is crucial and very necessary, this is to ensure that standard protocols and procedures are strictly adhered to, monitoring clinical trials is not an exception. It is one of the most crucial processes that should be monitored because human subjects are involved. In trying to monitor clinical trial, information and communication technology techniques can be deployed to facilitate the process and hence improve accuracy. This research formulates a new conceptual framework for monitoring clinical trial using Support Vector Machine and Artificial Neural Network classifiers with physiological datasets from a wearable device. The proposed framework prototype consists of data collection module, data transmission module, and data analysis and prediction module. The data analytic and prediction module is the core section of the proposed framework tailored with data analysis. These datasets are preprocessed and transformed and then used to train and test the system, through different experimental analysis including bagging Support Vector Machine (SVM) and Artificial Neural Network (ANN). The outcome of the analysis presents classification into three different categories, such as fit, unfit, and undecided participants. These various classifications are used to determine if a participant should be allowed to continue in the trial or not. This research provides a framework that is useful in monitoring clinical trial remotely, thereby informing the decision-making process of the research team.

Oncology Patients' Experiences With Novel Electronic Patient Portals to Support Care and Treatment: Qualitative Study With Early Users and Nonusers of Portals in Alberta, Canada.

BackgroundWith the current proliferation of clinical information technologies internationally, patient portals are increasingly being adopted in health care. Research, conducted mostly in the United States, shows that oncology patients have a keen interest in portals to gain access to and track comprehensive personal health information. In Canada, patient portals are relatively new and research into their use and effects is currently emerging. There is a need to understand oncology patients’ experiences of using eHealth tools and to ground these experiences in local sociopolitical contexts of technology implementation, while seeking to devise strategies to enhance portal benefits.ObjectiveThe purpose of this study was to explore the experiences of oncology patients and their family caregivers when using electronic patient portals to support their health care needs. We focused on how Alberta’s unique, 2-portal context shapes experiences of early portal adopters and nonadopters, in anticipation of a province-wide rollout of a clinical information system in oncology facilities.MethodsThis qualitative descriptive study employed individual semistructured interviews and demographic surveys with 11 participants. Interviews were audio-recorded and transcribed verbatim. Data were analyzed thematically. The study was approved by the University of Alberta Human Research Ethics Board.ResultsParticipants currently living with nonactive cancer discussed an online patient portal as one among many tools (including the internet, phone, videoconferencing, print-out reports) available to make sense of their diagnosis and treatment, maintain connections with health care providers, and engage with information. In the Fall of 2020, most participants had access to 1 of 2 of Alberta’s patient portals and identified ways in which this portal was supportive (or not) of their ongoing health care needs. Four major themes, reflecting the participants’ broader concerns within which the portal use was occurring, were generated from the data: (1) experiencing doubt and the desire for transparency; (2) seeking to become an informed and active member of the health care team; (3) encountering complexity; and (4) emphasizing the importance of the patient–provider relationship.ConclusionsAlthough people diagnosed with cancer and their family caregivers considered an online patient portal as beneficial, they identified several areas that limit how portals support their oncology care. Providers of health care portals are invited to recognize these limitations and work toward addressing them.

Effectiveness of applying clinical simulation scenarios and integrating information technology in medical-surgical nursing and critical nursing courses

BackgroundTo determine the impact of combining clinical simulation scenario training and Information Technology Integrated Instruction (ITII) on the teaching of nursing skills.Methods120 4th-year students in a nursing program who were enrolled in medical and surgical nursing courses. 61 received innovative instruction (experimental group) and 59 received conventional instruction (control group). The ADDIE model, systematic method of course development that includes analysis, design, development, implementation, and evaluation,was used to build simulation teaching and clinical scenarios and to create and modify objective structure clinical examination (OSCE) scenario checklists for acute myocardial infarction (AMI) care, basic life support and operation of automated external defibrillator (BLS), and subdural hemorrhage (SDH) care. The modified OSCE checklists were assessed for reliability, consistency, and validity. The innovative training included flipped classrooms, clinical simulation scenarios, ITII and blended learning formats.ResultsThe reliability and validity of the OSCE checklists developed in this study were acceptable and comparable or higher than checklists in past studies and could be utilized as an OSCE performance tool. Students in innovative instruction obtained significantly better OSCE performance, lab scores and improvements from the previous year’s grades. Significant differences were found in situational awareness (SA). No strong correlations were found between OSCE scores and clinical internship scores, and no significant differences were found between the groups in overall clinical internship performance.ConclusionsInnovative instruction showed better performance than conventional methods in summative evaluation of knowledge components, OSCE formative evaluation and clinical nursing internship scores, as well as improved situational awareness in nursing students.

Engaging Housestaff as Informatics Collaborators: Educational and Operational Opportunities.

In academic hospitals, housestaff (interns, residents, and fellows) are a core user group of clinical information technology (IT) systems, yet are often relegated to being recipients of change, rather than active partners in system improvement. These information systems are an integral part of health care delivery and formal efforts to involve and educate housestaff are nascent. This article develops a sustainable forum for effective engagement of housestaff in hospital informatics initiatives and creates opportunities for professional development. A housestaff-led IT council was created within an academic medical center and integrated with informatics and graduate medical education leadership. The Council was designed to provide a venue for hands-on clinical informatics educational experiences to housestaff across all specialties. In the first year, five housestaff co-chairs and 50 members were recruited. More than 15 projects were completed with substantial improvements made to clinical systems impacting more than 1,300 housestaff and with touchpoints to nearly 3,000 staff members. Council leadership was integrally involved in hospital governance committees and became the go-to source for housestaff input on informatics efforts. Positive experiences informed members' career development toward informatics roles. Key lessons learned in building for success are discussed. The council model has effectively engaged housestaff as learners, local champions, and key informatics collaborators, with positive impact for the participating members and the institution. Requiring few resources for implementation, the model should be replicable at other institutions.

The Childhood Obesity Data Initiative: A Case Study in Implementing Clinical-Community Infrastructure Enhancements to Support Health Services Research and Public Health.

We describe a participatory framework that enhanced and implemented innovative changes to an existing distributed health data network (DHDN) infrastructure to support linkage across sectors and systems. Our processes and lessons learned provide a potential framework for other multidisciplinary infrastructure development projects that engage in a participatory decision-making process. The Childhood Obesity Data Initiative (CODI) provides a potential framework for local and national stakeholders with public health, clinical, health services research, community intervention, and information technology expertise to collaboratively develop a DHDN infrastructure that enhances data capacity for patient-centered outcomes research and public health surveillance. CODI utilizes a participatory approach to guide decision making among clinical and community partners. CODI's multidisciplinary group of public health and clinical scientists and information technology experts collectively defined key components of CODI's infrastructure and selected and enhanced existing tools and data models. We conducted a pilot implementation with 3 health care systems and 2 community partners in the greater Denver Metro Area during 2018-2020. We developed an evaluation plan based primarily on the Good Evaluation Practice in Health Informatics guideline. An independent third party implemented the evaluation plan for the CODI development phase by conducting interviews to identify lessons learned from the participatory decision-making processes. We demonstrate the feasibility of rapid innovation based upon an iterative and collaborative process and existing infrastructure. Collaborative engagement of stakeholders early and iteratively was critical to ensure a common understanding of the research and project objectives, current state of technological capacity, intended use, and the desired future state of CODI architecture. Integration of community partners' data with clinical data may require the use of a trusted third party's infrastructure. Lessons learned from our process may help others develop or improve similar DHDNs.

The Clinical Engineering–Information Technology Professional Practice Interface

Clarifying the professional roles between clinical engineers and clinical informaticists potentially will reconcile the clinical engineering and information technology divide, yet the applied science of informatics lacks a defined core task relative to engineering design. Presenting a case study about the design and deployment of a clinical decision support system, we define a core task of informatics. Analyzing this case study given the complexity of clinical systems, we conclude that informatics seeks to solve problems at a hierarchical level above clinical engineering. Attention to the systems complexity of solutions to clinical problems is therefore necessary to demarcate roles and responsibilities between the professions.

Effect of Moodle Based Learning on Maternity Nursing Students' Knowledge and Skills Regarding Fundal Assessment During Puerperium

Background: Most postpartum complications are considered preventable if postpartum observation and examination is conducted effectively. Around 216 women died worldwide from 100,000 women due to postpartum complications. Thus, Aim of this research was to investigate effect of Moodle based learning on maternity nursing students' knowledge and skills regarding fundal assessment during puerperium. A Quasi- experimental research design was used. A simple random sample of 80 maternity nursing students was randomly divided into two equal group, namely; Moodle group and traditional group. The study was conducted at Obstetric and Gynecological Nursing clinical training laboratory and information technology laboratory at the Faculty of Nursing, Alexandria University and El-Shatby Maternity University Hospital. Tools: three tools were used: (1) Maternity nursing students' knowledge regarding fundal assessment during puerperium questionnaire, (2) Maternity nursing students' skills regarding fundal assessment during puerperium observational checklist and (3) Maternity nursing students’ satisfaction about using Moodle based learning in performing fundal assessment during puerperium. Results: revealed a statistically significant difference between the study subjects regarding Moodle group in relation to their knowledge and skills immediately, two weeks and two months after teaching sessions. The study concluded that students using Moodle based learning had better knowledge and skills retention than those of the traditional group at all three time periods. It was recommended that replication of the same study in different Egyptian faculties of nursing to introduce the concept of Moodle based learning and explore its importance for undergraduate and postgraduate nursing students.

A Systematic Review of Design Workshops for Health Information Technologies

Background: Design workshops offer effective methods in eliciting end-user participation from design inception to completion. Workshops unite stakeholders in the utilization of participatory methods, coalescing in the best possible creative solutions. Objective: This systematic review aimed to identify design approaches whilst providing guidance to health information technology designers/researchers in devising and organizing workshops. Methods: A systematic literature search was conducted in five medical/library databases identifying 568 articles. The initial duplication removal resulted in 562 articles. A criteria-based screening of the title field, abstracts, and pre-full-texts reviews resulted in 72 records for full-text review. The final review resulted in 10 article exclusions. Results: 62 publications were included in the review. These studies focused on consumer facing and clinical health information technologies. The studied technologies involved both clinician and patients and encompassed an array of health conditions. Diverse workshop activities and deliverables were reported. Only seven publications reported workshop evaluation data. Discussion: This systematic review focused on workshops as a design and research activity in the health informatics domain. Our review revealed three themes: (1) There are a variety of ways of conducting design workshops; (2) Workshops are effective design and research approaches; (3) Various levels of workshop details were reported.