Complex Socio-technical Systems Research Articles

Big Research Data Management Needs of Researchers at a Research- Intensive University - A Qualitative Study

Big Research Data Management (BRDM) infrastructure is a complex socio-technical system. The design and provision of effective BRDM services at research universities require a multipronged examination of individual, social, technical, and larger contextual (i.e., campus, state, and national context) aspects of the BRDM infrastructure needs and uses of their users. Although there is a significant body of literature on BRD already, an in-depth, theory-driven examination of researchers’ needs for BRDM services on university campuses and the challenges and hurdles they face in using and managing BRD is lacking. Furthermore, there is a dearth of research on university administrators’ motivation for providing BRD services on their campuses and the hurdles and barriers they face in providing those services.This study aims to contribute to the literature by investigating the BRD-related needs of researchers from different fields and the barriers and challenges to designing and providing such support at a research university. The ongoing Health Data Science Initiative (HDSI) of Florida State University and user interviews are used as the data sources of this study. The study is guided by activity theory to investigate the complex structure of activities and factors that make BRDM infrastructure successful on university campuses.When completed, the study will inform the design of BRDM infrastructure and services on university campuses by providing an evidence base for the perspectives and needs of BRD creators, users, curators, and policymakers. In particular, by understanding the BRDM requirements of researchers, university administrators can provide effective and user-centered BRDM solutions to them.

Reducing Data Uncertainties: Fuzzy Real-Time Safety Level Methodology for Socio-Technical Systems

This paper presents the fuzzy real-time safety level (Fuzzy RealTSL) methodology. It aims to address the data uncertainties resulting from a lack of sensors in complex sociotechnical systems and reduce the need for the determination of their safety level in real-time during their operation. To achieve this, the methodology utilizes: (1) safety constraints from STPA (systems theoretic process analysis) analysis and EWaSAP (early-warning-signs analysis process), (2) fuzzy logic as the mathematical backbone to identify the degree of confidence about the occurrence of unsafe system states, (3) a modified centroid point and spread ordering to enable ordering sequences of unsafe system states that can lead to accidents according to how detrimental they are to the system safety. The RealTSL methodology is presented through its step-by-step application to the panel alignment system of a solar park utilizing rotating solar arrays. This paper aims to open a new perspective on the STAMP literature for discussions of uncertainties from a lack of information about the system’s state and to make it easier to measure its safety level. Knowing the safety level of a system in real-time is crucial for the systems in question as it enables proactive risk management and enhances decision-making by providing immediate insights into potential hazards, thus safeguarding against accidents.

Resilience Metrics for Socio-Ecological and Socio-Technical Systems: A Scoping Review

An increased interest in the resilience of complex socio-ecological and socio-technical systems has led to a variety of metrics being proposed. An overview of these metrics and their underlying concepts would support identifying useful metrics for applications in science and engineering. This study undertakes a scoping review of resilience metrics for systems straddling the societal, ecological, and technical domains to determine how resilience has been measured, the conceptual differences between the proposed approaches, and how they align with the domains of their case studies. We find that a wide variety of resilience metrics have been proposed in the literature. Conceptually, ten different quantification approaches were identified. Four different disturbance types were observed, including sudden, continuous, multiple, and abruptly ending disturbances. Surprisingly, there is no strong pattern regarding socio-ecological systems being studied using the “ecological resilience” concept and socio-technical systems being studied using the “engineering resilience” concept. As a result, we recommend that researchers use multiple resilience metrics in the same study, ideally following different conceptual approaches, and compare the resulting insights. Furthermore, the used metrics should be mathematically defined, the included variables explained and their units provided, and the chosen functional form justified.

Roadmapping Roadmapping: Strategic planning for roadmapping systems

Roadmapping is a well-established technique in the context of innovation and strategy, with the potential to support organizations address the complex transformative challenges facing humanity in the 21st century. This is enabled by its systems-based architecture and visual form of roadmaps, supporting communication and reduction of information asymmetries in complex sociotechnical systems. This paper focuses on an adaptation of the roadmapping method to support strategic planning for roadmapping systems in organizations, addressing implementation challenges. This represents a novel application of roadmapping to business processes and systems, demonstrating the flexibility of the roadmapping approach. A workshop template (‘R2’) and process for supporting the roadmapping of roadmapping systems is presented, developed and refined through a series of six industrial cases, and illustrated with an application example in the additive manufacturing sector.

In situ simulation in the intensive care unit: A phenomenological study of staff experiences.

To explore the experiences of clinical and non-clinical staff in an intensive care unit regarding the perceived benefits and drawbacks of using in situ simulation as a training tool. A descriptive phenomenological qualitative study was conducted among clinical and nonclinical ICU personnel. Simulations and interviews were conducted until data saturation was achieved. The interviews were recorded, transcribed verbatim for analysis, and interpreted using the Colaizzi method. Ten participant interviews generated data saturation. ISS was found to be feasible and beneficial in the ICU, facilitating experiential and emotion-based learning in real-world environments. Eight result categories were identified: simulation benefits, simulation benefits in real conditions, scenario authenticity, interference with usual work, ISS sessions, high-fidelity generating affective bonding, ISS as knowledge reinforcement, and recommendations for improvement. The fundamental structure revealed that ISS is perceived as an authentic and emotionally impactful team simulation modality that promotes experiential learning, reflection, and care improvement opportunities within the complex sociotechnical system of the ICU. All interviewees considered ISS to be a feasible simulation tool that should be implemented in the ICU to improve knowledge and skills, thereby enhancing teamwork.

Identifying system adaptations to overcome technology-based workflow challenges in a telephone triage organization

Call-center-based telephone triage is an example of a complex sociotechnical system relying on successful interactions between patients, callers, and the integration of many digital technologies. Digital technologies such as computer decision support systems are used to standardize triage outcomes with little consideration of how these unique healthcare systems adapt to maintain functionality in response to real-world operating challenges. Using structured observations of call handlers in two call centers and guided by usability heuristics and the concept of ‘workarounds’, this paper aims to investigate the effects of technology design on workflow and system adaptations. Opportunities for improvement are highlighted, particularly, assessment prompts, and updating software to reflect dynamic real-world situations. Interactions between system components, especially technological and organizational processes affected workflow, making adaptations at the individual and organizational levels necessary to ensure callers could be triaged safely. System designers could consider these findings to improve systems and procedures during challenging periods.

Saving resources without sacrificing results: an empirical investigation of the dishwashing reality of British consumers in an international comparison

Abstract Routine household tasks, such as laundry or dishwashing, are complex socio-technical systems in which a variety of factors and actors interact, including manufacturers, technologies, regulators, consumer practices, cultural norms and infrastructures. A deep understanding of these socio-technical systems is necessary to find the right recommendations on how to optimise this system in order to achieve relevant savings in resource consumption without requiring a complete renewal of the infrastructure installed. In our case, we focus on automatic dishwashing in the United Kingdom and try to find out what an optimised consumer use of the dishwashers installed can look like and how many savings can be achieved. Accordingly, we modelled the base of dishwashers installed and conducted a consumer survey on dishwasher usage behaviour in sufficient detail to understand the interplay between the various factors. By simulating a change in usage behaviour, we find a potential energy saving of 21.3 % simply by following basic rules for selecting the appropriate programmes without the risk of a loss of performance.

Defining and characterizing the operational context for human systems integration

AbstractMany efforts from multiple academic and industrial disciplines have studied the notion of context. The systems engineering and human systems integration fields, however, lack a generalized definition and characterization of context, in particular the operational context of complex sociotechnical systems. This paper reviews context definitions and builds a generalized definition of the operational context of complex sociotechnical systems. The objective is then to identify and extract context properties which are often implicit in the literature and do not necessarily appear in the definitions. However, eliciting them is helpful for understanding what context is made of, how it relates to complex sociotechnical systems comprising human and non‐human agents, and how an early understanding of the operational context can prove valuable to designing efficient and robust systems. Our analysis is followed by an example of how our definition and derived properties apply to the case study of the design of a remote and virtual air traffic control center.

Using a digital data analytic tool to capture dynamic change in coordination patterns: An exploratory study of the Apollo 13 mission

The operational environment of complex sociotechnical systems is inherently uncertain, demanding constant coordination restructuring to adapt to dynamic situational demands. However, coordination changes in the Human Factors and Ergonomics Field have primarily been studied using static methods, overlooking moment-by-moment adjustments. In the current study, we address coordination restructuring by using THEME, a digital analytical tool capable of visualising and exploring coordination restructuring from a multi-layered perspective. We examine restructuring in coordination patterns during NASA's Apollo 13 Mission, revealing significant shifts from stable, long-duration ‘coordination hubs' in routine operations to shorter-duration patterns during a crisis situation. Additionally, the results highlight the importance of flexible switching between reciprocal and one-directed coordination, along with enhanced role distribution. This study underscores how exploring temporality-sensitive phenomena like coordination through digital technologies such as THEME, advances our understanding of incident analysis and resilient performance within complex systems.

Inequalities in the production and use of cement and concrete, and their consequences for decarbonisation and sustainable development

Concrete is vital for constructing infrastructure and housing, and cement is the key binding material within concrete. Concrete is an enabler of development, as concrete structures are key to delivering societal services in many sectors. Much recent research on cement and concrete has focussed on technical solutions to decarbonisation; however, there is a knowledge gap around how cement and concrete intersect with other facets of sustainable development. This study explores the intersection of cement and concrete with inequalities, both through their production as commodities and through their use in built assets. An exploratory analysis of this issue was carried out, comprising an evaluation of industry associations’ conceptions of sustainable development and inequalities, an analysis of underlying power dynamics for several inequality issues using Lukes’ three dimensional framework of power, and a reflection on how certain inequalities may pose risks to achieving decarbonisation and sustainable development aims. Our study shows that industry associations’ narratives around sustainable development generally lack a detailed vision for addressing inequalities, in comparison to their focus on decarbonisation. We find that inequalities are a systemic issue for cement and concrete, spanning intra- and inter-national scales, and all three dimensions of power. These findings highlight that several inequalities are consequential from structural, underlying inequalities, whilst other inequalities are specific to the sectors themselves. The cement and concrete sectors are recommended to develop their conception of inequalities in relation to sustainable development: this can help reduce inequalities within their own workforces more effectively, and also reduce the risks of missing their decarbonisation targets. For large, complex socio-technical systems, such as cement and concrete, it is vital for consideration of inequalities to inform strategic planning with regards to decarbonisation and sustainable development.

Unpacking the Complex Socio-Technical Systems Assemblages in Cybersecurity

The ensuing digital transformation means that cybersecurity solutioning increasingly occurs in the context of complex intractable socio-technical systems comprising non-technical elements, including human, social, and societal factors. These evolving cybersecurity ecosystem dynamics, at the confluence of cyber-physical-social spaces, present several challenges to techno-centric cybersecurity solutions including for risk assessment, threat modelling, and incident analysis. This paper unpacks the complexity of the cybersecurity domain and illustrates the associated socio-technical systems assemblages through a case study and situational analysis of a cybersecurity incident. It then reviews socio-technical systems analysis approaches from the safety management domain and discusses the alignment with and relevance for cybersecurity. The utility of these approaches is demonstrated by applying the functional resonance analysis method to the said cybersecurity incident. The situational analysis surfaces the diverse set of factors, including human, non-human, cultural, economic, institutional, and global, that directly played a role in the unfolding of the incident, and which need to be considered in risk assessment and incident analysis. Further, analysing the incident through the functional resonance analysis method shows the functional dependencies and cascade of performance variability between the different elements in this situation, which goes beyond simple, root-cause, linear causality, and purely technical explanations. Overall, the paper explicates the need for cybersecurity risk assessment and incident analysis that is commensurate with the complexity of underlying socio-technical cyber systems.

A taxonomy of factors that contribute to organizational Cybersecurity Awareness (CSA)

Purpose Developing cybersecurity awareness (CSA) is becoming a more and more important goal for modern organizations. CSA is a complex sociotechnical system where social, technical and organizational aspects affect each other in an intertwined way. With the goal of providing a holistic representation of CSA, this paper aims to develop a taxonomy of factors that contribute to organizational CSA. Design/methodology/approach The research used a design science approach including a literature review and practitioner interviews. A taxonomy was drafted based on 71 previous research publications. It was then updated and refined in two iterations of interviews with domain experts. Findings The result of this research is a taxonomy which outline six domains for importance for organization CSA. Each domain includes several activities which can be undertaken to increase CSA within an organization. As such, it provides a holistic overview of the CSA field. Practical implications Organizations can adopt the taxonomy to create a roadmap for internal CSA practices. For example, an organization could assess how well it performs in the six main themes and use the subthemes as inspiration when deciding on CSA activities. Originality/value The output of this research provides an overview of CSA based on information extracted from existing literature and then reviewed by practitioners. It also outlines how different aspects of CSA are interdependent on each other.

A conceptual model for measuring the maturity of an Intelligent Construction Environment

ABSTRACT Construction projects can be regarded as complex sociotechnical systems composed of diverse and dynamically interacting elements. Digital Transformation advancements can support construction companies in creating an environment to cope with complexity and improve performance. Nevertheless, reaching these advantages involves understanding how transformed processes should be managed and measured, such as using maturity assessment tools. The construction industry lacks maturity models encompassing the sector’s main characteristics and focusing on its production context. Therefore, this work proposes a conceptual model for measuring the maturity of an Intelligent Construction Environment from a sociotechnical perspective. Thus, first, the concept of an Intelligent Construction Environment is introduced. Then, based on two empirical studies consisting of 17 interviews and 11 days of on-site data collection, as well as an extensive literature review, 19 measurement dimensions associated with 13 principles and five maturity levels are proposed. This work’s theoretical contributions encompass an in-depth understanding of how the construction industry can be positioned in the digital transformation path from a sociotechnical perspective. Main practical contributions include the proposition of maturity measurement dimensions for an Intelligent Construction Environment, which indicates the aspects construction managers should focus on throughout the digital transformation process of the production environment.

Examining Ethical and Social Implications of Digital Mental Health Technologies Through Expert Interviews and Sociotechnical Systems Theory

This paper aims to understand how science and technology experts working in the digital mental health field interpret the ethical and social implications of its technologies, combining an ‘expert interview’ methodology with insights from sociotechnical systems theory. Following recruitment of experts in science and technology fields who had experience of supporting the development of DMH interventions, 11 semi-structured interviews were conducted and analyzed in accordance with the Framework Method. A single theme of ‘complexity of implications’ is presented here and divided into the categories of ‘implications for users’, ‘implications for healthcare professionals and systems’, and ‘implications for society’. Participants identified a range of ethical and social implications of digital mental health technologies at the three different levels, which this discussion relates to three key aspects of complex sociotechnical systems identified in existing theoretical work. These are ‘heterogeneity’, ‘interdependence’ and ‘distribution’, each of which raises important questions for future research about how complex values, relationships and responsibilities should be negotiated in digital mental health. The paper concludes that this study’s approach provides a model for understanding the implications of digital health more broadly, with participants’ combined experience and knowledge shedding light on key interventions at the forefront of digitalization in healthcare.

Managing Complexity in Socio-Technical Systems by Mimicking Emergent Simplicities in Nature: A Brief Communication.

In the context of socio-technical systems, traditional engineering approaches are inadequate, calling for a fundamental change in perspective. A different approach encourages viewing socio-technical systems as complex living entities rather than through a simplistic lens, which enhances our understanding of their dynamics. However, these systems are designed to facilitate human activities, and the goal is not only to comprehend how they operate but also to guide their function. Currently, we lack the appropriate terminology. Hence, we introduce two principal concepts, simplexity and complixity, drawing inspiration from how nature conceals intricate mechanisms beneath straightforward, user-friendly interfaces.

A novel approach to runway overrun risk assessment using FRAM and flight data monitoring

AbstractRunway overruns (ROs) are the result of an aircraft rolling beyond the end of a runway, which is one of the accident’s types that most frequently occurs on aviation. The risk of an RO arises from the synergistic effect among its precursors, such as unstable approaches, long touchdowns and inadequate use of deceleration devices. To analyse this complex socio-technical system, the current work proposes a customised functional resonance analysis method, called FRAM-FDM, as traditional techniques of risk and safety assessment do not identify the interactions and couplings between the various functional aspects of the system itself, especially regarding human and organisational components. Basically, FRAM-FDM is the coupling of a traditional FRAM with flight data monitoring (FDM) techniques, used here to quantify the variabilities of the flight crew performance while executing the required activity (i.e. the landing). In this proposal, these variabilities (i.e. the FRAM functions aspects) are aggregated by the addend of a logistic regression, resulting in a model to evaluate the flare operations and the brake application profile effect on the remaining distance to the end of the runway, used as a reference to classify the landing as acceptable or not. The present application of the FRAM-FDM assesses the operational risk of a sample fleet in overrunning the runway during landing, highlighting the brake pedal application profile as the most relevant contributor. The model improves the knowledge about the system behaviour, being useful to direct flight crew training.

Towards decision-making support for complex socio-technical system safety assessment: A hybrid model combining FRAM and dynamic Bayesian networks

Effectively managing system safety and resilience in critical infrastructures requires addressing emergent risks and critical resonances. This study introduces a quantitative model that merges Monte Carlo Simulation (MCS) of the Functional Resonance Analysis Method (FRAM) and Dynamic Bayesian Network (DBN) to assess technological, organizational, and human performance variability in complex social-technical systems. FRAM identifies system taxonomy and functional variability, while MCS pinpoints critical coupling, supplying prior probabilities for functional resonance. This information feeds into the DBN, facilitating the modeling of causal relationships and probabilistic inferences regarding risk uncertainties and system resonances. The model underwent rigorous testing and validation on a preheater cyclone system within the cement industry. This process involved the utilization of historical field data gathered from six prominent cement industries and input from thirty subject matter experts. The integrated approach deeply analyzes emerging risk indicators, unveiling interactions within organizational, human, and technical subsets, alongside performance variability. Furthermore, the model incorporates system learning parameters, aiding decision-making under uncertainty. These findings advance system safety and resilience management, offering insights for risk assessment and accident prevention across diverse scenarios in complex socio-technical systems.

Abstract PO5-10-09: Capturing Experiences: Navigating Breast Cancer Treatment of Nigerian Patients and Healthcare Providers Using Qualitative Interviews

Abstract Introduction A notable shift has occurred in medical relationships, placing greater emphasis on the role of patients within the healthcare system. A nascent body of literature in the US captures the experiences of patients following a diagnosis, but this is lacking in Nigeria. We used Systems Engineering Initiative for Patient Safety (SEIPS 2.0) as a theoretical framework from the discipline of human factors that serves as a guide for characterizing complex sociotechnical systems comprised of factors, work processes, and outcomes - with the patient and clinicians at the center. We specifically focused on the patient work network, which refers to individuals and communities that play role in supporting patient work. The objective of this study was to elicit the experiences of Nigerian breast cancer patients and healthcare providers by qualitative interviews and characterize productive and counterproductive activities of the patient work network. Methods The study was approved by the IRB. We used snowball sampling and social media to recruit Nigerian breast cancer patients and health care providers with experience treating breast cancer. One researcher conducted interviews that lasted 30–60 min using teleconferencing technology and an interview guide developed for this study. Questions for both patients and healthcare providers covered topics such as patient response to diagnosis, barriers and facilitators to care including people and communities within the patient’s network. We calculated descriptive statistics for demographics. Using thematic analysis, we carried out the analysis in the following stages: data review, category coding and data extraction, and synthesis and integration of findings. Results We interviewed 18 female patients (29-67 yrs old) and 6 healthcare providers (31-42 yrs old; 3 males). Twelve patients received treatment in urban areas and 6 in rural. Four patients had a bachelor's degree. Healthcare providers included primary, specialty, palliative, treatment, diagnostic care. We highlight a subset of the dataset with focus on productive versus unproductive work conducted by family and by religious community, with unproductive defined as potentially having negative impact on the patient and their experience (Table 1). Providers stated that patients who receive family support exhibit better health outcomes compared to those who do not. Providers shared that religious community can perpetuate patient denial in their diagnosis. Both patients and providers discussed an inclination towards seeking traditional care. Despite recognizing the challenges and pressures faced by patients, providers lacked in-depth understanding of the specific experiences patients encountered. Conclusion Our findings highlight the role of family and religious community in conducting activities that are both productive and unproductive facilitating productive activities and its influence on the decision-making process of patients. Alternatively, both family and religious community engage in activities counterproductive to the patient and their illness. Findings emphasize the importance of comprehensive support systems, education, and targeted interventions to improve the experiences and outcomes of Nigerian breast cancer patients. Effective strategies should address cultural beliefs, empower patients to make informed decisions, and enhance provider knowledge regarding the unique challenges faced by patients within the identified barriers. Table. Productive versus unproductive work conducted by family and by religious community Citation Format: Blessing Nwachukwu, Elizabeth Papautsky. Capturing Experiences: Navigating Breast Cancer Treatment of Nigerian Patients and Healthcare Providers Using Qualitative Interviews [abstract]. In: Proceedings of the 2023 San Antonio Breast Cancer Symposium; 2023 Dec 5-9; San Antonio, TX. Philadelphia (PA): AACR; Cancer Res 2024;84(9 Suppl):Abstract nr PO5-10-09.

El factor humano y la ergonomía en la «seguridad del paciente»

The human condition is linked to error in any activity that is performed, and the healthcare world is no exception. The origin of human error does not lie within the perversity of human nature, instead, it has its origins in latent failures in the healthcare environment and is a consequence of the processes and procedures applied. The science of the Human Factor deals with the application of knowledge to people (capabilities, characteristics and limitations), with the design and the management of the equipment they use and with the environments in which they work and the activities they carry out.Part of the Human Factor are the non-technical skills. These skills greatly influence people's behavior and, therefore, their performance and the quality of healthcare in a very complex socio-technical system.

UNDERSTANDING MEMORY MECHANISMS IN SOCIO-TECHNICAL SYSTEMS: THE CASE OF AN AGENT-BASED MOBILITY MODEL

This paper explores memory mechanisms in complex socio-technical systems, using a mobility demand model as an example case. We simplify a large-scale agent-based mobility model, formulate the corresponding stochastic process, and observe that the mobility decision process is non-Markovian. This is due to its dependence on the system’s history, including social structure and local infrastructure, which evolve based on prior mobility decisions. Complementing the mobility process with two history-determined components leads to an extended mobility process that is Markovian. Although our model is a very much reduced version of the original one, it remains too complex for the application of usual analytic methods. Instead, we employ simulations to examine the functionalities of the two history-determined components. We think that the structure of the analyzed stochastic process is exemplary for many socio-technical, -economic, -ecological systems. Additionally, it exhibits analogies with the framework of extended evolution, which has previously been used to study cultural evolution.