Intuitive Device Research Articles

Integrating automated dispensing cabinets into the medication dispensing process: feedback from the practice in European hospitals

ObjectivesAutomated dispensing cabinets (ADCs) offer improved medication safety, greater efficiency and return on investment. However, integrating ADCs into medication dispensing processes can be challenging in complex hospital environments. This study...

Toward an Intuitive Device for Construction Hazard Recognition Management: Eye Fixation–Related Potentials in Reinvestigation of Hazard Recognition Performance Prediction

Toward an Intuitive Device for Construction Hazard Recognition Management: Eye Fixation–Related Potentials in Reinvestigation of Hazard Recognition Performance Prediction

Introducing the Pi-CON Methodology to Overcome Usability Deficits during Remote Patient Monitoring.

The adoption of telehealth has soared, and with that the acceptance of Remote Patient Monitoring (RPM) and virtual care. A review of the literature illustrates, however, that poor device usability can impact the generated data when using Patient-Generated Health Data (PGHD) devices, such as wearables or home use medical devices, when used outside a health facility. The Pi-CON methodology is introduced to overcome these challenges and guide the definition of user-friendly and intuitive devices in the future. Pi-CON stands for passive, continuous, and non-contact, and describes the ability to acquire health data, such as vital signs, continuously and passively with limited user interaction and without attaching any sensors to the patient. The paper highlights the advantages of Pi-CON by leveraging various sensors and techniques, such as radar, remote photoplethysmography, and infrared. It illustrates potential concerns and discusses future applications Pi-CON could be used for, including gait and fall monitoring by installing an omnipresent sensor based on the Pi-CON methodology. This would allow automatic data collection once a person is recognized, and could be extended with an integrated gateway so multiple cameras could be installed to enable data feeds to a cloud-based interface, allowing clinicians and family members to monitor patient health status remotely at any time.

Feeling the breeze? Ventilation practices and occupant requirements for mechanical ventilation in residential buildings

The progression of climate change and the resulting need for improved energy efficiency, as well as the impact of the COVID-19 pandemic, have drawn attention to the importance of understanding ventilation practices and mechanical ventilation systems in residential buildings. The technical requirements for ventilation systems typically consider the energy efficiency of ventilation systems as the most important criterion. However, previous research has indicated a discrepancy between the necessary ventilation practices to maximize the technical performance of mechanical ventilation systems and the actual behavior of occupants. In this mixed-methods study, indoor climate needs, natural ventilation practices and occupants' requirements for mechanical ventilation were examined using qualitative interviews and an online questionnaire survey carried out in the German population (N = 952). Three main findings were identified: First, our results imply that ventilation practices vary among occupants and are influenced by situational, habitual, and goal-directed factors. Second, while our sample demonstrated a range of perceptions on optimal indoor climate and ventilation practices, we identified some shared prompts and strategies across four groups. Third, occupants highly valued quiet mechanical ventilation devices that provide fresh air and filter particles, while also maintaining control over window opening. The results for system requirements partially differed according to socio-demographic variables, e.g. older occupants valued comprehensible and intuitive devices more than younger respondents. We therefore conclude that it is essential to consider occupant needs and preferences in the design and implementation of mechanical ventilation systems to optimize their operation for optimal energy efficiency.

Advanced User Interfaces for Teleoperated Surgical Robotic Systems

AbstractIn recent years, advances in modern technology have altered the practice of surgery from open to minimally invasive surgery (MIS) aided by robots. Teleoperated surgical robotic systems (TSRSs) provide numerous significant benefits for MIS over traditional approaches, including improved safety, more efficient and precise surgery, better cosmesis, shorter recovery time, and reduced postoperative pain. Existing TSRSs’ master consoles, with improvements in vision systems, designs, and control methods, have significantly enhanced human–robot interactions, resulting in safer and more accurate medical intervention operations. Despite advances, haptic technologies, including sensors, machine assistance, and intuitive devices for user interfaces, are still limited, resulting in less effective usage of TSRSs for surgical operations. This review presents a summary of the emerging TSRSs with a focus on their user interfaces. In addition, advanced sensing, haptic, smart garments, and medical image artificial intelligence (AI) assistance technologies are shown with their potential for use in master consoles of the TSRSs are shown. Finally, a discussion on the need for a smart human‐robot interface for TSRSs is given.

Self-Assembly at a Macroscale Using Aerodynamics

Intuitive self-assembly devices are of great significance to the emerging applications of self-assembly theory. In this paper, a novel intuitive device with an aerodynamic system is fabricated for the self-assembly experiment. Table tennis balls were used as the objects to be assembled during the self-assembly process. To understand more about the system, two experiments were designed—the directed assembly experiment was conducted to organize a specific structure and to explore the influences of environmental variables, and the indirect assembly experiment repeated with the “bottom-up” self-organization process and expressed the characteristics of “the optimization” and “the emergence” in the self-organization process. This article expressed a novel self-assembly approach at a macroscale and created a new choice or idea for the structural design and the optimization method.

Research Trends of Human-Computer Interaction Studies in Construction Hazard Recognition: A Bibliometric Review.

Human–computer interaction, an interdisciplinary discipline, has become a frontier research topic in recent years. In the fourth industrial revolution, human–computer interaction has been increasingly applied to construction safety management, which has significantly promoted the progress of hazard recognition in the construction industry. However, limited scholars have yet systematically reviewed the development of human–computer interaction in construction hazard recognition. In this study, we analyzed 274 related papers published in ACM Digital Library, Web of Science, Google Scholar, and Scopus between 2000 and 2021 using bibliometric methods, systematically identified the research progress, key topics, and future research directions in this field, and proposed a research framework for human–computer interaction in construction hazard recognition (CHR-HCI). The results showed that, in the past 20 years, the application of human–computer interaction not only made significant contributions to the development of hazard recognition, but also generated a series of new research subjects, such as multimodal physiological data analysis in hazard recognition experiments, development of intuitive devices and sensors, and the human–computer interaction safety management platform based on big data. Future research modules include computer vision, computer simulation, virtual reality, and ergonomics. In this study, we drew a theoretical map reflecting the existing research results and the relationship between them, and provided suggestions for the future development of human–computer interaction in the field of hazard recognition from a practical perspective.

Is Cluster Analysis the Appropriate Statistical Method for Planning the Optimal Locations for Automated External Defibrillators?

Abstract The Automated External Defibrillator (AED) is an intuitive device used by witnesses of an incident without medical training in cases of sudden cardiac arrest. Its operation consists in delivering an electrical pulse to the cardiac conduction system, as a result of which normal heart rate is restored. The lack of awareness in society concerning the usefulness of the device and the inadequate deployment of AEDs result in their too infrequent application by witnesses of incidents. The aim of this paper is to verify whether cluster analysis is the appropriate statistical method to determine the appropriate deployment of AED devices on the basis of cases of sudden cardiac arrest in out-of-hospital conditions. The initial cluster analysis showed the validity of using the method in question for planning the appropriate locations of AEDs.

A Gesture-based Recognition System for Augmented Reality

With the geometrical improvement in Information Technology, current conventional input devices are becoming increasingly obsolete and lacking. Experts in Human Computer Interaction (HCI) are convinced that input devices remain the bottleneck of information acquisition specifically in when using Augmented Reality (AR) technology. Current input mechanisms are unable to compete with this trend towards naturalness and expressivity which allows users to perform natural gestures or operations and convert them as input. Hence, a more natural and intuitive input device is imperative, specifically gestural inputs that have been widely perceived by HCI experts as the next big input device. To address this gap, this project is set to develop a prototype of hand gesture recognition system based on computer vision in modeling basic human-computer interactions. The main motivation in this work is a technology that requires no outfitting of additional equipment whatsoever by the users. The gesture-based had recognition system was implemented using the Rapid Application Development (RAD) methodology and was evaluated in terms of its usability and performance through five levels of testing, which are unit testing, integration testing, system testing, recognition accuracy testing, and user acceptance testing. The test results of unit, integration, system testing as well as user acceptance testing produced favorable results. In conclusion, current conventional input devices will continue to bottleneck this advancement in technology; therefore, a better alternative input technique should be looked into, in particularly, gesture-based input technique which offers user a more natural and intuitive control.

MS16.02 Robotic Bronchoscopy: Driveless IP?

Introduction: Robotic bronchoscopy has been developed in response to challenges which face bronchoscopists in the diagnosis of peripheral pulmonary nodules. Further, such nodules are increasingly presented to bronchoscopists because of CT screening programs, and a general increase in the performance of chest CT in the community with resultant incidental detection of small nodules. Two platforms have undergone preliminary lab evaluations followed by in-human feasibility and safety studies. These are the Auris system and the Intuitive surgical system and the results of these studies are now published (1,2). Both have since had FDA approval and are undergoing post- marketing multicentre studies, the first as the Monarch system, the second as the Ion system. The challenges facing bronchoscopists are 1. The small size of nodules, 2. The peripheral nature of the nodules requiring small calibre scopes to reach them, 3. The complex anatomic pathways to reach them, and 4. The position of the nodules in relation to the airway, with many being “extrinsic” to the bronchus, making biopsy sampling difficult. Robotic bronchoscopy seeks to answer these challenges by integrating an array of components incorporating small size of the distal scope, excellent manoeuvrability of the distal end of the scope, real time display of CT-derived navigational assistance, and biopsy channel size in the distal end of the scope to allow good quality samples. Methods: The robotic aspect of the systems means robotic arms (2 with Auris and 1 with Intuitive) drive the scope into the airway under the direction of a physician operated console, as opposed to the hands of a physician holding the scope and advancing and directing the scope. Important in this regard is the system is not “automatic”, meaning the physician is in control of the device at all times, directing the scope into pre-planned airways under direct vision provided by the system. The robotic aspect of the devices means that the driving and directing of the scope are much more precise and not prone to slipping out of airways between biopsy attempts, reducing the need to re-navigate back to a nodule. The main difference in the systems relates to the design of the catheter (Figs 1 and 2). The Auris system has a telescoping end, with a scope extending out of an outer sheath, while the Intuitive scope has a single catheter, within which a removable optic can be removed to allow deployment of biopsy instruments. Figure 1: Distal end of the Auris system incorporating a sheath (light blue) and an inner bronchoscope (dark blue). The outer sheath(6mm) is wedged in a segmental bronchus, then the inner bronchoscope (4.2mm) is advanced to the distal airways. Figure 2. The distal catheter tip of the Intuitive system (outer diameter 3.4mm), showing accompanying shape sensing image which is displayed real time, providing continuous position feedback. Results: The Auris study reported 15 patients, and the Intuitive study 29 patients, mean lesion size 26mm (1.0-6.3) and 12.2 ± 4.2 mm respectively. Bronchus was sign was absent in all cases with Auris (predefined) whereas 44% were bronchus sign absent in the Intuitive study. All patients were intubated and the procedure performed under general anaesthesia. Most patients were discharged the same day. Both systems reported no adverse events from the device itself. One SAE was reported in the Intuitive study which was an anaesthetic complication related to use of muscle relaxants from which there were no long term sequelae. Successful navigation to the nodule was made in 14 of 15 and 28 of 29 patients respectively. EBUS Guide sheath confirmation was allowed just before biopsy in the Intuitive study but not the Auris study. The devices allowed multiple samples to be taken quickly; the use of needle sampling was common in the Intuitive study because of the nature of the extrabronchial lesions. Malignancy was confirmed in 7 of 9 cases with the Auris device and 13 of 15 cases with the Intuitive device. Conclusions: Robotic bronchoscopy offers unique capability for a proceduralists in combing excellent navigation with thin scopes and stability at the biopsy tip. These early results of sampling difficult nodules need to be followed up in multicentre studies, but suggest a significant potential in dealing with small peripheral nodule biopsy. Further the large size of the biopsy channels and the stability of the tip of the instruments due to the robotics could allow further evaluation of these devices to permit endolumenal therapies for small peripheral lung cancers.

Gait Phase Identification During Level, Incline and Decline Ambulation Tasks Using Portable Sonomyographic Sensing.

Clinical viability of powered lower-limb assistive devices requires reliable and intuitive control strategies. Stance and swing are the main phases of the gait cycle across different locomotion tasks. Hence, a reliable method to accurately identify these phases can decrease sensing complexity and assist in enabling high-level control of assistive devices. Ultrasound (US) imaging has recently been introduced as a new sensing modality that may provide a solution for intuitive device control. US images of the rectus femoris and vastus intermedius muscles were collected in humans during level, incline, and decline ambulation tasks. Five low-level static (i.e. time-independent) features of US images were measured with respect to a reference image, including correlation coefficient, sum of absolute differences, structural similarity index, sum of squared differences, and image echogenicity. Time-derivatives of the static features were also calculated as temporal features. Support vector machine classifiers were trained using these static features to identify the gait phase both dependent and independent of the ambulation tasks. The results indicate an accuracy of 88.3% in identifying the gait phases for task-independent classifiers when trained using only the static features. Performance of the classifiers improved significantly to 92.8% after using the temporal features (p $\lt0.01)$. The algorithm was efficient and the average processing speed was faster than 100 Hz. This study is the first demonstration on use of US imaging to provide continuous estimates of ambulation phase, and on multiple surfaces. These findings suggest task-independent approaches may reliably identify the main phases of the gait cycle. Advancements in this area of study may provide simpler intuitive strategies for high-level assistive device control and increase their clinical relevance.

Performance Projections for Two-dimensional Materials in Radio-Frequency Applications

Two-dimensional (2D) materials are attractive candidates for high-frequency electronic devices, due to their appreciable band gaps and high carrier mobilities and low effective masses. Using a well-calibrated ballistic quantum transport simulator along with simple, intuitive device physics, this study analyzes a large set of 2D materials for rf performance and its dependence on both intrinsic (material) and extrinsic (device) parameters. Phosphorene stands out as the best 2D material in this context. This work not only guides the choice of materials for rf transistors, but also highlights the device parameters critical to experimentally realizing high rf performance.

Introducing a Virtual Assistant to the Lab: A Voice User Interface for the Intuitive Control of Laboratory Instruments.

The introduction of smart virtual assistants (VAs) and corresponding smart devices brought a new degree of freedom to our everyday lives. Voice-controlled and Internet-connected devices allow intuitive device controlling and monitoring from all around the globe and define a new era of human-machine interaction. Although VAs are especially successful in home automation, they also show great potential as artificial intelligence-driven laboratory assistants. Possible applications include stepwise reading of standard operating procedures (SOPs) and recipes, recitation of chemical substance or reaction parameters to a control, and readout of laboratory devices and sensors. In this study, we present a retrofitting approach to make standard laboratory instruments part of the Internet of Things (IoT). We established a voice user interface (VUI) for controlling those devices and reading out specific device data. A benchmark of the established infrastructure showed a high mean accuracy (95% ± 3.62) of speech command recognition and reveals high potential for future applications of a VUI within the laboratory. Our approach shows the general applicability of commercially available VAs as laboratory assistants and might be of special interest to researchers with physical impairments or low vision. The developed solution enables a hands-free device control, which is a crucial advantage within the daily laboratory routine.

인간과 로봇의 효과적인 협동 작업을 위한 로봇 말단 장착형 직관적 교시장치

인간과 로봇의 효과적인 협동 작업을 위한 로봇 말단 장착형 직관적 교시장치

Development and application of a tyrosinase-based time-temperature indicator (TTI) for determining the quality of turbot sashimi

Time-temperature indicators (TTIs) are convenient intuitive devices that are widely used to predict food quality. The aim of this study is to develop a new simple device which can be attached to food packages as a quality indicator for turbot sashimi. In this study, a solid TTI based on the reaction between tyrosinase and tyrosine was developed. The Arrhenius behavior of this enzymatic TTI was studied. The kinetics of the tyrosinase-based TTI was investigated in the form of color change from colorless to dark black induced by the enzymatic reaction. The mathematical formula for the color alterations as a function of time and temperature was established. The longest indication time for the developed TTI was 50 hours at 4°C. The activation energy of the tyrosinase-based TTI was 0.409 kJ mol−1. The suitability of the tyrosinase-based TTI was validated for turbot sashimi using total plate count. The feasibility of using this TTI as a quality indicator for turbot sashimi was assessed based on the activation energy and indication time. Therefore, the tyrosinasebased TTI system developed in this study could be used as an effective tool for monitoring the quality changes of turbot sashimi during the distribution and storage.

Passive wireless tags for tongue controlled assistive technology interfaces.

Tongue control with low profile, passive mouth tags is demonstrated as a human-device interface by communicating values of tongue-tag separation over a wireless link. Confusion matrices are provided to demonstrate user accuracy in targeting by tongue position. Accuracy is found to increase dramatically after short training sequences with errors falling close to 1% in magnitude with zero missed targets. The rate at which users are able to learn accurate targeting with high accuracy indicates that this is an intuitive device to operate. The significance of the work is that innovative very unobtrusive, wireless tags can be used to provide intuitive human-computer interfaces based on low cost and disposable mouth mounted technology. With the development of an appropriate reading system, control of assistive devices such as computer mice or wheelchairs could be possible for tetraplegics and others who retain fine motor control capability of their tongues. The tags contain no battery and are intended to fit directly on the hard palate, detecting tongue position in the mouth with no need for tongue piercings.

Recent advances in robotic surgery for rectal cancer

Robotic technology, which has recently been introduced to the field of surgery, is expected to be useful, particularly in treating rectal cancer where precise manipulation is necessary in the confined pelvic cavity. Robotic surgery overcomes the technical drawbacks inherent to laparoscopic surgery for rectal cancer through the use of multi-articulated flexible tools, three-dimensional stable camera platforms, tremor filtering and motion scaling functions, and greater ergonomic and intuitive device manipulation. Assessments of the feasibility and safety of robotic surgery for rectal cancer have reported similar operation times, blood loss during surgery, rates of postoperative morbidity, and circumferential resection margin involvement when compared with laparoscopic surgery. Furthermore, rates of conversion to open surgery are reportedly lower with increased urinary and male sexual functions in the early postoperative period compared with laparoscopic surgery, demonstrating the technical advantages of robotic surgery for rectal cancer. However, long-term outcomes and the cost-effectiveness of robotic surgery for rectal cancer have not been fully evaluated yet; therefore, large-scale clinical studies are required to evaluate the efficacy of this new technology.

Inhaler Devices: The past, the Present, and the Future

Inhaler handling errors negatively impact asthma control and represent one of the most common challenges in asthma management. Overcoming inhaler handling errors can be achieved by increased awareness of errors, more explicit and consistent training in inhaler use, and development of ‘intuitive’ devices. Clinical studies have shown that dry powder inhalers (DPIs) have better dose consistency and delivery to the lungs, but this is also dependent on device and inhalation technique. In addition, recent clinical studies have demonstrated that Spiromax® is a more intuitive device than Turbuhaler®. In studies analysing patient device mastery, intuitive devices are preferred by patients because they are easy/simple to use and have effective dose delivery.

Abstract 338: Abdominal Fat Suspension Device for Maintaining Normal Cardiorespiratory Function in Obese Patients Undergoing Conscious Sedation During Surgery

Introduction: Obese patients undergoing surgical procedures that require conscious sedation have a heightened risk of perioperative morbidity because their excess abdominal tissue limits diaphragmatic excursion. We describe a simple, intuitive device that may help attenuate this increased risk. Methods: Our abdominal suspension device consists of 4 suction cups that grip onto the abdomen. The cups are attached to a horizontal beam that is supported by a height-adjustable frame anchored to both sides of the operating table. To confirm the efficacy of abdominal suspension for relieving stress on the heart, we tested 30 healthy subjects of normal weight in the supine position. We measured their heart rates with and without a 40-lb tissue model that was placed on the abdomen to simulate the excess abdominal weight seen in obese patients. Results: There was no significant difference in the average blood oxygen saturations before and after weight removal (97.7% vs. 97.5%, respectively; P =0.155). However, the decrease in heart rate was significant [76.2 vs. 68.9 beats/min, respectively, before and after weight removal; P <0.01 ( P =4.36×10 -6 )], implying decreased respiratory effort as determined by a 1-tailed paired t test. Conclusion: By helping to maintain normal cardiorespiratory function in obese patients during surgical procedures requiring conscious sedation, our abdominal suspension device shows great promise for reducing unnecessary cardiac stress and preventing perioperative respiratory complications.

Manipulator handling device for assembly of large‐size panels

PurposeThe purpose of this paper is to introduce a novel device to handle a robot manipulator which can grip large‐size panels. This concept arises from questioning why the glazing task is always performed manually and it is assumed that if the panel is handled by worker's bare hands, the material is lifted by a robot system and can be assembled to a frame easily and intuitively.Design/methodology/approachThis study proposes the intuitive manipulator device (IMD) which can be attached on the panel directly and connected to it with the coordinate of robot end‐effector based on a virtual coordinate of IMD. The virtual coordinate is defined by the detection of the location of the IMD from the robot end‐effector using IR sensor scanning and origin point estimation method. In this study, the robot manipulator system is operated by a combination of the commands of two IMDs to perform the panel assembly test and its aspect of input commands is compared with the previous force‐control based human‐robot cooperative systems.FindingsThe proposed system shows the better performance while reducing the frequent force reflection of robot system against an environment and simplifies the instant input source for robot control system. Those are caused by the intuitiveness of visual servoing performed by operators and the minimization of a force control strategy by utilizing the operator's own sensitivity. The proposed system shows the possibility of efficiency improvement and simple mechatronic system to realize the automation of panel assembly task.Originality/valueThe proposed device alternates the expensive 6‐axis F/T sensor system to handle the robot manipulator by using the two 3‐axis load cell and those force/torque combinations. Also, the developed device is portable and can attach on the material anywhere. That is why this system could cover various sizes of materials. This system minimizes the computational load to control the robot system and improves the efficiency of an assembly task based on the human‐robot cooperation strategy.