Human Interface Device Research Articles

Abstract 6239: Human computer interface guided approach to accelerate anticancer drug discovery: Application to human estrogen receptor interactome

Abstract Structure-based drug discovery of target specific drugs greatly rely on the existence of high resolution X-ray crystal structure of the target proteins. Flexible and dynamic regions including hinges and loops which constitute major protein-protein interaction sites as well as allosteric sites are often beyond the scope of current tools and techniques available for protein folding and modeling. Human ability in recognizing patterns and to solve complex puzzles are far superior to any existing computer program at folding these atypical regions of proteins. We have utilized an unconventional combination of using dynamic three-dimensional protein models as physical human computer interface (HCI) devices and integrated proteomics data to predict flexible and dynamic protein-protein interfaces and allosteric pockets of key regulatory proteins to accelerate compound discovery. To this end, we have successfully utilized 1) Flexible HCI devices to generate an ensemble of dynamic three dimensional structures which includes a subset of biologically active conformations among others (thereby exploring the viable chemical space) and 2) Structure refinement and efficient filtering of biologically active conformations can be accomplished by integrating protein-protein interface and fold proteomics data. Here we present AI ready, HCI guided exploration of human estrogen receptor interactome and early in vitro confirmatory analyses. AI approachs to predict 3D protein structures from amino acid sequences like AlphaFold are often on par with experimentally generated structures and AI-guided structure prediction or docking approaches have been reported to significantly reduce computer time utilization. Streamlining of HCIguided tools to enable access to dynamic druggable pockets in protein targets will accelerate drug discovery. Citation Format: Rajendram V. Rajnarayanan, Aya Alsabagh. Human computer interface guided approach to accelerate anticancer drug discovery: Application to human estrogen receptor interactome [abstract]. In: Proceedings of the American Association for Cancer Research Annual Meeting 2024; Part 1 (Regular Abstracts); 2024 Apr 5-10; San Diego, CA. Philadelphia (PA): AACR; Cancer Res 2024;84(6_Suppl):Abstract nr 6239.

Photocurable Carbon Nanotube/Polymer Nanocomposite for the 3D Printing of Flexible Capacitive Pressure Sensors.

A photocurable resin/carbon nanotube (CNT) nanocomposite was fabricated from aligned CNTs in an acrylic matrix. The conductivity of the nanocomposite increased rapidly and then stabilized when the CNT content was increased up to and beyond the percolation threshold. Various structures were created using a digital light processing (DLP) 3D printer. Various polymeric dispersants (SMA-amide) were designed and synthesized to improve the CNT dispersion and prevent aggregation. The benzene rings and lone electron pairs on the dispersant interacted with aromatic groups on the CNTs, causing the former to wrap around the latter. This created steric hindrance, thereby stabilizing and dispersing the CNTs in the solvent. CNT/polymer nanocomposites were created by combining the dispersant, CNTs, and a photocurable resin. The CNT content of the nanocomposite and the 3D printing parameters were tuned to optimize the conductivity and printing quality. A touch-based human interface device (HID) that utilizes the intrinsic conductivity of the nanocomposite and reliably detects touch signals was fabricated, enabling the free design of sensors of various styles and shapes using a low-cost 3D printer. The production of sensors without complex circuitry was achieved, enabling novel innovations.

Implementation and Analysis of WiFi Human Interface Device (HID) USB Using ATMEGA32U4 and ESP8266

Advances in technology have resulted in hacking occurring everywhere. Hacking is the act of illegally accessing data and information. It is not uncommon for many hacking cases to harm various parties due to ignorance. The results of hacking at this time are widespread, one of which is a ransomware virus that can encrypt data, a keylogger is software that can monitor keyboard activity, and a WiFi USB human interface device which is where this attack is a virtual keyboard. This research assembles the components used for Human Interface Device (HID) by utilizing ATMEGA32U4 as a virtual keyboard and ESP8266 as WiFi media. This technique is used to obtain target information and data. This research aims to make people more careful and overcome hacking. It is hoped that people will be more concerned about system and data security. Based on the research results, WiFi HID USB attacks can be dangerous for computer owners who need to be more aware of various hacker attacks because this technique can directly take target access.

Improving trace synthesis by utilizing computer vision for user action emulation

Forensic analyses are performed by skilled forensic practitioners who require reliable, state-of-the-art tooling and ongoing training. To provide both, education and academia rely on realistic training datasets. Those datasets are crucial to teaching investigators, validating forensic tools, advancing algorithms, and pursuing research. At the same time, the forensic community faces a shortcoming of realistic datasets, mainly due to ethical and legal reasons. To overcome this challenge, prior work introduced several frameworks aiming to create unproblematic replications of real evidence. Those frameworks generate synthetic datasets by populating disk images with traces of emulated user behavior. However, it is general consent that existing frameworks have some drawbacks concerning the quality of generated datasets, particularly due to the incorporation of unrealistic traces in GUI-based environments. Reviewing the implementation details of common frameworks, we found that current solutions miss realistic trace synthesis, reducing the quality and usefulness of synthesized datasets.By leveraging computer vision, this paper introduces a novel approach aiming to enhance the quality of synthetic datasets. We propose an architecture and provide an open-source implementation utilizing a hypervisor for creating Human Interface Device (HID) input, which is controlled by computer vision algorithms to imitate human-like user actions. In this way, we provide external GUI automation capabilities that enable more realistic trace synthesis than existing solutions and open up the applicability to a wide range of GUI-based operating systems. In contrast to previous research results, our approach is independent of software running in virtual machines, further optimizing the quality of generated datasets by omitting automation artifacts. Our experiments indicate that using external GUI automation for user action emulation results in a greater amount and a more widespread distribution of traces. Therefore our approach may refine the quality of datasets in this field.

Prevention of code injection from Human Interface Device (HID)

Prevention of code injection from Human Interface Device (HID)

Development of an MUM-T Integrated Simulation Platform

In this paper, we present a platform that can simulate Manned-UnManned Teaming (MUM-T) situations using various hardware and software being integrated. MUM-T, which combines unmanned aerial vehicles (UAVs) with an existing manned vehicle (MV), is growing into an indispensable strategy thanks to enormous advantages it provides. In order to test this indispensable strategy which involves flight control algorithms being applied for various MUM-T situations, it is certainly needed to run and evaluate three-dimensional (3D) MV-UAVs combined simulations in realistic environments. However, there is no such simulator that enables such 3D MUM-T simulations as well as the Human Interface (HI) for both MV pilot and the mission manager at a ground station. In this paper, we propose an MUM-T integrated simulation platform (MUM-T ISP) that combines a single full-scale helicopter simulator (for MV simulation) and multiple Iris/PX4-Autopilot (for UAVs simulation), along with specially developed HI devices (TM and TV). Tactical Monitor (TM), one of the HI devices, is a touchable tablet which allows the MV pilot to interact with UAVs by simple actions (e.g. touching a button), and the other HI device called Tactical Viewer (TV) allows the mission manager at a ground station to closely monitor the MUM-T situation via realistic 3D displays of MV and UAVs. The proposed MUM-T ISP is tested on several mission scenarios and then evaluated by actual pilots and the mission manager based on sensible criteria. It is expected that the proposed simulation platform may serve well as a training tool for prospective MV pilots working with UAVs, and also as a research tool for flight engineers developing control algorithms that make MV and UAVs work together.

Devising an approach to analyze the parameters for determining potential premodified firmware of USB devices

This paper reports the results of experiments and studies involving different types of devices that can implement a BadUSB scenario, for example, BadUSB, Rubber Ducky, which, when connected to a computer, impersonate a device with a Human Interface Device, emulating other devices such as a keyboard and mouse. Given the problem of the lack of management tools for detecting preliminary modifications of USB devices against attacks based on the seizure of computer control, a software and hardware system is proposed as an object of study. It is implemented programmatically in the Arduino IDE environment, and physically it is made on the Arduino Mega board with Shield, which reads the parameters of the devices. It monitors the startup of USB devices and checks each device for pre-retrofitting by passing HID descriptors from the connected hardware. Having parsed the data using Python, the data are represented in the appropriate form for analysis, on the basis of which a decision is made by the system on the possible preliminary modification of the USB drive from which these data came. This is due to the detailed consideration and thorough analysis of data, data types, temporal characteristics of data transmitted along different channels. The technical characteristics and functionality of USB devices were investigated; the parameters transmitted at the moment when they are supplied with power were determined. The system can draw a conclusion based on the analysis according to its algorithm and block a suspicious USB device that has been connected and that can intercept control over the computer. The results of the study could be used in the field of protection of information systems from attacks based on the seizure of control from external media. The designed solution increases the level of security of the system, making it possible to recognize a possibly pre-modified device at the connection stage

Intuitive assessment of spatial navigation beyond episodic memory: Feasibility and proof of concept in middle-aged and elderly individuals.

Deficits in spatial navigation in three-dimensional space are prevalent in various neurological disorders and are a sensitive cognitive marker for prodromal Alzheimer's disease, but are also associated with non-pathological aging. However, standard neuropsychological tests used in clinical settings lack ecological validity to adequately assess spatial navigation. Experimental paradigms, on the other hand, are often too difficult for seniors or patients with cognitive or motor impairments since most require operating a human interface device (HID) or use complex episodic memory tasks. Here, we introduce an intuitive navigation assessment, which is conceptualized using cognitive models of spatial navigation and designed to account for the limited technical experience and diverging impairments of elderly participants and neurological patients. The brief computer paradigm uses videos of hallways filmed with eye tracking glasses, without employing an episodic memory task or requiring participants to operate a HID. Proof of concept data from 34 healthy, middle-aged and elderly participants (56-78 years) provide evidence for the assessment's feasibility and construct validity as a navigation paradigm. Test performance showed normal distribution and was sensitive to age and education, which needs to be considered when investigating the assessment's psychometric properties in larger samples and clinical populations. Correlations of the navigation assessment with other neuropsychological tests confirmed its dependence on visuospatial skills rather than visual episodic memory, with age driving the association with working memory. The novel paradigm is suitable for a differentiated investigation of spatial navigation in elderly individuals and promising for experimental research in clinical settings.

An Intelligence Architecture for Grounded Language Communication with Field Robots

For humans and robots to collaborate effectively as teammates in unstructured environments, robots must be able to construct semantically rich models of the environment, communicate efficiently with teammates, and perform sequences of tasks robustly with minimal human intervention, as direct human guidance may be infrequent and/or intermittent. Contemporary architectures for human-robot interaction often rely on engineered human-interface devices or structured languages that require extensive prior training and inherently limit the kinds of information that humans and robots can communicate. Natural language, particularly when situated with a visual representation of the robot’s environment, allows humans and robots to exchange information about abstract goals, specific actions, and/or properties of the environment quickly and effectively. In addition, it serves as a mechanism to resolve inconsistencies in the mental models of the environment across the human-robot team. This article details a novel intelligence architecture that exploits a centralized representation of the environment to perform complex tasks in unstructured environments. The centralized environment model is informed by a visual perception pipeline, declarative knowledge, deliberate interactive estimation, and a multimodal interface. The language pipeline also exploits proactive symbol grounding to resolve uncertainty in ambiguous statements through inverse semantics. A series of experiments on three different, unmanned ground vehicles demonstrates the utility of this architecture through its robust ability to perform language-guided spatial navigation, mobile manipulation, and bidirectional communication with human operators. Experimental results give examples of component-level behaviors and overall system performance that guide a discussion on observed performance and opportunities for future innovation.

The Human Interface Device (HID) Attack on Android Lock Screen Non-Biometric Protections and Its Computational Complexity

Nowadays, information obtained from mobile phones is often the subject of evidence in front of a court. ForensicNowadays, information obtained from mobile phones is often the subject of evidence in front of a court. Forensicanalysts often come across smartphones about which they have no prior information. However, they need to extract data fromthem. The main prerequisite to extract the data is to bypass Android lock screen protection. The HID attack is a promisingmethod to break Android lock screen protection. In many cases, this is the only way how to break the smartphone´s nonbiometriclock screen protections on newer Android OS versions. The article contains examples of three non-biometric typesof Android smartphone lock screen protections and their computational complexity. The paper describes hardware and softwarerequirements for implementation of HID attack.

Importance of crystallinity improvement in MoS2 film by compound sputtering even followed by post sulfurization

The MoS2 film for chip-size area was synthesized by two step processes consisting of MoS2-compound sputtering and post sulfurization. We intentionally revealed that the crystallinity of sulfurized MoS2 film depends on that of just-after-sputtered film. Therefore, a crystallinity improvement just-after sputtering is mandatory to achieve an excellent quality MoS2 film after sulfur-vapor annealing for thin film transistor, sensor and human interface device applications.

Additive Manufacturing of Electronics from Silver Nanopowders Sintered on 3D Printed Low‐Temperature Substrates.

Additive manufacturing is more widely used these days in aerospace, power industry, and automotive. The latest reports indicate that electronics can be produced with this technique. This approach requires the development of new materials for the fabrication of conductive metallic layers on polymers. Herein, a hybrid technique based on fused deposition modeling, direct‐write, and selective laser sintering is demonstrated, for the fabrication of structural electronics. Highly conductive paths are obtained with conductivity values up to 3.2·106 S m−1 in a single printing and sintering additive process. The influence of process parameters is evaluated with several 3D printed polymer substrates affecting the electrical conductivity of the printed conductive paths and circuits. The developed hybrid technique allows performing selective thermal sintering of metallic pastes on polymer substrates exhibiting the value of melting temperatures much lower than the sintering temperature of the silver paste. This phenomenon can be explained with the proposed hypothesis that the activation energy of the sintering process of metallic paste and degradation of polymer substrate plays a key role in obtaining functional conductive metallic paths on polymer substrates. Application of the developed process is demonstrated with a simple human interface device and a circuit with light‐emitting diodes and power source.

Absolute Length Sensor Based on Time of Flight in Stretchable Optical Fibers

Soft and stretchable optical fibers are a promising all-polymer sensor element for extreme mechanical strains, pressures, bending, and other deformations. Compared to electronic sensors, the sensor elements are intrinsically stretchable and are not subject to electromagnetic interference. However, the typical approach of measuring deformation by tracking the transmitted light intensity is an integrating approach similar to resistance-based measurements; it does not provide information about the location or the nature of the deformation. This letter describes an alternate method for driving stretchable optical fibers: a consumer light detection and ranging chip connected to both ends of the fiber to measure its length via the time-of-flight (TOF) of a light pulse. This approach is a miniaturized, optics-based version of previous acoustic TOF and electronic time-domain reflectometry in robotics and human-interface devices. Such ranging systems collect spatial information using a small number of sensors. We found that the TOF approach can measure fiber lengths to within 1 mm on an overall length of ∼330 mm (>1% accuracy). Both the amplitude and TOF methods were sensitive to pressure that created microbending but in opposite directions. For bending radii greater than 7.5 mm, the TOF sensor was less sensitive to bending than the amplitude-based sensor. As a result, the TOF sensor accurately measured the perimeter of a shape with small-radius corners, while the amplitude-based sensor overreported the perimeter because of bending losses. Compared to earlier work, the TOF devices were less dependent on manufacturing variations that affected the signal level, such as fiber- source and fiber-detector alignment. We conclude that the amplitude method may be preferable for pure bending sensors, TOF sensors can distinguish pressure from stretching, and the TOF approach is notably better at measuring lengths over topography, such as in clothing-sizing and other wearable applications.

A Systematic Review of Real-Time Medical Simulations with Soft-Tissue Deformation: Computational Approaches, Interaction Devices, System Architectures, and Clinical Validations.

Simulating deformations of soft tissues is a complex engineering task, and it is even more difficult when facing the constraint between computation speed and system accuracy. However, literature lacks of a holistic review of all necessary aspects (computational approaches, interaction devices, system architectures, and clinical validations) for developing an effective system of soft-tissue simulations. This paper summarizes and analyses recent achievements of resolving these issues to estimate general trends and weakness for future developments. A systematic review process was conducted using the PRISMA protocol with three reliable scientific search engines (ScienceDirect, PubMed, and IEEE). Fifty-five relevant papers were finally selected and included into the review process, and a quality assessment procedure was also performed on them. The computational approaches were categorized into mesh, meshfree, and hybrid approaches. The interaction devices concerned about combination between virtual surgical instruments and force-feedback devices, 3D scanners, biomechanical sensors, human interface devices, 3D viewers, and 2D/3D optical cameras. System architectures were analysed based on the concepts of system execution schemes and system frameworks. In particular, system execution schemes included distribution-based, multithread-based, and multimodel-based executions. System frameworks are grouped into the input and output interaction frameworks, the graphic interaction frameworks, the modelling frameworks, and the hybrid frameworks. Clinical validation procedures are ordered as three levels: geometrical validation, model behavior validation, and user acceptability/safety validation. The present review paper provides useful information to characterize how real-time medical simulation systems with soft-tissue deformations have been developed. By clearly analysing advantages and drawbacks in each system development aspect, this review can be used as a reference guideline for developing systems of soft-tissue simulations.

High Diversity Gain MIMO-Antenna for UWB Application with WLAN Notch Band Characteristic Including Human Interface Devices

In this paper, a UWB–MIMO antenna with the WLAN band-notch (5.1–5.85 GHz) characteristic is offered. This antenna consists of two radiated patch feeding with a tapered line and fabricated on abundantly available FR-4 substrate having the size of 36 × 22 × 1.6 mm3. A notched-band response is achieved by introducing an open-ended stub on the ground plane. Results illustrate that the designed antenna has an impedance bandwidth from 3.1 to 11.2 GHz as well as good isolation i.e. S21 ≤ − 30 dB. Radiation efficiency is greater than 0.75 except the notched band is < 0.5. Diversity performance is also set the new paradigm in terms of ECC (≤ 0.008), TARC (≤ − 25 dB), CCL (≤ 0.3 bits/s/Hz), Mean effective gain ratio (MEGi) ≅ 1 and directive gain (≥ 9.95 dB) except the notched band. Proposed antenna characteristics are also found suitable for a human interface device, low-cost, and easily fabricated. Simulated results of the proposed antenna are tested and verified by the experimental results.

Optical Mouse Sensor for Eye Blink Detection and Pupil Tracking: Application in a Low-Cost Eye-Controlled Pointing Device

In this paper, a new application of the optical mouse sensor is presented. The optical mouse is used as a main low-cost infrared vision system of a new proposal of a head-mounted human-computer interaction (HCI) device controlled by eye movements. The default optical mouse sensor lens and illumination source are replaced in order to improve its field of view and capture entire eye images. A complementary 8-bit microcontroller is used to acquire and process these images with two optimized algorithms to detect forced eye blinks and pupil displacements which are translated to computer pointer actions. This proposal introduces an inexpensive and approachable plug and play (PnP) device for people with severe disability in the upper extremities, neck, and head. The presented pointing device performs standard computer mouse actions with no extra software required. It uses the human interface device (HID) standard class of the universal serial bus (USB) increasing its compatibility for most computer platforms. This new device approach is aimed at improving comfortability and portability of the current commercial devices with simple installation and calibration. Several performance tests were done with different volunteer users obtaining an average pupil detection error of 0.34 pixels with a successful detection in 82.6% of all mouse events requested by means of pupil tracking.

Reconnection Establishment Scheme Based on Energy Detection for Prepaged Bluetooth BR/EDR Device

The meteoric rise of Bluetooth reflects the widespread deployment of new portable Internet-of-Things devices. Although most of the light-weight devices depend on the Bluetooth low energy (LE), many human-interface devices still rely on basic rate and enhanced data rate (BR/EDR) technology. Unfortunately, BR/EDR does not offer a reconnection process, causing users to often endure long reconnection delays. To address this inefficiency, a semi-connection-based paging scheme (SCPS) is designed by proposing two additional machine states: 1) ready-to-reconnect and 2) suspended states. Furthermore, SCPS settings can be tuned to minimize the frame collisions during the triggering process. The effectiveness of the proposed scheme is verified by utilizing the discrete-time Markov chain model, and its performance is evaluated from various perspectives using numerical analysis and experimental results.

Mobile TWG

Abstract Invited Session on HETEROGENEOUS INTEGRATION ROADMAP – Mobile TWG. Smart phones continue to be the major human human-machine interface devices with &amp;gt;5Bn data subscribers and still growing! More functions &amp; intelligence added to interact with human, machine and environment in the Global Digital Society

Electromyography-based gesture recognition for quadriplegic users using hidden Markov model with improved particle swarm optimization

People with quadriplegia cannot move their body and limbs freely, making them unable to interact normally with their environment. This article aims to improve the life quality of quadriplegia patients through a development of a system to help them interact with their surroundings. A novel algorithm to classify human gestures is proposed in this article. The algorithm is developed as the core of an assistive technology system in the form of a human interface device, which utilizes electromyograph as its sensor. The system utilizes a wearable electromyograph with a custom software as the signal capturing and processing tool. The electrodes of the electromyograph are placed on certain positions on the face, corresponding to the locations of the major muscles that govern certain facial gestures. The signals are then processed using a novel algorithm that employs hidden Markov model and improved particle swarm optimization to classify the gesture. Based on the gestures, a custom command can be assigned for different conditions. The accuracy of the system is 96.25% for five gestures classification.

Model reference adaptive control for telemanipulation

A 1-DOF (degree-of-freedom) telemanipulation system is presented in this paper. The paper focuses on disturbance compensation of the haptic force feedback. The master and slave devices are connected via serial ports. The mechanism, which is applied as a human interface device, is subject to perceptible internal friction that must be eliminated. As a result, the operator would only feel the force feedback from the manipulated environment. The main contribution of this paper is the presentation of the telemanipulation device with a model reference adaptive control that compensates for the friction force using a direct model-based sliding mode algorithm.