Interactive User Control Research Articles

GESTURE CONTROLLED SMART GLOVE WITH WEB APPLICATION

his paper presents a gesture-controlled smart glove system integrated with a web application for interactive user interface and control. The glove utilizes an array of sensors, such as accelerometers, gyroscopes, and flex sensors, to detect hand movements and gestures with high precision. These sensors capture real-time data, which is processed by an embedded microcontroller unit (MCU) onboard the glove. The processed data is then transmitted wirelessly to a web application via Bluetooth or Wi-Fi connectivity. The web application, accessible through a browser on any device, provides a user-friendly interface for controlling various applications and devices remotely. Users can customize gesture mappings to specific actions, enabling seamless interaction with IoT devices, virtual reality environments, and computer applications. The system's architecture emphasizes modularity and scalability, allowing for easy integration of additional sensors or functionalities. Moreover, the web application employs responsive design principles, ensuring compatibility with different screen sizes and devices. In conclusion, the proposed gesture-controlled smart glove system offers a versatile and intuitive interface for interacting with digital environments. Its integration with a web application enhances accessibility and usability, making it suitable for a wide range of applications, including gaming, rehabilitation, and virtual control interfaces. Key Words: MCU, Flex sensors, Web Application, Gesture Control, IOT

A Fully Integrated Pipeline for Visual Carotid Morphology Analysis

AbstractAnalyzing stenoses of the internal carotids – local constrictions of the artery – is a critical clinical task in cardiovascular disease treatment and prevention. For this purpose, we propose a self‐contained pipeline for the visual analysis of carotid artery geometries. The only inputs are computed tomography angiography (CTA) scans, which are already recorded in clinical routine. We show how integrated model extraction and visualization can help to efficiently detect stenoses and we provide means for automatic, highly accurate stenosis degree computation. We directly connect multiple sophisticated processing stages, including a neural prediction network for lumen and plaque segmentation and automatic global diameter computation. We enable interactive and retrospective user control over the processing stages. Our aims are to increase user trust by making the underlying data validatable on the fly, to decrease adoption costs by minimizing external dependencies, and to optimize scalability by streamlining the data processing. We use interactive visualizations for data inspection and adaption to guide the user through the processing stages. The framework was developed and evaluated in close collaboration with radiologists and neurologists. It has been used to extract and analyze over 100 carotid bifurcation geometries and is built with a modular architecture, available as an extendable open‐source platform.

Computer Graphics Algorithm Demonstration System

With the rapid development of computer technology. Many scholars pay close attention to computer graphics algorithms, which makes computer graphics widely used in various fields and enters a new revolutionary era. The purpose of this paper is to study the evaluation of computer graphics algorithm demonstration systems. Combining theory with practice, on the basis of careful analysis of the principle of graphics algorithm, a new idea of synchronization of graphics production process and a specific algorithm for realizing graphics are proposed, and most graphics in computer graphics are visualized. It breaks the limitation that only two-dimensional graphic simulation effects can be realized, and increases the interactive user control system. The algorithm complexity is significantly reduced, the graphics creation speed is increased, and the simulation effect is more realistic. After the introduction of this visual teaching demonstration system, these abstract principles can be explained intuitively, which can significantly improve the teaching quality.

BassNet: A Variational Gated Autoencoder for Conditional Generation of Bass Guitar Tracks with Learned Interactive Control

Deep learning has given AI-based methods for music creation a boost by over the past years. An important challenge in this field is to balance user control and autonomy in music generation systems. In this work, we present BassNet, a deep learning model for generating bass guitar tracks based on musical source material. An innovative aspect of our work is that the model is trained to learn a temporally stable two-dimensional latent space variable that offers interactive user control. We empirically show that the model can disentangle bass patterns that require sensitivity to harmony, instrument timbre, and rhythm. An ablation study reveals that this capability is because of the temporal stability constraint on latent space trajectories during training. We also demonstrate that models that are trained on pop/rock music learn a latent space that offers control over the diatonic characteristics of the output, among other things. Lastly, we present and discuss generated bass tracks for three different music fragments. The work that is presented here is a step toward the integration of AI-based technology in the workflow of musical content creators.

PICO: Procedural Iterative Constrained Optimizer for Geometric Modeling.

Procedural modeling has produced amazing results, yet fundamental issues such as controllability and limited user guidance persist. We introduce a novel procedural model called PICO (Procedural Iterative Constrained Optimizer) and PICO-Graph that is the underlying procedural model designed with optimization in mind. The key novelty of PICO is that it enables the exploration of generative designs by combining both user and environmental constraints into a single framework by using optimization without the need to write procedural rules. The PICO-Graph procedural model consists of a set of geometry generating operations and a set of axioms connected in a directed cyclic graph. The forward generation is initiated by a set of axioms that use the connections to send coordinate systems and geometric objects through the PICO-Graph, which in turn generates more objects. This allows for fast generation of complex and varied geometries. Moreover, we combine PICO-Graph with efficient optimization that allows for quick exploration of the generated models and the generation of variants. The user defines the rules, the axioms, and the set of constraints; for example, whether an existing object should be supported by the generated model, whether symmetries exist, whether the object should spin, etc. PICO then generates a class of geometric models and optimizes them so that they fulfill the constraints. The generation and the optimization in our implementation provides interactive user control during model execution providing continuous feedback. For example, the user can sketch the constraints and guide the geometry to meet these specified goals. We show PICO on a variety of examples such as the generation of procedural chairs with multiple supports, generation of support structures for 3D printing, generation of spinning objects, or generation of procedural terrains matching a given input. Our framework could be used as a component in a larger design workflow; its strongest application is in the early rapid ideation and prototyping phases.

Scene Transitions and Teleportation in Virtual Reality and the Implications for Spatial Awareness and Sickness.

Various viewing and travel techniques are used in immersive virtual reality to allow users to see different areas or perspectives of 3D environments. Our research evaluates techniques for visually showing transitions between two viewpoints in head-tracked virtual reality. We present four experiments that focus on automated viewpoint changes that are controlled by the system rather than by interactive user control. The experiments evaluate three different transition techniques (teleportation, animated interpolation, and pulsed interpolation), different types of visual adjustments for each technique, and different types of viewpoint changes. We evaluated how differences in transition can influence a viewer's comfort, sickness, and ability to maintain spatial awareness of dynamic objects in a virtual scene. For instant teleportations, the experiments found participants could most easily track scene changes with rotational transitions without translational movements. Among the tested techniques, animated interpolations allowed significantly better spatial awareness of moving objects, but the animated technique was also rated worst in terms of sickness, particularly for rotational viewpoint changes. Across techniques, viewpoint transitions involving both translational and rotational changes together were more difficult to track than either individual type of change.

Learning bicycle stunts

We present a general approach for simulating and controlling a human character that is riding a bicycle. The two main components of our system are offline learning and online simulation. We simulate the bicycle and the rider as an articulated rigid body system. The rider is controlled by a policy that is optimized through offline learning. We apply policy search to learn the optimal policies, which are parameterized with splines or neural networks for different bicycle maneuvers. We use Neuroevolution of Augmenting Topology (NEAT) to optimize both the parametrization and the parameters of our policies. The learned controllers are robust enough to withstand large perturbations and allow interactive user control. The rider not only learns to steer and to balance in normal riding situations, but also learns to perform a wide variety of stunts, including wheelie, endo, bunny hop, front wheel pivot and back hop.

Programming and Playing with RoboSapien on line

RoboSapien is famous human like robot toy intended for playing with, of interested in, of all ages, and learning through the game, of some basic characteristics of robots and robotic control. The programming of RoboSapien as described in userâ??s manual is limited with the internal memory, battery life, and not very convenient input of actions through the multipurpose buttons of the RoboSapien IR remote control device. In order to offer better conditions for experimenting and using of RoboSapien, the web user interface was developed, that provides interactive user control, programming of command sequences of arbitrary length, observing of RoboSapien actions using the web cam that shows the movements and actions on web page. Access and control of RoboSapien by remote user through the web page user interface, is controlled by access levels depending on whether the user is logged in or not. The whole system is implemented in C# as ASP.NET project with NI USB 6501 digital I/O driving the CMOS 4066 analog switches for controlling the RoboSapien IR remote control device.

Need for cognition: understanding the influence of individual differences on virtual product experiences

Three-Dimensional (3D) product visualisation has been conceptualised as a new form of virtual product experience that enables consumers to simulate consumption experiences online. Virtual experience has most notably been characterised as imitating direct experience because of interactive user-control which allows consumers to alter, freely rotate, zoom-in or out and examine in detail products online. Current research in this area, however, has predominantly focused on understanding the technology with very little work exploring the impact of information processing styles. Therefore, in a laboratory experiment (n = 120) the influence of individual characteristics Need for Cognition (NFC) and product experience on brand attitude was examined. The results indicate that consumers high in NFC report more favourable brand attitudes during virtual experience evaluations than from direct experience.

Parallel and Real-time Trapping, Manipulating and Characterizing Microscopic Specimens

In the mesoscopic regime, very small forces that result from light-matter interaction are strong enough to significantly influence the motion of tiny particles. Until just a few years ago, virtually all laser manipulation schemes were based on trapping particles inside a single strongly focused beam and moving them into a desired position by translating the laser focus. Now, two decades later, a great deal of progress has been achieved in optical trapping and manipulation, both in terms of applications and technical developments. Particularly, much more versatile and general manipulation of particles and cell colonies is now possible by using specially tailored structures of light. 1 Such light patterns have unprecedented potential for manipulating mesoscopic objects and have already been successfully used to organize small particles, including microorganisms, in desired patterns and to sort samples of particles according to their size. 2 Optical trapping and manipulation of a plurality of micro-particles is now viable using reconfigurable patterns of optical fields. 3 This opens up research possibilities for many interdisciplinary fields, particularly those with biomedical relevance. With the advent of computeraddressable spatial light modulators, the reconfigurability of light patterns that can act as confining optical potential landscapes is made even more feasible with a great degree of interactive usercontrol. 4 We invented the “all-optical biophotonics workstation” to trap, manipulate and characterize microscopic specimens in parallel. We used an optical mapping from a beam-modulation module to obtain reconfigurable intensity patterns, corresponding to two independently

Investigating the potential of human echolocation in virtual sonic trigonometry

Describing a mathematical problem often involves visual diagrams. For blind students this accentuates the challenges they face. Projects such as LAMBDA have used linear speech and Braille to convey algebraic equations. However, spatial features, for example in trigonometry, are difficult to map to a linear‐based system. Traditional tactile methods (e.g. German film) convey simple shapes but need Braille support and speech‐tactile interfaces (e.g. NOMAD) require unconventional equipment. Cognitive issues regarding tactile interpretation of 3D shapes also persist. Blind students interact regularly with speech technology and audio games. This exposure means that the auditory system is potentially becoming accustomed to sonic interpretation of computer‐based information. Some of our research has looked at expanding the sonic environment to include spatial information aimed at trigonometry. The next stage is to provide interactive user control. Our system is based on a user interface model in order to consider the cognitive issues involved. We use Microsoft's XNA/XACT environment to create our auditory scene. In this paper we discuss how to implement sonic‐based user interaction while further simplifying our auditory scene. In order to achieve this, we examine the potential of human echolocation to orient within the virtual walls and corners of a triangle.

Interactive low‐dimensional human motion synthesis by combining motion models and PIK

AbstractThis paper explores the issue of interactive low‐dimensional human motion synthesis. We compare the performances of two motion models, i.e. Principal Components Analysis (PCA) or Probabilistic PCA (PPCA), for solving a constrained optimization problem within a low‐dimensional latent space. We use PCA or PPCA as a first step of preprocessing to reduce the dimensionality of the database to make it tractable, and to encapsulate only the essential aspects of a specific motion pattern. Interactive user control is provided by formulating a low‐dimensional optimization framework that uses a Prioritized Inverse Kinematics (PIK) strategy. The key insight of PIK is that the user can adjust a motion by adding constraints with different priorities. We demonstrate the robustness of our approach by synthesizing various styles of golf swing. This movement is challenging in the sense that it is highly coordinated and requires a great precision while moving with high speeds. Hence, any artifact is clearly noticeable in the solution movement. We simultaneously show results comparing local and global motion models regarding synthesis realism and performance. Finally, the quality of the synthesized animations is assessed by comparing our results against a per‐frame PIK technique. Copyright © 2007 John Wiley & Sons, Ltd.

Interactive Visualization of Intercluster Galaxy Structures in the Horologium-Reticulum Supercluster

We present GyVe, an interactive visualization tool for understanding structure in sparse three-dimensional (3D) point data. The scientific goal driving the tool's development is to determine the presence of filaments and voids as defined by inferred 3D galaxy positions within the Horologium-Reticulum supercluster (HRS). GyVe provides visualization techniques tailored to examine structures defined by the intercluster galaxies. Specific techniques include: interactive user control to move between a global overview and local viewpoints, labelled axes and curved drop lines to indicate positions in the astronomical RA-DEC-cz coordinate system, torsional rocking and stereo to enhance 3D perception, and geometrically distinct glyphs to show potential correlation between intercluster galaxies and known clusters. We discuss the rationale for each design decision and review the success of the techniques in accomplishing the scientific goals. In practice, GyVe has been useful for gaining intuition about structures that were difficult to perceive with 2D projection techniques alone. For example, during their initial session with GyVe, our collaborators quickly confirmed scientific conclusions regarding the large-scale structure of the HRS previously obtained over months of study with 2D projections and statistical techniques. Further use of GyVe revealed the spherical shape of voids and showed that a presumed filament was actually two disconnected structures.

A web-based simulation system for transport and retention of dissolved contaminants in soil

The movement of contaminants through the soil matrix is primarily a liquid phase process in which the chemical partitions between sorbed and dissolved phases. These phenomena have been modeled extensively and several computer models were developed. The use of those computer programs requires installation of the software in the users machine. Usually, post-processing of the numerical output provided by the software is required. In this paper, a web-based simulation environment for retention and transport of dissolved organic and inorganic compounds in soils is presented. The system was developed using Java and is based on the Multi-reaction Transport Model of heavy metals in soil. The mathematical and numerical formulation of the model is briefly sketched. The core computing components of the simulation environment were written in C or fortran for their computational efficiency. The emerging Java Native Interface (JNI) technique and the Swing interface were used to design a user-friendly simulator. Java security problems (due to the use of applets calling native libraries) are discussed and a solution to avoid security restrictions is provided. The simulation system provides interactive user control and real time visualization through standard web browsers. The Java-based simulation code was used to analyze a hypothetical soil contamination problem. The almost instantaneous visualization of results provided by the Java-based interface resulted in efficient and easy analyses. Although a performance comparison was not in mind, the evaluation of the same scenario using the original fortran code took three times as much total time (program run, evaluation of results and post-processing) as that using the Java simulation system.

Interactive and aliasing-free acoustic modeling of reflections and diffractions in architectural environments

A primary challenge in geometrical acoustic modeling is computation of reverberation paths from sound sources fast enough for real-time auralization. This paper describes an aliasing-free beam tracing algorithm based on precomputed spatial subdivision and beam tree data structures that enables real-time acoustic modeling and auralization for sound sources in interactive applications. The proposed method traces convex polyhedral beams from the location of each sound source and receiver through a precomputed spatial subdivision data structure, constructing a beam tree representing the regions of space reachable by potential sequences of transmissions, diffractions, and specular reflections at surfaces of a 3D polygonal model. By computing beam trees asynchronously (off-line), our system can generate reverberation paths between sources and receivers at interactive rates and spatialize audio signals in real-time as sources and receivers move under interactive user control. Unlike previous geometrical acoustic modeling work, our beam tracing method: (1) supports evaluation of early reverberated paths at interactive rates, (2) scales well for large, densely occluded architectural environments, and (3) computes paths of diffraction without aliasing using the uniform theory of diffraction. This system is being used to develop interactive applications in which a user experiences a virtual environment immersively via simultaneous auralization and visualization.

Presenting 3-D models of geological materials on the World Wide Web

In this article, we show how current World Wide Web technology can be used to present computerized 3-D models of geological materials. Unlike traditional, paper-based publishing, World Wide Web documents can incorporate several visualization techniques, some of which allow interactive user control. The concepts behind still images, animations, video sequences, object movies and virtual reality models are introduced. The advantages and pitfalls of the different visualization techniques are described, and their potential for the communication of 3-D models of geological materials is discussed. Web-resources providing the necessary browsing, playback and interaction software as well as specific authoring tools are referenced. In the HTML version of this article, which can be found on the accompanying CD-ROM, examples of 3-D macro- and microstructure reconstructions of geological materials are included as color images, animated sequences and interactive 3-D models.

User Control and Dynamic Reorganization of Multimedia Presentations During Playout

A methodology to dynamically adjust the multimedia presentations as a result of user interactions during the playout is introduced. A constraint-driven approach is described for the automated assembly, organization and playout of presentations from multimedia databases. To allow interactive user control over the playout of an automatically generated presentation, a set of control buttons are provided. Using these buttons, the user can control and change the flow of the presentation in a variety of ways. Interactive user control during the presentation playout, however, can introduce new delays in the original presentation schedule of multimedia segments and possibly change playout constraints. To account for these delays and changes, strategies to (a) dynamically reorganize the subpresentations into a presentation, (b) replace segments with their compacted clips, and (c) delete segments on the presentation graph are proposed.

Gamma spectrum analysis including NAA with SAMPO for windows

SAMPO for Windows is a high performance gamma spectrum analysis program. All the measurement, analysis and NAA phases can be done either under full interactive user control or user defined tasks can be used for automated measurement and analysis sequences including control of MCAs and sample changers. High resolution gamma-ray spectroscopy together with the possibility to resolve complex multiplets with high accuracy makesSAMPO very suitable for INAA. On the other hand, the possibility to automate analysis sequences allows its use effectively also in all routine NAA measurements.

Tool support for the synchronization and presentation of distributed multimedia

Synchronization of multiple media is a major issue in multimedia applications; in distributed systems, this problem is aggravated further. We present tools for the creation, editing, and presentation of synchronized multimedia objects. In particular, we describe a graphical Synchronization Editor for the specification of synchronization schemes and a Synchronizer for the execution of multimedia presentations. We emphasize the requirements imposed by an underlying distributed heterogeneous environment, as well as support for interactive user control. The tools described are not restricted to a fixed set of media, but support the inclusion of arbitrary user-defined media. The Synchronization Editor and Synchronizer are part of the Mode project, which in turn covers the ‘distributed multimedia object support’ part of NESTOR, an authoring/learning environment developed jointly by the Universities of Karlsruhe and Kaiserslautern and the Digital Equipment CEC, Karlsruhe.

SAMPO 90 High resolution interactive gamma-spectrum analysis including automation with macros

SAMPO 90 is a high performance gamma-spectrum analysis program for personal computers. It uses color graphics to display calibrations, spectra, fitting results as multiplet components, and analysis results. All the analysis phases can be done either under full interactive user control or macros and programmable function keys can be used for completely automated measurement and analysis sequences including the control of MCAs and sample changers. Accurate peak area determination of even the most complex multiplets, of up to 32 components, is accomplished using linear, non-linear and mixed mode fitting. Nuclide identification is done using associated lines techniques allowing interference correction for fully overlapping peaks. Peaked Background Subtraction can be performed and Minimum Detectable Activities calculated. The analysis reports and program parameters are fully customizable.