Real-time Interactive System Research Articles

Real Time Gesture Recognition in A Real Complex Environment Using Interactive Model Generation

This paper describes a real time gesture recognition method for interactive systems. Our method can recognize gesture robustly in a variety of real complex environments. For the robust gesture recognition, our method performs an interactive model generation before the recognition processing, and an individual gesture model is constructed by the interaction between a user and the computer. The individual gesture model is based on the template matching technique and it is constituted by the set of color template images which represent a set of specific poses of human part in a gesture. Using our method, we realize a real time interactive system, the Gesture Game System, which can activate the characters of video game by gestures in real-time and indicates the usefulness of our method.

New Real-time Interactive Cardiac Magnetic Resonance Imaging System

New Real-time Interactive Cardiac Magnetic Resonance Imaging System

Real-time interactive three-dimensional segmentation.

The authors developed a real-time, interactive three-dimensional (3D) segmentation pipeline that uses relatively low-level segmentation operations and provides two-dimensional and 3D visualization through a user-friendly graphical interface. The low-level segmentation processes were implemented on a massively parallel computer; the graphical user interface was written with a public domain software toolkit. Since their implementation 2 years ago, these segmentation tools have been applied to approximately 300 computed tomographic and magnetic resonance imaging data sets. Two typical clinical cases are presented to demonstrate their applications. The entire processing pipeline can be executed in a few seconds. The tools are simple to learn because they involve the use of low-level procedures and a user-friendly graphical interface with a short interactive response time. Segmentation of the bones, aorta, kidneys, and kidney cysts in case 1 could be performed in about 16 minutes. The time needed to segment each organ in case 2 ranged from about 15 minutes for the skin and brain to about 1 minute for the tumor. Satisfactory results can be obtained in a relatively short time with the real-time interactive 3D segmentation system. Operation of the system can be easily learned by a wide variety of nonspecialized users with some medical background.

New real-time interactive cardiac magnetic resonance imaging system

New real-time interactive cardiac magnetic resonance imaging system

Real-time interactive MRI on a conventional scanner.

A real-time interactive MRI system capable of localizing coronary arteries and imaging arrhythmic hearts in real-time is described. Non-2DFT acquisition strategies such as spiral-interleaf, spiral-ring, and circular echo-planar imaging provide short scan times on a conventional scanner. Real-time gridding reconstruction at 8-20 images/s is achieved by distributing the reconstruction on general-purpose UNIX workstations. An X-windows application provides interactive control. A six-interleaf spiral sequence is used for cardiac imaging and can acquire six images/s. A sliding window reconstruction achieves display rates of 16-20 images/s. This allows cardiac images to be acquired in real-time, with minimal motion and flow artifacts, and without breath holding or cardiac gating. Abdominal images are acquired at over 2.5 images/s with spiral-ring or circular echo-planar sequences. Reconstruction rates are 8-10 images/s. Rapid localization in the abdomen is demonstrated with the spiral-ring acquisition, whereas peristaltic motion in the small bowel is well visualized using the circular echo-planar sequence.

State saving for interactive optimistic simulation

Time Warp's optimistic scheduling requires the maintenance of simulation state history to support rollback in the event of causality violations. State history, and the ability to rollback the simulation, can provide unique functionality for human-in-the-loop simulation environments. This paper investigates the use of Time Warp to output valid simulation state in a near real-time manner, re-execute portions of the simulation, and interactively probe simulation values to ascertain underlying causes of transient behavior.A shared-memory, multi-threaded interactive simulation architecture is presented and the additional state saving requirements imposed by interactivity are examined. The shortcomings of existing state saving schemes lead us to propose Multiplexed State Saving (MSS). By interleaving checkpointing and incremental state logs MSS provides bounded rollback costs and asynchronous access to prior simulation state. The interaction algorithms and MSS form a scalable, bounded cost component suitable for use in a real-time interactive Time Warp system.

Towards the Design of a Real-Time Interactive Performance Sound System

The author discusses a realtime interactive sound system designed for the performance artist Stelarc. The sound system creates sound intrinsic to the body’s movement in space and is intended to augment Stelarc’s software-driven muscle-stimulator system, which allows direct control of his body movement. A description of system-hardware requirements and general design principles, an overview of sensors and transducers, and a discussion of software requirements, control routines and sound design principles are included.

Machine Listening and Composing with Cypher

Cypher is a real-time interactive music system with two major components: a listener and a player. The listener analyzes streams of MIDI data. The player uses various algorithmic techniques to produce new musical output. Both components are made up of many small, interconnected agents, operating on several hierarchical levels. The listener classifies features in the input and their behavior over time, sending messages that communicate this analysis to the player. Features classified include speed, density, dynamic, harmony, and rhythm. A user of Cypher can configure the player component to react to such messages, such that a reaction is the execution of compositional methods producing new music in response. A graphical interface allows the interactive specification of relations between feature classifications and types of response. Collections of relations can be saved, then recalled during performance by a score orientation component that tracks human performance and executes state changes at predetermined points in the score. Furthermore, an internal critic analyzes and alters Cypher's own output, representing a set of programmed aesthetic preferences, and ensuring a consistency of style in the program's responses. Cypher plays composed music in a manner that is sensitive to live human performance cues. It is able to analyze and respond creatively to unknown music. Finally, it can compose without input, using algorithms to either transform remembered material or generate new musical output. The work described here is an applied music theory; ideas about the description and generation of music are formalized to the point that they can be implemented in a computer program and tested in real time. Though textual traces of program activity can provide a detailed written account of the processing performed, the application of theoretical ideas in a real-time context brings the intellectual enterprise to a point of contact with complete musical examples, where the ear can judge the success of the theory.

Understanding the art of modular engineering

Many applications programs used in microcomputer systems are quite large, well beyond the capabilities of a single programmer. The paper describes an approach taken to partition the software of a large realtime interactive system into pieces which individual programmers can comprehend. The criteria for modularization which have been found to be useful are: resuse, adaption, concurrency, consistency and ownership. Examples of modules using these criteria and based on an actual implementation are described.

An Interactive Real-Time System for the Control of Sound Localization

One of the most significant parameters in the perception of music is related to the spatial characteristics of sound. Aside from the use of directionality in the reproduction of music in sound systems of homes, movies theatres, and concert halls, composers have shown interest in exploitation of the spatial dimension of sound since as early as the sixteenth century. We have precedents in works by composers such as Gabrieli, Berlioz, and, after the turn of the century, by Varese in Deserts, and by Stockhausen in Gesang der Jiinglinge (Stockhausen 1961). The landmark after the advent of the electroacoustic music is probably Chowning's Turenas, in which the composer uses graphic techniques to control the path and speed of sound sources as well as reverberation in the surrounding space. In this paper I will discuss the implementation of a tool that allows the composer to take advantage of the spatial control of sound through a portable, interactive real-time system having adequate graphics and computational ability.

Starkeeper® Network Troubleshooter: An Expert System Product

StarKeeper network troubleshooter is a real-time interactive expert system that assists clerks, technicians, and network administrators with varying skill and experience levels in isolating and correcting faults in Datakit® virtual-circuit switch networks. The system interrogates and manipulates network components via a standard login to an existing element management system. Given a symptom description and minimal background information, the system can automatically isolate and correct network faults. It provides detailed corrective procedures in cases where human intervention is required. Feedback mechanisms let the system adapt to different networks and to individual operators.

Van der Waals Surfaces in Molecular Modeling: Implementation with Real-Time Computer Graphics

A method is described for generating van der Waals molecular surfaces with a real-time interactive calligraphic color display system. These surfaces maintain their proper representation during bond rotation and global transformations, and an interior atom removal method yields a comprehensible picture of the molecular surface for large molecules. Both algorithms are faster than previous methods. This combination provides a powerful tool for real-time interactive molecular modeling.

An Architecture for Real-Time Sensory-Interactive Control of Robots in a Manufacturing Facility

A hierarchical architecture is described for a robot integrated into a real-time sensory interactive factory control system. In this architecture, high level goals are decomposed through a succession of levels, each producing strings of simpler commands to the next lower level. The bottom level generates the drive signals to the robot actuators. Each control level is a separate process with a limited scope of responsibility. Each performs the generic control function of sampling its input and generating appropriate outputs. The input is characterized by three types of data - a command from the next higher level, processed sensory data, and status feedback from the next lower level. The outputs are of three types - a command to the next lower level, a request for sensory information to the processing module at the same level, and a status feedback to the next higher level. This paper describes this generic control structure and its implementation in a real-time sensory-interactive control system for a manufacturing facility.

CAI support modules in FORTRAN and BASIC. II: PCM: A physical chemistry monitor for CAI

26. A real-time interactive system that presents students with questions that integrate the real-world with mathematics, allows new questions to be added without difficulty, and does not require knowledge of a programming language.