Investigators from multiple disciplines and applications areas are interested in Human body modeling, tracking, and synthesis related topics. These topics offer fertile ground for challenging research problems aswell as potential for awide range of applications. Our own interest and involvement in human modeling, analysis, and synthesis comes froma very specific need: that of developing “intelligent” environments or spaces [1–3]. An intelligent environment automatically derives and dynamically maintains an awareness of its composition as well as events and activities occurring within.Moreover, these spaces should be responsive to specific events and triggers. Such spaces need not be limited to rooms in buildings, but extend to outdoor environments [4] and any other spaces that humans occupy such as a performance on a stage or an automobile on a highway [5]. The spaces are monitored by multiple audio and video sensors, which can be unobtrusively embedded in the infrastructure. To avoid intrusion on the normal human activities in the space, all sensors, processors, and communication devices should remain “invisible” in the infrastructure. The system should also support natural and flexible interactions among the participants without specialized or encumbering devices. In a conference room environment, multiple video cameras and microphones may be embedded in walls and furniture. Video and audio signals are analyzed in real time for a wide range of low-level tasks, including person identification, localization and tracking, and gesture and voice recognition [6]. Combining the analysis tasks with human face and body synthesis enables efficient interactions with remote observers, effectively merging disjoint spaces into a single intelligent environment. We are currently embedding distributed video networks in rooms, laboratories, museums, and even outdoor public spaces in support of experimental research in this domain. This involves the development of new frameworks, architectures, and algorithms for audio and video processing as well as for the control of various functions associated with proper execution of a transaction within such intelligent spaces. These test beds are also helping to identify novel applications of such