Transmission Of Scenes Research Articles

Multiscale Functional Connectivity analysis of episodic memory reconstruction

Our ability to share memories constitutes a social foundation of our world. When exposed to another person's memory, individuals can mentally reconstruct the events described, even if they were not present during the related events. However, the extent to which the neuronal connectivity patterns elicited by the mental reconstruction of an event mirror those present in the brains of individuals who experienced the original event remains unclear. Through two independent fMRI experiments, we explore the Functional Connectivity (FC) patterns at different timescales associated with these cognitive processes using the innovative Multiscale Functional Connectivity (MFC) technique. This study aims to shed light on how our brains construct mental representations of scenes in a movie compared to the verbal transmission of the same scenes. Our results demonstrated that the Default Mode Network (DMN) plays a crucial role in these experiments and exhibits unique FC patterns across different timescales, yet remarkably consistent among participants. In addition, we found significant connectivity patterns within the temporal cortex, including significant contributions of the temporal pole and the fusiform gyrus, which exhibited a pivotal role in cooperation with the DMN in both experiments.

Compression of complex-valued hologram data using line index coding and image compression standards

Human Visual System (HVS) records 3D information of a scene while photography of a scene can record only 2D information. A hologram can record the 3D information of a scene as that of HVS and reproduce the same. Hologram recording in digital form requires large amount of memory and opens a window to challenging area of Hologram data compression techniques. The hologram records the depth information of a scene in the phase of complex data. Complex data represented in both rectangular and polar form are exploited to produce Line Index Coding (LIC) process. Before Line Index Coding, normalization of hologram is done to produce normalized hologram. After normalization Line Index Coding corresponding to complex representation is done for selected step size. After Line Index Coding the JPEG or JPEG2000 compression scheme is used to provide more compression. Analysis of the results through subjective and visual quality methods show that the combination of line index coding and JPEG coding produce significant compression when compared to the result obtained through LIC alone. This paper gives a scope for Digital Hologram Watermarking Systems, speeding up of transmission of 3D scenes, storage requirements in surveillance, multimedia and biomedical applications.

WebGL-based Visualization Method for Large-scale 3D Scene

For the requirements of transmission and real-time visualization of large-scale threedimensional scenes in the Web environment, this paper adopts the three-dimensional model data structure 3DTiles which is suitable for data sharing and network switching, and analyzes the advantages of building three-dimensional scenes based on 3D Tiles. Meanwhile, through the skipping loading of the hierarchical detail model, the model loading time, network requests and memory consumption are reduced, while the scene data drawing efficiency is improved. Based on these theories and technologies, this paper designs and builds a three-dimensional digital earth platform based on WebGL. Experimental results show that this platform can smoothly implement the drawing of large-scale 3D scenes, and achieve the visualization effects and good visual experience.

VERIFICATION OF IMAGE BASED AUGMENTED REALITY FOR URBAN VISUALIZATION

Abstract. Recently, visualization of urban scenes with various information attracts attention. For the transmission of urban scenes, virtual reality has been widely used. Since the virtual reality requires comprehensive and detailed three dimensional models, the manual dependent modelling takes a lot of time and effort. On the other hand, it has been tackled that various data is superimposed on the scene which the users see at the time instead of comprehensive modelling, which is well known as augmented reality (AR). Simultaneous localization and mapping (SLAM) has been attempted using simple video cameras for the AR. This method estimates exterior orientation factors of the camera, and three dimensional reconstructions of feature points simultaneously. The method, however, has been applied to only small indoor space. This paper investigates the applicability of the popular method of SALM to wide outdoor space, and improves the stability of the method. Through the application, the tracked feature points successfully are greatly reduced compared with application in indoor environment. According to the experimental result, simple markers or GPS are introduced as auxiliary information. The markers gives the stability of optimization, and GPS gives real scale to AR spaces. Additionally, feature points tracking method is modified by assigning amplitude of displacement and depth. The effect of the markers and GPS are confirmed. On the other hand, some limitations of the method are understood. As a result, more impressive visualization will be accomplished.

Zum großen Revisionsprozess der funerären Texte in der XI. Dynastie

Abstract This article discusses the transmission of pictorial scenes with a focus on style and iconography. Thus the coffins of the early Middle Kingdom do not only depend on textual transmission (CT) but also on pictorial transmission (including longer scenes). This article deals especially with the pictorial tradition of the coffins T 3 C, G 1 T and A 1 C and its origins. Attention is also paid to the socio-economic setting of the process of transmission.

Tit-for-Tat Based Solution in Parallel 3D Scenes Streaming

Recently, the peer-to-peer (P2P) based 3D scenes streaming has been a powerful tool to realize interactive downloading of large-scale virtual environments. In this paper, we introduce the design of a P2P based distributed virtual environments (DVE) with two layers, give the general steps for scenes streaming. To relieve the “prisoner’s dilemma” which exists in P2P scenes exchange, we propose a titfor-tat based solution, in which each peer computes every requester’s contribution on transmission of scenes firstly, and then downloading requests from those peers who provide more contribution will be processed with higher priorities. Simulation results show that our method improve the visual quality in walkthrough (shown by the fill ratio, fill ratio of base mesh and the base latency).

Transmission of 3D Scenes over Lossy Channels

This paper introduces a novel error correction scheme for the transmission of three-dimensional scenes over unreliable networks. We propose a novel Unequal Error Protection scheme for the transmission of depth and texture information that distributes a prefixed amount of redundancy among the various elements of the scene description in order to maximize the quality of the rendered views. This target is achieved exploiting also a new model for the estimation of the impact on the rendered views of the various geometry and texture packets which takes into account their relevance in the coded bitstream and the viewpoint required by the user. Experimental results show how the proposed scheme effectively enhances the quality of the rendered images in a typical depth-image-based rendering scenario as packets are progressively decoded/recovered by the receiver.

The Spatiotemporal Frequency Tuning of LGN Receptive Field Facilitates Neural Discrimination of Natural Stimuli

The efficient coding hypothesis suggests that the early visual system is optimized to represent stimuli in the natural environment. While it is believed that LGN processing removes the redundant information of natural scenes, it is not clear whether the early visual processing can selectively amplify important signals in natural stimuli to facilitate discrimination. In this study, we examined the functional role of LGN spatiotemporal frequency tuning in the processing of natural scenes. First, we characterized the relationship between spatial and temporal frequency tuning for LGN receptive fields. We found that LGN neurons exhibit inseparable spatiotemporal frequency tuning in a manner consistent with the feature of optimal filters that can maximize information transmission of natural scenes. Second, we analyzed the spatiotemporal power spectrum of natural scenes and found that some frequencies exhibit larger variation in power across different scenes. Interestingly, the preferred frequency of ensemble LGN neurons matches the range of frequencies in which natural power spectrum varies most. Comparison of neural discrimination for natural stimuli and for artificial stimuli with similar mean power spectra but different variation structure showed that the match between LGN tuning and natural spectra variation enhances neural discrimination for natural stimuli. Our results indicate that, in addition to removing redundancy, the spatiotemporal frequency characteristics of LGN neurons can facilitate neural discrimination of natural stimuli.

A Flexible Client-Driven 3DTV System for Real-Time Acquisition, Transmission, and Display of Dynamic Scenes

3D experience and free-viewpoint navigation are expected to be two essential features of next generation television. In this paper, we present a flexible 3DTV system in which multiview video streams are captured, compressed, transmitted, and finally converted to high-quality 3D video in real time. Our system consists of an camera array, 16 producer PCs, a streaming server, multiple clients, and several autostereoscopic displays. The whole system is implemented over IP network to provide multiple users with interactive 2D/3D switching, viewpoint control, and synthesis for dynamic scenes. In our approach, multiple video streams are first captured by a synchronized camera array. Then, we adopt a lengthened-B-field and region of interest- (ROI-) based coding scheme to guarantee a seamless view switching for each user as well as saving per-user transmission bandwidth. Finally, a convenient rendering algorithm is used to synthesize a visually pleasing result by introducing a new metric called Clarity Degree (CD). Experiments on both synthetic and real-world data have verified the feasibility, flexibility, and good performance of our system.

Streaming Route Panorama for Seamless City Guidance

This paper introduces an application of route panoramas (RP) in geospatial information visualization. An RP is a long image archiving scenes along a street. We model large geospatial areas such as a town with RPs at a more detailed level than a road map. This paper focuses on the indexing, transmission, and visualization of scenes. The pervasively embedded view-to-space links in the RPs guide transition to detailed spaces. We stream RPs on the Internet in response to the viewer's interaction in virtual city traversing. Various visualization styles of the RP are designed for city guidance on different platforms. Combined with other image media, viewers can look around, traverse a grid of routes, and retrieve information associated to various locations.

Multi-View Video: Get Ready for Next-Generation Television

Many believe that multi-view video is poised to change how people watch television and that it could become a driving force in interactive multimedia entertainment, for both desktop and mobile environments. An MVV system acquires several video sequences of the same scene simultaneously from more than one angle and transports these streams remotely. Scenes can be displayed interactively, letting the user rotate the view from multiple angles as if it were 3D and enjoy the feeling of being in the scene. Owing to the massive amount of data involved and extensive processing requirements, real-time MVV processing presents research issues that lie at the frontier of video coding, image processing, computer vision, and display technologies. Building a complete end-to-end MVV system also hinges on several additional technologies, such as real-time acquisition, transmission, and display of dynamic scenes that users can view interactively on conventional screens. Several research groups around the world are actively researching MVV

A novel framework for the interactive transmission of 3D scenes

We consider an interactive browsing environment for 3D scenes, which allows for the dynamic optimization of selected client views by distributing available transmission resources between geometry and texture components. Texture information is available at a server in the form of scalably compressed images, corresponding to a multitude of original image views. Surface geometry is also available at the server in the form of scalably compressed depth maps, again corresponding to a multitude of original views. Texture and depth components are both open to augmentation as more content becomes available. At any point in the interactive browsing experience, the server must decide how to allocate transmission resources between the delivery of new elements from the various original view bit-streams and new elements from the original geometry bit-streams. The proposed framework implicitly supports dynamic view sub-sampling, based on rate-distortion criteria, since the best server policy is not always to send the nearest original view image to the one which the client is rendering. In this paper, we particularly elaborate upon a novel strategy for distortion-sensitive synthesis of both geometry and rendered imagery at the client, based upon whatever data is provided by the server. We also outline how the JPIP standard for interactive communication of JPEG2000 images, can be leveraged for the 3D scene browsing application.

3D TV

Three-dimensional TV is expected to be the next revolution in the history of television. We implemented a 3D TV prototype system with real-time acquisition, transmission, and 3D display of dynamic scenes. We developed a distributed, scalable architecture to manage the high computation and bandwidth demands. Our system consists of an array of cameras, clusters of network-connected PCs, and a multi-projector 3D display. Multiple video streams are individually encoded and sent over a broadband network to the display. The 3D display shows high-resolution (1024 × 768) stereoscopic color images for multiple viewpoints without special glasses. We implemented systems with rear-projection and front-projection lenticular screens. In this paper, we provide a detailed overview of our 3D TV system, including an examination of design choices and tradeoffs. We present the calibration and image alignment procedures that are necessary to achieve good image quality. We present qualitative results and some early user feedback. We believe this is the first real-time end-to-end 3D TV system with enough views and resolution to provide a truly immersive 3D experience.

Efficient representation and streaming of 3D scenes

In the last few years several approaches (Proceedings of the Second International Workshop on Distributed Interactive Simulation and Real-Time Application, 1998, pp. 88–91; EUROGRAPHICS 2001, vol. 20(3) 2001) have been presented, which address the transmission and visualization of 3D scenes on distributed devices with different capabilities. These techniques are in the interest of a wide field of applications such as virtual chatrooms, product presentations, CAVE visualizations, 3D simulations, or 3D online games. In order to adapt the immense data effort to the capabilities of the devices and the networks, two basic problems have to be solved: the selection of the information according to the user's interest and the reduction of the selected data. Usually the first problem is reduced to visual aspects, which can be determined by visibility culling algorithms. This paper concentrates on the second problem and introduces a system in order to stream the data of even large 3D scenes to remote devices.

Digital route panoramas

Route panorama is a new image medium for digitally archiving and visualizing scenes along a route. It's suitable for registration, transmission, and visualization of route scenes. This article explores route panorama projection, resolution, and shape distortion. It also discusses how to improve quality, achieve real-time transmission, and display long route panoramas on the Internet.

Motion and disparity field estimation using rate-distortion optimization

A rate-distortion framework is used to define a displacement vector field estimation technique for use in video coding. This technique achieves maximum reconstructed image quality under the constraint of a target bit rate for the coding of the vector sequence. The technique may be adapted so as to limit its smoothing effect to homogeneous areas and avoid highly textured areas and edges. Use of this technique is evaluated for two application areas in which the need for high compression of displacement vector fields is particularly acute. The first is motion field coding for very-low-bit-rate image sequence transmission, as in video-phone applications. The second application area is coding for the transmission of dense disparity fields. This is needed for the generation at the receiver of intermediate viewpoints through spatial interpolation. It is also needed in a number of other applications requiring accurate depth knowledge, including three-dimensional medical data transmission and transmission of scenes to be postprocessed using depth-keyed segmentation. Experimental results illustrating the performance of the proposed technique in these application areas are presented and evaluated.

Motion and disparity field estimation using rate-distortion optimization

A rate-distortion framework is used to define a displacement vector field estimation technique for use in video coding. This technique achieves maximum reconstructed image quality under the constraint of a target bit rate for the coding of the vector sequence. The technique may be adapted so as to limit its smoothing effect to homogeneous areas and avoid highly textured areas and edges. Use of this technique is evaluated for two application areas in which the need for high compression of displacement vector fields is particularly acute. The first is motion field coding for very-low-bit-rate image sequence transmission, as in video-phone applications. The second application area is coding for the transmission of dense disparity fields. This is needed for the generation at the receiver of intermediate viewpoints through spatial interpolation. It is also needed in a number of other applications requiring accurate depth knowledge, including three-dimensional medical data transmission and transmission of scenes to be postprocessed using depth-keyed segmentation. Experimental results illustrating the performance of the proposed technique in these application areas are presented and evaluated.

TV Transmission of Three-Dimensional Scenes by Using Fly's Eye Lenses

TV Transmission of Three-Dimensional Scenes by Using Fly's Eye Lenses

The Effect of Channel Errors in the Differential Pulse-Code-Modulation Transmission of Sampled Imagery

This paper presents an analysis, simulation, and discussion of the effects of communication errors on four-bit differential pulse-code modulation (DPCM) sampled imagery. Simulations are presented that describe the effects of inserting periodic PCM updates in order to correct communication errors in the DPCM transmission of photographic scenes that have been scanned and sampled at the Nyquist rate.

Television in the United States

THE October issue of Electronics contains an illustrated article surveying the principal systems of television which are undergoing development in the United States of America. Of the six systems reviewed, four employ a cathode ray oscillograph type of tube for both transmission and reception; while the other two employ mechanical-optical systems comprising a vibrating mirror or a rotating mirrored disc, in conjunction with a photoelectric cell for transmission and a Kerr cell for reception. All the methods are capable of transmitting scenes photographed on the standard size of cinematograph film; most of them are also suitable for the transmission of studio scenes, while some can be successfully operated on outdoor scenic material. The number of scanning lines into which the picture is dissected for transmission varies from 60 to 400, while an average value of 240 lines is very popular. The transmission of such a picture at the standard cinematograph rate of 24 per second requires a communication channel of the order of 1,000 kc./sec., as compared with the space of 9 or 10 kc./sec. permitted in modern sound broadcasting. Such a large band-width is considered to be essential for satisfactory picture reproduction, and this technical limitation presents one of the most serious problems to the television worker. It requires transmitting and receiving circuits of great complexity and high cost, and it would appear to limit the available waveband for broadcast television to the ultra-short region below 10 metres. The article referred to discusses briefly the prospects of the commercial application of television in America, and expresses the opinion that in addition to the technical problems, there are other difficulties of a financial nature involved in the provision of a television programme service throughout the country.