Real-time High-definition Video Research Articles

End-to-End Real-Time Service Provisioning Over a SDN-Controllable Analog mmWave Fiber -Wireless 5G X-Haul Network

The current work presents the first experimental demonstration of real-time Ethernet (ETH) trial services and 4K-Ultra High Definition (UHD) video application transmission over a 2λ Wavelength Division Multiplexing (WDM) analog Fiber-Wireless (FiWi) mmWave X-haul network, supporting dynamic flexible capacity allocation through an integrated silicon photonic Si <sub xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">3</sub> N <sub xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">4</sub> Reconfigurable Optical Add Drop Multiplexer (ROADM) and 60 GHz wireless transmission across a 7 m V-band link distance, while controlled by a Software Defined Network (SDN) controller based on Open Daylight. Analog X-haul transport of the radio signals is based on an Intermediate Frequency over Fiber (IFoF) scheme centered at 1.5 GHz using an Orthogonal Frequency Division Multiplexing (OFDM) radio-waveform with a bandwidth of 204 MHz, generated by a Field Programmable Gated Array (FPGA)-based RF System-on-Chip (SoC) processor that converts on-the-fly the real-time ETH downlink traffic to analog radio and vice-versa for the uplink. Dynamic allocation of the X-haul traffic capacity is handled through the use of the 802.1Q Virtual Local Area Network (VLAN) tag-mechanism, which controls the forwarding operation to the proper DAC and InP EML for optical modulation using Intensity Modulation/Direct Detection (IM/DD) schemes, while the wavelength routing operation is handled by the low-loss four-port Si <sub xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">3</sub> N <sub xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">4</sub> ROADM featuring only 2.5 dB fiber-to-fiber losses based on a cascaded MZI-interleaver design on the TriPleX platform, routing the real-time traffic to a second mmWave antenna site. Detailed measurements and traffic statistics indicate end-to-end latency of less than 260 μs and a packet loss less than 0.0054% across a dynamic range of at least 6.5 dB in the optical domain, while the high user bandwidth and signal quality are validated by an uninterrupted 4K-UHD video transmission across the FiWi X-haul mmWave transport network. The current work aims to shape a complete technology roadmap for Point-to-Multipoint FiWi transport network architectures with high spectral efficiency X-haul transport for dense areas and 5G/6G hotspots of future mmWave Centralized Radio Access Networks (C-RANs).

Diagnóstico intraoperatorio remoto en Patología con transmisión de vídeo de alta definición a través de YouTube y Twitch

IntroductionRemote diagnosis of frozen sections is an important asset for hospitals that do not have full-time pathologists. Ongoing advances in information technology are constantly being incorporated and we have used real time high-definition video. Material and methodsOur microscope was connected to a video camera with a 1080p resolution and its signal sent to the computer where OBS software encoded and transmitted video streams to YouTube and Twitch distribution platforms. ResultsThe high-quality image thus achieved allows an accurate, remote evaluation of frozen sections. Access through web pages allows them to be reviewed anywhere from any device with an Internet connection. DiscussionRemote intraoperative diagnosis is a challenge for pathologists and image quality is a critical requirement for its implementation, which can be solved by video streaming technology. The proper training of technicians is essential. This system can also be applied to many other areas of pathology, such as teaching and consultation.

Accelerating Haze Removal Algorithm Using CUDA

The dark channel prior (DCP)-based single image removal algorithm achieved excellent performance. However, due to the high complexity of the algorithm, it is difficult to satisfy the demands of real-time processing. In this article, we present a Graphics Processing Unit (GPU) accelerated parallel computing method for the real-time processing of high-definition video haze removal. First, based on the memory access pattern, we propose a simple but effective filter method called transposed filter combined with the fast local minimum filter algorithm and integral image algorithm. The proposed method successfully accelerates the parallel minimum filter algorithm and the parallel mean filter algorithm. Meanwhile, we adopt the inter-frame atmospheric light constraint to suppress the flicker noise in the video haze removal and simplify the estimation of atmospheric light. Experimental results show that our implementation can process the 1080p video sequence with 167 frames per second. Compared with single thread Central Processing Units (CPU) implementation, the speedup is up to 226× with asynchronous stream processing and qualified for the real-time high definition video haze removal.

New Motion Estimation Algorithms and its VLSI architectures for Real Time High Definition Video Coding

This paper presents an efficient hardware design using the new Motion Estimation (ME) algorithms named: Multi-point Diamond Search (MPDS) and Dynamic Multi-Point Diamond Search (DMPDS). These algorithms are more efficient to avoid from local minima falls than traditional fast algorithms.This fact contributes to increase the quality of the motion vectors, especially in High Definition (HD) videos, were the number of local minima are considerable higher. Two versions of MPDS algorithm were proposed. The first one, focused on high performance, is capable to process videos QFHD at 30 frames per second when synthesized to Altera Stratix 4 and 90nm TSCM, with only 18mW. The second version is focused on quality enhancement and is capable to process HD 1080p videos in real time. The DMPDS architecture has been developed focusing on high performance and was synthesized to Altera stratix 4. This architecture is capable to process videos QFHD at 34 frames per second. In comparison to related works, our solutions obtained the highest processing rates, and a good trade-off among power consumption, area, memory bits and performance.

Near-earth space two-dimension opto-electronic turntable design

Near earth space is a space which has important strategic significance and application value in military, scientific exploration and other industry fields, one of the most practical application is to make a reconnaissance platform that can work normally in the near earth space. In this paper, a two-dimensional photoelectric turntable for video surveillance in near-earth space is designed, which can observe the azimuth angle 360° and pitch angle from −110° to 10°, and the capacity of this photoelectric turntable is 7 kg in a space of ϕ300 mm. The optical imaging load in the photoelectric turntable can output high-definition video in real time and the original image is stored in the memory card simultaneous. What is more, the imaging effect can be adjusted by controlling the magnification and focal length by sending commands through serial communication ports. The two-dimensional photoelectric turntable designed in this paper is mounted on the payload cabin and raised to 32.5 km for surveillance imaging. The experimental results show that the two-dimensional photoelectric turntable can work normally in the harsh near space environment, and the optical imaging load can output and record fluent high-definition video. The photoelectric turntable designed in this paper will be equipped with other optical load and take part in some near space exploration tasks in the future and obtain corresponding result.

A QoE Evaluation Method for RT-HDMV Based on Multipath Relay Service

Multipath diversity leads to a possible higher performance for real-time high definition video, especially for medical video transmission, which would improve the stability of multiple transmission paths in the symmetrical state, and avoid the potential losses of imaging information in the communication process. Most of the previous works are always based on the single-path end-to-end transmission, although the service had been demonstrated that it is unable to meet the rigorous demand for the RT-HDMV. In the paper, a multipath relay service based on the QoE (quality of experience) evaluation method is proposed for the RT-HDMV (real-time high definition medical video). The method eliminates several of the limitations in the existing methods for some conventional single-path transmission. It can fully utilize the finite network resources and transmission bandwidth to meet the users’ demands of the RT-HDMV to get a better score of the QoE. We use a four-stage framework to evaluate the QoE, which consists of constructing the multipath relay transmission for the RT-HDMV, calculating the weights of diversified QoS parameters in the multipath, designing the load distribution strategy by the mapping between the QoS (quality of service) and QoE, and redefining the rule of the QoE evaluation. Many experiments show that the proposed design scheme achieves weighting of the transmission sub-paths and computes the QoE score. Compared with the state-of-art methods in the single path transmission scene, our framework mainly gains the excellent performance for the RT-HDMV.

The Future of Earth Observation in Hydrology.

In just the past five years, the field of Earth observation has progressed beyond the offerings of conventional space agency based platforms to include a plethora of sensing opportunities afforded by CubeSats, Unmanned Aerial Vehicles (UAVs), and smartphone technologies that are being embraced by both for-profit companies and individual researchers. Over the previous decades, space agency efforts have brought forth well-known and immensely useful satellites such as the Landsat series and the Gravity Research and Climate Experiment (GRACE) system, with costs typically on the order of one billion dollars per satellite and with concept-to-launch timelines on the order of two decades (for new missions). More recently, the proliferation of smartphones has helped to miniaturise sensors and energy requirements, facilitating advances in the use of CubeSats that can be launched by the dozens, while providing ultra-high (3-5 m) resolution sensing of the Earth on a daily basis. Start-up companies that did not exist five years ago now operate more satellites in orbit than any space agency, and at costs that are a mere fraction of the cost of traditional satellite missions. With these advances come new space-borne measurements, such as real-time high-definition video for tracking air pollution, storm-cell development, flood propagation, precipitation monitoring, or even for constructing digital surfaces using structure-from-motion techniques. Closer to the surface, measurements from small unmanned drones and tethered balloons have mapped snow depths, floods, and estimated evaporation at sub-meter resolutions, pushing back on spatio-temporal constraints and delivering new process insights. At ground level, precipitation has been measured using signal attenuation between antennae mounted on cell phone towers, while the proliferation of mobile devices has enabled citizen-scientists to catalogue photos of environmental conditions, estimate daily average temperatures from battery state, and sense other hydrologically important variables such as channel depths using commercially available wireless devices. Global internet access is being pursued via high altitude balloons, solar planes, and hundreds of planned satellite launches, providing a means to exploit the Internet of Things as an entirely new measurement domain. Such global access will enable real-time collection of data from billions of smartphones or from remote research platforms. This future will produce petabytes of data that can only be accessed via cloud storage and will require new analytical approaches to interpret. The extent to which today's hydrologic models can usefully ingest such massive data volumes is unclear. Nor is it clear whether this deluge of data will be usefully exploited, either because the measurements are superfluous, inconsistent, not accurate enough, or simply because we lack the capacity to process and analyse them. What is apparent is that the tools and techniques afforded by this array of novel and game-changing sensing platforms present our community with a unique opportunity to develop new insights that advance fundamental aspects of the hydrological sciences. To accomplish this will require more than just an application of the technology: in some cases, it will demand a radical rethink on how we utilise and exploit these new observing systems to enhance our understanding of the Earth and its linked processes.

Performance of Video Streaming in Infrastructure-to-Vehicle Telematic Platforms With 60-GHz Radiation and IEEE 802.11ad Baseband

This paper proposes feasible and satisfactory system design parameters to mitigate the impact of interference on real-time high-definition video streaming in infrastructure-to-vehicle (I2V) telematic platforms utilizing 60-GHz radiation and the corresponding IEEE 802.11ad baseband. The analysis captures the impact of interference on the 60-GHz I2V vehicle (IV), which is caused by multiple interference sources through the 60-GHz wireless transmissions from nearby I2V base stations (IBSs) to their associated IVs. The impact of the interference on the quality of main 1080p at 30-frame/s (30 1080p frames/s) and 1080p at 60-frame/s (60 1080p frames/s) streaming is analyzed and estimated for various simulation settings.

Demonstration of 2.97-Gb/s video signal transmissions in DML-based IM-DDO-OFDM systems

Abstract To further investigate the feasibility of the digital signal processing (DSP) algorithms (e.g., symbol timing synchronization, channel estimation and equalization, and sampling clock frequency offset (SCFO) estimation and compensation) for real-time optical orthogonal frequency-division multiplexing (OFDM) system, 2.97-Gb/s real-time high-definition video signal parallel transmission is experimentally demonstrated in OFDM-based short-reach intensity-modulated direct-detection (IM-DD) systems. The experimental results show that, in the presence of ∼12 ppm SCFO between transmitter and receiver, the adaptively modulated OFDM signal transmission over 20 km standard single-mode fiber with an error bit rate less than 1 × 10−9 can be achieved by using only DSP-based small SCFO estimation and compensation method without utilizing forward error correction technique. To the best of our knowledge, for the first time, we successfully demonstrate that the video signal at a bit rate in excess of 1-Gb/s transmission in a simple real-valued inverse fast Fourier transform and fast Fourier transform based IM-DD optical OFDM system employing a directly modulated laser.

Real-time dual-band wireless videos in millimeter-wave radio-over-fiber system

A dual-band converged radio-over-fiber (RoF) access system at 60-GHz and 100-GHz millimeter-wave (mm-wave) is proposed. Real-time end-to-end delivery of two channels of independent high-definition (HD) video services simultaneously carried on 60-GHz and 100-GHz radios is demonstrated for the first time. PRBS data transmission with equivalent data rate and format is also tested to characterize the system performance. The analysis of the spectrum from the beating signal indicates the entire 60-GHz band and the W-band can be retrieved without interference. The real-time HD video display and error-free (BER<10–9) data transmission demonstrate the feasibility of the proposed wireless access system using converged fiber-optic and mm-wave RoF techniques.

A High Performance Hardware Architecture of H.264/AVC Fractional Motion Estimation

High-efficiency VLSI architecture based on data route and synchronous interpolation methodology for H.264/AVC fractional motion estimation is proposed in this paper. Data obtained from interpolation on-line are allocated to the next pipeline element, half-pixel and quarter-pixel matching circuit is time sharing multiplexed, bandwidth requirement is reduced, data throughput is improved, and hardware cost is saved effectively. The designs are implemented with 0.13 μm CMOS technology, experimental results show that the throughput of the proposed architecture can meet the speed requirements of real-time high-definition video encoding (1920x1080@30 fps) at the clock frequency of 300 MHz.

Real-time camera motion tracking in planar view scenarios

We propose a novel method for real-time camera motion tracking in planar view scenarios. This method relies on the geometry of a tripod, an initial estimation of camera pose for the first video frame and a primitive tracking procedure. This process uses lines and circles as primitives, which are extracted applying classification and regression tree. We have applied the proposed method to high-definition videos of soccer matches. Experimental results prove that our proposal can be applied to processing high-definition video in real time. We validate the procedure by inserting virtual content in the video sequence.

Demonstration and Comparison Study for V- and W-Band Real-Time High-Definition Video Delivery in Diverse Fiber-Wireless Infrastructure

This article experimentally demonstrates uncompressed high-definition video distribution in V-band (50–75 GHz) and W-band (75–110 GHz) fiber-wireless links achieving 3 m of wireless transmission in both cases. Access architecture is experimentally emulated by deploying single/multi-mode fibers. For the W-band, experimental assessment of passive and active approaches for implementation of remote antenna units is reported. The bit error rate performance of the optical and wireless channels is reported. A successful transmission of real-time uncompressed high-definition video in the V- and W-band fiber-wireless systems is demonstrated with prospects to pave the way for application-focused fiber-wireless connectivity.

Ultrawideband Signal Distribution Over Large-Core POF for In-Home Networks

A proof-of-concept real-time high definition (HD) video stream delivered over 50 m of 1 mm core diameter graded index plastic optical fiber and 3 m wireless link employing multiband orthogonal frequency division multiplexing ultrawideband (UWB) technology is studied and demonstrated. The HD video signal encapsulated into UWB frames exhibited an error vector magnitude performance of 11.9%, which is compliant with Federal Communications Commission requirements. Low-cost and off-the-shelf components were employed to realize a cost-effective solution for broadband in-home networks.

Joint Algorithm-Architecture Optimization of CABAC

This paper uses joint algorithm and architecture design to enable high coding efficiency in conjunction with high processing speed and low area cost. Specifically, it presents several optimizations that can be performed on Context Adaptive Binary Arithmetic Coding (CABAC), a form of entropy coding used in H.264/AVC, to achieve the throughput necessary for real-time low power high definition video coding. The combination of syntax element partitions and interleaved entropy slices, referred to as Massively Parallel CABAC, increases the number of binary symbols that can be processed in a cycle. Subinterval reordering is used to reduce the cycle time required to process each binary symbol. Under common conditions using the JM12.0 software, the Massively Parallel CABAC, increases the bins per cycle by 2.7 to 32.8× at a cost of 0.25 to 6.84% coding loss compared with sequential single slice H.264/AVC CABAC. It also provides a 2× reduction in area cost, and reduces memory bandwidth. Subinterval reordering reduces the critical path delay by 14 to 22%, while modifications to context selection reduces the memory requirement by 67%. This work demonstrates that accounting for implementation cost during video coding algorithms design can enable higher processing speed and reduce hardware cost, while still delivering high coding efficiency in the next generation video coding standard.

Architectures for multi-threaded MVC-compliant multi-view video decoding and benchmark tests

3D video based on stereo/multi-view representations is becoming widely popular. Real-time encoding/decoding of such video is an important concern as the number and spatial/temporal resolution of views increase. We present a systematic method for design and optimization of multi-threaded multi-view video encoding/decoding algorithms using multi-core processors and provide benchmark results for real-time decoding. The proposed multi-core decoding architectures are compliant with the current MVC extension of H.264/AVC international standard, and enable multi-threaded processing with negligible loss of encoding efficiency and minimum processing overhead. Benchmark results show that multi-core processors and multi-threading decoding are necessary for real-time high-definition multi-view video decoding and display.

The sarnoff engine: A massively parallel computer for high definition system simulation

This paper describes the Sarnoff Engine, a 1.6 TeraFLOP, ral-time, high definition, video and image processing computer. It is a second generation, scalable, linear array, multi-user, MIMD architecture focused on the applications of real-time high definition video and image processing (data compression encoders and decoders), 3D/4D data visualization, and neural network development. >