Wireless Video Transmission Research Articles

Voice interactive information metasurface system for simultaneous wireless information transmission and power transfer

Intelligent voice interaction offers a flexible and powerful way to connect individuals with smart devices beyond our expectations. The real-time nature of voice communication enables smart devices to comprehend the user language, execute the corresponding instructions, and facilitate seamless communications, transforming our lives in unprecedented ways. Owing to self-adaptive and reprogrammable functionalities, information metasurface (IMS) opens up a new avenue for smart home and smart cities. To further enhance the intelligence of IMS, we propose an IMS system via intelligent voice interaction and information processing. The voice interaction enables the efficient remote control on the IMS in a flexible, convenient, touchless manner. Leveraging speech recognition, speech synthesis, target detection, and communication technologies, the IMS system achieves automatic beam manipulation capabilities for wireless information transmissions and wireless power transfers. The IMS system is designed to operate in two distinct modes: instruction mode, wherein the user instructs the operations, and autonomous mode, wherein the automatic detections govern the actions, in which seamless mode switching through the voice commands is supported. Users can flexibly achieve precise control over the functions of the intelligent metasurface system through voice interaction at a distance, without the need for close-range manual touch control, which greatly simplifies the operation difficulty and is particularly suitable for remote control and complex application scenarios. A series of experiments, including wireless video transmissions and wireless power transfers are conducted to demonstrate the flexibility and convenience of the IMS system. The incorporation of intelligent voice interaction technology with the IMS presents a novel paradigm for the applications of programmable and information metasurfaces.

Toward Intraoperative Visual Intelligence: Real-Time Surgical Instrument Segmentation for Enhanced Surgical Monitoring.

Open surgery relies heavily on the surgeon's visual acuity and spatial awareness to track instruments within a dynamic and often cluttered surgical field. This system utilizes a head-mounted depth camera to monitor surgical scenes, providing both image data and depth information. The video captured from this camera is scaled down, compressed using MPEG, and transmitted to a high-performance workstation via the RTSP (Real-Time Streaming Protocol), a reliable protocol designed for real-time media transmission. To segment surgical instruments, we utilize the enhanced U-Net with GridMask (EUGNet) for its proven effectiveness in surgical tool segmentation. For rigorous validation, the system's performance reliability and accuracy are evaluated using prerecorded RGB-D surgical videos. This work demonstrates the potential of this system to improve situational awareness, surgical efficiency, and generate data-driven insights within the operating room. In a simulated surgical environment, the system achieves a high accuracy of 85.5% in identifying and segmenting surgical instruments. Furthermore, the wireless video transmission proves reliable with a latency of 200 ms, suitable for real-time processing. These findings represent a promising step towards the development of assistive technologies with the potential to significantly enhance surgical practice.

Experimental demonstration of a free space optical wireless video transmission system based on image compression sensing algorithm

The wireless transmission of video data mainly entails addressing the massive video stream data and ensuring the quality of image frame transmission. To reduce the amount of data and ensure an optimal data transmission rate and quality, we propose a free-space optical video transmission system that applies compressed sensing (CS) algorithms to wireless optical communication systems. Based on the Artix-7 series field programmable gate array (FPGA) chip, we completed the hardware design of the optical wireless video transceiver board; the CS image is transmitted online to the FPGA through Gigabit Ethernet, and the video data is encoded by gigabit transceiver with low power (GTP) and converted into an optical signal, which is relayed to the atmospheric turbulence simulation channel through an attenuator and a collimating mirror. After the optical signal is decoded by photoelectric conversion at the receiving end, the Camera-Link frame grabber is d; thus, the image is collected, and it is reconstructed offline. Herein, the link transmission conditions of different algorithm sampling rates, optical power at the receiving end, and atmospheric coherence length are measured. The experimental results indicate that the encrypt-then-compress (ETC) type algorithm exhibits a more optimal image compression transmission reconstruction performance, and that the 2D compressed sensing (2DCS) algorithm exhibits superior performance. Under the condition that the optical power satisfies the link connectivity, the PSNR value of the reconstructed image is 3–7 dB higher than that of the comparison algorithm. In a strong atmosphere turbulence environment, the peak signal-to-noise ratio (PSNR) of the corresponding reconstructed image under different transmission rates at the receiving end can still exceed 30 dB, ensuring the complete reconstruction of the image.

Error resilient wireless video transmission via parallel processing using puncturing rule enabled coding and decoding

The innovation in wireless video transmission lies in the methodology's holistic approach, which combines parallel processing, puncturing rule-enabled coding, comprehensive error correction, and focused video frame reconstruction. The methodology includes several stages, including video frame processing, channel coding, error simulation, and Viterbi decoding, all of which are optimized for improved performance. Parallel processing is used at each stage to improve computational efficiency. Convolutional encoding is used concurrently, with a puncturing rule to tailor the encoding process for individual packets. Following that, a binary symmetric channel model is used to simulate bit errors, allowing the system's error-resilient characteristics to be evaluated. Beyond the analysis performed on previously studied videos, the proposed approach is thoroughly evaluated across three distinct video datasets. Furthermore, the study delves into BER analysis, encompassing various error probabilities and employing incremental redundancy. This investigation sheds light on the system's robustness in correcting errors in a variety of error scenarios. Throughput measurements provide important information about the achieved data transmission rate during successful receptions, whereas the elapsed time metric measures the overall efficiency of the transmission process. Furthermore, the proposed method assesses Mean Squared Error (MSE) at 0.48 and Peak Signal-to-Noise Ratio (PSNR) at 51.30 dB across the entire operational process. The combined findings highlight the proposed approach's superiority, positioning it as a promising solution for robust and efficient wireless video communication. This results in a more stable and efficient gearbox system, distinguishing it from existing system.

Analog Backscatter Video Transmission for Wireless Capsule Endoscope

Wireless capsule endoscopy is a fast-growing technology in healthcare systems. Due to using battery for powering the camera, light source, wireless communication, and other electronics, it has substantial limitations with the image quality, frame rate, and operating time. In this work, we propose a wireless passive video transmission system for capsule endoscopy, in which the power consumption is reduced by using analog camera sensor, and implementing an innovative radar technique for remote reading of the analog video signal using radio frequency backscattering. The power consumption of the capsule communication system tends to zero. The communication electronics system is minimized to a single Varactor diode with appropriate matching circuits and the image sensor power consumption is reduced by eliminating the camera sensor’s analog to digital converter. With these improvements the capsule system can operate for a longer period of time which enables the feasibility of continuous video streaming during the gastric tract screening. The design feasibility is demonstrated in a phantom experiment, and validated in an animal experiment for depths 6–11 cm using a bi-static radar system at 400 MHz, implemented using software defined radio platform.

Resource Optimization for 3D Video SoftCast with Joint Texture/Depth Power Allocation

During wireless video transmission, channel conditions can vary drastically. When the channel fails to support the transmission bit rate, the video quality degrades sharply. A pseudo-analog transmission system such as SoftCast relies on linear operations to achieve a linear quality transition over a wide range of channel conditions. When transmitting 3D videos over SoftCast, the following issues arise: (1) assigning the transmission power to texture and depth maps to obtain the optimal overall quality and (2) handling 3D video data traffic by dropping and re-allocating resources. This paper solves the pseudo-analog transmission resource allocation problem and improves the results by applying the optimal joint power allocation. First, the minimum and the target distortion optimization problems are formulated in terms of a power–bandwidth pair versus distortion. Then, a minimum distortion optimization algorithm iteratively computes all the possible resource allocations to find the optimal allocation based on the minimum distortion. Next, the three-dimensional target distortion problem is divided into two subproblems. In the power-distortion problem, to obtain a target distortion, the algorithm exhaustively solves the closed form of the power resource under a predefined upper-bound bandwidth. For the bandwidth-distortion problem, reaching a target distortion requires solving iteratively for the bandwidth resource closed form, given a predefined power. The proposed resource control scheme shows an improvement in transmission efficiency and resource utilization. At low power usage, the proposed method could achieve a PSNR gain of up to 1.5 dB over SoftCast and even a 1.789 dB gain over a distortion-resource algorithm, using less than 1.4% of the bandwidth.

Soft transmission of 3D video for low power and low complexity scenario

Thanks to the rapid development of naked-eye 3D and wireless communication technology, 3D video related applications on mobile devices have attracted a lot of attention. Nevertheless, the time-varying characteristics of the wireless channel is very challenging for conventional source-channel coding based transmission strategy. Also, the high complexity of source-channel coding based transmission scheme is undesired for low power mobile terminals. An advanced transmission scheme named Softcast was proposed to achieve efficient transmission performance for 2D image/video. Unfortunately, it cannot be directly applied to wireless 3D video transmission with high efficiency. This paper proposes a more efficient soft transmission scheme for 3D video with a graceful quality adaptation within a wide range of channel Signal-to-Noise Ratio (SNR). The proposed method first extends the linear transform to 4 dimensions with additional view dimension to eliminate the view redundancy, and then metadata optimization and chunk interleaving are designed to further improve the transmission performance. Meanwhile, a synthesis distortion based chunk discard strategy is developed to improve the overall 3D video quality under the condition of limited bandwidth. The experimental results demonstrate that the proposed method significantly improves the 3D video transmission performance over the wireless channel for low power and low complexity scenarios.

S-CAM: An Untethered Insertable Laparoscopic Surgical Camera Robot with Non-Contact Actuation

Fully insertable robotic imaging devices represent a promising future of minimally invasive laparoscopic vision. Emerging research efforts in this field have resulted in several proof-of-concept prototypes. One common drawback of these designs derives from their clumsy tethering wires which not only cause operational interference but also reduce camera mobility. In this paper, a tetherless insertable surgical camera (s-CAM) robot with non-contact transabdominal actuation is presented for single-incision laparoscopic vision. Wireless video transmission and control communication using onboard power help eliminate cumbersome tethering wires. Furthermore, magnetic based camera actuation gets rid of intrinsic physical constraints of mechanical driving mechanisms, thereby improving camera mobility and reducing operational interference. In addition, a custom Bluetooth low energy (BLE) application profile and a real-time operating system (RTOS) based multitask programming framework are also proposed to facilitate embedded software design for insertable medical devices. Initial ex vivo test results of the s-CAM design have demonstrated technical feasibility of a tetherless insertable laparoscopic camera. Effective imaging is confirmed at as low as 500 lx illumination. Wireless laparoscopic vision is accessible within a distance of more than 10 m. Transabdominal BLE communication is stable at over −52 dBm and shows its potential for wireless control of insertable medical devices. RTOS based sfotware event response is bounded within 1 ms while the CPU usage is at 3∼5%. The device is able to work for 50 min with its onboard power. For the mobility, the robot can translate against the interior abdominal wall to reach full abdomen quadrants, tilt between −180 and +180, and pan in the range of 0∼360. The s-CAM has brought robotic laparoscopic imaging one step further toward less invasiveness and more dexterity.

Wireless multipath video transmission: when IoT video applications meet networking—a survey

Wireless multipath video transmission: when IoT video applications meet networking—a survey

Visual Communication Design Based on Collaborative Wireless Communication Video Transmission

With the development of wireless communication technology, video and multimedia have become an integral part of visual communication design. Designers want higher interactivity, diversity, humanization, and plurality of attributes in the process of visual communication. This makes the process of visual communication have high requirements for the quality and real-time data transmission. To address the problem of transmitting HD video in a heterogeneous wireless network with multiple concurrent streams to improve the transmission rate and thus enhance the user experience, with the optimization goal of minimizing the system transmission delay and the delay difference between paths, the video sender and receiver are jointly considered, and the video transmission rate and the cache size at the receiver are adaptively adjusted to improve the user experience, and a cooperative wireless communication video transmission based on the control model for video transmission based on cooperative wireless communication is established, and video streams with self-similarity and long correlation are studied based on Pareto distribution and P / P / l queuing theory, based on which an adaptive streaming decision method for video streams in heterogeneous wireless networks is proposed. Simulation results show that the proposed multistream concurrent adaptive transmission control method for heterogeneous networks is superior in terms of delay and packet loss rate compared with the general load balancing streaming decision method, in terms of transmission efficiency and accuracy.

Measurement of latency during real-time wireless video transmission for remote supervision of autonomous agricultural machines

As the prominence of autonomous vehicles continues to rise within agriculture, remote surveillance of the equipment is likely to become a key aspect of operation. Transmission latency during the relay of video from vehicle to viewer is not well explored and is an important part of communications which should be assessed. A riding mower was equipped with a Raspberry Pi using GStreamer and an open-source latency measurement library to assemble a real-time streaming system to evaluate transmission latency in different environments using cellular and radio transmission. In most locations, measured latencies were under 200–300 ms. In areas where cellular connection quality was adequate, cellular latency and variance were reduced compared to that of radio transmission for higher qualities of video. In areas of poor cellular network coverage, cellular transmission latency increased while radio transmission latencies remained constant. Overall, latency tends to increase with video quality to a statistically significant degree. It is recommended that real-time video can be transmitted over short distances for edge-of-field surveillance of autonomous agricultural machines using existing cellular networks in areas where adequate cellular signal strength is available. If adequate cellular signal strength is not available in a specific field location, it is recommended that video should be transmitted using radio transmission.

A flexible and compact tri‐band antenna for vehicular wireless video transmission systems

A flexible and compact <scp>tri‐band</scp> antenna for vehicular wireless video transmission systems

A low-cost wireless endoscope camera: a preliminary report

BackgroundTechnology currently used for surgical endoscopy was developed and is manufactured in high-income economies. The cost of this equipment makes technology transfer to resource constrained environments difficult. We aimed to design an affordable wireless endoscope to aid visualisation during rigid endoscopy and minimally invasive surgery (MIS). The initial prototype aimed to replicate a 4-mm lens used in rigid cystoscopy.MethodsFocus was placed on using open-source resources to develop the wireless endoscope to significantly lower the cost and make the device accessible for resource-constrained settings. An off the shelf miniature single-board computer module was used because of its low cost (US$10) and its ability to handle high-definition (720p) video. Open-source Linux software made monitor mode (“hotspot”) wireless video transmission possible. A 1280 × 720 pixel high-definition tube camera was used to generate the video signal. Video is transmitted to a standard laptop computer for display. Bench testing included latency of wireless digital video transmission. Comparison to industry standard wired cameras was made including weight and cost. The battery life was also assessed.ResultsIn comparison with industry standard cystoscope lens, wired camera, video processing unit and light source, the prototype costs substantially less. (US$ 230 vs 28 000). The prototype is light weight (184 g), has no cables tethering and has acceptable battery life (of over 2 h, using a 1200 mAh battery). The camera transmits video wirelessly in near real time with only imperceptible latency of < 200 ms. Image quality is high definition at 30 frames per second. Colour rendering is good, and white balancing is possible. Limitations include the lack of a zoom.ConclusionThe novel wireless endoscope camera described here offers equivalent high-definition video at a markedly reduced cost to contemporary industry wired units and could contribute to making minimally invasive surgery possible in resource-constrained environments.

HD video transmission of multi-rotor Unmanned Aerial Vehicle based on 5G cellular communication network

In UAV (Unmanned Aerial Vehicle) mission scenarios for aerial reconnaissance and aerial photography, wireless video backhaul is one of the essential functions. In recent years, with the rapid development of UAV in the military and civilian fields, mobile high-quality video backhaul has become a trend. This paper analyzes the hardware structure and software architecture of the UAV HD video wireless transmission model. The overall model is described from three levels of hardware, software, and link interface, and its software architecture is analyzed. Aiming at the high-frequency and large-bandwidth transmission system under 5G small cells, the influence of new channel characteristics on physical layer parameters is analyzed, and the frame structure design parameters such as subcarrier spacing and cyclic prefix are optimized. Considering the low throughput rate in multi-hop wireless networks, this paper innovatively proposes a slide mode based on frame rate adjustment. The simulation results show that the revised throughput prediction value has higher accuracy than the traditional method, and the bit rate adjustment is timely and can maintain a certain stability. Combining the advantages of the high and low bit rate schemes, the continuous video transmission is maintained while providing higher quality.

A Design of SDR-Based Pseudo-analog Wireless Video Transmission System

The pseudo-analog wireless video transmission technology can improve the effectiveness, reliability, and robustness of the conventional digital system in video broadcast scenarios. Although some prototypes of IEEE 802.11 series have been developed for researchers to do simulations and experiments, they are usually expensive and provide very limited access to the physical layer. More importantly, these prototypes cannot be used to verify the correctness of the new proposed pseudo-analog wireless video transmission algorithms directly due to limited modulation modes they can support. In this paper, we present a novel design of software radio platform (SDR)-based pseudo-analog wireless video transceiver which is completely transparent and allows users to learn all the implementation details. Firstly, we prove that the analog method can also achieve the optimal performance as the digital method from the perspective of the rate-distortion theory. Then, we describe the two hardware implementation difficulties existed in the designing process including the data format modification and the non-linear distortion. Next, we introduce the implementation details of the designed transceiver. Finally, we analyze the performance of the designed transceiver. Specifically, the results show that the designed system can work effectively in both simulations and experiments.

Closely Mounted UWB MIMO Antenna with Notch Characteristics for Short-Range Wireless Video Transmission Application

ABSTRACT In this paper, we introduce a four-port self-isolated double-sided Ultra Wide Band (UWB) MIMO antenna with WLN notch characteristics for short-range wireless high-definition (HD) video transmission applications. The double side orthogonal arrangement of the radiators is adopted to mitigate the mutual coupling between the four radiators without using an isolation structure. The proposed MIMO antenna design provides a UWB band with the notch characteristics at 5 GHz (4.6–5.9 GHz) by removing tapered rectangular slot. Employing a two-sided structure technique, it achieves an impedance bandwidth of 3.1–13 GHz while keeping isolation above 20 dB and a compact size of . Critical parameters that affect antenna performance, such as bandwidth, surface current, radiation characteristics, envelope correlation coefficient (ECC), peak gain, are being investigated. Also, the proposed simulation and measurement results of the two-sided MIMO antenna show that it is suitable for UWB because of wide impedance bandwidth, radiation pattern, high gain, low ECC, and high isolation. Indoor environment test was conducted using the National Instruments (NI) 802.11 framework to verify the real-time short-range wireless HD video transmission and reception capacity of the proposed MIMO antenna.

Outage-Capacity-Based Cross Layer Resource Management for Downlink NOMA-OFDMA Video Communications: Non-Deep Learning and Deep Learning Approaches

Prior works either considered outage capacity of wireless video transmission systems but did not consider NOMA which is a key technology for 5G ultra-reliable low-latency (URLLC), or concerned the ergodic capacity of NOMA-OFDMA systems but did not consider the outage capacity emphasized in 5G URLLC scenario. In this paper, outage capacity (as well as ergodic capacity) maximization in a 5G URLLC scenario, are considered, using two proposed resource management schemes (i.e. B, C) and finally, proposed deep-learning-based versions of Schemes B and C (i.e. Schemes B' and C') to reduce the complexity and the latency for 5G URLLC. The proposed schemes re-allocate subcarrier according to outage capacity- instead of ergodic capacity only-maximization objective and choose the candidate user to gain subcarrier in a new way to improve the outage capacity. The numerical results show the proposed Scheme B and C increase the outage capacity (the percentage of satisfied users) from 79.2% for a prior work (Scheme A) to 85.2% and 92.6%, respectively. Scheme C also increases the ergodic capacity (average PSNR) from 34.7dB for Scheme A to 35.5dB. The deep learning based Schemes B' and C' perform slightly poorer than the corresponding non deep learning based Schemes B and C but the execution time/latency of Scheme B'/C' is less than Schemes B/C.

Temporal information based GoP adaptation for linear video delivery schemes

An original wireless video transmission scheme called SoftCast has been recently proposed to deal with the issues encountered in conventional wireless video broadcasting systems (e.g. cliff effect). In this paper, we evaluate and optimize the performance of the SoftCast scheme according to the transmitted video content. Precisely, an adaptive coding mechanism based on GoP-size adaptation, which takes into account the temporal information fluctuations of the video, is proposed. This extension denoted Adaptive GoP-size mechanism based on Content and Cut detection for SoftCast (AGCC-SoftCast) significantly improves the performance of the SoftCast scheme. It consists in modifying the GoP-size according to the shot changes and the spatio-temporal characteristics of the transmitted video. When hardware capacities, such as buffer or processor performance are limited, an alternative method based only on the shot changes detection (AGCut-SoftCast) is also proposed. Improvements up to 16 dB for the PSNR and up to 0.55 for the SSIM are observed with the proposed solutions at the cut boundaries. In addition, temporal visual quality fluctuations are reduced under 1dB in average, showing the effectiveness of the proposed methods.

Joint Texture/Depth Power Allocation for 3-D Video SoftCast

Recently, a novel uncoded (pseudoanalog) scheme called SoftCast is proposed for wireless video transmission, which eliminates the cliff effect of the state-of-the-art source-channel coding based schemes and achieves linear quality transition within a wide range of channel signal-to-noise ratio. Therefore, SoftCast-like uncoded and hybrid transmission has become an attractive research issue for natural 2-D video. However, very few studies focus on the SoftCast-based wireless transmission of the 3-D video (3DV) currently. One critical issue of 3DV SoftCast is how to allocate the limited power budget of the transmitter to the texture videos and depth maps of the 3DV to achieve the optimal overall quality on the receiver side, including the transmission quality of the reference views and the synthesis quality of the virtual views. This paper attempts to solve the optimal joint power allocation problem in an efficient way. First, we formulate the target problem as a constrained power-distortion optimization (PDO) problem mathematically. Then, each part of the distortion is analyzed and formulated in a closed form. Finally, the PDO problem is mapped to an unconstrained convex optimization problem and solved by the Lagrangian multiplier method. Simulation results demonstrate that the performance of the proposed method is close to that of the full search method, which can provide the best performance theoretically. Nevertheless, the complexity of the proposed method is negligible compared with that of the full search method. In addition, as compared with the fixed ratio (e.g., 1:1) power allocation between texture and depth, the proposed method can achieve a PNSR gain up to 1.8 dB.

Reliable and Robust Unmanned Aerial Vehicle Wireless Video Transmission

The wireless video transmission environment of unmanned aerial vehicles (UAVs) is complex and unstable given the high mobility and changeable working conditions of UAVs, which lead to burst and consecutive errors and high error rates. A compressed video stream is extremely sensitive to transmission errors, such that even a single bit error sharply degrades the video quality. Hence, we propose an intraframe pixel-row-interleaved error concealment algorithm that interleaves pixel rows to generate high similarity in different parts of a frame, thereby achieving intraframe error resilience. Subsequently, we suggest an interframe time-field-interleaved alternative motion-compensated prediction that allows for automatic error elimination and recovers at least four consecutive frames in wireless video communications. The experiments demonstrate that the proposed algorithms recover frames with excellent subjective and objective effects. Moreover, these algorithms can provide reliable and robust video transmission for UAVs.