Full HD Research Articles

Optimized Hardware Design using Sobel and Median Filters for Lane Detection

In this paper, the image is received from the camera and the lane is sensed. There are various ways to detect lanes. Generally, the method of detecting edges uses a lot of the Sobel edge detection and the Canny edge detection. The minimum use of multiplication and division is used when designing for the hardware configuration. The images are tested using a black box image mounted on the vehicle. Because the top of the image of the used the black box is mostly background, the calculation process is excluded. Also, to speed up, YCbCr is calculated from the image and only the data for the desired color, white and yellow lane, is obtained to detect the lane. The median filter is used to remove noise from images. Intermediate filters excel at noise rejection, but they generally take a long time to compare all values. In this paper, by using addition, the time can be shortened by obtaining and using the result value of the median filter. In case of the Sobel edge detection, the speed is faster and noise sensitive compared to the Canny edge detection. These shortcomings are constructed using complementary algorithms. It also organizes and processes data into parallel processing pipelines. To reduce the size of memory, the system does not use memory to store all data at each step, but stores it using four line buffers. Three line buffers perform mask operations, and one line buffer stores new data at the same time as the operation. Through this work, memory can use six times faster the processing speed and about 33% greater quantity than other methods presented in this paper. The target operating frequency is designed so that the system operates at 50MHz. It is possible to use 2157fps for the images of 640by360 size based on the target operating frequency, 540fps for the HD images and 240fps for the Full HD images, which can be used for most images with 30fps as well as 60fps for the images with 60fps. The maximum operating frequency can be used for larger amounts of the frame processing.

No-reference artifacts measurements based video quality metric

In multimedia delivery, perceived quality of video signal has a significant role in overall users Quality of Experience (QoE). Therefore, multimedia service providers must constantly measure and monitor perceived video quality, which is usually performed using no-reference (NR) video quality metrics. In this paper, a novel NR objective video quality metric named Artifacts Measurements Based Video Quality Metric (AMB-VQM) is proposed. In addition to artifacts measures computed by blocking (BL), packet-loss (PL), and freezing (FZ) artifacts detection algorithms, the metric incorporates artifacts masking based on spatial and temporal video content complexity. Furthermore, a newly created FERIT-RTRK-2 video quality database, which contains 486 Full HD test video sequences impaired by video compression (MPEG-2, H.264/AVC, and H.265), packet-loss, frame freezing, and combinations of these procedures, is presented in this paper. FERIT-RTRK-2 database is publicly available for scientific community at http://www.rt-rk.com/other/VideoDBReadme.html. Additionally, newly created user-friendly subjective video quality assessment tool with graphical user interface, which can be used for conducting of subjective video quality experiments, is presented. In experimental part the performance of the proposed AMB-VQM is compared to this of 10 other objective video quality metrics (PSNR, SSIM, VSNR, PSNRHVS, PSNRHVSM, VIFP, ViS3, ST-MAD, BRISQUE, VIIDEO) using distorted video sequences from four different video quality databases: CSIQ, LIVE, FERIT-RTRK and FERIT-RTRK-2. The results show that AMB-VQM achieves high performance when predicting the video quality for videos distorted in different manners. AMB-VQM results outperform the results of most of the analyzed popular and very often used video quality metrics.

Interview

interview

A high throughput two-dimensional discrete cosine transform and MPEG4 motion estimation using vector coprocessor

In this work a configurable and scalable vector coprocessor for real time processing of MPEG4 motion estimation (ME) and two-dimensional DCT (2D DCT) is presented. A sequential DSP processor based on a reduced instruction set computer (RISC) processor architecture would require a frequency of 15 GHz for the real time processing of these two processes for a common intermediate format (CIF) sized sequence at 25 frames per second (fps). This frequency requirement will increase further if the image dimensions are increased. On the other hand our architecture on FPGA can achieve the real time processing rate at low frequency for CIF sized sequence and at higher frequency for full high definition (FHD) sequence for combined ME and 2D DCT. Due to configurable nature of the architecture and FPGA, this can be extended to higher dimensional image sequences. An important aspect of the architecture is that same datapath that is used for ME is also used for 2D DCT, with minor modification, leading to saving in area and time consumption. In addition the processor–coprocessor architecture has lower energy consumption and cost than the sequential processor.

Life-Tags

We introduce "Life-Tags," a wearable, smartglasses-based system for abstracting life in the form of clouds of tags and concepts automatically extracted from snapshots of the visual reality recorded by wearable video cameras. Life-Tags summarizes users' life experiences using word clouds, highlighting the "executive summary" of what the visual experience felt like for the smartglasses user during some period of time, such as a specific day, week, month, or the last hour. In this paper, we focus on (i) design criteria and principles of operation for Life-Tags, such as its first-person, eye-level perspective for recording life, passive logging mode, and privacy-oriented operation, as well as on (ii) technical and engineering aspects for implementing Life-Tags, such as the block architecture diagram highlighting devices, software modules, third-party services, and dataflows. We also conduct a technical evaluation of Life-Tags and report results from a controlled experiment that generated 21,600 full HD snapshots from six indoor and outdoor scenarios, representative of everyday life activities, such as walking, eating, traveling, etc., with a total of 180 minutes of recorded life to abstract with tag clouds. Our experimental results and Life-Tags prototype inform design and engineering of future life abstracting systems based on smartglasses and wearable video cameras to ensure effective generation of rich clouds of concepts, reflective of the visual experience of the smartglasses user.

In-Plane Behavior of Auxetic Non-Woven Fabric Based on Rotating Square Unit Geometry under Tensile Load.

This paper reports the auxetic behavior of modified conventional non-woven fabric. The auxetic behavior of fabric was achieved by forming rotating square unit geometry with a highly ordered pattern of slits by laser cutting. Two commercial needle-punched non-woven fabric used as lining and the reinforcement fabric for the footwear industry were investigated. The influence of two rotating square unit sizes was analyzed for each fabric. The original and modified fabric samples were subjected to quasi-static tensile load by using the Tinius Olsen testing machine to observe the in-plane mechanical properties and deformation behavior of tested samples. The tests were recorded with a full high-definition (HD) digital camera and the video recognition technique was applied to determine the Poisson’s ratio evolution during testing. The results show that the modified samples exhibit a much lower breaking force due to induced slits, which in turn limits the application of such modified fabric to low tensile loads. The samples with smaller rotating cell sizes exhibit the highest negative Poisson’s ratio during tensile loading through the entire longitudinal strain range until rupture. Non-woven fabric with equal distribution and orientation of fibers in both directions offer better auxetic response with a smaller out-of-plane rotation of rotating unit cells. The out-of-plane rotation of unit cells in non-homogenous samples is higher in machine direction.

A 5.5‐inch full HD foldable AMOLED display based on neutral‐plane splitting concept

AbstractSplitting of the mechanical neutral plane is a promising concept for foldable displays because it reduces the folding stress in each layer of the display. We verified the splitting concept experimentally and revealed a linear relation between the relative position of the neutral plane and the logarithm of the adhesive's elastic modulus. As the modulus decreased, the position of the neutral plane approached that of perfect splitting. On the basis of the neutral‐plane splitting concept, we developed 5.5‐inch full high‐definition foldable active matrix organic light‐emitting diode (AMOLED) displays, which endured 150 k inward folding cycles and 150 k outward folding cycles with folding radii of 3 and 5 mm, respectively. This study is expected to improve the flexibility of designing foldable AMOLED displays, enabling better balance of the portability versus practicality trade‐off in mobile displays.

67‐2: 5.5 inch Full Screen Flexible High‐Resolution OLED Display Fabricated by Ink Jet Printing Method

A 5.5 inch full high definition (FHD, 1920 × 1080) printed flexible OLED display (high resolution up to 402ppi) was fabricated with inkjet printing technology. Special sub‐pixel arrangement of Green‐Green‐Blue (GGRB) was employed to show the potential of inkjet printed top‐emission OLED in mobile display application. The electro‐luminance performance of both bottom‐emission and top‐emission printed OLED was investigated.

17‐3: Low‐Power High‐Definition Wireless Near‐Eye Displays Based on Prism Optics

Intevac's latest technology developments in the field of free‐form prism based near‐eye display are presented. The optical design process and system level considerations are discussed in the context of Intevac's recently launched WX40 wireless helmet‐mounted near‐eye display. This display delivers full HD resolution at exceptionally low latency across an ultra‐wideband link, providing untethered viewing over a range of several meters. This is achieved in a ruggedized, compact, low power package with full environmental sealing for operation in military and industrial environments.

P‐17: IGZO TFT Gate Driver with Independent both Bootstrapping and Control Units for AMOLED Mobile Display

An IGZO TFTs integrated gate driver with an independent bootstrapping structure and an independent control unit is proposed for AMOLED display. The driver can output both programmable multi‐pulse scan signals and normally‐high‐voltage emission control signals. Compared with the traditional bootstrapping node structure with a long rising time of 1.06 µs, and the diode‐connected bootstrapping node structure with a long falling time of 1.60 µs, the proposed driver has a short and symmetric rising and falling time of about 0.64 µs. Cascaded simulation results show that the driver may be applicable to 5.5‐in full HD AMOLED panel.

46‐3: Distinguished Paper: 5.5‐inch Full HD Foldable AMOLED Display Based on Neutral‐Plane Splitting Concept

Splitting of neutral plane is a promising concept for foldable displays because of reducing folding stress in each layer composing them. We verified the concept experimentally and developed a 5.5‐inch full HD foldable AMOLED display, which endured 150k inward folding cycles with a radius of 3 mm.

Study of Subjective Quality and Objective Blind Quality Prediction of Stereoscopic Videos.

We present a new subjective and objective study on full high-definition (HD) stereoscopic (3D or S3D) video quality. In subjective study, we constructed an S3D video dataset with 12 pristine and 288 test videos, and the test videos are generated by applying the H.264 and H.265 compression, blur and frame freeze artifacts. We also propose a no reference (NR) objective video quality assessment (QA) algorithm that relies on measurements of the statistical dependencies between the motion and disparity subband coefficients of S3D videos. Inspired by the Generalized Gaussian Distribution (GGD) approach in liu2011statistical, we model the joint statistical dependencies between the motion and disparity components as following a Bivariate Generalized Gaussian Distribution (BGGD). We estimate the BGGD model parameters (α,β) and the coherence measure (Ψ) from the eigenvalues of the sample covariance matrix (M) of the BGGD. In turn, we model the BGGD parameters of pristine S3D videos using a Multivariate Gaussian (MVG) distribution. The likelihood of a test video's MVG model parameters coming from the pristine MVG model is computed and shown to play a key role in the overall quality estimation. We also estimate the global motion content of each video by averaging the SSIM scores between pairs of successive video frames. To estimate the test S3D video's spatial quality, we apply the popular 2D NR unsupervised NIQE image QA model on a frame-by-frame basis on both views. The overall quality of a test S3D video is finally computed by pooling the test S3D video's likelihood estimates, global motion strength and spatial quality scores. The proposed algorithm, which is 'completely blind' (requiring no reference videos or training on subjective scores) is called the Motion and Disparity based 3D video quality evaluator (MoDi3D). We show that MoDi3D delivers competitive performance over a wide variety of datasets including the IRCCYN dataset, the WaterlooIVC Phase I dataset, the LFOVIA dataset and our proposed LFOVIAS3DPh2 S3D video dataset.

AUTOMATIC DETECTION AND RECOGNITION OF 3D MANUAL GESTURES FOR HUMAN-MACHINE INTERACTION

Abstract. In this paper, we propose an approach to detect and recognize 3D one-handed gestures for human-machine interaction. The logical structure of the modules of the system for recording a gestural database is described. The logical structure of the database of 3D gestures is presented. Examples of frames showing gestures in the format of Full High Definition, in the map depth mode and in the infrared illustrated. Models of a deep convolutional network for detecting faces and hand shapes are described. The results of automatic detection of the area with the face and the shape of the hand are given. Identified the distinctive features of the gesture at a certain point in time. The process of recognizing 3D one-handed gestures is described. Due to its versatility, this method can be used in tasks of biometrics, computer vision, machine learning, automatic systems of face recognition, sign languages.

Encoding Shaky Videos by Integrating Efficient Video Stabilization

This paper presents a novel video coding method by integrating video stabilization for shaky videos. By reusing the stabilized motion of feature points and geometric transformations, a better predictor can be established to replace the original motion vectors in the motion estimation stage of video coding. Then, these motion vectors are optimized based on statistics of the residuals between the stabilization predictor and the standard one to improve the efficiency of motion search. As a result, our method brings much less computational cost to motion estimation than encoding the stabilized frames separately (e.g., 24% for the enhanced predictive zonal search algorithm, 17% for the unsymmetrical-cross multi-hexagon-grid search algorithm), while the Bjontegaard distortion (BD) bit rate and BD-peak signal-to-noise ratio still have the comparable performance with multiple quantization parameters. Specially, the implementation of our integrative system based on $\times 264$ is very fast and of low latency, by which full HD videos can be simultaneously stabilized and encoded with more than 30 frames per second in the fastest mode, even on the mobile platform. The experiments on a variety of shaky videos demonstrate the potential of our method in terms of effectiveness and efficiency.

Лапароскопическая резекция почки с опухолью под контролем УЗИ

The choice of method of surgical treatment for endophytic kidney tumors depends on the precise definition of the location and size, the extent of invasion into adjacent tissues and the type of vascularization. Intraoperative ultrasound (IOUS) in combination with 3D-CT allow to receive this information. The aim of this study was to compare the laparoscopic-assisted extracorporeal partial nephrectomy and laparoscopic partial nephrectomy with IOUS and visualization in Full HD, 3D Full HD and 4K modes. A total of 77 patients aged 43-75 years with endophytic renal tumors were included in the study. They were undergone either extracorporeal partial nephrectomy or laparoscopic partial nephrectomy with IOUS. We compared the rate of positive surgical margins, early postoperative bleeding, de novo renal failure or aggravation of preexisting renal failure and stricture of vesico-ureteric anastomosis. The rate of early postoperative bleeding, chronic kidney failure and pathologically-proven positive surgical margin in patients who underwent extracorporeal partial nephrectomy followed by kidney autotransplantation was 23.1%, 13.4% and 13.4%, respectively. After laparoscopic partial nephrectomy these values were 12%, 16.7% and 8.3%, respectively. The best outcomes were achieved in patients who underwent laparoscopic partial nephrectomy with IOUS and with a use of visualization in Full HD, 3D Full HD and 4K modes.

Focus on lasers, imaging, and microscopy

Focus on lasers, imaging, and microscopy

QEVO® - A new digital endoscopic microinspection tool - A cadaveric study and first clinical experiences (case series).

Background:The use of endoscopes in neurosurgery is well established, but the integration of a full high definition signaling, 45° angled endoscopic tool into a digital surgical microscope, is new. We report our first experiences in a cadaveric study and a clinical case series using the new microinspection tool QEVO® that serves as a plug-in feature for the recently launched KINEVO 900 digital visualization platform (CARL ZEISS MEDITEC, Oberkochen, Germany). For illustration purposes, we offer video footage.Methods:The handling, workflow, and visualization patterns of the QEVO® microinspection tool were critically evaluated in cadaver specimens by simulating four standardized neurosurgical approaches: (1) pterional, (2) retrosigmoidal, (3) transsphenoidal, (4) and transcallosal. Similarly, we evaluated the QEVO® tool in corresponding clinical cases of (1) aneurysm clipping, (2) removal of cerebellar cavernoma, (3) and pituitary adenomectomy.Results:In both the cadaveric study and clinical case series, the QEVO® tool was found to be beneficial in terms of high-quality visualization of fine structures and for displaying hidden anatomical details (“looking around the corner”). The handling was good, and the workflow was easy. However, the use of this tool was restricted by the lack of an external fixation and a working channel, the shortness of the tool, and the impossibility to switch to a 0° or 30° optic.Conclusion:Despite some restrictions, the QEVO® microinspection tool is an innovative, handheld, endoscopic tool that allows excellent additional visualization of the surgical field. In our opinion, this tool effectively enhances the modern neurosurgical armamentarium.

High-Level Synthesis of Online K-Means Clustering Hardware for a Real-Time Image Processing Pipeline.

The growing need for smart surveillance solutions requires that modern video capturing devices to be equipped with advance features, such as object detection, scene characterization, and event detection, etc. Image segmentation into various connected regions is a vital pre-processing step in these and other advanced computer vision algorithms. Thus, the inclusion of a hardware accelerator for this task in the conventional image processing pipeline inevitably reduces the workload for more advanced operations downstream. Moreover, design entry by using high-level synthesis tools is gaining popularity for the facilitation of system development under a rapid prototyping paradigm. To address these design requirements, we have developed a hardware accelerator for image segmentation, based on an online K-Means algorithm using a Simulink high-level synthesis tool. The developed hardware uses a standard pixel streaming protocol, and it can be readily inserted into any image processing pipeline as an Intellectual Property (IP) core on a Field Programmable Gate Array (FPGA). Furthermore, the proposed design reduces the hardware complexity of the conventional architectures by employing a weighted instead of a moving average to update the clusters. Experimental evidence has also been provided to demonstrate that the proposed weighted average-based approach yields better results than the conventional moving average on test video sequences. The synthesized hardware has been tested in real-time environment to process Full HD video at 26.5 fps, while the estimated dynamic power consumption is less than 90 mW on the Xilinx Zynq-7000 SOC.

A Pareto-Optimal Multi-filter Architecture on FPGA for Image Processing Applications

Conventional two-dimensional filters for digital image processing are computationally intensive and consume significant hardware resources on field-programmable gate array (FPGA). Multiple filters implemented at a very low area and power budget are essential requirements of modern embedded systems for performing diversified image processing tasks. The previously reported multi-filter architectures are infeasible, since they do not provide pareto-optimal solution in terms of flexibility, hardware cost and versatility. This work presents a pareto-optimal multi-filter architecture that cater to these three major design concerns. The high degree of flexibility is induced in design by the deployment of an efficient customized 2,3 tree structure. This implements successive odd filter kernels in 44 different combinations with the maximum \(9 \times 9\) size, without hardware blocking. These implemented filters are structurally optimized and versatile for realizing diverse filter types at a very low cost. The complete design occupies only 2319 Slices on Xilinx Artix-7 FPGA and performs at 111 fps for full HD resolution with a very low power consumption of 197.5 mW. With these attributes, the proposed multi-filter architecture implements multiple filters of diverse types at very low area and power; this makes it well suited for image processing applications in real time. Finally, the proposed architecture is validated using Digilent Nexys4 development board.

Engineering a Live UHD Program from the International Space Station

The first-ever live downlink of Ultra-High Definition (UHD) video from the International Space Station (ISS) was the highlight of a “Super Session” at the National Association of Broadcasters (NAB) Show in April 2017. Ultra-High Definition is four times the resolution of “full HD” or “1080P” video. Also referred to as “4K”, the Ultra-High Definition video downlink from the ISS all the way to the Las Vegas Convention Center required considerable planning, pushed the limits of conventional video distribution from a space-craft, and was the first use of High Efficiency Video Coding (HEVC) from a space-craft. The live event at NAB will serve as a pathfinder for more routine downlinks of UHD as well as use of HEVC for conventional HD downlinks to save bandwidth. A similar demonstration was conducted in 2006 with the Discovery Channel to demonstrate the ability to stream HDTV from the ISS. This paper will describe the overall work flow and routing of the UHD video, how audio was synchronized even though the video and audio were received many seconds apart from each other, and how the demonstration paves the way for not only more efficient video distribution from the ISS, but also serves as a pathfinder for more complex video distribution from deep space. The paper will also describe how a “live” event was staged when the UHD video coming from the ISS had a latency of 10+ seconds. In addition, the paper will touch on the unique collaboration between the inherently governmental aspects of the ISS, commercial partners Amazon and Elemental, and the National Association of Broadcasters.