Abstract

To improve the spatial error concealment (SEC) for consecutive block loss, an edge-aware spatial-frequency extrapolation (ESFE) algorithm and its edge-guided parametric model are proposed by selectively incorporating the Hough-based edge synthesis into the frequency-based extrapolation architecture. The dominant edges that cross the missing blocks are firstly identified by the Canny detector, and then the robust Hough transformation is utilized to systematically connect these discontinuous edges. During the generation of edge-guided parametric model, the synthesized edges are utilized to divide the missing blocks into the structure-preserving regions, and thus the residual error is reliably reduced. By successively minimizing the weighted residual error and updating the parametric model, the known samples are approximated by a set of basis functions which are distributed in a region containing both known and unknown samples. Compared with other state-of-the-art SEC algorithms, experimental results show that the proposed ESFE algorithm can achieve better reconstruction quality for consecutive block loss while keeping relatively moderate computational complexity.

Highlights

  • To reduce computational complexity and memory burdens, the block-based image/ video coding has been widely used in visual communication

  • To further improve the reconstruction performance in case of consecutive block loss, we propose an edge-aware spatial-frequency extrapolation (ESFE) algorithm with its edge-guided parametric model, which incorporates the edge synthesis into the frequency-based extrapolation, and exploits high frequency terms in image description

  • Experimental results The proposed edgeaware spatial-frequency extrapolation (ESFE) algorithm will be compared with other state-of-the-art spatial error concealment (SEC) methods, such as Markov random field (MRF) (Shirani et al 1999), Bilinear interpolation (BI) (Varsa et al 2001), orientation adaptive interpolation (OAI) (Li and Orchard 2002), content-adaptive error concealment (CAEC) (Zhang et al 2004), KMMSE (Koloda et al 2014a), order-adaptive linear predictor (OALP) (Liu et al 2014), hybrid exemplar-based inpainting and spatial interpolation (HEISI) (Chung and Yim 2014), and XFSE (Koloda et al 2014b)

Read more

Summary

Background

To reduce computational complexity and memory burdens, the block-based image/ video coding has been widely used in visual communication. To further improve the reconstruction performance in case of consecutive block loss, we propose an edge-aware spatial-frequency extrapolation (ESFE) algorithm with its edge-guided parametric model, which incorporates the edge synthesis into the frequency-based extrapolation, and exploits high frequency terms in image description. In order to further clarify the mechanism of edge synthesis via Hough transformation, Fig. 3 shows the experimental results for four typical images and intra-frames: 1st intraframe of Foreman (352 × 288, QP = 22), Lena (512 × 512), 1st intra-frame of RaceHorses (832 × 480, QP = 37), Airport (1024 × 1024), where the yellow line represents the synthesized edge among missing blocks, and the experimental settings are given in “Experimental results” section.

Determining the best fitting basis function
Determining the expansion coefficients
Updating the edge-guided parametric model
Final parametric model
Conclusions
Full Text
Paper version not known

Talk to us

Join us for a 30 min session where you can share your feedback and ask us any queries you have

Schedule a call

Disclaimer: All third-party content on this website/platform is and will remain the property of their respective owners and is provided on "as is" basis without any warranties, express or implied. Use of third-party content does not indicate any affiliation, sponsorship with or endorsement by them. Any references to third-party content is to identify the corresponding services and shall be considered fair use under The CopyrightLaw.