Moving Picture Experts Group Research Articles

최인접 거리 비율 정합을 이용한 영상 특징점 선택 방법

본 논문에서는 현재 진행 중인 MPEG(Motion Picture Experts Group, ISO/IEC JTC1 SC29 WG11)의 표준화 작업 중 CDVS(Compact Descriptor for Visual Search)의 CE-7(Core Experiment)인 특징점 선택에 대한 방법을 제안한다. 서술자의 경량화를 위해서는 영상으로부터 추출된 많은 수의 특징점들 중에서 영상 정합에 사용될 중요한 특징점들을 선택해야 한다. 본 논문에서는 최 인접 거리 비율 정합(Nearest Neighbor distance ratio matching) 방법에 의해 영상 정합 단계에서 사용되지 않고 버려지는 특징점들을 미리 추출 단에서 제거하는 방법 제안하였다. 제안된 방법을 통하여 적은 비트 전송률을 요하는 시스템에서 특징점의 낭비를 피할 수 있고 결과적으로 추가적인 특징점을 사용할 수 있으므로 전체적인 성능 향상을 얻을 수 있었다. 제안된 알고리즘을 통하여 Pair-wise 정합 실험에서 기존의 Test Model 대비 최고 2.3%의 성공율(True positive rate)의 향상을 보였다. In this paper, we propose a feature point selection method for MPEG CDVS CE-7 which is processing on International Standard task. Among a large number of extracted feature points, more important feature points which is used in image matching should be selected for the compactness of image descriptor. The proposed method is that remove the feature point in the extraction phase which is filtered by nearest neighbor distance ratio matching in the matching phase. We can avoid the waste of the feature point and employ additional feature points by the proposed method. The experimental results show that our proposed method can obtain true positive rate improvement about 2.3% in pair-wise matching test compared with Test Model.

Overview of the High Efficiency Video Coding (HEVC) Standard

High Efficiency Video Coding (HEVC) is currently being prepared as the newest video coding standard of the ITU-T Video Coding Experts Group and the ISO/IEC Moving Picture Experts Group. The main goal of the HEVC standardization effort is to enable significantly improved compression performance relative to existing standards-in the range of 50% bit-rate reduction for equal perceptual video quality. This paper provides an overview of the technical features and characteristics of the HEVC standard.

Block Merging for Quadtree-Based Partitioning in HEVC

The joint development of the upcoming High Efficiency Video Coding (HEVC) standard by ITU-T Video Coding Experts Group and ISO/IEC Moving Picture Experts Group marks a new step in video compression capability. In technical terms, HEVC is a hybrid video-coding approach using quadtree-based block partitioning together with motion-compensated prediction. Even though a high degree of adaptability is achieved by quadtree-based block partitioning, this approach has certain intrinsic drawbacks, which may result in redundant sets of motion parameters being transmitted. Previous work has shown that those redundancies can effectively be removed by merging the leafs of a particular quadtree structure. Following this concept, a block merging algorithm for HEVC is now proposed. This algorithm generates a single motion parameter set for a whole region of contiguous motion-compensated blocks. In this paper, we describe the various components of the proposed block merging algorithm and, using experimental evidence, demonstrate their benefits in terms of coding efficiency.

Neuro-Fuzzy approach to video transmission over ZigBee

This research paper presents Neuro-Fuzzy applications to Moving Picture Expert Group (MPEG-4) video transmission in IEEE 802.15.4 ZigBee wireless. ZigBee can operate within 2.4GHz frequency with a data rate of 250kb/s, which may interfere with other wireless devices functioning within the same frequency band such as WiFi and Bluetooth. MPEG-4 Variable Bit Rate (VBR) video demands large bandwidth, and may cause data loss and time delay in the data rate limited ZigBee channel as a result of high variation in bit rate. Consequently, it is almost impracticable for MPEG-4 VBR video to be transmitted in the ZigBee channel. This paper introduces two new Neuro-Fuzzy schemes to monitor the input and the output of a data storage entitled traffic-regulating buffer. The input of the buffer is controlled by a Neuro-Fuzzy scheme to ensure that the traffic-regulating buffer neither flooded nor starved with video data. The output of the traffic-regulating buffer is observed by a second Neuro-Fuzzy scheme to make sure the departure-rate conforms to the traffic condition of ZigBee. The simulation results demonstrate that the proposed two Neuro-Fuzzy schemes reduce the excessive data loss and improve the picture quality, as compared with the conventional MPEG-4 VBR video over ZigBee.

VHDL Implementation of H.264 Video Coding Standard

<p>This Paper contains VHDL implementation of H.264 video coding standard, which is new video coding standard of the ITU-T Video Coding Experts Group and the ISO/IEC Moving Picture Experts Group. The main goal of the H.264/AVC standardization effort is to enhance compression performance and provision of a “network-friendly” video representation addressing “conversational” (video telephony) and “no conversational” (storage, broadcast, or streaming) applications.H.264 video coder standard is having fundamental blocks like transform and quantization, Intra prediction, Inter prediction and Context Adaptive Variable Length Coding (CAVLC). Each block is designed and integrated to one top module in VHDL.</p>

MPEG 시스템 및 서비스 정보를 이용한 끊김 없는 모바일 방송 녹화 방법

모바일 방송 단말기의 일반적인 녹화 방법은 대상 콘텐츠의 내용과 관계없이 녹화 시작 및 종료 시점까지의 모든 수신 데이터를 저장하게 되는데, 이러한 경우 콘텐츠 중간에 삽입되는 광고 등 시청자가 원하지 않는 콘텐츠도 같이 녹화되는 현상이 발생하게 된다. 이러한 문제를 해결하기 위하여, 본 논문에서는 녹화 대상 방송 스트림에서 광고 등이 삽입되어 MPEG-2 (Moving Picture Expert Group-2) TS (Transport Stream) 패킷 스트림의 단절이 발생하는지를 파악한 후, 단절이 발생할 경우에는 그 시점을 예측하여 이를 녹화 과정에 적용하는 끊김 없는 (seamless) 녹화 방법을 제안한다. 제안한 끊김 없는 녹화 방법에서는 먼저 TS 패킷 확장 헤더인 적응 필드 (adaptation field)의 관련 플래그 (flag)를 통해 스트림의 단절 유무를 파악한 후, 단절이 발생할 것으로 판단된 경우에는 적응 필드의 splice_countdown값을 분석하여 단절 시점을 예측한다. 이와 같이 TS 스트림의 단절 시점을 파악한 후 단절 이후의 TS 스트림은 저장하지 않고 광고 등이 종료되어 다시 원 TS 스트림으로 복귀한 이후의 데이터를 저장함으로써, 콘텐츠의 내용이 끊기지 않는 녹화 콘텐츠를 제공할 수 있다. 기존의 모바일 방송 단말기의 소프트웨어를 일부 수정하여 실시한 모의실험을 통해 제안한 끊김 없는 녹화 방법의 우수성을 확인하였다. In the general recording method of mobile broadcasting, all incoming broadcasting streams after recording time will be saved regardless of its content. In this case, as such that viewers do not want to record, commercial advertisement, are saved together. In order to solve these problems, the proposed method checks if the contents such as advertisements are exist in the target stream by analysing the splicing in incoming MPEG-2 TS streams and, if splicing happened, excludes incoming stream after the splicing in the recording process. In the proposed method, first the splice in the recording stream is verified using the related flags of adaptation field in the TS packet and, if judged to cause a splice, the time of splicing is to be estimated by evaluating the value of splice_countdown filed. In this way, the proposed algorithm provides the seamless recording method by estimating the time of splice and excluding the contents after the splicing. To evaluate the proposed seamless recording method, the simulation was carried out by modifying the software of the existing mobile broadcasting terminal.

A GOP-aware multipath source routing protocol for MPEG video delivery over mobile ad hoc networks

This paper proposes a group of picture (GOP)-aware multipath source routing protocol (GMSR) for real-time moving picture experts group (MPEG) video delivery in mobile ad hoc networks (MANETs). First, as existing multipath routing protocols usually produce large amount of route reply packets in a short period of time, which may cause traffic congestion, a cumulative route reply strategy (CRR) is employed in this work. Second, in order to enhance the reliability of the CRR, we investigate a selective route reply salvaging policy (SRRS) to protect an important route reply packet. Finally, we explore a novel cross-layer design framework according to the characteristics of MPEG video streams. On this basis, we introduce a GOP-aware flow control strategy (GFC) to coordinate video delivery, working together with the routing protocol. Our simulation results demonstrate that the GMSR achieves a significant improvement of the quality of real-time video streaming.

Combining MPEG Tools to Generate Video Summaries Adapted to the Terminal and Network

Moving picture experts group (MPEG) standards provide tools for a broad range of purposes, covering from coding to metadata description tools. In this paper, the combined use of tools from different MPEG standards is described in the context of a video summarization application. The main objective of the framework is the efficient generation of summaries, integrated with their adaptation to the user's terminal and network. The MPEG-4 Scalable Video Coding specification is used for fast adaptation and summary bitstream generation. MPEG-21 digital item adaptation tools are used to describe metadata related to the user's terminal and network. MPEG-7 tools are used to describe the summary. Finally, the framework is compared with alternative approaches (variations and transcoding), in terms of efficiency, rate-distortion performance and other aspects.

Efficient inverse transform architectures for multi-standard video coding applications

Hardware designs that can support multiple standards are required for versatile media players. The study proposes a unified inverse transform architecture that can be efficiently used in Moving Picture Expert Group and ITU International Telecommunication Standardisation Sector (ITU-T) H.264/advanced video coding (AVC), Microsoft video codec 1 (VC-1) and Chinese Audio Video Coding Standard (AVS) decoders. For H.264/AVC 8-, 4- and 2-point inverse transforms, the computational complexity in the proposed architecture is similar to that defined in the H.264/AVC standard. By using the symmetry of the transform matrices, the matrix product operations of the inverse transforms in VC-1 and AVS are efficiently decomposed to use only shifters, adders and subtractors. All the computations are verified and designed using a hardware unit to achieve a low-cost hardware kernel. The proposed multiple-transform architecture contains fast 1-D transforms and rounding operations for the computation of H.264/AVC, VC-1 and AVS 8- and 4-point inverse transforms. Simulation results show that the total number of gates for the proposed architecture is 8983, which is much lower than that required for architectures without hardware sharing. Compared with individual designs, the proposed shared architecture reduces the number of logic gates by a factor of two with a penalty of 20% in data throughput.

Cloud-Based Personalization of New Advertising and e-Commerce Models for Video Consumption

Over the last few years, we have witnessed a generalization of the consumption of video contents through different media (computers, television, mobile phones, tablets,…) that converge into a unified user experience in an (almost) all-IP technological environment. At the same time, there have been significant advances in the generation and characterization of multimedia contents, due to the advent of social networking and the consolidation of standards like moving picture experts group (MPEG)-4 and MPEG-7. Finally, it is becoming easier and more natural to interact with multimedia contents, thanks to devices like tactile screens and touchpads. Overall, this landscape enables great possibilities for advertising and e-commerce, far beyond the traditional business models of broadcast TV. In this paper, we present a novel realization of two non-invasive advertising and e-commerce models to exploit those possibilities, grounded on a cloud-based personalization engine. This system cannot only identify the most interesting products to advertise to each user at any time, but also compose personalized applications on the fly, ready to run on different consumer device platforms. Our experiments show that this proposal can be very positively perceived by the end users.

MPEG DASH: The Enabler Standard for Video Delivery over the Internet

Internet video is experiencing a dramatic growth in both fixed and mobile environments. All available data points indicate that internet video is likely to be the long-awaited killer application for mobile data networks. It will also create significant business opportunities for the fixed internet access providers. Internet video is currently dominated by a handful of proprietary technologies that exploit and reuse existing Web infrastructure to deliver internet video. To address these market demands, the Motion Picture Experts Group (MPEG), in coordination with the Third Generation Partnership Project, has taken the lead to define an enabler standard for streaming video and multimedia delivery over the internet. MPEG Dynamic Adaptive Streaming over HTTP (DASH) specifies a delivery format that enables interoperability among servers and clients from various vendors. DASH clients can select and dynamically switch representations to provide a seamless user experience. The standard evolves proprietary HyperText Transfer Protocol (HTTP) streaming solutions to provide a universal format for internet video delivery by reusing, building on, and interfacing with a significant number of existing state-of-the-art technologies.

The MPEG-7 Video Signature Tools for Content Identification

This paper presents the core technologies of the video signature tools recently standardized by ISO/IEC Moving Picture Experts Group (MPEG) as an amendment to the MPEG-7 Standard (ISO/IEC 15938). The video signature is a high-performance content fingerprint that is suitable for desktop scale to web-scale deployment and provides high levels of robustness to common video editing operations and high temporal localization accuracy at extremely low false alarm rates, achieving a detection rate in the order of 96% at a false alarm rate in the order of five false matches per million comparisons. The applications of the video signature are numerous and include rights management and monetization, distribution management, usage monitoring, metadata association, and corporate or personal database management. In this paper, we review the prior work in the field, explain the standardization process and status, and provide details and evaluation results for the video signature tools.

HEVC: The New Gold Standard for Video Compression: How Does HEVC Compare with H.264/AVC?

Digital video has become ubiquitous in our everyday lives; everywhere we look, there are devices that can display, capture, and transmit video. The recent advances in technology have made it possible to capture and display video material with ultrahigh definition (UHD) resolution. Now is the time when the current Internet and broadcasting networks do not even have sufficient capacity to transmit large amounts of HD content-Let alone UHD. The need for an improved transmission system is more pronounced in the mobile sector because of the introduction of lightweight HD resolutions (such as 720 pixel) for mobile applications. The limitations of current technologies prompted the International Standards Organization/International Electrotechnical Commission Moving Picture Experts Group (MPEG) and International Telecommunication Union-Telecommunication Standardization Sector Video Coding Experts Group (VCEG) to establish the Joint Collaborative Team on Video Coding (JCT-VC), with the objective to develop a new high-performance video coding standard.

MPEG DASH 기반 service-compatible 3D 콘텐츠 대상 HTTP adaptive streaming 적용방안

최근 3D 입체영상에 대한 소비자들의 관심 증대로 가전 업체들은 3D TV, 3D Monitor등의 제품들을 출시하고 있고, 이에 따라 3D 콘텐츠 시장도 급격히 성장할 것으로 예상된다. 그러나 이러한 3D 콘텐츠를 서비스함에 있어서 보다 높은 대역폭이 요구되어지므로 QoS(Quality of Service)를 보장하지 않는 IP 기반 전송환경에서의 고화질 3D 스트리밍 서비스는 소비자에게 끊김 없는 영상서비스를 제공하는데 제약이 있다. 이러한 문제를 해결하기 위해서, IP 망 네트워크 환경을 고려하여 사용자들이 원하는 콘텐츠를 네트워크 환경에 따라 적절한 품질로 제공 할 수 있는 적응적 스트리밍 서비스 기술이 현재 국제 표준화 기구인 MPEG(Moving Picture experts Group)에서 DASH(Dynamic Adaptive Streaming over HTTP)라는 이름으로 표준화가 진행 중에 있다. 그러나 DASH에서는 독립된 좌, 우 영상이 단일 segment안에 2개의 Elementary Stream(ES)으로 구성되어 있는 service- compatible 기반의 스테레오스코픽 콘텐츠에 대한 명확한 scheme이 나타나지 않는다. 따라서 본 논문에서는 DASH를 이용한 service-compatible 기반의 효율적인 적응적 3D 스트리밍 서비스 제공 방안을 제안한다. DASH를 이용한 3D 서비스는 사용자들에게 IP 망을 통한 다양한 품질의 3D 콘텐츠를 제공함으로써 끊김 없는 3D 스트리밍 서비스가 가능하고, 또한 하나의 3D 콘텐츠로 다양한 디바이스에 적용 가능하다는 이점이 있다. Recently, many consumer electronics manufacturers have produced 3D devices such as 3DTVs and 3D monitors as interests in a stereoscopic video service are getting increased. However, most of 3D services are focused on local storage or bandwidth guaranteed service since 3D stereoscopic video service require bandwidth more stable and larger. This property causes difficulties in seamless stereoscopic video streaming services under IP based open network environment that cannot guarantee quality of services. In order to achieve a seamless video streaming service the international standard organization MPEG (Moving Pictures Experts Group) has developed the adaptive HTTP streaming technology called as DASH (Dynamic Adaptive Streaming over HTTP). However, the DASH doesn't have obvious scheme which can express the two elementary video streams based service-compatible stereoscopic contents in one segment. Therefore, this paper proposes a scheme of efficient 3D adaptive streaming service based on the DASH, which covers not only frame-packing stereoscopic contents but also service-compatible ones. The 3D adaptive HTTP streaming scheme introduced in this paper is able to provide 3D contents with various qualities to user and also has benefit that single 3D content can be applied to a variety of devices.

The DVB File Format [Standards in a Nutshell

The Digital Video Broadcasting (DVB) Project develops standards for television broadcast services. The DVB File Format, one of the recent DVB standards, is intended to be a recording format for received broadcasts and a file interchange format when recorded broadcasts are copied or moved from one DVB-compatible device to another. The DVB File Format is an extension of the ISO Base Media File Format (ISOBMFF), which is widely used as a basis format for various container formats, such as MPEG-4 File Format (MP4) and 3GP File Format (3GP) developed by the Moving Picture Experts Group (MPEG) and the Third Generation Partnership Project (3GPP), respectively.

Bitrate Scalability for Multi-Pulse Based Code Excited Linear Prediction Speech Coder

Problem statement: The bitrate scalability is an important functionality that is defined in the Moving Picture Expert Group (MPEG-4) requirements. Since the traffic in a communication network varies with time, the capability of varying the bitrate of a speech coder is needed. Approach: This study proposes an approach to vary the bitrate by using a bitrate scalable tool which is attached with the core section of Multi-Pulse based Code Excited Linear Predictive (MP-CELP) coder. The bitrates scalable tool employs multi-stage excitation coding based on an embedded-coding approach. The multi-pulse excitation codebook at each stage is adaptively produced depending on the selected excitation signal at the previous stage. Results: The experimental results show that the speech quality of the proposed coder with the bitrate scalable tools is improved above the speech quality of the conventional coder. Conclusion: From the study, the proposed approach gives a tool to improve the speech compression and can also support a variety of coder bitrates.

Screening of snoring with an MP3 recorder

Snoring patients seeking medical assistance represent a wide range of clinical and sleep study findings from nonsleepy nonapneic snoring to severe obstructive sleep apnea syndrome. The prevalence of snoring is high and it significantly impacts quality of life. Its objective diagnosis usually requires a sleep study. We developed a system to analyze snoring sounds with a Moving Picture Experts Group Layer-3 Audio (MP3) recorder device and present its value in the screening of snoring. We recorded snoring sounds during in-lab polysomnography (PSG) in 200 consecutive patients referred for a suspicion of obstructive sleep apnea. Snoring was recorded during the PSG with two microphones: one attached to the throat and the other to the ceiling; an MP3 device was attached to the patient's collar. Snoring was confirmed when the MP3 acoustic signal exceeded twice the median value of the acoustic signal for the entire recording. Results of the MP3 snoring recording were compared to the snoring recordings from the PSG. MP3 recording proved technically successful for 87% of the patients. The Pearson correlation between PSG snoring and MP3 snoring was highly significant at 0.77 (p < 0.001). The MP3 recording device underestimated the snoring time by a mean ± SD of 32 ± 55 min. The recording of snoring with an MP3 device provides reliable information about the patient's snoring.

MPEG-M: Multimedia Service Platform Technologies [Standards in a Nutshell

MPEG-M is a suite of ISO/IEC standards (ISO/IEC 23006) that has been developed under the auspices of Moving Picture Experts Group (MPEG). MPEG-M, also known as Multimedia Service Platform Technologies (MSPT), facilitates a collection of middleware application programming interfaces (APIs) and elementary services (ESs) as well as service aggregation so that service providers (SPs) can offer users a plethora of innovative services by extending current Internet Protocol television (IPTV) technology toward the seamless integration of personal content creation and distribution, e-commerce, social networks, and Internet distribution of digital media.

Rate adaptation for dynamic adaptive streaming over HTTP in content distribution network

Recently the 3rd Generation Partnership Project (3GPP) and the Moving Picture Experts Group (MPEG) specified Dynamic Adaptive Streaming over HTTP (DASH) to cope with the shortages in progressive HTTP based downloading and Real-time Transport Protocol (RTP) over the User Datagram Protocol (UDP), shortly RTP/UDP, based streaming. This paper investigates rate adaptation for the serial segment fetching method and the parallel segment fetching method in Content Distribution Network (CDN). The serial segment fetching method requests and receives segments sequentially whereas the parallel segment fetching method requests media segments in parallel. First, a novel rate adaptation metric is presented in this paper, which is the ratio of the expected segment fetch time (ESFT) and the measured segment fetch time to detect network congestion and spare network capacity quickly. ESFT represents the optimum segment fetch time determined by the media segment duration multiplied by the number of parallel HTTP threads to deliver media segments and the remaining duration to fetch the next segment to keep a certain amount of media time in the client buffer. Second, two novel rate adaptation algorithms are proposed for the serial and the parallel segment fetching methods, respectively, based on the proposed rate adaptation metric. The proposed rate adaptation algorithms use a step-wise switch-up and a multi-step switch-down strategy upon detecting the spare networks capacity and congestion with the proposed rate adaptation metric. To provide a good convergence in the representation level for DASH in CDN, a sliding window is used to measure the latest multiple rate adaptation metrics to determine switch-up. To decide switch-down, a rate adaptation metric is used. Each rate adaptation metric represents a reception of a segment/portion of a segment, which can be fetched from the different edge servers in CDN, hence it can be used to estimate the corresponding edge server bandwidth. To avoid buffer overflow due to a slight mismatch in the optimum representation level and bandwidth, an idling method is used to idle a given duration before sending the next segment. In order to solve the fairness between different clients who compete for bandwidth, the prioritized optimum segment fetch time is assigned to the newly joined clients. The proposed rate adaptation method does not require any transport layer information, which is not available at the application layer without cross layer communication. Simulation results show that the proposed rate adaptation algorithms for the serial and the parallel segment fetching methods quickly adapt the media bitrate to match the end-to-end network capacity, provide an advanced convergence and fairness between different clients and also effectively control buffer underflow and overflow for DASH in CDN. The reported simulation results demonstrate that the parallel rate adaptation outperforms the serial DASH rate adaptation algorithm with respect to achievable media bitrates while the serial rate adaptation is superior to the parallel DASH with respect to the convergence and buffer underflow frequency.

Application and discussion of MP5 in medical multimedia teaching

At present, there is a relative shortage of multimedia classroom resources of medical schools. Yan'an Hospital of Kunming Medical College proposed the new model of teaching methods of portable multimedia classrooms composed of MP5. According to the teaching practice and the results from the questionnaire, it is approved by the teachers and students. Key words: Multimedia teaching; Moving picture experts group audio layer 5; Medical education; New teaching model