1- https://doi.org/10.1109/icip51287.2024.10647545
Partial Inter-Frame Coding for Dynamic Meshes
Translate Article 
The MPEG-3DGH group is advancing a new standard for dynamic mesh encoding, known as Video-based Dynamic Mesh Coding (V-DMC). While V-DMC improves efficiency by toggling between intra- and inter-frame coding, it struggles with dynamic meshes that change inconsistently across frames. To address this issue, we introduce a novel partial inter-frame coding mode within the V-DMC framework. The method initiates by partitioning the adjacent frames into temporally aligned segments. These segments are then classified as suitable for either intra-frame or inter-frame coding based on the detection of inconsistent changes. Leveraging these segmentations, we introduce a partial inter-frame coding mode that allows for the selective application of intra- and inter-frame coding at the level of individual segments. Experiments on the MPEG V-DMC test sequences demonstrate that our method can achieve BD-rate improvement over the anchor in terms of D1, D2, Luma, Cb, and Cr PSNRs by -2.1%,-2.7%,-4.7%,-5.4%, and -4.5%, respectively.
- Research Article
- 54
- 10.1017/atsip.2018.15
- Jan 1, 2018
- APSIPA Transactions on Signal and Information Processing
We introduce the polygon cloud, a compressible representation of three-dimensional geometry (including attributes, such as color), intermediate between polygonal meshes and point clouds. Dynamic polygon clouds, like dynamic polygonal meshes and dynamic point clouds, can take advantage of temporal redundancy for compression. In this paper, we propose methods for compressing both static and dynamic polygon clouds, specifically triangle clouds. We compare triangle clouds to both triangle meshes and point clouds in terms of compression, for live captured dynamic colored geometry. We find that triangle clouds can be compressed nearly as well as triangle meshes, while being more robust to noise and other structures typically found in live captures, which violate the assumption of a smooth surface manifold, such as lines, points, and ragged boundaries. We also find that triangle clouds can be used to compress point clouds with significantly better performance than previously demonstrated point cloud compression methods. For intra-frame coding of geometry, our method improves upon octree-based intra-frame coding by a factor of 5–10 in bit rate. Inter-frame coding improves this by another factor of 2–5. Overall, our proposed method improves over the previous state-of-the-art in dynamic point cloud compression by 33% or more.
- Conference Article
- 8
- 10.1109/icassp48485.2024.10447762
- Apr 14, 2024
The Video-based Dynamic Mesh Coding (V-DMC) standard exploits the temporal correlation by tracing the motions of the vertices, which applies only to tracked frames with one-to-one vertex correspondence. For non-tracked frames, only intra mode is applied. This paper proposes an embedded graph representation method that can efficiently represent inter-frame differences for both tracked and non-tracked frames. First, we construct an embedded graph by simplifying the given mesh. Then, we compute a set of affine transformations on graph nodes and use their linear combinations to represent the inter-frame difference. Finally, we apply our implementation to increase the number of predicted frames (P-frames) and thus improve the resulting coding performance. Evaluations on Moving Picture Experts Group (MPEG) test sequences demonstrate the significant rate distortion improvements achieved by our method over V-DMC. The proposed method is highly compliant with V-DMC, and a part of it has been adopted into the V-DMC reference software during the MPEG-3DGH 144th meeting.
