Abstract

In this article, a motion vector-based video key frame detection algorithm is proposed to solve the problem of miss election and missing selection caused by the difficulty in detecting the moving target characteristics of the video key frame. Firstly, the entropy of adjacent frame difference and the two-dimensional entropy of image are introduced, and the combination of the two is taken as the measurement of the difference between video frames. Secondly, outliers are detected by statistical tools to obtain the lens boundary, thus realizing the adaptive lens detection of video content. Then, ViBe algorithm is used to detect the foreground object in the video sequence and extract the scale-invariant feature transformation features of the foreground moving object. Finally, the motion vector is introduced, and the sum of the block matching results is motion vector by partitioning the two adjacent frames and performing block matching. The magnitude of motion vector reflects the intensity of motion in the video, so active and inactive motion regions are obtained, and the similarity of video frames is calculated according to the defined formula, and key frames are extracted in these regions respectively. The experimental results show that the detection algorithm proposed in this article improves the video results with rich motion information obviously, and the objective indexes and subjective scores are improved to some extent, which improves the universality of the algorithm. In addition, this article also studies the display mode of key frame extraction results in virtual reality environment. The key frame display mode of video in virtual reality is optimized mainly by changing the display mode of information and changing the scene and testing the result of user task execution.

Highlights

  • In recent years, with the continuous progress of Internet video technology and the continuous update of mobile video devices, browsing video has increasingly become an important way for people to understand the world and obtain information [1], [2]

  • Outliers are detected by statistical tools to obtain the lens boundary, realizing the adaptive lens detection of video content

  • The magnitude of motion vector reflects the intensity of motion in the video, so active and inactive motion regions are obtained, and the similarity of video frames is calculated according to the defined formula, and key frames are extracted in these regions respectively

Read more

Summary

INTRODUCTION

With the continuous progress of Internet video technology and the continuous update of mobile video devices, browsing video has increasingly become an important way for people to understand the world and obtain information [1], [2]. It is difficult for video users to quickly and accurately obtain the content they want from such a large amount of video information. A kind of method for text annotation of video content information is called text description-based retrieval method [5], [6] This method has the disadvantage of losing video time information. This article introduces the video key frame extraction technology, and studies and explores the key frame display mode and method in VR environment. Zhu: Video Key Frame Monitoring Algorithm and VR Display Based on Motion Vector miss election and missing selection caused by the difficulty in detecting the moving target characteristics of the video key frame. The user experience under virtual reality environment is studied and the task execution ability of users under different display modes is explored

RELEVANT WORKS
ANALYSIS OF VIDEO KEY FRAME CHARACTERISTICS
VIDEO KEY FRAME DETECTION ALGORITHM BASED ON MOTION VECTOR
VIDEO LENS DETECTION METHOD
ACTIVE REGION DIVISION BASED ON MOTION VECTOR
CONCLUSION

Talk to us

Join us for a 30 min session where you can share your feedback and ask us any queries you have

Schedule a call

Disclaimer: All third-party content on this website/platform is and will remain the property of their respective owners and is provided on "as is" basis without any warranties, express or implied. Use of third-party content does not indicate any affiliation, sponsorship with or endorsement by them. Any references to third-party content is to identify the corresponding services and shall be considered fair use under The CopyrightLaw.