Efficient visual attention driven framework for key frames extraction from hysteroscopy videos

Abstract

Recent years have shown enthusiastic research interests in diagnostic hysteroscopy (DH), where various regions of the female reproductive system are visualized for diagnosing uterine disorders. Currently, the hysteroscopy videos produced during various sessions of patients are stored in medical libraries, which are usually browsed by medical specialists Gynecologists to visualize previous videos of a patient or to study similar cases. However, the abundant redundancy of frames in DH videos make this searching relatively more difficult for gynecologists, wasting their time browsing such large libraries. In this context, video summarization can be used to reduce this redundancy by extracting key frames, thus making the process of browsing and indexing DH videos more efficient. In this letter, we propose an efficient domain-specific visual attention-driven framework for summarizing DH videos. For key frames extraction, multi-scale contrast, texture, curvature, and motion based saliency features are computed for each frame using integral image, which are then fused by a linear weighted fusion scheme to acquire a final saliency map. Experimental results in comparison with other related state-of-the-art schemes confirm the effectiveness and efficiency of the proposed framework.