Semantic Texton Forests Research Articles

Semantic Texton Forests for Image Categorization and Segmentation

Semantic Texton Forests for Image Categorization and Segmentation

A Survey on Semantic Texton Forests for Image Categorization and Segmentation

A Survey on Semantic Texton Forests for Image Categorization and Segmentation

Manifold Embedding and Semantic Segmentation for Intraoperative Guidance With Hyperspectral Brain Imaging.

Recent advances in hyperspectral imaging have made it a promising solution for intra-operative tissue characterization, with the advantages of being non-contact, non-ionizing, and non-invasive. Working with hyperspectral images in vivo, however, is not straightforward as the high dimensionality of the data makes real-time processing challenging. In this paper, a novel dimensionality reduction scheme and a new processing pipeline are introduced to obtain a detailed tumor classification map for intra-operative margin definition during brain surgery. However, existing approaches to dimensionality reduction based on manifold embedding can be time consuming and may not guarantee a consistent result, thus hindering final tissue classification. The proposed framework aims to overcome these problems through a process divided into two steps: dimensionality reduction based on an extension of the T-distributed stochastic neighbor approach is first performed and then a semantic segmentation technique is applied to the embedded results by using a Semantic Texton Forest for tissue classification. Detailed in vivo validation of the proposed method has been performed to demonstrate the potential clinical value of the system.

Automated Detection of Multiple Pavement Defects

AbstractKnowing the pavement condition is essential for efficiently deciding on maintenance programs. Current practice is predominantly manual with only 0.4% of inspections happening automatically. All methods in the literature aiming at automating condition assessment focus on two defects at most, or are too expensive for practical application. In this paper, the authors propose a low-cost method that automatically detects pavement defects simultaneously using parking camera video data. The types of defects addressed in this paper are two types of cracks (longitudinal and transverse), patches, and potholes. The method uses the semantic texton forests (STFs) algorithm as a supervised classifier on a calibrated region of interest (myROI), which is the area of the video frame depicting only the usable part of the pavement lane. It is validated using data collected from the local streets of Cambridge, U.K. Based on the results of multiple experiments, the overall accuracy of the method is above 82%, with a p...

Semantic segmentation of images exploiting DCT based features and random forest

This paper presents an approach for generating class-specific image segmentation. We introduce two novel features that use the quantized data of the Discrete Cosine Transform (DCT) in a Semantic Texton Forest based framework (STF), by combining together colour and texture information for semantic segmentation purpose. The combination of multiple features in a segmentation system is not a straightforward process. The proposed system is designed to exploit complementary features in a computationally efficient manner. Our DCT based features describe complex textures represented in the frequency domain and not just simple textures obtained using differences between intensity of pixels as in the classic STF approach. Differently than existing methods (e.g., filter bank) just a limited amount of resources is required. The proposed method has been tested on two popular databases: CamVid and MSRC-v2. Comparison with respect to recent state-of-the-art methods shows improvement in terms of semantic segmentation accuracy.

Content-Aware Image Retargeting Based on Semantic Analysis

This paper presents a retargeting approach based on semantic analysis. Our approach has better performance in images that have comlicated backgroud or multi-objects. Our aim is to protect important object in retargeting process. So we brought in object recognition and image importance calculation for retargeting. This approach consists of three parts: object recognition, the importance of image calculation and image retargeting. (i) Firstly we optimized semantic texton forest (STF)[11]and got much better results of object recognition.(ii) Secondly we presented a method called dynamically adjust importance image calculation. (iii) Thirdly we give a retargeting method based on triangular mesh. According to importance image we cover Delaunay triangular mesh on image and solve optimization mesh transforming based on energy function which subjects to least energy loss and boundary restraint. Compared with previous approaches, our method has better result in some complex scene images.

Image categorization using a semantic hierarchy model with sparse set of salient regions

Image categorization in massive image database is an important problem. This paper proposes an approach for image categorization, using sparse set of salient semantic information and hierarchy semantic label tree (HSLT) model. First, to provide more critical image semantics, the proposed sparse set of salient regions only at the focuses of visual attention instead of the entire scene was formed by our proposed saliency detection model with incorporating low and high level feature and Shotton's semantic texton forests (STFs) method. Second, we also propose a new HSLT model in terms of the sparse regional semantic information to automatically build a semantic image hierarchy, which explicitly encodes a general to specific image relationship. And last, we archived image dataset using image hierarchical semantic, which is help to improve the performance of image organizing and browsing. Extension experimental results showed that the use of semantic hierarchies as a hierarchical organizing framework provides a better image annotation and organization, improves the accuracy and reduces human's effort.

Segmentation and Recognition of Highway Assets Using Image-Based 3D Point Clouds and Semantic Texton Forests

AbstractEfficient data collection of high-quantity and low-cost highway assets such as road signs, traffic signals, light poles, and guardrails is a critical element to the operation, maintenance, and preservation of transportation infrastructure systems. Despite its importance, current practice of highway asset data collection is time-consuming, subjective, and potentially unsafe. The high volume of the data that needs to be collected can also negatively impact the quality of the analysis. To address these limitations, this paper proposes a new algorithm for semantic segmentation and recognition of highway assets using video frames collected from a car-mounted camera. The proposed set of algorithms (1) takes the captured frames and using a pipeline of structure from motion and multiview stereo reconstructs a three-dimensional (3D) point cloud model of the highway and surrounding assets; (2) using a Semantic Texton Forest classifier, each geo-registered two-dimensional (2D) video frame at the pixel-level ...

A combined method for multi-class image semantic segmentation

Multi-class image semantic segmentation (MCISS) is one of the most crucial steps toward many applications related with consumer electronics fields such as image editing and content-based image retrieval. Existing MCISS approaches often consider only the top-down process and suffer from poor label consistency among neighboring pixels. To overcome this limitation, this paper proposes a combined MCISS method to integrate a state-of-the-art topdown (TD) approach Semantic Texton Forests (STF) and a classical bottom-up (BU) approach JSEG to exploit their relative merits. Experimental results on two challenging datasets show that the proposed method can achieve higher accuracy in comparison with the original STF method, while it does not notably prolong the computational time. In addition, several insights into the evaluation metrics of MCISS are reported.