Expert Ground Truth Research Articles

Concurrent segmentation of the prostate on MRI and CT via linked statistical shape models for radiotherapy planning

Prostate gland segmentation is a critical step in prostate radiotherapy planning, where dose plans are typically formulated on CT. Pretreatment MRI is now beginning to be acquired at several medical centers. Delineation of the prostate on MRI is acknowledged as being significantly simpler to perform, compared to delineation on CT. In this work, the authors present a novel framework for building a linked statistical shape model (LSSM), a statistical shape model (SSM) that links the shape variation of a structure of interest (SOI) across multiple imaging modalities. This framework is particularly relevant in scenarios where accurate boundary delineations of the SOI on one of the modalities may not be readily available, or difficult to obtain, for training a SSM. In this work the authors apply the LSSM in the context of multimodal prostate segmentation for radiotherapy planning, where the prostate is concurrently segmented on MRI and CT. The framework comprises a number of logically connected steps. The first step utilizes multimodal registration of MRI and CT to map 2D boundary delineations of the prostate from MRI onto corresponding CT images, for a set of training studies. Hence, the scheme obviates the need for expert delineations of the gland on CT for explicitly constructing a SSM for prostate segmentation on CT. The delineations of the prostate gland on MRI and CT allows for 3D reconstruction of the prostate shape which facilitates the building of the LSSM. In order to perform concurrent prostate MRI and CT segmentation using the LSSM, the authors employ a region-based level set approach where the authors deform the evolving prostate boundary to simultaneously fit to MRI and CT images in which voxels are classified to be either part of the prostate or outside the prostate. The classification is facilitated by using a combination of MRI-CT probabilistic spatial atlases and a random forest classifier, driven by gradient and Haar features. The authors acquire a total of 20 MRI-CT patient studies and use the leave-one-out strategy to train and evaluate four different LSSMs. First, a fusion-based LSSM (fLSSM) is built using expert ground truth delineations of the prostate on MRI alone, where the ground truth for the gland on CT is obtained via coregistration of the corresponding MRI and CT slices. The authors compare the fLSSM against another LSSM (xLSSM), where expert delineations of the gland on both MRI and CT are employed in the model building; xLSSM representing the idealized LSSM. The authors also compare the fLSSM against an exclusive CT-based SSM (ctSSM), built from expert delineations of the gland on CT alone. In addition, two LSSMs trained using trainee delineations (tLSSM) on CT are compared with the fLSSM. The results indicate that the xLSSM, tLSSMs, and the fLSSM perform equivalently, all of them out-performing the ctSSM. The fLSSM provides an accurate alternative to SSMs that require careful expert delineations of the SOI that may be difficult or laborious to obtain. Additionally, the fLSSM has the added benefit of providing concurrent segmentations of the SOI on multiple imaging modalities.

Community annotation experiment for ground truth generation for the i2b2 medication challenge

Within the context of the Third i2b2 Workshop on Natural Language Processing Challenges for Clinical Records, the authors (also referred to as 'the i2b2 medication challenge team' or 'the i2b2 team' for short) organized a community annotation experiment. For this experiment, the authors released annotation guidelines and a small set of annotated discharge summaries. They asked the participants of the Third i2b2 Workshop to annotate 10 discharge summaries per person; each discharge summary was annotated by two annotators from two different teams, and a third annotator from a third team resolved disagreements. In order to evaluate the reliability of the annotations thus produced, the authors measured community inter-annotator agreement and compared it with the inter-annotator agreement of expert annotators when both the community and the expert annotators generated ground truth based on pooled system outputs. For this purpose, the pool consisted of the three most densely populated automatic annotations of each record. The authors also compared the community inter-annotator agreement with expert inter-annotator agreement when the experts annotated raw records without using the pool. Finally, they measured the quality of the community ground truth by comparing it with the expert ground truth. The authors found that the community annotators achieved comparable inter-annotator agreement to expert annotators, regardless of whether the experts annotated from the pool. Furthermore, the ground truth generated by the community obtained F-measures above 0.90 against the ground truth of the experts, indicating the value of the community as a source of high-quality ground truth even on intricate and domain-specific annotation tasks.

Bridging the gap between tagging and querying vocabularies: Analyses and applications for enhancing multimedia IR

Collaborative tagging has become an increasingly popular means for sharing and organizing Web resources, leading to a huge amount of user-generated metadata. These annotations represent quite a few different aspects of the resources they are attached to, but it is not obvious which characteristics of the objects are predominantly described. The usefulness of these tags for finding/re-finding the annotated resources is also not completely clear. Several studies have started to investigate these issues, however only by focusing on a single type of tagging system or resource. We study this problem across multiple domains and resource types and identify the gaps between the tag space and the querying vocabulary. Based on the findings of this analysis, we then try to bridge the identified gaps, focusing in particular on multimedia resources. We focus on the two scenarios of music and picture resources and develop algorithms, which identify usage ( theme) and opinion ( mood) characteristics of the items. The mood and theme labels our algorithms infer are recommended to the users, in order to support them during the annotation process. The evaluation of the proposed methods against user judgements, as well as against expert ground truth reveal the high quality of our recommended annotations and provide insights into possible extensions for music and picture tagging systems to support retrieval.

Bridging the Gap between Tagging and Querying Vocabularies: Analyses and Applications for Enhancing Multimedia IR

Collaborative tagging has become an increasingly popular means for sharing and organizing Web resources, leading to a huge amount of user-generated metadata. These annotations represent quite a few different aspects of the resources they are attached to, but it is not obvious which characteristics of the objects are predominantly described. The usefulness of these tags for finding/re-finding the annotated resources is also not completely clear. Several studies have started to investigate these issues, however only by focusing on a single type of tagging system or resource.We study this problem across multiple domains and resource types and identify the gaps between the tag space and the querying vocabulary. Based on the findings of this analysis, we then try to bridge the identified gaps, focusing in particular on multimedia resources. We focus on the two scenarios of music and picture resources and develop algorithms, which identify usage (theme) and opinion (mood) characteristics of the items. The mood and theme labels our algorithms infer are recommended to the users, in order to support them during the annotation process. The evaluation of the proposed methods against user judgements, as well as against expert ground truth reveal the high quality of our recommended annotations and provide insights into possible extensions for music and picture tagging systems to support retrieval.

An image score inference system for RNAi genome-wide screening based on fuzzy mixture regression modeling

With recent advances in fluorescence microscopy imaging techniques and methods of gene knock down by RNA interference (RNAi), genome-scale high-content screening (HCS) has emerged as a powerful approach to systematically identify all parts of complex biological processes. However, a critical barrier preventing fulfillment of the success is the lack of efficient and robust methods for automating RNAi image analysis and quantitative evaluation of the gene knock down effects on huge volume of HCS data. Facing such opportunities and challenges, we have started investigation of automatic methods towards the development of a fully automatic RNAi–HCS system. Particularly important are reliable approaches to cellular phenotype classification and image-based gene function estimation. We have developed a HCS analysis platform that consists of two main components: fluorescence image analysis and image scoring. For image analysis, we used a two-step enhanced watershed method to extract cellular boundaries from HCS images. Segmented cells were classified into several predefined phenotypes based on morphological and appearance features. Using statistical characteristics of the identified phenotypes as a quantitative description of the image, a score is generated that reflects gene function. Our scoring model integrates fuzzy gene class estimation and single regression models. The final functional score of an image was derived using the weighted combination of the inference from several support vector-based regression models. We validated our phenotype classification method and scoring system on our cellular phenotype and gene database with expert ground truth labeling. We built a database of high-content, 3-channel, fluorescence microscopy images of Drosophila Kc 167 cultured cells that were treated with RNAi to perturb gene function. The proposed informatics system for microscopy image analysis is tested on this database. Both of the two main components, automated phenotype classification and image scoring system, were evaluated. The robustness and efficiency of our system were validated in quantitatively predicting the biological relevance of genes.

Automated fish age estimation from otolith images using statistical learning

Abstract The acquisition of age and growth data is of key importance for fisheries research (assessment, marine ecology issues, etc.). Consequently, automating this task is of great interest. In this paper, we investigate the use of statistical learning techniques for fish age estimation. The core of this study lies in the definition of relevant image-related features. We rely on the computation of a 1D representation summing up the content of otolith images within a predefined area of interest. Features are then extracted from this non-stationary representation depicting the alternation of seasonal growth rings. Thus, fish age estimation can be viewed as a multi-class classification issue using statistical learning strategies. In particular, a procedure based on demodulation and remodulation of fish growth patterns is used to improve the generalization properties of the trained classifiers. The experimental evaluation is carried out over a dataset of 320 plaice otolith images from age groups 1–6. We analyze both, the performances of several statistical classifiers, namely SVMs (support vector machines) and neural networks, and the relevance of the proposed image-based feature sets. In addition, the combination of additional biological and shape features to the image-related ones is considered. We reach a rate of correct age estimation of 88% w.r.t. the expert ground truth. This demonstrates the relevance of the proposed approach for the automation of routine aging and for computer-assisted aging.