Hybrid Generative-discriminative Approach Research Articles

Adaptive-Attentive Geolocalization From Few Queries: A Hybrid Approach

We tackle the task of cross-domain visual geo-localization, where the goal is to geo-localize a given query image against a database of geo-tagged images, in the case where the query and the database belong to different visual domains. In particular, at training time, we consider having access to only few unlabeled queries from the target domain. To adapt our deep neural network to the database distribution, we rely on a 2-fold domain adaptation technique, based on a hybrid generative-discriminative approach. To further enhance the architecture, and to ensure robustness across domains, we employ a novel attention layer that can easily be plugged into existing architectures. Through a large number of experiments, we show that this adaptive-attentive approach makes the model robust to large domain shifts, such as unseen cities or weather conditions. Finally, we propose a new large-scale dataset for cross-domain visual geo-localization, called SVOX.

$$\text {ALR}^n$$ ALR n : accelerated higher-order logistic regression

This paper introduces Accelerated Logistic Regression: a hybrid generative-discriminative approach to training Logistic Regression with high-order features. We present two main results: (1) that our combined generative-discriminative approach significantly improves the efficiency of Logistic Regression and (2) that incorporating higher order features (i.e. features that are the Cartesian products of the original features) reduces the bias of Logistic Regression, which in turn significantly reduces its error on large datasets. We assess the efficacy of Accelerated Logistic Regression by conducting an extensive set of experiments on 75 standard datasets. We demonstrate its competitiveness, particularly on large datasets, by comparing against state-of-the-art classifiers including Random Forest and Averaged n-Dependence Estimators.

Investigating Topic Models' Capabilities in Expression Microarray Data Classification

In recent years a particular class of probabilistic graphical models-called topic models-has proven to represent an useful and interpretable tool for understanding and mining microarray data. In this context, such models have been almost only applied in the clustering scenario, whereas the classification task has been disregarded by researchers. In this paper, we thoroughly investigate the use of topic models for classification of microarray data, starting from ideas proposed in other fields (e.g., computer vision). A classification scheme is proposed, based on highly interpretable features extracted from topic models, resulting in a hybrid generative-discriminative approach; an extensive experimental evaluation, involving 10 different literature benchmarks, confirms the suitability of the topic models for classifying expression microarray data.

Deriving kernels from generalized Dirichlet mixture models and applications

In the last few years hybrid generative discriminative approaches have received increasing attention and their capabilities have been demonstrated by several applications in different domains. Hybrid approaches allow the incorporation of prior knowledge about the nature of the data to classify. Past work on hybrid approaches has focused on Gaussian data, however, and less attention has been given to other kinds of non-Gaussian data which appear in many applications. In this article we introduce a class of generative kernels based on finite mixture models for non-Gaussian data classification. This particular class is based on the generalized Dirichlet distribution which have been shown to be effective to model this kind of data. We demonstrate the efficacy of the proposed framework on two challenging applications namely object detection and content-based image classification via the integration of color and spatial information.