Abstract

A novel approach to perform unsupervised sequential learning for functional data is proposed. The goal is to extract reference shapes (referred to as templates) from noisy, deformed and censored realizations of curves and images. The proposed model generalizes the Bayesian dense deformable template model, a hierarchical model in which the template is the function to be estimated and the deformation is a nuisance, assumed to be random with a known prior distribution. The templates are estimated using a Monte Carlo version of the online Expectation–Maximization (EM) algorithm. The designed sequential inference framework is significantly more computationally efficient than equivalent batch learning algorithms, especially when the missing data is high-dimensional. Some numerical illustrations on curve registration problem and templates extraction from images are provided to support the methodology.

Highlights

  • Functional data analysis is concerned with the analysis of curves and shapes, which often display common patterns and variations

  • We propose the Monte Carlo online EM (MCoEM), an online algorithm in which the curves/shapes are processed one at a time and only once, allowing to estimate the unknown parameters of the mixture of deformable templates model

  • We have proposed a statistical framework to perform sequential and unsupervised inference of a deformable template model, with application to curve synchronization and shape extraction

Read more

Summary

Introduction

Functional data analysis is concerned with the analysis of curves and shapes, which often display common patterns and variations (in amplitude, orientations, time–space warping, etc. . . ). This alternative has been considered, among others by Liu and Yang (2009) and Frey and Jojic (2003), in which the transformed mixture of Gaussian models was used Another way to handle the E-step, suggested in Gaffney and Smyth (2004) and Bernhardt et al (2015), consists in performing an approximate Bayesian integration, which amounts to replace the posterior distribution of the hidden data conditionally to the observation by a Gaussian distribution, obtained from a Laplace approximation. We propose the Monte Carlo online EM (MCoEM), an online algorithm in which the curves/shapes are processed one at a time and only once, allowing to estimate the unknown parameters of the mixture of deformable templates model.

A basic deformable model
A mixture of deformable templates
Sequential parameter estimation using the Online EM algorithm
Sampling from the missing data joint posterior distribution
MCMC on an extended state space
Choice of the pseudo-prior densities
Numerical illustration
Growth velocity curve study
Deformable template model
Sampling the missing data
Template estimation
Handwritten digits template extraction
Parameter estimation We consider two learning setups
Remark on the number of components in the mixture
Classification
Partially-supervised learning
Fully-unsupervised learning
Discussion
Full Text
Paper version not known

Talk to us

Join us for a 30 min session where you can share your feedback and ask us any queries you have

Schedule a call

Disclaimer: All third-party content on this website/platform is and will remain the property of their respective owners and is provided on "as is" basis without any warranties, express or implied. Use of third-party content does not indicate any affiliation, sponsorship with or endorsement by them. Any references to third-party content is to identify the corresponding services and shall be considered fair use under The CopyrightLaw.