Ratio Probability Density Research Articles

Online Direct Density-Ratio Estimation Applied to Inlier-Based Outlier Detection.

Many machine learning problems, such as nonstationarity adaptation, outlier detection, dimensionality reduction, and conditional density estimation, can be effectively solved by using the ratio of probability densities. Since the naive two-step procedure of first estimating the probability densities and then taking their ratio performs poorly, methods to directly estimate the density ratio from two sets of samples without density estimation have been extensively studied recently. However, these methods are batch algorithms that use the whole data set to estimate the density ratio, and they are inefficient in the online setup, where training samples are provided sequentially and solutions are updated incrementally without storing previous samples. In this letter, we propose two online density-ratio estimators based on the adaptive regularization of weight vectors. Through experiments on inlier-based outlier detection, we demonstrate the usefulness of the proposed methods.

Importance sampling based algorithm for efficient reliability analysis of axially loaded piles

In reliability analysis, the crude Monte Carlo method is known to be computationally demanding. To improve computational efficiency, this paper presents an importance sampling based algorithm that can be applied to conduct efficient reliability evaluation for axially loaded piles. The spatial variability of soil properties along the pile length is considered by random field modeling, in which a mean, a variance, and a correlation length are used to statistically characterize a random field. The local averaging subdivision technique is employed to generate random fields. In each realization, the random fields are used as inputs to the well-established load transfer method to evaluate the load–displacement behavior of an axially loaded pile. Failure is defined as the event where the vertical movement at the pile top exceeds the allowable displacement. By sampling more heavily from the region of interest and then scaling the indicator function back by a ratio of probability densities, a faster rate of convergence can be achieved in the proposed importance sampling algorithm while maintaining the same accuracy as in the crude Monte Carlo method. Two examples are given to demonstrate the accuracy and the efficiency of the proposed method. It is shown that the estimate based on the proposed importance sampling method is unbiased. Furthermore, the size of samples can be greatly reduced in the developed method.

Tail Behavior and Limit Distribution of Maximum of Logarithmic General Error Distribution

Logarithmic general error distribution, an extension of the log-normal distribution, is proposed. Some interesting properties of the log GED are derived. These properties are applied to establish the asymptotic behavior of the ratio of probability densities and the ratio of the tails of the logarithmic general error and log-normal distributions, and to derive the asymptotic distribution of the partial maximum of an independent and identically distributed sequence obeying the log GED.

Tail Behavior of the General Error Distribution

An inequality on the tail behavior of the general error distribution and an asymptotic Mills-type ratio are established. Two applications are provided. The first application considers the asymptotic behavior of the ratio of probability densities and the ratio of the tails of the general error and normal distributions. The second application establishes the asymptotic distribution of the partial maximum of an independent and identically distributed sequence from the general error distribution.