Information-based Metrics Research Articles

Multidecadal Changes of the Seasonal Potential Predictability of Winter PNA and Associated Circulation Anomalies

Abstract Utilizing ensemble hindcast data from the Community Earth System Model (CESM) spanning the years 1900–2014, the multidecadal changes in the seasonal potential predictability of the winter Pacific–North American (PNA) teleconnection pattern and associated circulation anomalies have been investigated by using an information-based metric of relative entropy and the method of the most predictable component analysis. Results show that the seasonal potential predictability of winter PNA has significant multidecadal changes, with values much higher at the two ends of the twentieth century and much lower in between particularly in the 1930s and 1940s. The changes in the seasonal potential predictability of winter PNA are mostly reflected by the temporal evolutions of PNA rather than the location changes of active centers. Further, the changes are mostly contributed by the external forcing of El Niño–Southern Oscillation (ENSO)-related sea surface temperature anomalies in tropical central and eastern Pacific. In particular, the combined effects of lower amplitudes, reduced persistence, and a more eastward shift in warming centers lead to the reduced seasonal potential predictability of PNA and associated circulation changes in the 1930s and 1940s. Significance Statement Seasonal prediction of the winter Pacific–North American (PNA) teleconnection pattern and associated circulation anomalies is very important due to its profound climate impacts. Understanding the multidecadal fluctuations and its driving sources of the potential predictability of winter PNA and associated circulation anomalies are meaningful for skillful seasonal prediction of winter PNA and circulation anomalies as well as related climate variations. This study for the first time shows that the multidecadal fluctuations of the potential predictability of winter PNA are quite significant and the changes are mostly reflected by its temporal evolutions rather than spatial shifts of active centers. Furthermore, this study shows that the strength, persistence, and warming center locations of ENSO-related sea surface temperatures in tropical Pacific play a crucial role on the multidecadal changes of the potential predictability of winter PNA and associated circulation anomalies.

Sparse Depth-Guided Image Enhancement Using Incremental GP with Informative Point Selection.

We propose an online dehazing method with sparse depth priors using an incremental Gaussian Process (iGP). Conventional approaches focus on achieving single image dehazing by using multiple channels. In many robotics platforms, range measurements are directly available, except in a sparse form. This paper exploits direct and possibly sparse depth data in order to achieve efficient and effective dehazing that works for both color and grayscale images. The proposed algorithm is not limited to the channel information and works equally well for both color and gray images. However, efficient depth map estimations (from sparse depth priors) are additionally required. This paper focuses on a highly sparse depth prior for online dehazing. For efficient dehazing, we adopted iGP for incremental depth map estimation and dehazing. Incremental selection of the depth prior was conducted in an information-theoretic way by evaluating mutual information (MI) and other information-based metrics. As per updates, only the most informative depth prior was added, and haze-free images were reconstructed from the atmospheric scattering model with incrementally estimated depth. The proposed method was validated using different scenarios, color images under synthetic fog, real color, and grayscale haze indoors, outdoors, and underwater scenes.

Sensing-Oriented Communications in Vehicular Networks: Sensing Assessment and Resource Allocation

This letter studies sensing-oriented communications in vehicular networks in which multiple vehicles are equipped with visual sensors whose observations are transmitted to the cloud to estimate 3D environment model. Our aim is to maximize the sensing quality under communication constraints, which are twofold, i.e., the number of activated observations and the number of bits. We first propose information-based metrics to evaluate both accuracy and completeness of sensing in the network, and reveal the impacts of communication constraints on sensing based on eigenspace decomposition. Moreover, we design a hierarchical communication resource allocation scheme, with their performance validated by numerical results.

Maximum-relevance and maximum-diversity of positive ranks: A novel feature selection method

With the existing abundance of intelligent and expert systems, there is a need for selecting a subset of highly relevant features with low redundancy. In filter approaches, the feature subsets are iteratively computed by evaluating the candidate features in terms of their relevance with the target class and pairwise redundancies. The use mutual information-based metrics has been extensively studied as an approach to quantifying the relevance and redundancy of candidate features. In this study, a novel filter approach based on ranks of positive instances is proposed. In this approach, redundancy is replaced by diversity to quantify the complementarity of a candidate feature with respect to the already selected subset. Both relevance and diversity are computed in terms of the ranks of positive instances, which is analogous to the computation of the area under the receiver operating characteristic curve (AUC). Experiments conducted on 15 UCI and microarray gene expression data sets have confirmed that the proposed multivariate filter feature selection approach provides better performance scores when compared to other competing multivariate methods as well as benchmark univariate filters.

Predictively consistent prior effective sample sizes.

Determining the sample size of an experiment can be challenging, even more so when incorporating external information via a prior distribution. Such information is increasingly used to reduce the size of the control group in randomized clinical trials. Knowing the amount of prior information, expressed as an equivalent prior effective sample size (ESS), clearly facilitates trial designs. Various methods to obtain a prior's ESS have been proposed recently. They have been justified by the fact that they give the standard ESS for one-parameter exponential families. However, despite being based on similar information-based metrics, they may lead to surprisingly different ESS for nonconjugate settings, which complicates many designs with prior information. We show that current methods fail a basic predictive consistency criterion, which requires the expected posterior-predictive ESS for a sample of size N to be the sum of the prior ESS and N. The expected local-information-ratio ESS is introduced and shown to be predictively consistent. It corrects the ESS of current methods, as shown for normally distributed data with a heavy-tailed Student-t prior and exponential data with a generalized Gamma prior. Finally, two applications are discussed: the prior ESS for the control group derived from historical data and the posterior ESS for hierarchical subgroupanalyses.

A two-stage processing approach for contrast intensified image fusion

Purpose Integrating complementary information with high-quality visual perception is essential in infrared and visible image fusion. Contrast-enhanced fusion required for target detection in military, navigation and surveillance applications, where visible images are captured at low-light conditions, is a challenging task. This paper aims to focus on the enhancement of poorly illuminated low-light images through decomposition prior to fusion, to provide high visual quality. Design/methodology/approach In this paper, a two-step process is implemented to improve the visual quality. First, the low-light visible image is decomposed to dark and bright image components. The decomposition is accomplished based on the selection of a threshold using Renyi’s entropy maximization. The decomposed dark and bright images are intensified with the stochastic resonance (SR) model. Second, texture information-based weighted average scheme for low-frequency coefficients and select maximum precept for high-frequency coefficients are used in the discrete wavelet transform (DWT) domain. Findings Simulations in MATLAB were carried out on various test images. The qualitative and quantitative evaluations of the proposed method show improvement in edge-based and information-based metrics compared to several existing fusion techniques. Originality/value In this work, a high-contrast, edge-preserved and brightness-improved image is obtained by the processing steps considered in this work to get good visual quality.

Optimal Sensor Placement Methods in Active High Power Density Electronic Systems With Experimental Validation

Abstract Increasing the efficiency and density of power electronic systems (PESs) is an important objective for many high-impact applications, such as electric vehicle charging and aircraft electrification. Due to compactness and high heat dissipation, careful thermal monitoring of such PESs is required. Strategic placement of temperature sensors can improve the accuracy of real-time temperature distribution estimates. Enhanced temperature estimation supports increased power throughput and density because PESs can be operated in a less conservative manner while still preventing thermal failure. This article presents new methods for temperature sensor placement for 2- and 3-dimensional PESs that (1) improve computational efficiency (by orders of magnitude in at least one case), (2) support the use of more accurate evaluation metrics, and (3) are scalable to high-dimension sensor placement problems. These methods are tested via sensor placement studies based on a single-phase flying capacitor multi-level (FCML) prototype inverter. Information-based metrics are derived from a resistance-capacitance (RC) lumped parameter thermal model. Other more general metrics and system models are possible through the application of a new continuous relaxation strategy introduced here for placement representation. A new linear programming (LP) formulation is presented that is compatible with a particular type of information-based metric. This LP strategy is demonstrated to support an efficient solution of finely discretized large-scale placement problems. The optimal sensor locations obtained from these methods were tested via physical experiments. The new methods and results presented here may aid the development of thermally aware PESs with significantly enhanced capabilities.

Evaluating Complexity of Fetal MEG Signals: A Comparison of Different Metrics and Their Applicability.

In this work, we aim to investigate whether information based metrics of neural activity are a useful tool for the quantification of consciousness before and shortly after birth. Neural activity is measured using fetal magnetoencephalography (fMEG) in human fetuses and neonates. Based on recent theories on consciousness, information-based metrics are established to measure brain complexity and to assess different levels of consciousness. Different metrics (measures of entropy, compressibility and fractality) are, thus, explored in a reference population and their usability is evaluated. For comparative analysis, two fMEG channels were selected: one where brain activity was previously detected and one at least 15 cm away, that represented a control channel. The usability of each metric was evaluated and results from the brain and control channel were compared. Concerning the ease of use with fMEG data, Lempel-Ziv-Complexity (LZC) was evaluated as best, as it is unequivocal and needs low computational effort. The fractality measures have a high number of parameters that need to be adjusted prior to analysis and therefore forfeit comparability, while entropy measures require a higher computational effort and more parameters to adjust compared to LZC. Comparison of a channel with brain activity and a control channel in neonatal recordings showed significant differences in most complexity metrics. This clear difference can be seen as proof of concept for the usability of complexity metrics in fMEG. For fetal data, this comparison produced less clear results which can be related to leftover maternal signals included in the control channel. Further work is necessary to conclusively interpret results from the analysis of fetal recordings. Yet this study shows that complexity metrics can be used for fMEG data on early consciousness and the evaluation gives a guidance for future work. The inconsistency of results from different metrics highlights the challenges of working with complexity metrics as neural correlates of consciousness, as well as the caution one should apply to interpret them.

Shannon-Inspired Statistical Computing for the Nanoscale Era

Modern day computing systems are based on the von Neumann architecture proposed in 1945 but face dual challenges of: 1) unique data-centric requirements of emerging applications and 2) increased nondeterminism of nanoscale technologies caused by process variations and failures. This paper presents a Shannon-inspired statistical model of computation (statistical computing) that addresses the statistical attributes of both emerging cognitive workloads and nanoscale fabrics within a common framework. Statistical computing is a principled approach to the design of non-von Neumann architectures. It emphasizes the use of information-based metrics; enables the determination of fundamental limits on energy, latency, and accuracy; guides the exploration of statistical design principles for low signal-to-noise ratio (SNR) circuit fabrics and architectures such as deep in-memory architecture (DIMA) and deep in-sensor architecture (DISA); and thereby provides a framework for the design of computing systems that approach the limits of energy efficiency, latency, and accuracy. From its early origins, Shannon-inspired statistical computing has grown into a concrete design framework validated extensively via both theory and laboratory prototypes in both CMOS and beyond. The framework continues to grow at both of these levels, yielding new ways of connecting systems through architectures, circuits, and devices, for the semiconductor roadmap to march into the nanoscale era.

A Study of BER-Optimal ADC-Based Receiver for Serial Links

Analog-to-digital converter (ADC)-based multi-Gb/s serial link receivers have gained increasing attention in the backplane community due to the desire for higher I/O throughput, ease of design portability, and flexibility. However, the power dissipation in such receivers is dominated by the ADC. ADCs in serial links employ signal-to-noise-and-distortion ratio (SNDR) and effective-number-of-bit (ENOB) as performance metrics as these are the standard for generic ADC design. This paper studies the use of information-based metrics such as bit-error-rate (BER) to design a BER-optimal ADC (BOA) for serial links. Channel parameters such as the $m$ -clustering value and the threshold non-uniformity metric $h_{t}$ are introduced and employed to quantify the BER improvement achieved by a BOA over a conventional uniform ADC (CUA) in a receiver. Analytical expressions for BER improvement are derived and validated through simulations. A prototype BOA is designed, fabricated and tested in a 1.2 V, 90 nm LP CMOS process to verify the results of this study. BOA's variable-threshold and variable-resolution configurations are implemented via an 8-bit single-core, multiple-output passive digital-to-analog converter (DAC), which incurs an additional power overhead of $ 0.1% (approximately 50 $\mu\text{W}$ ). Measurement results show examples in which the BER achieved by the 3-bit BOA receiver is lower by a factor of $10^{9}$ and $10^{10}$ , as compared to the 4-bit and 3-bit CUA receivers, respectively, at a data rate of 4-Gb/s and a transmitted signal amplitude of 180 mVppd.

Potential Predictability of North American Surface Temperature. Part I: Information-Based versus Signal-To-Noise-Based Metrics

Abstract In this study, the potential predictability of the North American (NA) surface air temperature was explored using information-based predictability framework and Ensemble-Based Predictions of Climate Changes and their Impacts (ENSEMBLES) multiple model ensembles. Emphasis was put on the comparison of predictability measured by information-based metrics and by the conventional signal-to-noise ratio (SNR)-based metrics. Furthermore, the potential predictability was optimally decomposed into different modes by maximizing the predictable information (equivalent to the maximum of SNR), from which the most predictable structure was extracted and analyzed. It was found that the conventional SNR-based metrics underestimate the potential predictability, in particular in these areas where the predictable signals are relatively weak. The most predictable components of the NA surface air temperature can be characterized by the interannual variability mode and the long-term trend mode. The former is inherent to tropical Pacific sea surface temperature (SST) forcing such as El Niño–Southern Oscillation (ENSO), whereas the latter is closely associated with the global warming. The amplitude of the two modes has geographical variations in different seasons. On this basis, the possible physical mechanisms responsible for the predictable mode of interannual variability and its potential benefits to the improvement of seasonal climate prediction were discussed.

Info-gibbs: a motif discovery algorithm that directly optimizes information content during sampling

Discovering cis-regulatory elements in genome sequence remains a challenging issue. Several methods rely on the optimization of some target scoring function. The information content (IC) or relative entropy of the motif has proven to be a good estimator of transcription factor DNA binding affinity. However, these information-based metrics are usually used as a posteriori statistics rather than during the motif search process itself. We introduce here info-gibbs, a Gibbs sampling algorithm that efficiently optimizes the IC or the log-likelihood ratio (LLR) of the motif while keeping computation time low. The method compares well with existing methods like MEME, BioProspector, Gibbs or GAME on both synthetic and biological datasets. Our study shows that motif discovery techniques can be enhanced by directly focusing the search on the motif IC or the motif LLR. http://rsat.ulb.ac.be/rsat/info-gibbs