Information Theory Research Articles

Statistical Response of ENSO Complexity to Initial Condition and Model Parameter Perturbations

Abstract Studying the response of a climate system to perturbations has practical significance. Standard methods in computing the trajectory-wise deviation caused by perturbations may suffer from the chaotic nature that makes the model error dominate the true response after a short lead time. Statistical response, which computes the return described by the statistics, provides a systematic way of reaching robust outcomes with an appropriate quantification of the uncertainty and extreme events. In this paper, information theory is applied to compute the statistical response and find the most sensitive perturbation direction of different El Niño–Southern Oscillation (ENSO) events to initial value and model parameter perturbations. Depending on the initial phase and the time horizon, different state variables contribute to the most sensitive perturbation direction. While initial perturbations in sea surface temperature (SST) and thermocline depth usually lead to the most significant response of SST at short and long ranges, respectively, initial adjustment of the zonal advection can be crucial to trigger strong statistical responses at medium range around 5–7 months, especially at the transient phases between El Niño and La Niña. It is also shown that the response in the variance triggered by external random forcing perturbations, such as the wind bursts, often dominates the mean response, making the resulting most sensitive direction very different from the trajectory-wise methods. Finally, despite the strong non-Gaussian climatology distributions, using Gaussian approximations in the information theory is efficient and accurate for computing the statistical response, allowing the method to be applied to sophisticated operational systems. Significance Statement The purpose of this work is to better understand how El Niño–Southern Oscillation (ENSO) responds to changes in its initial state and internal dynamics or external forcings. A statistical quantification of this response allows for the comprehension of the triggering conditions and the effect of climate change on the occurrence frequency and strength of each type of ENSO event. Such a study also allows to detect the most sensitive perturbation directions, which has practical significance in guiding anthropogenic activities. The approach used to study the response in this work is through the framework of information theory, which allows for an unbiased and robust assessment of the statistical response that is not affected by the turbulent dynamics of the system.

An experimental and numerical study on chloride transport in concrete under single bending load and coastal soft soil environment

This paper presents an experimental and numerical simulation study on the corrosion of chloride ions in concrete components, using a single pre-applied bending load to represent an additional bending moment caused by an external one-off disturbance. Besides, a novel correlation testing method, the Pearson-Mutual Information (PMI) method, is proposed based on Pearson correlation coefficients and mutual information theory. The findings indicate that a significant effect on chloride ion transport is only observed when the ratio of the applied bending load to the ultimate bending load (λ) exceeds 0.3. There is a distinctly positive and nonlinear relationship between λ and free chloride concentration (CCl), the apparent chloride diffusion coefficient (Da), as well as apparent surface chloride concentration (Cs). The bivariate time-varying model developed in this study demonstrates high fitting accuracy, with simulation results that closely correspond to actual measured data, achieving a coefficient of determination (R²) of 0.98 or higher. Furthermore, a sensitivity analysis of the model input parameters indicates that Cs is more sensitive than Da, and λ is identified as the key parameter. The impacts of the interfacial transition zone (ITZ) and its diffusion coefficient (Ditz) were found to be minimal on the output of the model.

Simondon’s Heterodox Naturalism: Form, Information and Self-Organization in Imagination and Invention

This article presents Simondon’s psycho-biological thinking as a type of heterodox naturalism centring on the self-organizing activity of vital forms. Despite his critique of classic notions of form, notably Aristotelian hylomorphism, Simondon revises this concept through a critical expansion and synthesis of information theory and Gestalt psychology. In his lecture series Imagination and Invention (1965–6) in particular, he develops an account of psycho-biological activity as governed by what he calls ‘images’: relatively autonomous informational sub-systems that serve to regulate the relationship between organism and environment and that constitute the condition for creative action or invention. Focusing on his analysis of the individualization of perceptual objects, the article goes on to show that ‘forms’ for Simondon feature as emergent properties of quantum thresholds of ‘information’ within these systems. It also argues that such a conception offers a more promising alternative to both idealist philosophies of perception and materialist interpretations of deconstruction.

The Application of Information Theory to Interpret Shore Platform Erosion Rates

Advancements in information physics have recently introduced the application of information theory to investigate physical systems. The behaviour of erosion at the granular scale is to date still a complex system to unpack, and therefore geomorphology research requires novel approaches to better inform the interpretation of temporal and spatial erosion patterns at different scales. This paper applies information theory concepts to re-evaluate erosional data that were measured on limestone surfaces of two shore platforms in Malta with a traversing micro-erosion meter (TMEM). By representing erosion rates through their information content using a Box-Cox style transformation of the raw data (application of an inverse normal distribution function to fractionally ranked data), it is possible to identify points and measurement periods that contribute to a disproportionately large share of unexpected erosion rates that could provide more insight into the causes of erosion rates. Despite the variations in the information content from erosion rates at individual measurement points, most points consistently contribute to a similar amount of information. These findings illuminate the importance of considering the informational value of erosion data to further understand the underlying physical processes and potentially improve predictive models.

«Theory of everything»: types of information and the theory of interpretation in «Philosophy of chance» by Stanisław Lem

The article is focused on the S. Lem’s perspective of the literary work as a product of the reader’s apprehension of the text in the culture discourse. The aim of the research is to describe the Lem’s view on the structure of the text; Lem’s encounter as a writer, a reader, and a philosopher is used to state the conditions and characteristics of the text interpretation. By the means of multiple introspection the author of “Philosophy of chance” devotes his research to the explanation of his model of the literary work as a product of the social-cultural existence. Moreover, the author’s aim is to state the characteristics of the text creation and interpretation. Therefore, the research shows a new, “cybernetic” approach to the text interpretation based on the comparison between the text structural characteristics and the rules of the mathematical theory of probability and the theory of information. The futurological view lies in the hypothesis about the text as a “self-learning program” (also known as a neuronet) which can transform due to the developing conditions of the interpretation process. As a matter of fact, S. Lem highlights two types of information: selective and structural. Both types might be identified in the text, but that depends on the reader, his encounter and expertise.

Synergy as the Failure of Distributivity

The concept of emergence, or synergy in its simplest form, is widely used but lacks a rigorous definition. Our work connects information and set theory to uncover the mathematical nature of synergy as the failure of distributivity. For the trivial case of discrete random variables, we explore whether and how it is possible to get more information out of lesser parts. The approach is inspired by the role of set theory as the fundamental description of part–whole relations. If taken unaltered, synergistic behavior is forbidden by the set-theoretic axioms. However, random variables are not a perfect analogy of sets: we formalize the distinction, highlighting a single broken axiom—union/intersection distributivity. Nevertheless, it remains possible to describe information using Venn-type diagrams. The proposed multivariate theory resolves the persistent self-contradiction of partial information decomposition and reinstates it as a primary route toward a rigorous definition of emergence. Our results suggest that non-distributive variants of set theory may be used to describe emergent physical systems.

Discovery of Highly Bioactive Peptides through Hierarchical Structural Information and Molecular Dynamics Simulations.

Peptide drugs play an essential role in modern therapeutics, but the computational design of these molecules is hindered by several challenges. Traditional methods like molecular docking and molecular dynamics (MD) simulation, as well as recent deep learning approaches, often face limitations related to computational resource demands, complex binding affinity assessments, extensive data requirements, and poor model interpretability. Here, we introduce PepHiRe, an innovative methodology that utilizes the hierarchical structural information in peptide sequences and employs a novel strategy called Ladderpath, rooted in algorithmic information theory, to rapidly generate and enhance the efficiency and clarity of novel peptide design. We applied PepHiRe to develop BH3-like peptide inhibitors targeting myeloid cell leukemia-1, a protein associated with various cancers. By analyzing just eight known bioactive BH3 peptide sequences, PepHiRe effectively derived a hierarchy of subsequences used to create new BH3-like peptides. These peptides underwent screening through MD simulations, leading to the selection of five candidates for synthesis and subsequent in vitro testing. Experimental results demonstrated that these five peptides possess high inhibitory activity, with IC50 values ranging from 28.13 ± 7.93 to 167.42 ± 22.15 nM. Our study explores a white-box model driven technique and a structured screening pipeline for identifying and generating novel peptides with potential bioactivity.

Computing MEMs and Relatives on Repetitive Text Collections

We consider the problem of computing the Maximal Exact Matches (MEMs) of a given pattern \(P[1\mathinner{.. }m]\) on a large repetitive text collection \(T[1\mathinner{.. }n]\) over an alphabet of size \(\sigma\) , which is represented as a (hopefully much smaller) run-length context-free grammar of size \(g_{rl}\) . We show that the problem can be solved in time \(O(m^{2}\log^{\epsilon}n)\) , for any constant \(\epsilon\gt0\) , on a data structure of size \(O(g_{rl})\) . Further, on a locally consistent grammar of size \(O(\delta\log\frac{n\log\sigma}{\delta\log n})\) , the time decreases to \(O(m\log m(\log m+\log^{\epsilon}n))\) . The value \(\delta\) is a function of the substring complexity of \(T\) and \(\Omega(\delta\log\frac{n\log\sigma}{\delta\log n})\) is a tight lower bound on the compressibility of repetitive texts \(T\) , so our structure has optimal size in terms of \(n\) , \(\sigma\) , and \(\delta\) . We extend our results to several related problems, such as finding \(k\) -MEMs, MUMs, rare MEMs, and applications. Categories and Subject Descriptors: E.1 [Data structures] ; E.2 [Data storage representations] ; E.4 [Coding and information theory]: Data compaction and compression; F.2.2 [Analysis of algorithms and problem complexity] : Nonnumerical algorithms and problems— Pattern matching, Computations on discrete structures, Sorting and searching

Comparison of Judgment Document Information Between China and Russia Based on Corpus

The study of legal comparisons has become particularly important as the number of foreign-related legal disputes has increased dramatically with the growing number of cross-border trade. This study discovers the differences and similarities between Chinese and Russian judgment documents and provides a linguistic basis for the academic theoretical researches and the call for linguists to enter the courtrooms by establishing a corpus of Chinese and Russian judgement documents, quantifying and analysing the Chinese and Russian judgement documents based on the Legal Discourse Information Theory. It can be found that the macro-structure of civil ruling documents is clearer but does not provide more micro-information. By adding language elements, it can be seen that there are more information points and information components in Russian criminal judgment documents. The information points in Chinese civil judgment documents are more concentrated than in Russian civil judgment documents, while they are more similar in terms of the proportion and type of information components.

Discovery and characterization of a dense sub-Saturn TOI-6651b

We report the discovery and characterization of a transiting sub-Saturn exoplanet TOI-6651b using PARAS-2 spectroscopic observations. The host, TOI-6651 (mV ≈ 10.2), is a sub-giant, metal-rich G-type star with [Fe / H] = 0.225−0.0450.044[Fe/H] = 0.225−0.045+0.044, Teff = 5940 ± 110 K, and log g = 4.087−0.032+0.035. Joint fitting of the radial velocities from PARAS-2 spectrograph and transit photometric data from Transiting Exoplanet Survey Satellite (TESS) reveals a planetary mass of 61.0−7.9+7.6 M⊕ and radius of 5.09−0.26+0.27 R⊕, in a 5.056973−0.000018+0.000016 day orbit with an eccentricity of 0.091−0.062+0.096. TOI-6651b has a bulk density of 2.52−0.44+0.52 g cm−3, positioning it among the select few known dense sub-Saturns and making it notably the densest detected with TESS. TOI-6651b is consistent with the positive correlation between planet mass and the host star’s metallicity. We find that a considerable portion ≈87% of the planet’s mass consists of dense materials such as rock and iron in the core, while the remaining mass comprises a low-density envelope of H/He. TOI-6651b lies at the edge of the Neptunian desert, which will be crucial for understanding the factors shaping the desert boundaries. The existence of TOI-6651b challenges conventional planet formation theories and could be a result of merging events or significant atmospheric mass loss through tidal heating, highlighting the complex interplay of dynamical processes and atmospheric evolution in the formation of massive dense sub-Saturns.

An Edge-on Regular Disk Galaxy at z = 5.289

While rotation-supported gas disks are known to exist as early as at z ≈ 7, it is still a general belief that stellar disks form late in the Universe. This picture is now being challenged by the observations from the James Webb Space Telescope (JWST), which have revealed a large number of disk-like galaxies that could be at z > 3, with some being candidates at z > 7. As an early formation of stellar disks will greatly impact our theory of galaxy formation and evolution, it is important to determine when such systems first emerged. Here we present D-CEERS-RUBIES-z5289 at z = 5.289 ± 0.001, the second confirmed stellar disk at z > 5, discovered using the archival JWST NIRCam imaging and NIRSpec spectroscopic data. This galaxy has a highly regular edge-on disk morphology, extends to ∼6.2 kpc along its major axis, and has an effective radius of ∼1.3–1.4 kpc. Such a large stellar disk is yet to be produced in numerical simulations. By analyzing its 10-band spectral energy distribution using four different tools, we find that it has a high stellar mass of 109.5–10.0 M ⊙. Its age is in the range of 330–510 Myr, and it has a mild star formation rate of 10–30 M ⊙ yr−1. While the current spectroscopic data do not allow the derivation of its rotation curve, the width of its Hα line from the partial slit coverage on one side of the disk reaches ∼345 km s−1, which suggests that it could have a significant contribution from rotation.

A Fisher Information Theory of Aesthetic Preference for Complexity

When evaluating sensory stimuli, people tend to prefer those with not too little or not too much complexity. A recent theoretical proposal for this phenomenon is that preference has a direct link to the Observed Fisher Information that a stimulus carries about the environment. To make this theory complete, one must specify the model that the brain has about complexities in the world. Here, we develop this model by first obtaining the distributions of three indices of complexity measured as normalized Shannon Entropy in real-world images from seven environments. We then search for a parametric model that accounts for these distributions. Finally, we measure the Observed Fisher Information that each image has about the parameters of this model. The results show that with few exceptions, the distributions of image complexities are unimodal, have negative skewness, and are leptokurtotic. Moreover, the sign and magnitude of the skewness varies systematically with the location of the mode. After investigating tens of models for these distributions, we show that the Logit-Losev function, a generalization of the hyperbolic-secant distribution, fits them well. The Observed Fisher Information for this model shows the inverted-U-shape behavior of complexity preference. Finally, we discuss ways to test our Fisher-Information theory.

Critical Points in the Noiseberg Achievable Region of the Gaussian Z-Interference Channel

The Gaussian signaling strategy with power control for the Gaussian Z-interference channel with weak interference is reviewed in this paper. In particular, we study the various communication strategies that may arise at various points of the capacity region and identify the locations of the phase transitions between the various strategies. The Gaussian Z-interference channel with weak interference is known to have two critical points in its capacity region, where the slope of the region shows a sudden change. They occur at the points of the unconditional maximum rate for one of the users and the maximum rate that can be accommodated by the other user. In this paper, we discuss additional critical points (locations of phase transitions) in the achievable region of this channel. These turn out to be second-order phase transitions, i.e., we do not observe a discontinuous slope in the achievable rate region, but there is a discontinuity in the second derivative of the rate contour of the achievable region. This review paper is mainly based on some of our ITA (Information Theory and Applications Workshop, UCSD, San Diego, CA, USA) papers since 2011.

Money laundering and the automobile industry: a comparative study between the laws of Mauritius and UK

Purpose Motor vehicles play a vital role in the economic and social growth of any country. However, they have recently become instruments and a source of illegally obtained financial gains for criminal bodies and individuals. This study aims to assess the laws of Mauritius on AML procedures to prevent money laundering through vehicles transactions. Design/methodology/approach To achieve the research objective, the black letter research method was used by analysing laws, regulations and case laws on the subject matter. A desk-based and doctrinal approach was also used by examining policy papers, scholarly articles and newspaper materials on the researched topic. Additionally, the research adopted a comparative analysis by assessing how the laws of another country address the issue of money laundering through vehicle transaction and the selected country is the UK. Findings The research concluded that Mauritius AML laws are lagging behind of the UK laws and accordingly, some measures were suggested to deal with the issue of money laundering through vehicles transactions. Accordingly, this research recommended that motor vehicle dealers who are high value dealers engaged in cash transactions above certain threshold, must also be categorised as reporting persons under the FIAMLA such that the prescribed AML measures apply to them. Additionally, it is convenient for the FCC to be embodied with some additional punitive and corrective powers to assist the Commission in its fight for the prevention and elimination of financial crimes in Mauritius. Originality/value At present, this study will be among the first academic writings on the intersection between money laundering and the automobile industry and on the effectiveness of the legal and regulatory measures undertaken by the Mauritian authorities to prevent money laundering through vehicles transactions. The study is carried out with the aim of combining a large amount of empirical, theoretical and factual information that can be of use to various stakeholders and not only to academics.

Only consciousness truly exists? Two problems for IIT 4.0’s ontology

In this article we present two ontological problems for the Integrated Information Theory of Consciousness 4.0: what we call the (i) the intrinsicality 2.0 problem, and (ii) the engineering problem. These problems entail that truly existing, conscious entities can depend on, and be engineered from, entities that do not objectively exist, which is problematic: if something does not exist in objective reality (i.e., in itself, independently of another entity’s consciousness), then it seems that it cannot be part of the material basis and determinants of other entities that do exist on their own. We argue that the core origin of these problems lies in IIT’s equation between true existence and phenomenal existence (consciousness), and the corresponding ontological exclusion of non-conscious physical entities (i.e., extrinsic entities) from objective reality. In short, these two problems seem to show that IIT should reconsider the ontological status of these extrinsic entities, because they need to exist objectively to account for the ontological implications of the scenarios we present here, which are permitted by the operational framework of the theory.

The Representative Points of Generalized Alpha Skew-t Distribution and Applications

Assuming the underlying statistical distribution of data is critical in information theory, as it impacts the accuracy and efficiency of communication and the definition of entropy. The real-world data are widely assumed to follow the normal distribution. To better comprehend the skewness of the data, many models more flexible than the normal distribution have been proposed, such as the generalized alpha skew-t (GAST) distribution. This paper studies some properties of the GAST distribution, including the calculation of the moments, and the relationship between the number of peaks and the GAST parameters with some proofs. For complex probability distributions, representative points (RPs) are useful due to the convenience of manipulation, computation and analysis. The relative entropy of two probability distributions could have been a good criterion for the purpose of generating RPs of a specific distribution but is not popularly used due to computational complexity. Hence, this paper only provides three ways to obtain RPs of the GAST distribution, Monte Carlo (MC), quasi-Monte Carlo (QMC), and mean square error (MSE). The three types of RPs are utilized in estimating moments and densities of the GAST distribution with known and unknown parameters. The MSE representative points perform the best among all case studies. For unknown parameter cases, a revised maximum likelihood estimation (MLE) method of parameter estimation is compared with the plain MLE method. It indicates that the revised MLE method is suitable for the GAST distribution having a unimodal or unobvious bimodal pattern. This paper includes two real-data applications in which the GAST model appears adaptable to various types of data.

Negotiation Strategies and Their Effect on Organizational Success: Analytical Research in The Iraqi Ministry of Industry and Minerals

Purpose: This study aims to determine the impact of Negotiation Strategies (NS) on Organizational Success(OS) in the Iraqi Ministry of Industry and Minerals. Conceptual Framework: The NS includes dimensions (cooperative strategy, competitive strategy, avoidance strategy, bargaining strategy and absorption strategy) measured by (Thomas, 2008), and OS includes dimensions (resources, organizational structure, management, process and knowledge management) measured by (Hamedi & Azimi, 2013)​. Design/Methodology/approach: The descriptive analytical method was adopted in completing the current research, on a sample of senior and middle leaders in the Iraqi Ministry of Industry and Minerals under study, which numbered (120) individuals, and they were selected using the comprehensive survey stratified sample method. Findings: We found that NS plays a positive role in achieving organizational success in the Iraqi Ministry of Industry and Minerals. NS enhances cooperation and coordination between parties within the ministry, which has led to improved operations. Thus, the main and sub-hypotheses of the research were proven correct. Research, Practical & Social implications: Identify the latest developments and fundamental ideas related to the variables of the study (NS - organizational success) to find interrelationships between the variables. Originality/value: Providing those concerned and interested with practical and theoretical information that explains the nature of the research variables, their sources and causes, the extent of their reflection on the research sample, and the extent of the interest of the researched organization (the Iraqi Ministry of Industry and Minerals) in their dimensions.

Evidence for Greater Marking along Ethnic Boundaries.

The coordination of beliefs, norms, and behaviors is foundational to theories of group formation. However, because beliefs and norms are not directly observable, signaling mechanisms are required to build reliable signals of latent traits. Although the mathematical theory behind these signals is robust, there is very little testing of ethnic marker theory or of its key propositions that markers become more prevalent along ethnic boundaries and where more than two cultural groups are in contact. We present an ethnographic test of this theory with phonetic differences serving as potential group signals. The data derive from an ethnographic and linguistic investigation in two contrasting secondary school settings in Utah, one that is majority European American and one that is ethnically more diverse. Word list recordings were collected as part of interviews with teens from different backgrounds. We extracted acoustic data from the speech of European Americans (EAs) and Pacific Islanders (PIs), then analyzed differences in the pronunciation of the vowel in words such as "bit." We found evidence of greater phonetic marking at the more diverse school, along more prominent boundaries of ethnic interaction. These results align with predictions made by the theoretical models. This initial empirical test of model predictions provides justification for the development of more complex models that could account for more variables within the environment.

Quantum-Inspired Fusion for Open-Domain Question Answering

Open-domain question-answering systems need models capable of referencing multiple passages simultaneously to generate accurate answers. The Rational Fusion-in-Decoder (RFiD) model focuses on differentiating between causal relationships and spurious features by utilizing the encoders of the Fusion-in-Decoder model. However, RFiD reliance on partial token information limits its ability to determine whether the corresponding passage is a rationale for the question, potentially leading to inappropriate answers. To address this issue, we propose a Quantum-Inspired Fusion-in-Decoder (QFiD) model. Our approach introduces a Quantum Fusion Module (QFM) that maps single-dimensional into multi-dimensional hidden states, enabling the model to capture more comprehensive token information. Then, the classical mixture method from quantum information theory is used to fuse all information. Based on the fused information, the model can accurately predict the relationship between the question and passage. Experimental results on two prominent ODQA datasets, Natural Questions and TriviaQA, demonstrate that QFiD outperforms the strong baselines in automatic evaluations.

A novel autonomous exploration algorithm via LiDAR/IMU SLAM and hierarchical subsystem for mobile robot in unknown indoor environments

Abstract Autonomous exploration in unknown environments is an essential capability for mobile robots. The complexity of autonomous exploration, however, means that existing algorithms struggle to balance efficiency and comprehensiveness, causing low mapping accuracy and redundant path planning. To perform accurate and efficient exploration tasks, we have proposed a novel autonomous exploration algorithm via LiDAR/IMU (Inertial Measurement Unit) Simultaneous Localization and Mapping (SLAM) and hierarchical subsystem for mobile robot in unknown environments. Firstly, to enhance mapping accuracy for mobile robot exploration, LiDAR/IMU SLAM is improved with the assistance of backward propagation and iterated Kalman filter, and Bidirectional Rapidly–Exploring Random Trees* (BI–RRT*) is applied for efficient frontier point detection. Secondly, we optimize local path planning by leveraging information theory through perceptual quality evaluation, which is then integrated with global path planning utilizing an enhanced Travelling Salesman Problem solver and a sparse grid map to amplify exploration efficiency. Thirdly, an enhanced hierarchical autonomous exploration method for mobile robots is proposed, which incorporates local path planning for seamless navigation around highly promising exploration spots, coupled with global path planning to effectively interconnect various sub–regions. Finally, simulations and field tests have demonstrated that the proposed method explores an unknown indoor environment with a 30.8% reduction in exploration time and a 29.9% reduction in exploration path in comparison with Dynamic Stage Viewpoint Planner. The map constructed in this paper has more accurate details and exploration paths have been shortened to ensure effective exploration.