High-dimensional Systems Research Articles

Identifying mechanisms and therapeutic targets in muscle using Bayesian parameter estimation with conditional variational autoencoders.

Machine learning techniques have potential to accelerate discoveries in biologically complex systems. However, they require large data sets and can be challenging in high dimensional systems such as cardiac muscle. In this study, we combined experimental measures of cardiac muscle twitch forces with mechanistic simulations and a newly developed mixture of Bayesian inference with neural networks (in autoencoders) to solve the inverse problem of determining the underlying kinetics for observed force generation by cardiac muscle. The autoencoders are trained on millions of simulations spanning parameter spaces that correspond to the mechanochemistry of cardiac sarcomeres. We apply the trained model to experimental data in order to infer parameters that can explain a diseased twitch and ways to recover it.

Variable resolution machine learning optimization of antennas using global sensitivity analysis.

The significance of rigorous optimization techniques in antenna engineering has grown significantly in recent years. For many design tasks, parameter tuning must be conducted globally, presenting a challenge due to associated computational costs. The popular bio-inspired routines often necessitate thousands of merit function calls to converge, generating prohibitive expenses whenever the design process relies on electromagnetic (EM) simulation models. Surrogate-assisted methods offer acceleration, yet constructing reliable metamodels is hindered in higher-dimensional spaces and systems with highly nonlinear characteristics. This work suggests an innovative technique for global antenna optimization embedded within a machine-learning framework. It involves iteratively refined kriging surrogates and particle swarm optimization for generating infill points. The search process operates within a reduced-dimensionality region established through fast global sensitivity analysis. Domain confinement enables the creation of accurate behavioral models using limited training data, resulting in low CPU costs for optimization. Additional savings are realized by employing variable-resolution EM simulations, where low-fidelity models are utilized during the global search stage (including sensitivity analysis), and high-fidelity ones are reserved for final (gradient-based) tuning of antenna parameters. Comprehensive verification demonstrates the consistent performance of the proposed procedure, its superiority over benchmark techniques, and the relevance of the mechanisms embedded into the algorithm for enhancing search process reliability, design quality, and computational efficiency.

Exploring Nonlocal Correlations in Arbitrarily High-Dimensional Systems

Abstract The utilization of higher-dimensional systems holds promise for unveiling novel phenomena and enhancing the efficacy of practical tasks, such as entanglement-based quantum cryptography. However, detecting quantum correlations within qudit systems poses a formidable challenge. In this study, we delve into the intricacies of Bell’s nonlocality within higher-dimensional systems. We introduce a novel correlation function and leverage it to construct a family of Bell inequalities adapted for quantum systems of arbitrary dimensionality. By gauging the probability of local realism violation under random measurements as our primary metric, we explore the relation between pure state entanglement and nonlocality. Our findings align closely with predictions derived from the comprehensive polytope analysis via linear programming methods. While our focus predominantly centers on the two-qudit scenario, our methodology readily extends to the N -partite case, accommodating an arbitrary number of measurements per party.

Witnessing Quantum Incompatibility Structures in High-Dimensional Multimeasurement Systems

Witnessing Quantum Incompatibility Structures in High-Dimensional Multimeasurement Systems

On convergence of linear response formulae in some piecewise hyperbolic maps

Abstract When high-dimensional non-uniformly hyperbolic chaotic systems undergo dynamical perturbations, their long-time statistics are generally observed to respond differentiably with respect to the perturbation. Although important in applications, this differentiability, which is thought to be connected to the dimensionality of the system, has remained resistant to rigorous study outside of the one-dimensional setting. To model non-uniformly hyperbolic systems in multiple dimensions, we consider a family of the mathematically tractable class of piecewise smooth hyperbolic maps, the Lozi maps. For these maps, we prove that the existence of a formal derivative of the response reduces to conditional mixing of the SRB measure on the singularity set. Heuristically, this suggests that Lozi maps, and piecewise uniformly expanding maps more generally, should have linear response.

Prediction of chaotic dynamics and extreme events: A recurrence-free quantum reservoir computing approach

In chaotic dynamical systems, extreme events manifest in time series as unpredictable large-amplitude peaks. Although deterministic, extreme events appear seemingly randomly, which makes their forecasting difficult. By learning the dynamics from observables (data), reservoir computers can time accurately predict extreme events and chaotic dynamics, but they may require many degrees of freedom (large reservoirs). In this paper, by exploiting quantum-computer ansätze and entanglement, we design reservoir computers with compact reservoirs and accurate prediction capabilities. First, we propose the recurrence-free quantum reservoir computer (RF-QRC) architecture. By developing quantum feature maps and removing recurrent connections, the RF-QRC has quantum circuits with smaller depths. This allows the RF-QRC to scale well with higher-dimensional chaotic systems, which makes it suitable for hardware implementation. Second, we forecast the temporal chaotic dynamics and their long-term statistics of low- and higher-dimensional dynamical systems. We find that RF-QRC requires smaller reservoirs than classical reservoir computers for higher-dimensional systems and the same predictability. Third, we apply the RF-QRC to the time prediction of extreme events in a model of a turbulent shear flow with turbulent bursts. We find that the RF-QRC has longer predictability than the classical reservoir computer for extreme events forecasting. The results and analyses indicate that quantum-computer ansätze offers nonlinear expressivity and computational scalability, which are useful for forecasting chaotic dynamics and extreme events. This work opens new opportunities for using quantum machine learning on near-term quantum computers. Published by the American Physical Society 2024

Discussion of S. Ponsioen, S, Jain and G. Haller: “Model reduction to spectral submanifolds and forced-response calculation in high-dimensional mechanical systems”, Journal of Sound and Vibration 488, 2020, pages 1–23

The authors of the discussed article considered two examples (1) a finite element model of a linear beam with a cubic spring attachment having 10 to 10,000 degrees of freedom, and (2) a finite element model of a geometrically nonlinear Timoshenko beam having 21 degrees of freedom. The authors concluded that Harmonic Balance (HB) becomes intractable for those examples. In this discussion, we falsify this conclusion. We demonstrate that very well-tractable computation effort is obtained when properly using the HB tool NLvib that was also employed in the discussed article. In particular, for (1), the well-known exact condensation to the nonlinear part of the equation system is carried out. For (2), suitable parameters are set for the path continuation and the Newton-type solver. With this, the computation takes from split seconds to about two minutes instead of the many hours reported in the discussed article.

State-of-the-art nonstationary hypersurface damage assessment approach for energy harvesters

Since EH (Energy Harvesters) constitute nowadays a vital part of renewable energy engineering, experimental research is required in addition to numerical modeling, serving reliable structural design and ensuring prolonged device service time. The performance of GPEH (GalloPing EH) has been examined in this case study, utilizing comprehensive laboratory wind tunnel tests, carried out under realistic windspeed conditions. Novel structural multivariate risks assessment methodology, presented here, being feasible for nonstationary nonlinear GPEH dynamic systems, that had been either physically measured over a representative period, providing jointly quasi-ergodic time-series, or directly numerically MCS (Monte Carlo Simulated). Based on laboratory-measured GPEH dynamics, the presented analysis demonstrates that the proposed multivariate hypersurface methodology offers robust predictions of the structural failure/damage risks. Furthermore, when dealing with raw measured timeseries, representing the high-dimensional dynamic system, existing risk assessment techniques struggle to handle nonlinear inter-correlations between GPEH critical components. This case study's main objective has been to validate and benchmark the novel multimodal risk assessment methodology, which utilizes multivariate nonstationary lab-recorded time histories to extract relevant design information from the underlying GPEH dynamics.The proposed state-of-the-art nonstationary hypersurface reliability approach being of a generic nature, offering additional capacity for damage/failure risks prognostics for a wide range of nonlinear multidimensional nonstationary systems. Forecasted damage and failure risks have been supplied with confidence bands, demonstrating the experimental setup's robustness, as well as the useful design features of the presented nonstationary hypersurface risks assessment methodology. It should be noted that the presented reliability methodology being mathematically exact, and it does not rely on simplifying assumptions.

Data-driven prediction of vortex solitons and multipole solitons in whispering gallery mode microresonator

Deep learning incorporating physics knowledge has become a powerful tool for studying the dynamic behavior of high-dimensional nonlinear systems. In this paper, the two-stage mini-batch resampling of adaptive physics-informed neural network (TMA-PINN) method is proposed to solve the (2 + 1)-dimensional variable-coefficient Lugiato-Lefever equation (vLLE). The vortex soliton in the WGM microresonator with different external excitation is investigated by TMA-PINN. It is found that external excitation can cause the rotation of vortex solitons. In addition, the effect of topological charge and external excitation on the dynamical characteristics of spatial solitons including vortex solitons and multipole solitons are investigated. The results show that the final shape of the rotation of vortex solitons and the number of azimuth lobes of multipole solitons are controlled by topological charges. Compared with classical PINN, TMA-PINN can better handle the gradient balance of various loss terms in (2 + 1)-dimensional vLLE to reconstruct the dynamic behavior of WGM microresonator solitons, having potential applications in other nonlinear systems.

Entanglement polygon inequalities for a class of mixed states

Abstract The study on the entanglement polygon inequality of multipartite systems has attracted much attention. However, most of the results are on pure states. Here we consider the property for a class of mixed states, which are the reduced density matrices of generalized W-class states in multipartite higher dimensional systems. First we show the class of mixed states satisfies the entanglement polygon inequalities in terms of Tsallis-q entanglement, then we propose a class of tighter inequalities for mixed states in terms of Tsallis-q entanglement. At last, we get an inequality for the mixed states, which can be regarded as a relation for bipartite entanglement.

Deep Learning for Solving Partial Differential Equations: A Review of Literature

Partial Differential Equations (PDEs) are fundamental in modeling various phenomena in physics, engineering, and finance. Traditional numerical methods for solving PDEs, such as finite element and finite difference methods, often face limitations when applied to high-dimensional and complex systems. In recent years, deep learning has emerged as a promising alternative for approximating solutions to PDEs, offering potential improvements in both efficiency and scalability. This paper provides a comprehensive review of the literature on deep learning-based methods for solving PDEs, focusing on key approaches such as Physics-Informed Neural Networks (PINNs), deep Galerkin methods, and neural operators. These methods leverage the expressiveness of neural networks to capture underlying physics while avoiding the curse of dimensionality associated with classical techniques. We explore the theoretical foundations, advantages, and limitations of these deep learning models, along with their applications in diverse fields like fluid dynamics, quantum mechanics, and financial modeling. Additionally, this review examines recent advancements in hybrid models that combine traditional numerical methods with deep learning approaches to enhance accuracy and stability. Through this review, we highlight key trends and open challenges in the field, paving the way for future research at the intersection of deep learning and computational mathematics.

Sufficient variable selection of high dimensional nonparametric nonlinear systems based on Fourier spectrum of density-weighted derivative

Sufficient variable selection of high dimensional nonparametric nonlinear systems based on Fourier spectrum of density-weighted derivative

Two-dimensional non-Abelian Thouless pump

Non-Abelian Thouless pumps are periodically driven systems designed by the non-Abelian holonomy principle, in which quantized transport of degenerate eigenstates emerges, exhibiting noncommutative features such that the outcome depends on the pumping sequence. The study of non-Abelian Thouless pump is currently restricted to 1D systems, while extending it to higher-dimensional systems will not only provide effective means to probe non-Abelian physics in high-dimensional topological systems, but also expand the dimension and type of associated non-Abelian geometric phase matrix for potential applications. Here, we propose the design and experimental realization of 2D non-Abelian Thouless pumps on a photonic chip with 2D photonic waveguide arrays, where degenerate photonic modes are topologically pumped simultaneously along two real-space directions. We reveal the associated non-Abelian group and experimentally demonstrate the non-Abelian feature by measuring the pumping sequence dependent output. The proposed 2D non-Abelian Thouless pump shows promising applications for robust optical interconnections and optical computing.

Disassembling one-dimensional chains in molybdenum oxides

Abstract The dimensionality of quantum materials strongly affects their physical properties. Although many emergent phenomena, such as charge-density wave and Luttinger liquid behavior, are well understood in one-dimensional (1D) systems, the generalization to explore them in higher dimensional systems is still a challenging task. In this study, we aim to bridge this gap by systematically investigating the crystal and electronic structures of molybdenum-oxide family compounds, where the contexture of 1D chains facilitates rich emergent properties. While the quasi-1D chains in these materials share general similarities, such as the motifs made up of MoO6 octahedrons, they exhibit vast complexity and remarkable tunability. We disassemble the 1D chains in molybdenum oxides with different dimensions and construct effective models to excellently fit their low-energy electronic structures obtained by ab initio calculations. Furthermore, we discuss the implications of such chains on other physical properties of the materials and the practical significance of the effective models. Our work establishes the molybdenum oxides as simple and tunable model systems for studying and manipulating the dimensionality in quantum systems.

A Local Macroscopic Conservative (LoMaC) Low Rank Tensor Method for the Vlasov Dynamics

In this paper, we propose a novel Local Macroscopic Conservative (LoMaC) low rank tensor method for simulating the Vlasov-Poisson (VP) system. The LoMaC property refers to the exact local conservation of macroscopic mass, momentum and energy at the discrete level. This is a follow-up work of our previous development of a conservative low rank tensor approach for Vlasov dynamics (arXiv:2201.10397). In that work, we applied a low rank tensor method with a conservative singular value decomposition to the high dimensional VP system to mitigate the curse of dimensionality, while maintaining the local conservation of mass and momentum. However, energy conservation is not guaranteed, which is a critical property to avoid unphysical plasma self-heating or cooling. The new ingredient in the LoMaC low rank tensor algorithm is that we simultaneously evolve the macroscopic conservation laws of mass, momentum and energy using a flux-difference form with kinetic flux vector splitting; then the LoMaC property is realized by projecting the low rank kinetic solution onto a subspace that shares the same macroscopic observables by a conservative orthogonal projection. The algorithm is extended to the high dimensional problems by hierarchical Tuck decomposition of solution tensors and a corresponding conservative projection algorithm. Extensive numerical tests on the VP system are showcased for the algorithm’s efficacy.

Global Exponential Synchronization of Delayed Quaternion-Valued Neural Networks via Decomposition and Non-Decomposition Methods and Its Application to Image Encryption

With the rapid advancement of information technology, digital images such as medical images, grayscale images, and color images are widely used, stored, and transmitted. Therefore, protecting this type of information is a critical challenge. Meanwhile, quaternions enable image encryption algorithm (IEA) to be more secure by providing a higher-dimensional mathematical system. Therefore, considering the importance of IEA and quaternions, this paper explores the global exponential synchronization (GES) problem for a class of quaternion-valued neural networks (QVNNs) with discrete time-varying delays. By using Hamilton’s multiplication rules, we first decompose the original QVNNs into equivalent four real-valued neural networks (RVNNs), which avoids non-commutativity difficulties of quaternions. This decomposition method allows the original QVNNs to be studied using their equivalent RVNNs. Then, by utilizing Lyapunov functions and the matrix measure method (MMM), some new sufficient conditions for GES of QVNNs under designed control are derived. In addition, the original QVNNs are examined using the non-decomposition method, and corresponding GES criteria are derived. Furthermore, this paper presents novel results and new insights into GES of QVNNs. Finally, two numerical verifications with simulation results are given to verify the feasibility of the obtained criteria. Based on the considered master–slave QVNNs, a new IEA for color images Mandrill (256 × 256), Lion (512 × 512), Peppers (1024 × 1024) is proposed. In addition, the effectiveness of the proposed IEA is verified by various experimental analysis. The experiment results show that the algorithm has good correlation coefficients (CCs), information entropy (IE) with an average of 7.9988, number of pixels change rate (NPCR) with average of 99.6080%, and unified averaged changed intensity (UACI) with average of 33.4589%; this indicates the efficacy of the proposed IEAs.

Dynamics of high-dimensional quantum systems coupled to a harmonic bath. General theory and implementation via multiconfigurational wave packets and truncated hierarchical equations for the mean-fields.

Modeling the dynamics of a quantum system coupled to a dissipative environment becomes particularly challenging when the system's dimensionality is too high to permit the computation of its eigenstates. This problem is addressed by introducing an eigenstate-free formalism, where the open quantum system is represented as a mixture of high-dimensional, time-dependent wave packets governed by coupled Schrödinger equations, while the environment is described by a multi-component quantum master equation. An efficient computational implementation of this formalism is presented, employing a variational mixed Gaussian/multiconfigurational time-dependent Hartree (G-MCTDH) ansatz for the wave packets and propagating the environment dynamics via hierarchical equations, truncated at the first or second level of the hierarchy. The effectiveness of the proposed methodology is demonstrated on a 61-dimensional model of phonon-driven vibrational relaxation of an adsorbate. G-MCTDH calculations on 4- and 10-dimensional reduced models, combined with truncated hierarchical equations for the mean fields, nearly quantitatively replicate the full-dimensional quantum dynamical results on vibrational relaxation while significantly reducing the computational time. This approach thus offers a promising quantum dynamical method for modeling complex system-bath interactions, where a large number of degrees of freedom must be explicitly considered.

Estimating reaction barriers with deep reinforcement learning1

Stable states in complex systems correspond to local minima on the associated potential energy surface. Transitions between these local minima govern the dynamics of such systems. Precisely determining the transition pathways in complex and high-dimensional systems is challenging because these transitions are rare events, and isolating the relevant species in experiments is difficult. Most of the time, the system remains near a local minimum, with rare, large fluctuations leading to transitions between minima. The probability of such transitions decreases exponentially with the height of the energy barrier, making the system’s dynamics highly sensitive to the calculated energy barriers. This work aims to formulate the problem of finding the minimum energy barrier between two stable states in the system’s state space as a cost-minimization problem. It is proposed to solve this problem using reinforcement learning algorithms. The exploratory nature of reinforcement learning agents enables efficient sampling and determination of the minimum energy barrier for transitions.

Representing turbulent statistics with partitions of state space. Part 2. The compressible Euler equations

This is the second part of a two-part paper. We apply the methodology of the first paper (Souza, J. Fluid Mech., vol. 997, 2024, A1) to construct a data-driven finite-volume discretization of the Liouville/Fokker–Planck equation of a high-dimensional dynamical system, i.e. the compressible Euler equations with gravity and rotation evolved on a thin spherical shell. We show that the method recovers a subset of the statistical properties of the underlying system, steady-state distributions of observables and autocorrelations of particular observables, as well as revealing the global Koopman modes of the system. We employ two different strategies for the partitioning of a high-dimensional state space, and explore their consequences.

Use of Deep-Learning-Accelerated Gradient Approximation for Reservoir Geological Parameter Estimation

The estimation of space-varying geological parameters is often not computationally affordable for high-dimensional subsurface reservoir modeling systems. The adjoint method is generally regarded as an efficient approach for obtaining analytical gradient and, thus, proceeding with the gradient-based iteration algorithm; however, the infeasible memory requirement and computational demands strictly prohibit its generic implementation, especially for high-dimensional problems. The autoregressive neural network (aNN) model, as a nonlinear surrogate approximation, has gradually received increasing popularity due to significant reduction of computational cost, but one prominent limitation is that the generic application of aNN to large-scale reservoir models inevitably poses challenges in the training procedure, which remains unresolved. To address this issue, model-order reduction could be a promising strategy, which enables us to train the neural network in a very efficient manner. A very popular projection-based linear reduction method, i.e., propel orthogonal decomposition (POD), is adopted to achieve dimensionality reduction. This paper presents an architecture of a projection-based autoregressive neural network that efficiently derives an easy-to-use adjoint model by the use of an auto-differentiation module inside the popular deep learning frameworks. This hybrid neural network proxy, referred to as POD-aNN, is capable of speeding up derivation of reduced-order adjoint models. The performance of POD-aNN is validated through a synthetic 2D subsurface transport model. The use of POD-aNN significantly reduces the computation cost while the accuracy remains. In addition, our proposed POD-aNN can easily obtain multiple posterior realizations for uncertainty evaluation. The developed POD-aNN emulator is a data-driven approach for reduced-order modeling of nonlinear dynamic systems and, thus, should be a very efficient modeling tool to address many engineering applications related to intensive simulation-based optimization.