Sherrington-Kirkpatrick Spin Glass Model Research Articles

Triadic interaction in the background of a pairwise spin-glass.

Developing an equilibrium solution for a pairwise spin-glass with a quenched random infinite range shows a continuous phase transition. Models with p-spin interactions have been studied and the exact solution was provided that shows a continuous phase transition for p=2 and a first-order one for p>2. Although the p-spin interactions were studied individually without considering lower-order interactions, is it always feasible to ignore the lower ones? Here, we are interested in finding an analytical solution for considering a triadic interaction as a perturbation in the background of a pairwise interaction in the Sherrington-Kirkpatrick spin-glass model. Our results indicate a sudden phase transition as a consequence of considering triadic interactions that signal a switch from a continuous to an explosive phase transition.

Unlearning regularization for Boltzmann machines

Boltzmann machines (BMs) are graphical models with interconnected binary units, employed for the unsupervised modeling of data distributions. When trained on real data, BMs show the tendency to behave like critical systems, displaying a high susceptibility of the model under a small rescaling of the inferred parameters. This behavior is not convenient for the purpose of generating data, because it slows down the sampling process, and induces the model to overfit the training-data. In this study, we introduce a regularization method for BMs to improve the robustness of the model under rescaling of the parameters. The new technique shares formal similarities with the unlearning algorithm, an iterative procedure used to improve memory associativity in Hopfield-like neural networks. We test our unlearning regularization on synthetic data generated by two simple models, the Curie–Weiss ferromagnetic model and the Sherrington–Kirkpatrick spin glass model. We show that it outperforms Lp -norm schemes and discuss the role of parameter initialization. Eventually, the method is applied to learn the activity of real neuronal cells, confirming its efficacy at shifting the inferred model away from criticality and coming out as a powerful candidate for actual scientific implementations.

Complete replica solution for the transverse field Sherrington-Kirkpatrick spin glass model with continuous-time quantum Monte Carlo method

Complete replica solution for the transverse field Sherrington-Kirkpatrick spin glass model with continuous-time quantum Monte Carlo method

Statistical mechanics of the maximum-average submatrix problem

We study the maximum-average submatrix problem, wherein given an N × N matrix J, one needs to find the k × k submatrix with the largest average number of entries. We investigate the problem for random matrices J, whose entries are i.i.d. random variables, by mapping it to a variant of the Sherrington–Kirkpatrick spin-glass model at fixed magnetisation. We analytically characterise the phase diagram of the model as a function of the submatrix average and the size of the submatrix k in the limit N→∞ . We consider submatrices of size k=mN with 0<m<1 . We find a rich phase diagram, including dynamical, static one-step replica symmetry breaking (1-RSB) and full-step RSB. In the limit of m → 0, we find a simpler phase diagram featuring a frozen 1-RSB phase, where the Gibbs measure comprises exponentially many pure states each with zero entropy. We discover an interesting phenomenon, reminiscent of the phenomenology of the binary perceptron: there are efficient algorithms that provably work in the frozen 1-RSB phase.

Bound on annealing performance from stochastic thermodynamics, with application to simulated annealing.

Annealing is the process of gradually lowering the temperature of a system to guide it towards its lowest energy states. In an accompanying paper [Y. Luo etal., Phys. Rev. E 108, L052105 (2023)10.1103/PhysRevE.108.L052105], we derived a general bound on annealing performance by connecting annealing with stochastic thermodynamics tools, including a speed limit on state transformation from entropy production. We here describe the derivation of the general bound in detail. In addition, we analyze the case of simulated annealing with Glauber dynamics in depth. We show how to bound the two case-specific quantities appearing in the bound, namely the activity, a measure of the number of microstate jumps, and the change in relative entropy between the state and the instantaneous thermal state, which is due to temperature variation. We exemplify the arguments by numerical simulations on the Sherrington-Kirkpatrick (SK) model of spin glasses.

Model templates: transdisciplinary application and entanglement

The omnipresence of the same basic equations, function forms, algorithms, and quantitative methods is one of the most spectacular characteristics of contemporary modeling practice. Recently, the emergence of the discussion of templates and template transfer has addressed this striking cross-disciplinary reach of certain mathematical forms and computational algorithms. In this paper, we develop a notion of a model template, consisting of its mathematical structure, ontology, prototypical properties and behaviors, focal conceptualizations, and the paradigmatic questions it addresses. We apply this notion to three widely disseminated and powerful model templates: the Sherrington-Kirkpatrick model of spin glasses, scale-free networks, and the Kuramoto model of synchronization. We argue that what appears to be an interdisciplinary model transfer between different domains turns out, from a broader perspective, to be the application of transdisciplinary model templates across a multitude of domains. We also point out a further feature of template-based modeling that so far has not been discussed: template entanglement. Such entanglement enhances and makes manifest the conceptual side of model templates.

Mimicking of thermal spin dynamics by controlling sparsity of interactions in Ising spin computing with digital logic circuits

We introduce extraction-type majority voting logic (E-MVL) that explores the ground state of an Ising spin model. The spin dynamics of E-MVL approximately follow that of thermal spins based on the Boltzmann distribution, even though E-MVL intentionally reduces the information of the problem graph by controlling the sparsity of problem graphs to realize high-speed calculation. We solved the Sherrington-Kirkpatrick spin-glass model using E-MVL and simulated annealing (SA). The probability of obtaining a solution with a 99% E-MVL accuracy is maintained at approximately 85% over the problem size, and E-MVL achieves a high accuracy compared to that of SA.

Spherical Spin Glass Model with External Field

We analyze the free energy and the overlaps in the 2-spin spherical Sherrington Kirkpatrick spin glass model with an external field for the purpose of understanding the transition between this model and the one without an external field. We compute the limiting values and fluctuations of the free energy as well as three types of overlaps in the setting where the strength of the external field goes to zero as the dimension of the spin variable grows. In particular, we consider overlaps with the external field, the ground state, and a replica. Our methods involve a contour integral representation of the partition function along with random matrix techniques. We also provide computations for the matching between different scaling regimes. Finally, we discuss the implications of our results for susceptibility and for the geometry of the Gibbs measure. Some of the findings of this paper are confirmed rigorously by Landon and Sosoe in their recent paper which came out independently and simultaneously.

The Free Energy of a Quantum Sherrington\u2013Kirkpatrick Spin-Glass Model for Weak Disorder

We extend two rigorous results of Aizenman, Lebowitz, and Ruelle in their pioneering paper of 1987 on the Sherrington–Kirkpatrick spin-glass model without external magnetic field to the quantum case with a “transverse field” of strength mathsf {b}. More precisely, if the Gaussian disorder is weak in the sense that its standard deviation mathsf {v}>0 is smaller than the temperature 1/beta , then the (random) free energy almost surely equals the annealed free energy in the macroscopic limit and there is no spin-glass phase for any mathsf {b}/mathsf {v}ge 0. The macroscopic annealed free energy turns out to be non-trivial and given, for any beta mathsf {v}>0, by the global minimum of a certain functional of square-integrable functions on the unit square according to a Varadhan large-deviation principle. For beta mathsf {v}<1 we determine this minimum up to the order (beta mathsf {v})^{4} with the Taylor coefficients explicitly given as functions of beta mathsf {b} and with a remainder not exceeding (beta mathsf {v})^{6}/16. As a by-product we prove that the so-called static approximation to the minimization problem yields the wrong beta mathsf {b}-dependence even to lowest order. Our main tool for dealing with the non-commutativity of the spin-operator components is a probabilistic representation of the Boltzmann–Gibbs operator by a Feynman–Kac (path-integral) formula based on an independent collection of Poisson processes in the positive half-line with common rate beta mathsf {b}. Its essence dates back to Kac in 1956, but the formula was published only in 1989 by Gaveau and Schulman.

Free energy of the quantum Sherrington–Kirkpatrick spin-glass model with transverse field

We consider the quantum Sherrington–Kirkpatrick (SK) spin-glass model with a transverse field and provide a formula for its free energy in the thermodynamic limit, valid for all inverse temperatures β &amp;gt; 0. To characterize the free energy, we use the path integral representation of the partition function and approximate the model by a sequence of finite-dimensional vector-spin glasses with Rd-valued spins. This enables us to use the results of Panchenko who generalized [Ann. Probab. 46(2), 829–864 (2018); ibid, 46(2), 865–896 (2018)] the Parisi formula to classical vector-spin glasses. As a consequence, we can express the thermodynamic limit of the free energy of the quantum SK model as the d → ∞ limit of the free energies of the d-dimensional approximations of the model.

Spin Glass Energy Minimization through Learning and Evolution

The research considers the minimization of spin glass energy via learning and evolution. The Sherrington-Kirkpatrick spin-glass model is used. A population of autonomous agents is considered. The genotype and phenotype of each agent are chains consisting of a great number of spins. The energy of spin glasses is minimized through learning and evolution of agents. The genotypes of agents are optimized by evolution; the phenotypes are optimized by learning. The evolution of a population of agents is analyzed. In the evolution the fitness of agents is determined by the energy of the spin glass of final phenotypes resulted from learning: the lower the energy is, the higher the fitness of the agent is. In the next generation agents are selected with probabilities corresponding to their fitnesses. Agents-descendants get mutationally modified genotypes of agents-ancestors. The interaction between learning and evolution during the spin glass energy minimization is investigated. The research involves the computer simulation.

Fundamental limits of detection in the spiked Wigner model

We study the fundamental limits of detecting the presence of an additive rank-one perturbation, or spike, to a Wigner matrix. When the spike comes from a prior that is i.i.d. across coordinates, we prove that the log-likelihood ratio of the spiked model against the nonspiked one is asymptotically normal below a certain reconstruction threshold which is not necessarily of a “spectral” nature, and that it is degenerate above. This establishes the maximal region of contiguity between the planted and null models. It is known that this threshold also marks a phase transition for estimating the spike: the latter task is possible above the threshold and impossible below. Therefore, both estimation and detection undergo the same transition in this random matrix model. Further information on the performance of the optimal test is also provided. Our proofs are based on Gaussian interpolation methods and a rigorous incarnation of the cavity method, as devised by Guerra and Talagrand in their study of the Sherrington–Kirkpatrick spin-glass model.

Realizable solutions of the Thouless-Anderson-Palmer equations.

We show that the only solutions of the Thouless-Anderson-Palmer (TAP) equations for the Sherrington-Kirkpatrick model of Ising spin glasses which can be found by iteration are those whose free energy lies on the border between replica-symmetric and broken-replica-symmetric states, when the number of spins N is large. Convergence to this same borderline also happens in quenches from a high-temperature initial state to a locally stable state where each spin is parallel to its local field; both are examples of self-organized criticality. At this borderline the band of eigenvalues of the Hessian associated with a solution extends to zero, so the states reached have marginal stability. We have also investigated the factors which determine the free-energy difference between a stationary solution corresponding to a saddle point and its associated minimum, which is the barrier which has to be surmounted to escape from the vicinity of a TAP minimum or pure state.

Replica symmetry breaking in bipartite spin glasses and neural networks

Some interesting recent advances in the theoretical understanding of neural networks have been informed by results from the physics of disordered many-body systems. Motivated by these findings, this work uses the replica technique to study the mathematically tractable bipartite Sherrington-Kirkpatrick (SK) spin-glass model, which is formally similar to a restricted Boltzmann machine (RBM) neural network. The bipartite SK model has been previously studied assuming replica symmetry; here this assumption is relaxed and a replica symmetry breaking analysis is performed. The bipartite SK model is found to have many features in common with Parisi's solution of the original, unipartite SK model, including the existence of a multitude of pure states which are related in a hierarchical, ultrametric fashion. As an application of this analysis, the optimal cost for a graph partitioning problem is shown to be simply related to the ground state energy of the bipartite SK model. As a second application, empirical investigations reveal that the Gibbs sampled outputs of an RBM trained on the MNIST data set are more ultrametrically distributed than the input data themselves.

Many-body localization-delocalization transition in the quantum Sherrington-Kirkpatrick model

We analyze many-body localization (MBL) to delocalization transition in Sherrington-Kirkpatrick (SK) model of Ising spin glass (SG) in the presence of a transverse field $\Gamma$. Based on energy resolved analysis, which is of relevance for a closed quantum system, we show that the quantum SK model has many-body mobility edges separating MBL phase which is non-ergodic and non-thermal from the delocalized phase which is ergodic and thermal. The range of the delocalized regime increases with increase in the strength of $\Gamma$ and eventually for $\Gamma$ larger than $\Gamma_{CP}$ the entire many-body spectrum is delocalized. We show that the Renyi entropy is almost independent of the system size in the MBL phase, hinting towards an area law in this infinite range model while the delocalized phase shows volume law scaling of Renyi entropy. We further obtain spin glass transition curve in energy density $\epsilon$-$\Gamma$ plane from the collapse of eigenstate spin susceptibility. We demonstrate that in most of the parameter regime SG transition occurs close to the MBL transition indicating that the SG phase is non-ergodic and non-thermal while the paramagnetic phase is delocalized and thermal.

Possible ergodic-nonergodic regions in the quantum Sherrington-Kirkpatrick spin glass model and quantum annealing.

We explore the behavior of the order parameter distribution of the quantum Sherrington-Kirkpatrick model in the spin glass phase using Monte Carlo technique for the effective Suzuki-Trotter Hamiltonian at finite temperatures and that at zero temperature obtained using the exact diagonalization method. Our numerical results indicate the existence of a low- but finite-temperature quantum-fluctuation-dominated ergodic region along with the classical fluctuation-dominated high-temperature nonergodic region in the spin glass phase of the model. In the ergodic region, the order parameter distribution gets narrower around the most probable value of the order parameter as the system size increases. In the other region, the Parisi order distribution function has nonvanishing value everywhere in the thermodynamic limit, indicating nonergodicity. We also show that the average annealing time for convergence (to a low-energy level of the model, within a small error range) becomes system size independent for annealing down through the (quantum-fluctuation-dominated) ergodic region. It becomes strongly system size dependent for annealing through the nonergodic region. Possible finite-size scaling-type behavior for the extent of the ergodic region is also addressed.

The effects of the one-step replica symmetry breaking on the Sherrington–Kirkpatrick spin glass model in the presence of random field with a joint Gaussian probability density function for the exchange interactions and random fields

The Sherrington–Kirkpatrick Ising spin glass model, in the presence of a random magnetic field, is investigated within the framework of the one-step replica symmetry breaking. The two random variables (exchange integral interaction Jij and random magnetic field hi) are drawn from a joint Gaussian probability density function characterized by a correlation coefficient ρ, assuming positive and negative values. The thermodynamic properties, the three different phase diagrams and system’s parameters are computed with respect to the natural parameters of the joint Gaussian probability density function at non-zero and zero temperatures. The low temperature negative entropy controversy, a result of the replica symmetry approach, has been partly remedied in the current study, leading to a less negative result. In addition, the present system possesses two successive spin glass phase transitions with characteristic temperatures.

Stability of the quantum Sherrington-Kirkpatrick spin glass model.

I study in detail the quantum Sherrington-Kirkpatrick (SK) model, i.e., the infinite-range Ising spin glass in a transverse field, by solving numerically the effective one-dimensional model that the quantum SK model can be mapped to in the thermodynamic limit. I find that the replica symmetric solution is unstable down to zero temperature, in contrast to some previous claims, and so there is not only a line of transitions in the (longitudinal) field-temperature plane (the de Almeida-Thouless, AT, line) where replica symmetry is broken, but also a quantum de Almeida-Thouless (QuAT) line in the transverse field-longitudinal field plane at T=0. If the QuAT line also occurs in models with short-range interactions its presence might affect the performance of quantum annealers when solving spin glass-type problems with a bias (i.e., magnetic field).

Effects of smooth random surface on fluid monolayer thermodynamics

We consider the lattice gas approach to statistical mechanics of fluid adsorbed on random surfaces with fluid-fluid and fluid-surface potentials. It was shown that effective Hamiltonian contains quenched random interactions and random site fields. Their statistical features combine the properties of random geometry and fluid-fluid pair interaction potential. The high-temperature expansion leads to infinite-ranged random field model and Sherrington–Kirkpatrick spin-glass model. Thermodynamic properties are evaluated using replica theory procedure widely used to analyze quenched disorder systems. On the other hand we consider the random field model in random graph with finite connectivity instead of previous “infinite-ranged” approximations. This model has been investigated using finite connectivity technique. The replica symmetry ansatz for the order function is expressed in terms of an effective-field distribution. Analysis of random geometry effects on thermodynamic properties in such approach was done for the first time.

Classical-to-quantum crossover in the critical behavior of the transverse-field Sherrington-Kirkpatrick spin glass model.

We study the critical behavior of the Sherrington-Kirkpatrick model in transverse field (at finite temperature) using Monte Carlo simulation and exact diagonalization (at zero temperature). We determine the phase diagram of the model by estimating the Binder cumulant. We also determine the correlation length exponent from the collapse of the scaled data. Our numerical studies here indicate that critical Binder cumulant (indicating the universality class of the transition behavior) and the correlation length exponent cross over from their "classical" to "quantum" values at a finite temperature (unlike the cases of pure systems, where such crossovers occur at zero temperature). We propose a qualitative argument supporting such an observation, employing a simple tunneling picture.