High performance implementations of the 2D Ising model on GPUs

Abstract

We present and make available novel implementations of the two-dimensional Ising model that is used as a benchmark to show the computational capabilities of modern Graphic Processing Units (GPUs). The rich programming environment now available on GPUs and flexible hardware capabilities allowed us to quickly experiment with several implementation ideas: a simple stencil-based algorithm, recasting the stencil operations into matrix multiplies to take advantage of Tensor Cores available on NVIDIA GPUs, and a highly optimized multi-spin coding approach. Using the managed memory API available in CUDA allows for simple and efficient distribution of these implementations across a multi-GPU NVIDIA DGX-2 server. We show that even a basic GPU implementation can outperform current results published on TPUs (Yang et al., 2019) and that the optimized multi-GPU implementation can simulate very large lattices faster than custom FPGA solutions (Ortega-Zamorano et al., 2016). Program summaryProgram title: cuIsing (optimized).CPC Library link to program files:http://dx.doi.org/10.17632/xrb9xtkbcp.1Licensing provisions: MIT license.Programming languages: CUDA C, Python.Nature of problem: Two dimensional Ising model for spin systems.Solution method: Checkerboard Metropolis algorithm.