A dynamical systems approach to turbulence envisions the flow as a trajectory through a high-dimensional state space [Hopf, Commun. Appl. Maths 1, 303 (1948)]. The chaotic dynamics are shaped by the unstable simple invariant solutions populating the inertial manifold. The hope has been to turn this picture into a predictive framework where the statistics of the flow follow from a weighted sum of the statistics of each simple invariant solution. Two outstanding obstacles have prevented this goal from being achieved: 1) paucity of known solutions and 2) the lack of a rational theory for predicting the required weights. Here, we describe a method to substantially solve these problems, and thereby provide compelling evidence that the probability density functions (PDFs) of a fully developed turbulent flow can be reconstructed with a set of unstable periodic orbits. Our method for finding solutions uses automatic differentiation, with high-quality guesses constructed by minimizing a trajectory-dependent loss function. We use this approach to find hundreds of solutions in turbulent, two-dimensional Kolmogorov flow. Robust statistical predictions are then computed by learning weights after converting a turbulent trajectory into a Markov chain for which the states are individual solutions, and the nearest solution to a given snapshot is determined using a deep convolutional autoencoder. In this study, the PDFs of a spatiotemporally chaotic system have been successfully reproduced with a set of simple invariant states, and we provide a fascinating connection between self-sustaining dynamical processes and the more well-known statistical properties of turbulence.