Density functional theory (DFT) calculations are routinely used to screen for functional materials for a variety of applications. This screening is often carried out with a few descriptors, which use ground-state properties that typically ignore finite temperature effects. Finite-temperature effects can be included by calculating the vibration properties, and this can greatly improve the fidelity of computational screening. An important challenge for DFT-based screening is the sensitivity of the predictions to the choice of the exchange correlation function. In this work, we rigorously explore the sensitivity of finite temperature thermodynamic properties to the choice of the exchange correlation functional using the built-in error estimation capabilities within the Bayesian Error Estimation Functional-van der Waals (BEEF-vdW). The vibrational properties are estimated using the Debye model, and we quantify the uncertainty associated with finite-temperature properties for a diverse collection of materials. We find good agreement with experiment and small spread in predictions over different exchange correlation functionals for Mg, Al2O3, Al, Ca, and GaAs. In the case of Li, Li2O, and NiO, however, we find a large spread in predictions as well as disagreement between experiment and functionals due to complex bonding environments. While the energetics generated by the BEEF-vdW ensemble is typically normal, the complex mapping through the Debye model leads to the derived finite temperature properties having non-Gaussian behavior. We test a wide variety of probability distributions that best represent the finite temperature distribution and find that properties such as specific heat, Gibbs free energy, entropy, and thermal expansion coefficient are well described by normal or transformed normal distributions, while the prediction spread of volume at a given temperature does not appear to be drawn from a single distribution. Given the computational efficiency of the approach, we believe that uncertainty quantification should be routinely incorporated into finite-temperature predictions. In order to facilitate this, we have open-sourced the code base under the name dePye.