Biomolecular condensates are viscoelastic materials defined by time-dependent, sequence-specific complex shear moduli. Here, we show that viscoelastic moduli can be computed directly using a generalization of the Rouse model that leverages information regarding intra- and inter-chain contacts, which we extract from equilibrium configurations of lattice-based Metropolis Monte Carlo (MMC) simulations of phase separation. The key ingredient of the generalized Rouse model is a graph Laplacian that we compute from equilibrium MMC simulations. We compute two flavors of graph Laplacians, one based on a single-chain graph that accounts only for intra-chain contacts, and the other referred to as a collective graph that accounts for inter-chain interactions. Calculations based on the single-chain graph systematically overestimate the storage and loss moduli, whereas calculations based on the collective graph reproduce the measured moduli with greater fidelity. However, in the long time, low-frequency domain, a mixture of the two graphs proves to be most accurate. In line with the theory of Rouse and contrary to recent assertions, we find that a continuous distribution of relaxation times exists in condensates. The single crossover frequency between dominantly elastic vs dominantly viscous behaviors does not imply a single relaxation time. Instead, it is influenced by the totality of the relaxation modes. Hence, our analysis affirms that viscoelastic fluid-like condensates are best described as generalized Maxwell fluids. Finally, we show that the complex shear moduli can be used to solve an inverse problem to obtain the relaxation time spectra that underlie the dynamics within condensates. This is of practical importance given advancements in passive and active microrheology measurements of condensate viscoelasticity.