Peptide-based supramolecular hydrogels are an attractive class of soft materials for biomedical applications when biocompatibility is a key requirement as they exploit the physical self-assembly of short self-assembling peptides avoiding the need for chemical cross-linking. Based on the knowledge developed through our previous work, we designed two novel peptides, E(FKFE)2 and K(FEFK)2, that form transparent hydrogels at pH 7. We characterized the phase behavior of these peptides and showed the clear link that exists between the charge carried by the peptides and the physical state of the samples. We subsequently demonstrate the cytocompatibility of the hydrogel and its suitability for 3D cell culture using 3T3 fibroblasts and human mesenchymal stem cells. We then loaded the hydrogels with two polymers, poly-l-lysine and dextran. When polymer and peptide fibers carry opposite charges, the size of the elemental fibril formed decreases, while the overall level of fiber aggregation and fiber bundle formation increases. This overall network topology change, and increase in cross-link stability and density, leads to an overall increase in the hydrogel mechanical properties and stability, i.e., resistance to swelling when placed in excess media. Finally, we investigate the diffusion of the polymers out of the hydrogels and show how electrostatic interactions can be used to control the release of large molecules. The work clearly shows how polymers can be used to tailor the properties of peptide hydrogels through guided intermolecular interactions and demonstrates the potential of these new soft hydrogels for use in the biomedical field in particular for delivery or large molecular payloads and cells as well as scaffolds for 3D cell culture.