Chiral perovskite nanoparticles and films are promising for integration in emerging spintronic and optoelectronic technologies, yet few design rules exist to guide the development of chiral material properties. The chemical space of potential building blocks for these nanostructures is vast, and the mechanisms through which organic ligands can impart chirality to the inorganic perovskite lattice are not well understood. In this work, we investigate how the properties of chiral ammonium ligands, the most common organic ligand type used with perovskites, affect the circular dichroism of strongly quantum confined CsPbBr3 nanocrystals. We show that aromatic ammonium ligands with stronger electron-donating groups lead to higher-intensity circular dichroism associated with the lowest-energy excitonic transition of the perovskite nanocrystal. We argue that this behavior is best explained by a modulation of the exciton wavefunction overlap between the nanocrystal and the organic ligand, as the functional groups on the ligand can shift electron density toward the organic species-perovskite lattice interface to increase the imprinting.