The Cr-doped Ca3CoMn1-xCrxO6 (x=0, 0.05, 0.1, 0.15) polycrystalline samples were prepared using a modified sol-gel method. The structural, magnetic and dielectric properties were systemically investigated. With increasing Cr3+-doping level, the partial Co2+ ions change to Co3+, leading to a decreased lattice volume. Correspondingly, the length of the short-range magnetic correlation is inhibited and a faster dynamic behavior in time dependent magnetization is found. At the benefit of the magnetic structural changes with the introduction of Cr3+ ions, the relaxor degree of the ferroelectric transition that induced by the exchange striction becomes lower, while the activation energy of the frozen polar-nanoregions increases. The replacement of Mn4+ by Cr3+ also leads to a reduced intra-chain antiferromagnetic coupling and the emergence of Co3+-Co3+ ferromagnetic interaction. As consequence, the Curie-Weiss temperature (θ) increases monotonously. The variation in dielectric permittivity with magnetic field confirms the existence of large magnetodielectric coupling in the Ca3CoMn1-xCrxO6 (0 ≤ x ≤ 0.15) samples. Especially for the x = 0.15 sample, the permittivity changes by about 7% under the magnetic field of H=4 T.