High-entropy ceramics have garnered significant attention in recent years owing to their exceptional properties and structural diversity. In this work, single-phase medium/high entropy ceramics, namely (Ca0.2Sr0.4Ba0.4)(Zr0.5Ti0.5)O3 and (Ca0.2Sr0.4Ba0.4)(Zr0.1Ti0.9)O3, were successfully designed and prepared utilizing Spark Plasma Sintering (SPS). A comprehensive investigation was conducted into the phase structure, microscopic morphology, dielectric properties, and thermal behavior of these ceramics. It was observed that all ceramics maintained a cubic perovskite structure (space group: Pm3‾m), and the introduction of multi-element doping rendered them more stable across a wide frequency and temperature range. Notably, (Ca0.2Sr0.4Ba0.4)(Zr0.5Ti0.5)O3 exhibited remarkably low dielectric loss (0.0001 at 1 kHz) at room temperature, along with excellent dielectric temperature stability (25–400 °C). By reducing the zirconium concentration in (Ca0.2Sr0.4Ba0.4)(Zr0.1Ti0.9)O3, a slight decrease in dielectric temperature stability was observed (25–350 °C); however, it demonstrated lower thermal conductivity (0.41 W/(m·K), 1200 °C) and maintained good high-temperature stability. The discovery highlights the promising practicality of both ceramics for high-temperature dielectric applications.