Numerous studies have been conducted on pulse dielectric barrier discharge (DBD) because it can produce powerful discharges uniformly at atmospheric pressure with a fast rise time. Although much research has been conducted on pulse DBD below 10 kHz, relatively little has been conducted on pulse DBD at high pulse repetition rates (PRRs). Therefore, in this study, the ozone generation and discharge characteristics of bipolar pulse DBD in atmospheric-pressure air at a high PRR of 10 kHz or above were investigated. According to the results of this study, with the exception of electron temperature, most discharge characteristics need for practical applications—like transfer charge, electron density, and discharge uniformity—improved as the voltage and duty ratio increased at high PRR. On the contrary, increasing the PRR exhibited trade-off features like low electron temperature, low discharge uniformity, and a high number of discharges per unit time. Ozone generation demonstrated good results at high voltage, appropriate PRR, and low duty ratio, but applying suitable electrical conditions is crucial considering ozone generation speed and power consumption. The findings of this study will be very beneficial for high-PRR pulse DBD applications that require quick and effective processing. Additionally, they will be useful for researching the characteristics of pulse DBD at high PRR.