Orbital maneuver detection for non-cooperative targets in space is a key task in space situational awareness. This study develops a passive maneuver detection algorithm using line-of-sight angles measured by a space-based optical sensor, especially for targets in high-altitude orbit. Emphasis is placed on constructing a new characterization for maneuvers as well as the corresponding detection method. First, the concept of relative angular momentum is introduced to characterize the orbital maneuver of the target quantitatively, and the sensitivity of the proposed characterization is analyzed mathematically. Second, a maneuver detection algorithm based on the new characterization is designed in which sliding windows and correlations are utilized to determine the mutation of the maneuver characterization. Subsequently, a numerical simulation system composed of error models, reference missions and trajectories, and computation models for estimating errors is established. Then, the proposed algorithm is verified through numerical simulations for both long-range and close-range targets. The results indicate that the proposed algorithm is effective. Additionally, the sensitivity of the proposed algorithm to the width of the sliding window, accuracy of the optical sensor, magnitude and number of maneuvers, and different relative orbit types is analyzed, and the sensitivity of the new characterization is verified using simulations.