ABSTRACT. Declining populations of grassland breeding birds have led to increased efforts to assess habitat quality, typically by estimating density or relative abundance. Because some grassland habitats may function as ecological traps, a more appropriate metric for determining quality is breeding success, which is challenging to determine for many cryptic-nesting grassland birds. This difficulty led Vickery et al. (1992) to propose a reproductive index based on behavioral observations rather than nest fate. We rigorously evaluated the index for 2 years using a Savannah Sparrow (Passerculus sandwichensis) population in western New York and found a weak correlation in classification of the breeding stages of monitored territories among multiple observers (r = 0.398). We also discovered a large difference between overall territory and nest success rates independently estimated with the index (9.8% over the entire breeding cycle) and with nest searching and monitoring (41.7% of nests successfully fledged yo...