Data-driven techniques could be used to enhance decision-making capacity of breeders and farmers. We used an RGB camera on an unmanned aerial vehicle (UAV) to collect time series data on sugar beet canopy coverage (CC) and canopy height (CH) from small-plot breeding fields including 20 genotypes per season over 3 seasons. Digital orthomosaic and digital surface models were created from each flight and were converted to individual plot-level data. Plot-level data including CC and CH were calculated on a per-plot basis. A multiple regression model was fitted, which predicts root weight (RW) (r = 0.89, 0.89, and 0.92 in the 3 seasons, respectively) and sugar content (SC) (r = 0.79, 0.83, and 0.77 in the 3 seasons, respectively) using individual time point CC and CH data. Individual CC and CH values in late June tended to be strong predictors of RW and SC, suggesting that early season growth is critical for obtaining high RW and SC. Coefficient of parentage was not a strong factor influencing SC. Integrals of CC and CH time series data were calculated for genetic analysis purposes since they are more stable over multiple growing seasons. Calculations of general combining ability and specific combining ability in F1 offspring demonstrate how growth curve quantification can be used in diallel cross analysis and yield prediction. Our simple yet robust solution demonstrates how state-of-the-art remote sensing tools and basic analysis methods can be applied to small-plot breeder fields for selection purpose.