To evaluate a predictive model's ability to determine cattle mortality following first and second treatment for bovine respiratory disease and to understand the differences in net returns comparing predictive models to the status quo. 2 boosted decision tree models were constructed, 1 using data known at first treatment and 1 with data known at second treatment. Then, the economic impact of each outcome (true positive, true negative, false positive, and false negative) was estimated using various market values to determine the net return per head of using the predictive model to determine which animals should be culled at treatment. This was compared to the status quo to determine the difference in net return. The models constructed for the prediction of mortality performed with moderate accuracy (areas under the curve > 0.7). The economic analysis found that the models at a high specificity (> 90%) could generate a positive net return in comparison to status quo. This study showed that predictive models may be a useful tool to make culling decisions and could result in positive net returns. Bovine respiratory disease is the costliest health condition experienced by cattle on feed. Feedyard record-keeping systems generate vast amounts of data that could be used in predictive models to make management decisions. It is essential to understand the accuracy of predictions made via machine learning. However, the economic impact of implementing predictive models in a feedyard will influence adoption.