In research on generating a predictive schedule, the scheduling problem is often viewed as a deterministic problem. However, the real-life job shop environment is stochastic in that information on job attributes and shop floor status is not precisely known in advance. In this situation, in order to increase the effectiveness of a predictive schedule in practice, the focus should be on creating a robust schedule. The purpose of this paper is to investigate the robustness of a number of scheduling rules in a dynamic and stochastic environment using the rolling time horizon approach. A cost-based performance measure is used to evaluate the scheduling rules. The simulation results, under various conditions in a balanced and unbalanced shop, are presented and the effects of the rescheduling interval and operational factors including shop load conditions and a bottleneck on the robustness of the schedule are studied. From the results the key factors that influence the robustness of a scheduling system are identified and, consequently, general guidelines for creating robust schedules are proposed.