Creep rupture can happen in two ways, brittle and ductile creep rupture. Brittle creep rupture of austenitic stainless steels proceeds with the nucleation, growth and coalescence of grain boundary cavities. A creep cavity nucleation model has been developed previously, which considers cavity nucleation at particles and sub-boundary corners due to grain boundary sliding. A modified constrained cavity growth model has been used to describe the cavity growth behavior with combination of the cavity nucleation models. In this paper, the brittle creep rupture has been analyzed by combining the cavity nucleation and growth models. The physically based models where no adjustable parameters were involved were used to predict the brittle creep rupture strength. On the other hand, previously developed basic models for ductile creep rupture based on exhaustion of the creep ductility have been used. The creep rupture strength of common austenitic stainless steels has been predicted quantitatively by taking both ductile and brittle rupture into account. The predicted rupture times for ductile rupture are longer than those for brittle rupture at high stresses and low temperatures with a reversed situation at low stresses and high temperatures. This reproduces the characteristic change in slope in the creep rupture curves.