The paper presents a general method and procedure for fatigue reliability assessment integrating automated ultrasonic non-destructive inspections. The basic structure of an automated ultrasonic inspection system is presented. Fatigue reliability assessment methodology is developed using uncertainty quantification models for detection, sizing, and fatigue model parameters. The probability of detection model is based on a classical log-linear model coupling the actual flaw size with the ultrasonic inspection reported size. Using probabilistic modeling, the distribution of the actual flaw size is derived. Reliability assessment procedure using ultrasonic inspection data is suggested. A steam turbine rotor example with realistic ultrasonic inspection data is presented to demonstrate the overall method. Calculations and interpretations of assessment results based on risk recommendations for industrial applications are given.