Systematic risk has been a focus for stress testing and risk capital assessment. Under the Vasicek asymptotic single risk factor model framework, entity default risk for a risk homogeneous portfolio divides into two parts: systematic and entity specific. While entity specific risk can be modelled by a probit or logistic model using a relatively short period of portfolio historical data, modeling of systematic risk is more challenging. In practice, most default risk models do not fully or dynamically capture systematic risk. In this paper, we propose an approach to modeling systematic and entity specific risks by parts and then aggregating together analytically. Systematic risk is quantified and modelled by a multifactor Vasicek model with a latent residual, a factor accounting for default contagion and feedback effects. The asymptotic maximum likelihood approach for parameter estimation for this model is equivalent to least squares linear regression. Conditional entity PDs for scenario tests and through-the-cycle entity PD all have analytical solutions. For validation, we model the point-in-time entity PD for a commercial portfolio, and stress the portfolio default risk by shocking the systematic risk factors. Rating migration and portfolio loss are assessed.