This paper concerns two polarization orientation parameters of built-up areas derived from the polarimetric synthetic aperture radar (PolSAR) data considering two modeling orthogonal dihedral structures. The first orientation parameter is derived from the well-known circular polarization algorithm with the enrichment of arc distance median filtering using an adaptive neighborhood. The derivation of the second orientation parameter is realized by combining the slope-induced changes in polarimetric orientation angle with the shape-from-shading technique. The combination provides the possibility to measure the incidence angle and the azimuth component of the terrain slopes from the cross-pol SAR intensity image. With reference to the cross scattering model, a doubled cross scattering model (DCSM) is introduced by incorporating the orientation parameters, thus serving to guide the model-based decomposition. Using the DCSM refines the estimation of the cross-pol component by enabling us to further reveal the scattering characteristics of built-up areas. Following a novel criterion, the decomposition is implemented at two layers: one for urban areas and one for nonurban areas. The performance of parameter derivation is demonstrated and evaluated with airborne synthetic aperture radar, uninhabited aerial vehicle synthetic aperture radar, and GF-3 fully PolSAR data over different test sites. The decomposed results are consistent with the reference information provided by the National Land Cover Database 2011 about the land cover classification of test sites and encourage the use of the proposed decomposition scheme for different applications.