The goal of this study was to investigate the soil particle-size distribution (PSD) and pore structure characteristics in the Kubuqi Desert in order to provide basic data for gaining insights into the soil-modifying properties of the local vegetation. Based on laser diffraction analysis, we measured the soil PSD and calculated the single and multi-fractal dimensions of the soils under typical artificial forest and natural grassland vegetation. The diameters, volumes and surface areas of the soil pores were determined via nitrogen adsorption experiments. The relationships between the fractal characteristics and pore structure parameters of the soil were investigated via redundancy analysis and stepwise regression. The clay content was less than 2.0%, and the sand content was greater than 75.0%. There was variability in the PSD and fractal dimension, which was mainly observed for the 0–20 cm, 20–80 cm, and 80–100 cm soil layers. In the 0–80 cm, the fine particle content, single fractal dimension (D), entropy dimension (D1), ratio of D1 to the capacity dimension (D1/D0), and correlation dimension (D2) were smaller for the forest soils than for the grassland soils. The fine particle (clay and silt) content of the 80–100 cm soil layer was approximately 37.8% higher for the Salix psammophila-8a than for the Salix psammophila-3a, and it was approximately 161.4% higher for the Populus popular-35a than for the Pinus sylvestris var. mongolica-8a. The silt content, D1, D1/D0, and D2 were significantly positively correlated with the specific surface area (SSA), total pore volume (TPV), and average pore diameter (APD) of the nanopores (p < 0.05, 0.01, or 0.001), and they were significantly negatively correlated with the percentage of the micropore volume (PMV) (p < 0.05 or 0.01). In the Kubuqi Desert, the fine particle content and fractal dimensions of the soil layer below the root zone of shrub and arbor vegetation increased with increasing stand age, but the trend was reversed in the shallower soil layers. The variability of the soil PSD characteristics was strongly correlated with the variability of the nanopore parameters on the microscopic scale, suggesting that the total pore volume, average pore diameter, and percentage of the micropore volume may be potential indicators of the soil structure and quality.