This article used Carboniferous-Permian coals from the Jungar, Hedong, and Weibei Coalfields in the east of the Ordos Basin as research samples. Characteristics of coal quality, petrology, mineralogy, and geochemistry were analyzed by proximate analysis, inductively coupled plasma mass spectrometry, X-ray fluorescence spectroscopy, X-ray diffraction analysis, scanning electron microscopy-energy spectrum analysis, and incident light microscope. The enrichment regulations, distribution patterns, and occurrences of REY (rare earth element and yttrium) in coal under different geological conditions were compared. Geological significance and the influence of REY were then discussed. The average REY of Permian coal in the eastern margin of the basin is 127.9 μg/g, CC = 1.87, and the average REY of Carboniferous coal is 117.49 μg/g, CC = 1.72, which are within the normal enrichment range. The inorganic affinity of REYs in the study area is strong and mainly occurs in clay minerals and detrital phosphates and correlates well with LREY. The Permian coal sedimentary environment is more oxidized than the Taiyuan formation, and the Carboniferous coal sedimentary environment is noticeably more affected by marine water. With an increasing degree of coalification, the concentration of rare earth elements (REE) in high-rank coal vitrinite is lower than that in inertinite. In contrast, the concentration of REEs in low-rank coal is the opposite. This is because the oxygen-containing functional groups that can combine with REEs in vitrinite reduce significantly, resulting in the loss of trace elements into other forms. The provenance of the northern and central regions of the study area is mainly sedimentary rocks, granite, alkaline basalt, and continental tholeiite, while the southern region is mainly granite and sedimentary rocks.