This study investigated the possibility of using basalt, diabase, and andesite natural stones instead of virgin fine aggregates. Substitution percentages varied between 10% and 40% according to the sand mass. The effect of basalt, diabase, and andesite addition on concrete performance was evaluated using strength and durability tests performed on the samples at the end of 7, 28, and 60 days. In addition, petrographic-mineralogical, X-ray diffraction (XRD), and scanning electron microscopy (SEM) analyses of basalt, diabase, and andesite stones were evaluated. The 60-day compressive strengths of the samples were 39% higher in samples with basalt additives, 35% higher in samples with diabase additives, and 37% higher in samples with andesite additives than in the control sample. At the end of 28 days, the water absorption rates of the samples with additives were 113.83%–55.81% less that of the control sample, on average, and the samples suffered 26%–52% less wear loss than the control sample. In addition, at the end of the freeze–thaw cycles, the compressive strengths of the samples with basalt, diabase, and andesite added were 67%, 63%, and 64% higher than that of the reference sample, respectively. The compressive strength values of samples exposed to the effect of sulfate for 180 days were examined, and samples with basalt, diabase, and andesite added had compressive strength values an average of 33.35%, 32.52%, and 32.80% higher than that of the reference sample, respectively. This study proves the usability of basalt, diabase, and andesite natural stones and their wastes as fine aggregate.