In Japan, it is forecasted that massive amounts of concrete waste material will be generated in the future as a result of demolition of many buildings, and expansion of the use of recycled aggregate is expected. In this study, it was verified the effect when relatively large amount of admixture is mixed, a combination of recycled fine aggregate of different quality and various admixtures, combination of each admixture in order to realize high strength and high durability by using recycled aggregate. The increase in the drying shrinkage ratio due to the deterioration of the recycled fine aggregate quality was larger than the fluctuation due to the admixture mixing ratio and the drying shrinkage ratio was distributed by forming a group for each quality of recycled fine aggregate. In the relationship between the pore volume and the compressive strength, when evaluated with pore volume of 2 μm or less in both cases, a good linear relationship could be confirmed. The relationship between the pore volume and the drying shrinkage rate was similar. Therefore, it was suggested that compressive strength and drying shrinkage ratio of mortar contained composite recycled fine aggregate and admixture could be predicted by evaluating with the pore volume of 2 μm or less.