Non-interactive zero-knowledge (NIZK) proof systems are very useful for statement verification without interaction in cryptography; they entail just one message, called the proof, that convinces the verifier of the truth of the statement without leaking any extra information. Many NIZK proof systems are related to quadratic residuosity languages and follow three main steps. First, the prover and the verifier sample a common reference string (CRS) in some particular form. Second, the prover proves that n is a Blum integer (BL,n=p1t1·p2t2, where p1 and p2 are different primes both congruent to 3 modulo 4, and t1 and t2 are odd). Third, various statements (e.g., NQRn,ORn,ANDn,T(k,t), and 3SAT) can be proven by the prover based on the properties of BL. In this study, we improve the NIZK proof system for n∈BL based on the special distribution of the square roots modulo n and embed this proof in the third step. Moreover, we show that the CRS can be sampled more efficiently using the improved process.