Early reflection sounds and subsequent reverberation sounds are processed in different modes by separate processing devices in order to obtain reverberation effects close to those of natural sound as well as to freely produce reverberation effects that do not exist in natural sound. When the early reflection sound overlaps the subsequent reverberation sound in time, the early reflection sound and the subsequent reverberation sound are produced without noise. There is no need to omit either one of them. Besides, complex envelope control is executed for the early reflection sound, and the envelope levels are weighted and fluctuated. Therefore, it is possible to establish a highly sophisticated sound field.