Electroencephalography (EEG) is used to monitor brain activity. The brain signals consist of different frequency band signals delta, theta, alpha, beta, and gamma waves. The signals are affected by external noise which reduces the quality of the EEG signal due to which it becomes difficult to do further processing of EEG signals like feature extraction or extraction of meaningful features from EEG signal. Therefore, it becomes important to filter the noise from the EEG signal before feature extraction or classification of the EEG signal. The research article presents an overview of different types of windowing filter techniques like Rectangular, Bartlett, Hamming, Hanning, and Kaiser windows applied for finite impulse response (FIR) behavior which is used for EEG signal processing for different brain waves processed in different frequency bands. The comparative analysis is carried out in terms of the response time of brain frequency bands for different windowing filter techniques using the MATLAB 2023 signal processing simulation tool. The novelty of the work lies in estimating minimum latency and appropriate filter selection for various typical EEG waves, since the EEG signals are pre-supposed in the hardware chip design, noise elimination is the first step in high-performance computing applications. The Bartlett window band stop has an optimal response time of 12.666 s for delta waves, a highpass filter with a response time of 16.187 s for theta waves, a bandpass with a response time of 13.122 s for alpha waves, a highpass filter with a response time of 17.866 s for beta waves, and a highpass filter with a response time of 13.797 s for gamma waves. The Barlett window FIR filter is well-suited for EEG applications.