The major cause of the increasing world mortality rate is cardiovascular disease (CVD), killing 17.9 million people annually. Current techniques are costly, challenging to operate on, and an expert is needed to confirm the diagnosis results. Phonocardiogram (PCG) signals are heart sound recordings of heart rhythms and have many advantages over traditional auscultation methods. This work targets CVD detection through PCG signal analysis using different artificial neural networks (ANN) and fusion of spectral features. PCG signal is acquired through the subject’s heart by a self-designed PCG acquisition setup. It is then pre-processed and extracted five spectral features with the highest pair-wise differences. Five different types of ANN named narrow, wide, tri-layered, bi-layered, and medium are simulated with 99.99% accuracy. This proposed architecture is non-invasive, moderate, and reliable compared to current approaches and also offers great guidance in offering new low-cost alternatives for CVD diagnosis techniques.