Measuring the properties of polymer solutions is crucial for understanding fundamental polymer physics. The longitudinal ultrasound measurement method offers a promising technique for characterizing these properties. In this study, we develop a mathematical model to correlate longitudinal ultrasonic signals with the material properties of polyethylene oxide (PEO) from dilute to concentrated aqueous solutions. After applying reflection and diffraction corrections, the accuracy of the measurement results improves to over 97%. Our findings reveal a positive correlation between the speed of sound, density, and longitudinal modulus with the mass concentration of PEO. Additionally, ultrasonic relaxation analysis reveals that PEO solutions exhibit at least one relaxation process in the frequency range of 3 to 7 MHz, independent of concentration and molecular weight. Compared to dilute solutions, the relaxation amplitude in concentrated solutions is larger and accompanied by strong nonlinearity, attributed to conformational changes caused by molecular entanglement in concentrated solutions.