Using polydimethylsiloxane (PDMS) as a basic matrix to prepare ethanol and butanol permselective pervaporation membranes is a vibrant field. Many studies have verified that the three-dimensional Hansen solubility parameters (HSP) theory offers a valid explanation for the swelling performance of ethanol and butanol in PDMS. Five parameters (δD, δP, δH, δt, and Ra) are defined in HSP theory which can be individually used to explain the interaction strength between a solvent and a polymer. However, for the above five parameters, which one is the most effective parameter for deciding the swelling degree still needs to be determined. In this study, a commonly used hydroxy-terminated PDMS precursor was adopted to prepare the PDMS network. The HSP of the chosen PDMS precursor was measured by an advanced “solubility-rating” method. The special software package HSPiP (4.1.03), purchased from the HSPiP team, was used to process the “solubility-rating” results. The equilibrium swelling degree (Q value) of the PDMS network in water, ethanol, butanol, and toluene was measured and the relationships between the five HSP parameters of the solvents and the logarithmic equilibrium swelling degree, log(Q), were discussed. It was found that the measured polar parameter, δP, of PDMS was 0.12 MPa0.5. The measured hydrogen bonding parameter, δH, was larger than δP, attaining a value of 8.6 MPa0.5, because the hydroxy groups directly contributed to the hydrogen bonding solubility parameter, δH. With respect to the relationships between log(Q) and δD, δP, δH, δt, and Ra, linear relationships existed after plotting log(Q) vs. δP and log(Q) vs. δH. The linear relation degree of the fitted lines was 0.995 and 0.989, respectively. Their standard deviations were 0.149 and 0.232, respectively. Therefore, a better linear relationship existed between log(Q) and δP than the other solubility parameters. This indicated that the polar interaction was the main effect for deciding the swelling degree of the PDMS network in water and alcohol systems.