Despite the excellent oxygen barrier and biodegradability of polyvinyl alcohol (PVA), its poor physical properties owing to its inherent hydrophilicity limit its application. In this paper, we report a novel surface modification technique for PVA films, involving the control of the predrying conditions (i.e., amount of residual solvent) of the coated PVA film and adjusting the electrospinning process of hydrophobic polycaprolactone (PCL) nanofibers onto the PVA films. The residual solvent of the coated PVA film was varied by changing the predrying time. A shorter predrying time increased the residual solvent content significantly (p < 0.05) and the flexibility of the coated PVA film. Moreover, scanning electron microscopy depicted the improved physical binding of hydrophobic PCL nanofibers to the hydrophilic PVA surface with increased penetration depth to the PVA film with shorter drying times. The PVA/PCL composite films with different predrying times and electrospun PCL nanofibers exhibited an apparent increase in the contact angle from 8.3° to 95.1°. The tensile strength of the pure PVA film increased significantly (p < 0.05) from 7.5 MPa to 77.4 MPa and its oxygen permeability decreased from 5.5 to 1.9 cc/m2·day. Therefore, our newly developed technique is cost-effective for modifying the surface and physical properties of hydrophilic polymers, broadening their industrial applications.