The rate- and temperature-dependent mechanical behavior of unidirectional carbon fiber-reinforced polyvinylidene fluoride (PVDF) is investigated through uniaxial tension and compression experiments under various off-axis loading conditions. To improve the understanding of the behavior of the composite, a 3D micromechanical model is developed. Microscopic analyses are used to characterize the geometrical properties of the UD composite at the fiber length-scale. These properties are used to construct a periodic 3D representative volume element (RVE). In combination with periodic boundary conditions, uniaxial macroscopic deformation (in any possible direction) is applied to the RVE to accurately and efficiently model off-axis loading. The rate- and temperature-dependent behavior of the PVDF matrix is accurately described using an elasto-viscoplastic constitutive model. The finite element simulations of uniaxial tension and compression tests are compared to the experimental data and the micromechanical response is analyzed. The micromechanical model accurately describes the rate-dependent macroscopic behavior of unidirectional carbon fiber-reinforced PVDF for various off-axis loading directions at different temperatures. Analysis of the local matrix response in the RVE reveals the influence of the matrix on the macroscopic behavior of the composite.