The material model consists of a viscoelastic Burgers element and an additional viscoplastic Bingham element when the effective stress exceeds the yield stress. For partly plastic vessel walls, expressions are derived for the stress and strain state in pressurised or relaxation loaded thick-walled cylinders in plane strain and spheres. For the spherical problem, the material compressibility is accounted for. The influence of the different material parameters on the behaviour of the vessels is evaluated. It is shown that the magnitude of the Maxwell viscosity is of major importance for the long-term behaviour of thick-walled partly plastic vessels.