Microstate geometries are proposed microstates of black holes which can be described within supergravity. Even though their number may not reproduce the full entropy of black holes with finite-sized horizons, they still offer a glimpse into the microscopic structure of black holes. In this paper we construct a new set of microstate geometries of the supersymmetric D1-D5-P black hole, where the momentum charge is carried by a vector field, as seen from the perspective of six-dimensional supergravity. To aid our construction, we develop an algorithm which solves a complicated partial differential equation using the regularity of the geometries. The new solutions are asymptotically AdS3 × S3, and have a long, but finite AdS2 throat that caps off without ever developing a horizon. These microstate geometries have a holographic interpretation as coherent superpositions of heavy states in the boundary D1-D5 CFT. We identify the states which are dual to our newly constructed solutions and carry out some basic consistency checks to support our identification.