Production of oocytes from pluripotent cell cultures in a dish represents a new paradigm in stem cell and developmental biology and has implications for how we think about life. The spark of life for the next generation occurs at fertilization when sperm and oocyte fuse. In animals, gametes are the only cells that transmit their genomes to the next generation. Oocytes contain in addition a large cytoplasm with factors that direct embryonic development. Reconstitution of mouse oocyte and embryonic development in culture provides experimental opportunities and facilitates an unprecedented understanding of molecular mechanisms. However, the application of in vitro gametogenesis to reproductive medicine or infertility treatment remains challenging. One significant concern is the quality of in vitro-derived oocytes. Here, we review the current understanding and identify limitations in generating oocytes in vitro. From this basis, we explore opportunities for future improvements of the in vitro approach to generating high-quality oocytes.