During embryogenesis in plants, cell identities are specified de novo, starting from a single cell. By combining imaging, genomic profiling, and genetics, principles of early plant development have been unraveled in the dicotyledonous plant Arabidopsis. A central emerging question, however, is how well zygotic embryogenesis in Arabidopsis reflects homologous processes in other plant species, including early diverging, non-flowering, and non-seed plants. Here, we consider plant embryogenesis with an emphasis on its evolutionary history, the diverse modes of its initiation, and the concepts in pattern formation among morphologically distinct plant groups. Furthermore, we explore challenges and future directions in plant embryogenesis research.