Gut-associated lymphoid tissue is one of the most diverse and complex immune compartments in the human body. The subepithelial compartment of the gut consists of immune cells of innate and adaptive immunity, non-hematopoietic mesenchymal cells, and stem cells of different origins, and is organized into secondary (and even tertiary) lymphoid organs, such as Peyer’s patches, cryptopatches, and isolated lymphoid follicles. The function of isolated lymphoid follicles is multifaceted; they play a role in the development and regeneration of the large intestine and the maintenance of (immune) homeostasis. Isolated lymphoid follicles are also extensively associated with the epithelium and its conventional and non-conventional immune cells; hence, they can also function as a starting point or maintainer of pathological processes such as inflammatory bowel diseases or colorectal carcinogenesis. These relationships can significantly affect both physiological and pathological processes of the intestines. We aim to provide an overview of the latest knowledge of isolated lymphoid follicles in colonic inflammation and colorectal carcinogenesis. Further studies of these lymphoid organs will likely lead to an extended understanding of how immune responses are initiated and controlled within the large intestine, along with the possibility of creating novel mucosal vaccinations and ways to treat inflammatory bowel disease or colorectal cancer.