Listeria monocytogenes is an important foodborne pathogen known for causing listeriosis. To gain insights into the pathogenicity, genetic characterization, and evolution of various Listeria species, in vitro cell adhesion and invasion ability assays and whole-genome sequencing were performed using four Listeria strains isolated from livestock and poultry slaughterhouses. The four Listeria strains exhibited adhesion and invasion abilities in Caco-2 and RAW264.7 cells. Pathogenic Liv1-1 and Lm2-20 had higher adhesion ability, but non-pathogenic Lin4-99 was more invasive than Lm2-20 (p < 0.05). Genetic characterization revealed the presence of a single chromosome without plasmid across four strains with similar whole-genome sizes and G + C% content. Analysis of key pathogenic genes underscored the presence of multiple virulence genes among the four Listeria strains. In contrast, non-pathogenic Listeria lacked LIPI-1, LIPI-2, and LIPI-3 genes, which could possibly be the cause of their non-pathogenicity despite their in vitro cell adhesion and invasion abilities. Thus, genetic determinants of Listeria do not necessarily predict cell adhesion and/or invasive ability in vitro. This study presents a comprehensive comparative genome-wide analysis of four Listeria strains, offering invaluable insights into the pathogenesis of the Listeria genus.