Listeria monocytogenes is a facultative intracellular bacterial pathogen that escapes from a phagosome and grows in the host cell cytosol. The pore-forming cholesterol-dependent cytolysin, listeriolysin O (LLO), mediates bacterial escape from vesicles and is ∼10-fold more active at an acidic than neutral pH. By swapping dissimilar residues from a pH-insensitive orthologue, perfringolysin O (PFO), we identified leucine 461 as unique to pathogenic Listeria and responsible for the acidic pH optimum of LLO. Conversion of leucine 461 to the threonine present in PFO increased the hemolytic activity of LLO almost 10-fold at a neutral pH. L. monocytogenes synthesizing LLO L461T, expressed from its endogenous site on the bacterial chromosome, resulted in a 100-fold virulence defect in the mouse listeriosis model. These bacteria escaped from acidic phagosomes and initially grew normally in cells and spread cell to cell, but prematurely permeabilized the host membrane and killed the cell. These data show that the acidic pH optimum of LLO results from an adaptive mutation that acts to limit cytolytic activity to acidic vesicles and prevent damage in the host cytosol, a strategy also used by host cells to compartmentalize lysosomal hydrolases.