A recombinant virus assay was used to characterize in detail neutralizing antibody responses directed at circulating autologous HIV in plasma. Examining serial plasma specimens in a matrix format, most patients with primary HIV infection rapidly generated significant neutralizing antibody responses to early (0–39 months) autologous viruses, whereas responses to laboratory and heterologous primary strains were often lower and delayed. Plasma virus continually and rapidly evolved to escape neutralization, indicating that neutralizing antibody exerts a level of selective pressure that has been underappreciated based on earlier, less comprehensive characterizations. These data argue that neutralizing antibody responses account for the extensive variation in the envelope gene that is observed in the early months after primary HIV infection.