Antibody responses are characterized by increasing affinity and diversity over time. Affinity maturation occurs in germinal centers by a mechanism that involves repeated cycles of somatic mutation and selection. How antibody responses diversify while also undergoing affinity maturation is not as well understood. Here, we examined germinal center (GC) dynamics by tracking B cell entry, division, somatic mutation, and specificity. Our experiments show that naive B cells continuously enter GCs where they compete for T cell help and undergo clonal expansion. Consistent with late entry, invaders carry fewer mutations but can contribute up to 30% or more of the cells in late-stage germinal centers. Notably, cells entering the germinal center at later stages of the reaction diversify the immune response by expressing receptors that show low affinity to the immunogen. Paradoxically, the affinity threshold for late GC entry is lowered in the presence of high-affinity antibodies.