Naïve T cells differentiate into effector cells upon stimulation with antigen, a process that is accompanied by changes in the chromatin structure of effector cytokine genes. Using histone acetylation to evaluate these changes, we showed that T cell receptor (TCR) stimulation results in early activation of the genes encoding both interleukin 4 and interferon-γ. We found that continued culture in the presence of polarizing cytokines established a selective pattern of histone acetylation on both cytokine genes; this correlated with restricted access of the transcription factor NFAT1 to these gene regulatory regions as well as mutually exclusive gene expression by the differentiated T cells. Our data point to a biphasic process in which cytokine-driven signaling pathways maintain and reinforce chromatin structural changes initiated by the TCR. This process ensures that cytokine genes remain accessible to the relevant transcription factors and promotes functional cooperation of the inducible transcription factor NFAT with lineage-specific transcription factors such as GATA-3 and T-bet.