MHC class I molecules display oligopeptides on the cell surface to enable T cell immunosurveillance of intracellular pathogens and tumors. Speed is of the essence in detecting viruses, which can complete a full replication cycle in just hours, whereas tumor detection is typically a finding-the-needle-in-the-haystack exercise. We review current evidence supporting a nonrandom, compartmentalized selection of peptidogenic substrates that focuses on rapidly degraded translation products as a main source of peptide precursors to optimize immunosurveillance of pathogens and tumors.