The majority of transmembrane proteins are integrated into the endoplasmic reticulum (ER) by virtue of a signal sequence‐mediated co‐translational process. However, a substantial portion of transmembrane proteins fails to reach the ER, leading to mislocalized cytosolic polypeptides. Their appropriate recognition and removal are of the utmost importance to avoid proteotoxic stress. Here, we identified UBQLN4 as a BAG6‐binding factor that eliminates newly synthesized defective polypeptides. Using a truncated transmembrane domain protein whose degradation occurs during a pre‐ER incorporation process as a model, we show that UBQLN4 recognizes misassembled proteins in the cytoplasm and targets these to the proteasome. We suggest that the exposed transmembrane segment of the defective polypeptides is essential for the UBQLN4‐mediated substrate discrimination. Importantly, UBQLN4 recognizes not only the defective model substrate but also a pool of endogenous defective proteins that were induced by the depletion of the SRP54 subunit of the signal recognition particle. This study identifies a novel quality control mechanism for newly synthesized and defective transmembrane domain polypeptides that fail to reach their correct destination at the ER membrane.