Since protein kinases are frequently mutated or otherwise deregulated in human malignancies, they serve as a target for differentiating between tumor cells and normal tissues. Imatinib mesylat (IM), an inhibitor of the BCR-ABL tyrosine kinase was introduced in 2001 and has revolutionized the treatment of patients with chronic myeloid leukemia (CML). Since 2005 a second generation of tyrosine kinase inhibitors is to follow in Imatinib's footsteps: The development of these new small molecules was promoted by the identification of potential target kinases within the cellular signaling apparatus. Modern biochemical tools provide relevant amounts of these target kinases necessary for high throughput screening (HTS) campaigns and for elucidation of their 3-D structure by crystallography. Supported by computational chemistry the resulting data have enabled rational drug design. In this review low molecular weight inhibitors used for the CML treatment are summarized, pointing out their chemical similarities and differences.