Pancreatic ductal adenocarcinoma (PDAC) belongs to the most lethal solid tumors in humans. A histological hallmark feature of PDAC is the pronounced tumor microenvironment (TME) that dynamically evolves during tumor progression. The TME consists of different non-neoplastic cells such as cancer-associated fibroblasts, immune cells, endothelial cells, and neurons. Furthermore, abundant extracellular matrix components such as collagen and hyaluronic acid as well as matricellular proteins create a highly dynamic and hypovascular TME with multiple biochemical and physical interactions among the various cellular and acellular components that promote tumor progression and therapeutic resistance. In recent years, intensive research efforts have resulted in a significantly improved understanding of the biology and pathophysiology of the TME in PDAC, and novel stroma-targeted approaches are emerging that may help to improve the devastating prognosis of PDAC patients. However, none of anti-stromal therapies has been approved in patients so far, and there is still a large discrepancy between multiple successful preclinical results and subsequent failure in clinical trials. Furthermore, recent findings suggest that parts of the TME may also possess tumor-restraining properties rendering tailored therapies even more challenging.