Time-related biases in observational studies of drug effects have been described extensively in different therapeutic areas but less so in diabetes. Immortal time bias, time-window bias, and time-lag bias all tend to greatly exaggerate the benefits observed with a drug.

These time-related biases are described and shown to be prominent in observational studies that have associated metformin with impressive reductions in the incidence of and mortality from cancer. As a consequence, metformin received much attention as a potential anticancer agent; these observational studies sparked the conduction of randomized, controlled trials of metformin as cancer treatment. However, the spectacular effects reported in these studies are compatible with time-related biases.

We found that 13 observational studies suffered from immortal time bias; 9 studies had not considered time-window bias, whereas other studies did not consider inherent time-lagging issues when comparing the first-line treatment metformin with second- or third-line treatments. These studies, subject to time-related biases that are avoidable with proper study design and data analysis, led to illusory extraordinarily significant effects, with reductions in cancer risk with metformin ranging from 20 to 94%. Three studies that avoided these biases reported no effect of metformin use on cancer incidence.

Although observational studies are important to better understand the effects of drugs, their proper design and analysis is essential to avoid major time-related biases. With respect to metformin, the scientific evidence of its potential beneficial effects on cancer would need to be reassessed critically before embarking on further long and expensive trials.