Stroke is an important risk factor for dementia, but the exact mechanisms involved in cognitive decline remain unclear. In this study, we related baseline MRI brain measures with later cognitive decline. Seventy-nine stroke survivors aged 75+ years without dementia were recruited 3-month post-stroke. They underwent yearly neuropsychological assessments and had an MRI at baseline and 2 years. Medial temporal lobe atrophy (MTA) was scored and volume of white matter hyperintensities (WMH) was measured at baseline. The rate of ventricular enlargement was measured by comparing the baseline and repeat images. Linear regression indicated that memory loss was related to both baseline memory and MTA (p=0.001; standardized regression coefficient β=−0.35) but not WMH volume. The only independent predictor of ventricular enlargement was MTA (p=0.003; β=0.47). However, no baseline MRI variable differed between those who did (18%) and did not (82%) develop dementia. The association of MTA but not WMH with subsequent cognitive decline and increasing brain atrophy suggests a greater role for Alzheimer type than vascular pathology in delayed cognitive impairment after stroke.