Cerebrospinal fluid (CSF) biomarkers T-Tau and Aβ(42) are linked with Alzheimer’s disease (AD), yet little is known about the relationship between CSF biomarkers and structural brain alteration in healthy adults. In this study we examined the extent to which AD biomarkers measured in CSF predict brain microstructure indexed by diffusion tensor imaging (DTI) and volume indexed by T1-weighted imaging. Forty-three middle-aged adults with parental family history of AD received baseline lumbar puncture and MRI approximately 3.5 years later. Voxel-wise image analysis methods were used to test whether baseline CSF Aβ(42), total tau (T-Tau), phosphorylated tau (P-Tau) and neurofilament light protein predicted brain microstructure as indexed by DTI and gray matter volume indexed by T1-weighted imaging. T-Tau and T-Tau/Aβ(42) were widely correlated with indices of brain microstructure (mean, axial, and radial diffusivity), notably in white matter regions adjacent to gray matter structures affected in the earliest stages of AD. None of the CSF biomarkers were related to gray matter volume. Elevated P-Tau and P-Tau/Aβ(42) levels were associated with lower recognition performance on the Rey Auditory Verbal Learning Test. Overall, the results suggest that CSF biomarkers are related to brain microstructure in healthy adults with elevated risk of developing AD. Furthermore, the results clearly suggest that early pathological changes in AD can be detected with DTI and occur not only in cortex, but also in white matter.