Some cognitively healthy individuals develop brain amyloid accumulation, suggestive of incipient Alzheimer’s disease (AD), but the effect of amyloid on other potentially informative imaging modalities, such as Diffusion Tensor Imaging (DTI), in characterizing brain changes in preclinical AD requires further exploration. In this study, a sample (N = 139, mean age 60.6, range 46 to 71) from the Wisconsin Registry for Alzheimer’s Prevention (WRAP), a cohort enriched for AD risk factors, was recruited for a multimodal imaging investigation that included DTI and [C-11]Pittsburgh Compound B (PiB) positron emission tomography (PET). Participants were grouped as amyloid positive (Aβ+), amyloid indeterminate (Aβi), or amyloid negative (Aβ-) based on the amount and pattern of amyloid deposition. Regional voxel-wise analyses of four DTI metrics, fractional anisotropy (FA), mean diffusivity (MD), axial diffusivity (Da), and radial diffusivity (Dr), were performed based on amyloid grouping. Three regions of interest (ROIs), the cingulum adjacent to the corpus callosum, hippocampal cingulum, and lateral fornix, were selected based on their involvement in the early stages of AD. Voxel-wise analysis revealed higher FA among Aβ+ compared to Aβ- in all three ROIs and in Aβi compared to Aβ- in the cingulum adjacent to the corpus callosum. Follow-up exploratory whole-brain analyses were consistent with the ROI findings, revealing multiple regions where higher FA was associated with greater amyloid. Lower fronto-lateral gray matter MD was associated with higher amyloid burden. Further investigation showed a negative correlation between MD and PiB signal, suggesting that Aβ accumulation impairs diffusion. Interestingly, these findings in a largely presymptomatic sample are in contradistinction to relationships reported in the literature in symptomatic disease stages of Mild Cognitive Impairment and AD, which usually show higher MD and lower FA. Together with analyses showing that cognitive function in these participants is not associated with any of the four DTI metrics, the present results suggest an early relationship between PiB and DTI, which may be a meaningful indicator of the initiating or compensatory mechanisms of AD prior to cognitive decline.