The objective of this study was to investigate the relationship between accelerometer-measured physical activity (PA) and glucose metabolism in asymptomatic late-middle-aged adults. Ninety-three cognitively healthy late-middle-aged adults from the Wisconsin Registry for Alzheimer’s Prevention participated in this cross-sectional study. They underwent 18F-fluorodeoxyglucose positron emission tomography (FDG-PET) imaging and wore an accelerometer (ActiGraph GT3X+) to measure free-living PA. Accelerometer data yielded measures of light (LPA), moderate (MPA), and vigorous (VPA) intensity PA. FDG-PET images were scaled to the cerebellum and pons, and cerebral glucose metabolic rate was extracted from specific regions of interest (ROIs) known to be hypometabolic in AD, i.e., hippocampus, posterior cingulate, inferior temporal cortex, and angular gyrus. Regression analyses were utilized to examine the association between PA and glucose metabolism, while adjusting for potential confounds. There were associations between MPA and glucose metabolism in all ROIs examined. In contrast, LPA was not associated with glucose uptake in any ROI and VPA was only associated with hippocampal FDG uptake. Secondary analyses did not reveal associations between sedentary time and glucose metabolism in any of the ROIs. Exploratory voxel-wise analysis identified additional regions where MPA was significantly associated with glucose metabolism including the precuneus, supramarginal gyrus, amygdala, and middle frontal gyrus. These findings suggest that the intensity of PA is an important contributor to neuronal function in a late-middle-aged cohort, with MPA being the most salient. Prospective studies are necessary for fully elucidating the link between midlife engagement in PA and later life development of AD.