The overall goal of this research is the design of statistical atlas models that can be created from normal subjects, but may generalize to be applicable to abnormal brains. We present a new style of joint modeling of fMRI, DTI, and structural MRI. Motivated by the fact that a white matter tract and related cortical areas are likely to displace together in the presence of a mass lesion (brain tumor), in this work we propose a rotation and translation invariant model that represents the spatial relationship between fiber tracts and anatomic and functional landmarks. This landmark distance model provides a new basis for representation of fiber tracts and can be used for detection and prediction of fiber tracts based on landmarks. Our results indicate that the measured model is consistent across normal subjects, and thus suitable for atlas building. Our experiments demonstrate that the model is robust to displacement and missing data, and can be successfully applied to a small group of patients with mass lesions.