Date Published:2015 Sep
To enhance neuro-navigation, high quality pre-operative images must be registered onto intra-operative configuration of the brain. Therefore evaluation of the degree to which structures may remain misaligned after registration is critically important. We consider two Hausdorff Distance (HD)-based evaluation approaches: the edge-based HD (EBHD) metric and the Robust HD (RHD) metric as well as various commonly used intensity-based similarity metrics such as Mutual Information (MI), Normalised Mutual Information (NMI), Entropy Correlation Coefficient (ECC), Kullback-Leibler Distance (KLD) and Correlation Ratio (CR). We conducted the evaluation by applying known deformations to simple sample images and real cases of brain shift. We conclude that the intensity-based similarity metrics such as MI, NMI, ECC, KLD and CR do not correlate well with actual alignment errors, and hence are not useful for assessing misalignment. On the contrary, the EBHD and the RHD metrics correlated well with actual alignment errors; however, they have been found to underestimate the actual misalignment. We also note that it is beneficial to present HD results as a percentile-HD curve rather than a single number such as the 95-percentile HD. Percentile-HD curves present the full range of alignment errors and also facilitate the comparison of results obtained using different approaches. Furthermore, the qualities that should be possessed by an ideal evaluation metric were highlighted. Future studies could focus on developing such an evaluation metric.