Intraoperative tissue deformation, known as brain shift, decreases the benefit of using preoperative images to guide neurosurgery. Non-rigid registration of preoperative magnetic resonance (MR) to intraoperative ultrasound (US) has been proposed as a means to compensate for brain shift. We focus on the initial registration from MR to predurotomy US. We present a method that builds on previous work to address the need for accuracy and generality of MR-iUS registration algorithms in multi-site clinical data. To improve accuracy of registration, we use high-dimensional texture attributes instead of image intensities and propose to replace the standard difference-based attribute matching with correlation-based attribute matching. We also present a strategy that deals explicitly with the large field-of-view mismatch between MR and iUS images. We optimize key parameters across independent MR-iUS brain tumor datasets acquired at three different institutions, with a total of 43 tumor patients and 758 corresponding landmarks to validate the registration algorithm. Despite differences in imaging protocols, patient demographics and landmark distributions, our algorithm was able to reduce landmark errors prior to registration in three data sets (5.37 ± 4.27, 4.18 ± 1.97 and 6.18 ± 3.38 mm, respectively) to a consistently low level (2.28 ± 0.71, 2.08 ± 0.37 and 2.24 ± 0.78 mm, respectively). Our algorithm is compared to 15 other algorithms that have been previously tested on MR-iUS registration and it is competitive with the state-of-the-art on multiple datasets. We show that our algorithm has one of the lowest errors in all datasets (accuracy), and this is achieved while sticking to a fixed set of parameters for multi-site data (generality). In contrast, other algorithms/tools of similar performance need per-dataset parameter tuning (high accuracy but lower generality), and those that stick to fixed parameters have larger errors or inconsistent performance (generality but not the top accuracy). We further characterized landmark errors according to brain regions and tumor types, a topic so far missing in the literature. We found that landmark errors were higher in high-grade than low-grade glioma patients, and higher in tumor regions than in other brain regions.
PURPOSE: Quantitative parameter maps, as opposed to qualitative grayscale images, may represent the future of diagnostic MRI. A new quantitative MRI method is introduced here that requires a single 3D acquisition, allowing good spatial coverage to be achieved in relatively short scan times. METHODS: A multipathway multi-echo sequence was developed, and at least 3 pathways with 2 TEs were needed to generate T , T , T , B , and B maps. The method required the central k-space region to be sampled twice, with the same sequence but with 2 very different nominal flip angle settings. Consequently, scan time was only slightly longer than that of a single scan. The multipathway multi-echo data were reconstructed into parameter maps, for phantom as well as brain acquisitions, in 5 healthy volunteers at 3 T. Spatial resolution, matrix size, and FOV were 1.2 × 1.0 × 1.2 mm , 160 × 192 × 160, and 19.2 × 19.2 × 19.2 cm (whole brain), acquired in 11.5 minutes with minimal acceleration. Validation was performed against T , T , and T maps calculated from gradient-echo and spin-echo data. RESULTS: In Bland-Altman plots, bias and limits of agreement for T and T results in vivo and in phantom were -2.9/±125.5 ms (T in vivo), -4.8/±20.8 ms (T in vivo), -1.5/±18.1 ms (T in phantom), and -5.3/±7.4 ms (T in phantom), for regions of interest including given brain structures or phantom compartments. Due to relatively high noise levels, the current implementation of the approach may prove more useful for region of interest-based as opposed to pixel-based interpretation. CONCLUSIONS: We proposed a novel approach to quantitatively map MR parameters based on a multipathway multi-echo acquisition.
PURPOSE: Matching points that are derived from features or landmarks in image data is a key step in some medical imaging applications. Since most robust point matching algorithms claim to be able to deal with outliers, users may place high confidence in the matching result and use it without further examination. However, for tasks such as feature-based registration in image-guided neurosurgery, even a few mismatches, in the form of invalid displacement vectors, could cause serious consequences. As a result, having an effective tool by which operators can manually screen all matches for outliers could substantially benefit the outcome of those applications. METHODS: We introduce a novel variogram-based outlier screening method for vectors. The variogram is a powerful geostatistical tool for characterizing the spatial dependence of stochastic processes. Since the spatial correlation of invalid displacement vectors, which are considered as vector outliers, tends to behave differently than normal displacement vectors, they can be efficiently identified on the variogram. RESULTS: We validate the proposed method on 9 sets of clinically acquired ultrasound data. In the experiment, potential outliers are flagged on the variogram by one operator and further evaluated by 8 experienced medical imaging researchers. The matching quality of those potential outliers is approximately 1.5 lower, on a scale from 1 (bad) to 5 (good), than valid displacement vectors. CONCLUSION: The variogram is a simple yet informative tool. While being used extensively in geostatistical analysis, it has not received enough attention in the medical imaging field. We believe there is a good deal of potential for clinically applying the proposed outlier screening method. By way of this paper, we also expect researchers to find variogram useful in other medical applications that involve motion vectors analyses.
We introduce an approach for image segmentation based on sparse correspondences between keypoints in testing and training images. Keypoints represent automatically identified distinctive image locations, where each keypoint correspondence suggests a transformation between images. We use these correspondences to transfer label maps of entire organs from the training images to the test image. The keypoint transfer algorithm includes three steps: (i) keypoint matching, (ii) voting-based keypoint labeling, and (iii) keypoint-based probabilistic transfer of organ segmentations. We report segmentation results for abdominal organs in whole-body CT and MRI, as well as in contrast-enhanced CT and MRI. Our method offers a speed-up of about three orders of magnitude in comparison to common multi-atlas segmentation, while achieving an accuracy that compares favorably. Moreover, keypoint transfer does not require the registration to an atlas or a training phase. Finally, the method allows for the segmentation of scans with highly variable field-of-view.
A simple but general solution of Navier's equation for axisymmetric shear wave propagation in a homogeneous isotropic viscoelastic medium is presented. It is well-suited for use as a forward model for some acoustic radiation force impulse based shear wave elastography applications because it does not require precise knowledge of the strength of the source, nor its spatial or temporal distribution. Instead, it depends on two assumptions: (1) the source distribution is axisymmetric and confined to a small region near the axis of symmetry, and (2) the propagation medium is isotropic and homogeneous. The model accounts for the vector polarization of shear waves and exactly represents geometric spreading of the shear wavefield, whether spherical, cylindrical, or neither. It makes no assumption about the frequency dependence of material parameters, i.e., it is material-model independent. Validation using measured shear wavefields excited by acoustic radiation force in a homogeneous gelatin sample show that the model accounts for well over 90% of the measured wavefield "energy." An optimal fit of the model to simulated shear wavefields with noise in a homogeneous viscoelastic medium enables estimation of both the shear storage modulus and shear wave attenuation to within 1%.
This paper presents a method for automatically calibrating and assessing the calibration quality of an externally tracked 2-D ultrasound (US) probe by scanning arbitrary, natural tissues, as opposed a specialized calibration phantom as is the typical practice. A generative topic model quantifies the posterior probability of calibration parameters conditioned on local 2-D image features arising from a generic underlying substrate. Auto-calibration is achieved by identifying the maximum a-posteriori image-to-probe transform, and calibration quality is assessed online in terms of the posterior probability of the current image-to-probe transform. Both are closely linked to the 3-D point reconstruction error (PRE) in aligning feature observations arising from the same underlying physical structure in different US images. The method is of practical importance in that it operates simply by scanning arbitrary textured echogenic structures, e.g., in-vivo tissues in the context of the US-guided procedures, without requiring specialized calibration procedures or equipment. Observed data take the form of local scale-invariant features that can be extracted and fit to the model in near real-time. Experiments demonstrate the method on a public data set of in vivo human brain scans of 14 unique subjects acquired in the context of neurosurgery. Online calibration assessment can be performed at approximately 3 Hz for the US images of pixels. Auto-calibration achieves an internal mean PRE of 1.2 mm and a discrepancy of [2 mm, 6 mm] in comparison to the calibration via a standard phantom-based method.
Segmentation is a fundamental task for extracting semantically meaningful regions from an image. The goal of segmentation algorithms is to accurately assign object labels to each image location. However, image noise, shortcomings of algorithms, and image ambiguities cause uncertainty in label assignment. Estimating this uncertainty is important in multiple application domains, such as segmenting tumors from medical images for radiation treatment planning. One way to estimate these uncertainties is through the computation of posteriors of Bayesian models, which is computationally prohibitive for many practical applications. However, most computationally efficient methods fail to estimate label uncertainty. We therefore propose in this paper the active mean fields (AMF) approach, a technique based on Bayesian modeling that uses a mean-field approximation to efficiently compute a segmentation and its corresponding uncertainty. Based on a variational formulation, the resulting convex model combines any label-likelihood measure with a prior on the length of the segmentation boundary. A specific implementation of that model is the Chan-Vese segmentation model, in which the binary segmentation task is defined by a Gaussian likelihood and a prior regularizing the length of the segmentation boundary. Furthermore, the Euler-Lagrange equations derived from the AMF model are equivalent to those of the popular Rudin-Osher-Fatemi (ROF) model for image denoising. Solutions to the AMF model can thus be implemented by directly utilizing highly efficient ROF solvers on log-likelihood ratio fields. We qualitatively assess the approach on synthetic data as well as on real natural and medical images. For a quantitative evaluation, we apply our approach to the tt icgbench dataset.
Magnetic Resonance Imaging (MRI) is widely used in routine clinical diagnosis and treatment. However, variations in MRI acquisition protocols result in different appearances of normal and diseased tissue in the images. Convolutional neural networks (CNNs), which have shown to be successful in many medical image analysis tasks, are typically sensitive to the variations in imaging protocols. Therefore, in many cases, networks trained on data acquired with one MRI protocol, do not perform satisfactorily on data acquired with different protocols. This limits the use of models trained with large annotated legacy datasets on a new dataset with a different domain which is often a recurring situation in clinical settings. In this study, we aim to answer the following central questions regarding domain adaptation in medical image analysis: Given a fitted legacy model, (1) How much data from the new domain is required for a decent adaptation of the original network?; and, (2) What portion of the pre-trained model parameters should be retrained given a certain number of the new domain training samples? To address these questions, we conducted extensive experiments in white matter hyperintensity segmentation task. We trained a CNN on legacy MR images of brain and evaluated the performance of the domain-adapted network on the same task with images from a different domain. We then compared the performance of the model to the surrogate scenarios where either the same trained network is used or a new network is trained from scratch on the new dataset. The domain-adapted network tuned only by two training examples achieved a Dice score of 0.63 substantially outperforming a similar network trained on the same set of examples from scratch.
The gynecological cancer mortality rate, including cervical, ovarian, vaginal and vulvar cancers, is more than 20,000 annually in the US alone. In many countries, including the US, external-beam radiotherapy followed by high dose rate brachytherapy is the standard-of-care. The superior ability of MR to visualize soft tissue has led to an increase in its usage in planning and delivering brachytherapy treatment. A technical challenge associated with the use of MRI imaging for brachytherapy, in contrast to that of CT imaging, is the visualization of catheters that are used to place radiation sources into cancerous tissue. We describe here a precise, accurate method for achieving catheter segmentation and visualization. The algorithm, with the assistance of manually provided tip locations, performs segmentation using image-features, and is guided by a catheter-specific, estimated mechanical model. A final quality control step removes outliers or conflicting catheter trajectories. The mean Hausdorff error on a 54 patient, 760 catheter reference database was 1.49 mm; 51 of the outliers deviated more than two catheter widths (3.4 mm) from the gold standard, corresponding to catheter identification accuracy of 93% in a Syed-Neblett template. In a multi-user simulation experiment for evaluating RMS precision by simulating varying manually-provided superior tip positions, 3σ maximum errors were 2.44 mm. The average segmentation time for a single catheter was 3 s on a standard PC. The segmentation time, accuracy and precision, are promising indicators of the value of this method for clinical translation of MR-guidance in gynecologic brachytherapy and other catheter-based interventional procedures.
We present an efficient probabilistic model of anatomical variability in a linear space of initial velocities of diffeomorphic transformations and demonstrate its benefits in clinical studies of brain anatomy. To overcome the computational challenges of the high dimensional deformation-based descriptors, we develop a latent variable model for principal geodesic analysis (PGA) based on a low dimensional shape descriptor that effectively captures the intrinsic variability in a population. We define a novel shape prior that explicitly represents principal modes as a multivariate complex Gaussian distribution on the initial velocities in a bandlimited space. We demonstrate the performance of our model on a set of 3D brain MRI scans from the Alzheimer's Disease Neuroimaging Initiative (ADNI) database. Our model yields a more compact representation of group variation at substantially lower computational cost than the state-of-the-art method such as tangent space PCA (TPCA) and probabilistic principal geodesic analysis (PPGA) that operate in the high dimensional image space.
Neurosurgery makes use of preoperative imaging to visualize pathology, inform surgical planning, and evaluate the safety of selected approaches. The utility of preoperative imaging for neuronavigation, however, is diminished by the well-characterized phenomenon of brain shift, in which the brain deforms intraoperatively as a result of craniotomy, swelling, gravity, tumor resection, cerebrospinal fluid (CSF) drainage, and many other factors. As such, there is a need for updated intraoperative information that accurately reflects intraoperative conditions. Since 1982, intraoperative ultrasound has allowed neurosurgeons to craft and update operative plans without ionizing radiation exposure or major workflow interruption. Continued evolution of ultrasound technology since its introduction has resulted in superior imaging quality, smaller probes, and more seamless integration with neuronavigation systems. Furthermore, the introduction of related imaging modalities, such as 3-dimensional ultrasound, contrast-enhanced ultrasound, high-frequency ultrasound, and ultrasound elastography, has dramatically expanded the options available to the neurosurgeon intraoperatively. In the context of these advances, we review the current state, potential, and challenges of intraoperative ultrasound for brain tumor resection. We begin by evaluating these ultrasound technologies and their relative advantages and disadvantages. We then review three specific applications of these ultrasound technologies to brain tumor resection: (1) intraoperative navigation, (2) assessment of extent of resection, and (3) brain shift monitoring and compensation. We conclude by identifying opportunities for future directions in the development of ultrasound technologies.
OBJECTIVE: Magnetic resonance imaging (MRI) is a widely used imaging modality for studies of knee osteoarthritis (OA). Compared to radiography, MRI offers exceptional soft tissue imaging and true three-dimensional (3D) visualization. However, MRI is expensive both due to the cost of acquisition and evaluation of the images. The goal of our study is to develop a new method to address the cost of MRI by combining innovative acquisition methods and automated post-processing software. METHODS: Ten healthy volunteers were scanned with three different MRI protocols: A standard 3D dual-echo steady state (DESS) pulse sequence, an accelerated DESS (DESS), acquired at approximately half the time compared to DESS, and a multi-echo time DESS (DESS), which is capable of producing measurements of T2 relaxation time. A software tool was used to measure cartilage volume. Accuracy was quantified by comparing DESS to DESS and DESS and precision was measured using repeat readings and acquisitions. T2 precision was determined using duplicate DESS acquisitions. Intra-class correlation coefficients (ICCs), root-mean square standard deviation (RMSSD), and the coefficient of variation (CoV) were used to quantify accuracy and precision. RESULTS: The accuracies of DESS and DESS were CoV = 3.7% and CoV = 6.6% respectively, while precision was 3.8%, 3.0%, and 3.1% for DESS, DESS and DESS. T2 repositioning precision was 5.8%. CONCLUSION: The results demonstrate that accurate and precise quantification of cartilage volume is possible using a combination of substantially faster MRI acquisition and post-processing software. Precise measurements of cartilage T2 and volume can be made using the same acquisition.
Registration of multiple 3D ultrasound sectors in order to provide an extended field of view is important for the appreciation of larger anatomical structures at high spatial and temporal resolution. In this paper, we present a method for fully automatic spatio-temporal registration between two partially overlapping 3D ultrasound sequences. The temporal alignment is solved by aligning the normalized cross correlation-over-time curves of the sequences. For the spatial alignment, corresponding 3D Scale Invariant Feature Transform (SIFT) features are extracted from all frames of both sequences independently of the temporal alignment. A rigid transform is then calculated by least squares minimization in combination with random sample consensus. The method is applied to 16 echocardiographic sequences of the left and right ventricles and evaluated against manually annotated temporal events and spatial anatomical landmarks. The mean distances between manually identified landmarks in the left and right ventricles after automatic registration were (mean ± SD) 4.3 ± 1.2 mm compared to a reference error of 2.8 ± 0.6 mm with manual registration. For the temporal alignment, the absolute errors in valvular event times were 14.4 ± 11.6 ms for Aortic Valve (AV) opening, 18.6 ± 16.0 ms for AV closing, and 34.6 ± 26.4 ms for mitral valve opening, compared to a mean inter-frame time of 29 ms.
Magnetic Resonance (MR) imaging provides excellent image quality at a high cost and low frame rate. Ultrasound (US) provides poor image quality at a low cost and high frame rate. We propose an instance-based learning system to obtain the best of both worlds: high quality MR images at high frame rates from a low cost single-element US sensor. Concurrent US and MRI pairs are acquired during a relatively brief offine learning phase involving the US transducer and MR scanner. High frame rate, high quality MR imaging of respiratory organ motion is then predicted from US measurements, even after stopping MRI acquisition, using a probabilistic kernel regression framework. Experimental results show predicted MR images to be highly representative of actual MR images.
PURPOSE: To describe how B0 inhomogeneities can cause errors in proton resonance frequency (PRF) shift thermometry, and to correct for these errors. METHODS: With PRF thermometry, measured phase shifts are converted into temperature measurements through the use of a scaling factor proportional to the echo time, TE. However, B0 inhomogeneities can deform, spread, and translate MR echoes, potentially making the "true" echo time vary spatially within the imaged object and take on values that differ from the prescribed TE value. Acquisition and reconstruction methods able to avoid or correct for such errors are presented. RESULTS: Tests were performed in a gel phantom during sonication, and temperature measurements were made with proper shimming as well as with intentionally introduced B0 inhomogeneities. Errors caused by B0 inhomogeneities were observed, described, and corrected by the proposed methods. No statistical difference was found between the corrected results and the reference results obtained with proper shimming, while errors by more than 10% in temperature elevation were corrected for. The approach was also applied to an abdominal in vivo dataset. CONCLUSION: Field variations induce errors in measured field values, which can be detected and corrected. The approach was validated for a PRF thermometry application.
Patient-mounted needle guide devices for percutaneous ablation are vulnerable to patient motion. The objective of this study is to develop and evaluate a software system for an MRI-compatible patient-mounted needle guide device that can adaptively compensate for displacement of the device due to patient motion using a novel image-based automatic device-to-image registration technique. We have developed a software system for an MRI-compatible patient-mounted needle guide device for percutaneous ablation. It features fully-automated image-based device-to-image registration to track the device position, and a device controller to adjust the needle trajectory to compensate for the displacement of the device. We performed: (a) a phantom study using a clinical MR scanner to evaluate registration performance; (b) simulations using intraoperative time-series MR data acquired in 20 clinical cases of MRI-guided renal cryoablations to assess its impact on motion compensation; and (c) a pilot clinical study in three patients to test its feasibility during the clinical procedure. FRE, TRE, and success rate of device-to-image registration were [Formula: see text] mm, [Formula: see text] mm, and 98.3% for the phantom images. The simulation study showed that the motion compensation reduced the targeting error for needle placement from 8.2 mm to 5.4 mm (p < 0.0005) in patients under general anesthesia (GA), and from 14.4 mm to 10.0 mm ([Formula: see text]) in patients under monitored anesthesia care (MAC). The pilot study showed that the software registered the device successfully in a clinical setting. Our simulation study demonstrated that the software system could significantly improve targeting accuracy in patients treated under both MAC and GA. Intraprocedural image-based device-to-image registration was feasible.
PURPOSE: To develop and evaluate an approach to estimate the respiratory-induced motion of lesions in the chest and abdomen. MATERIALS AND METHODS: The proposed approach uses the motion of an initial reference needle inserted into a moving organ to estimate the lesion (target) displacement that is caused by respiration. The needles position is measured using an inertial measurement unit (IMU) sensor externally attached to the hub of an initially placed reference needle. Data obtained from the IMU sensor and the target motion are used to train a learning-based approach to estimate the position of the moving target. An experimental platform was designed to mimic respiratory motion of the liver. Liver motion profiles of human subjects provided inputs to the experimental platform. Variables including the insertion angle, target depth, target motion velocity and target proximity to the reference needle were evaluated by measuring the error of the estimated target position and processing time. RESULTS: The mean error of estimation of the target position ranged between 0.86 and 1.29 mm. The processing maximum training and testing time was 5 ms which is suitable for real-time target motion estimation using the needle position sensor. CONCLUSION: The external motion of an initially placed reference needle inserted into a moving organ can be used as a surrogate, measurable and accessible signal to estimate in real-time the position of a moving target caused by respiration; this technique could then be used to guide the placement of subsequently inserted needles directly into the target.
Brain shift during tumor resection compromises the spatial validity of registered preoperative imaging data that is critical to image-guided procedures. One current clinical solution to mitigate the effects is to reimage using intraoperative magnetic resonance (iMR) imaging. Although iMR has demonstrated benefits in accounting for preoperative-to-intraoperative tissue changes, its cost and encumbrance have limited its widespread adoption. While iMR will likely continue to be employed for challenging cases, a cost-effective model-based brain shift compensation strategy is desirable as a complementary technology for standard resections. We performed a retrospective study of [Formula: see text] tumor resection cases, comparing iMR measurements with intraoperative brain shift compensation predicted by our model-based strategy, driven by sparse intraoperative cortical surface data. For quantitative assessment, homologous subsurface targets near the tumors were selected on preoperative MR and iMR images. Once rigidly registered, intraoperative shift measurements were determined and subsequently compared to model-predicted counterparts as estimated by the brain shift correction framework. When considering moderate and high shift ([Formula: see text], [Formula: see text] measurements per case), the alignment error due to brain shift reduced from [Formula: see text] to [Formula: see text], representing [Formula: see text] correction. These first steps toward validation are promising for model-based strategies.
OBJECTIVE: The purpose of this article is to report our intermediate to long-term outcomes with image-guided percutaneous hepatic tumor cryoablation and to evaluate its technical success, technique efficacy, local tumor progression, and adverse event rate. MATERIALS AND METHODS: Between 1998 and 2014, 299 hepatic tumors (243 metastases and 56 primary tumors; mean diameter, 2.5 cm; median diameter, 2.2 cm; range, 0.3-7.8 cm) in 186 patients (95 women; mean age, 60.9 years; range, 29-88 years) underwent cryoablation during 236 procedures using CT (n = 126), MRI (n = 100), or PET/CT (n = 10) guidance. Technical success, technique efficacy at 3 months, local tumor progression (mean follow-up, 2.5 years; range, 2 months to 14.6 years), and adverse event rates were calculated. RESULTS: The technical success rate was 94.6% (279/295). The technique efficacy rate was 89.5% (231/258) and was greater for tumors smaller than 4 cm (93.4%; 213/228) than for larger tumors (60.0%; 18/30) (p < 0.0001). Local tumor progression occurred in 23.3% (60/258) of tumors and was significantly more common after the treatment of tumors 4 cm or larger (63.3%; 19/30) compared with smaller tumors (18.0%; 41/228) (p < 0.0001). Adverse events followed 33.8% (80/236) of procedures and were grade 3-5 in 10.6% (25/236) of cases. Grade 3 or greater adverse events more commonly followed the treatment of larger tumors (19.5%; 8/41) compared with smaller tumors (8.7%; 17/195) (p = 0.04). CONCLUSION: Image-guided percutaneous cryoablation of hepatic tumors is efficacious; however, tumors smaller than 4 cm are more likely to be treated successfully and without an adverse event.
OBJECTIVE: We report nine consecutive percutaneous image-guided cryoablation procedures of head and neck tumors in seven patients (four men and three women; mean age, 68 years; age range, 50-78 years). Ablation of the entire tumor for local control or ablation of a region of tumor for pain relief or preservation of function was achieved in eight of nine procedures. One patient experienced intraprocedural bradycardia, and another developed a neopharyngeal abscess. There were no deaths, permanent neurologic or functional deficits, vascular complications, or adverse cosmetic sequelae due to the procedures. CONCLUSION: Percutaneous image-guided cryoablation offers a potentially less morbid minimally invasive treatment option than salvage head and neck surgery. The complications that we encountered may be avoidable with increased experience. Further work is needed to continue improving the safety and efficacy of cryoablation of head and neck tumors and to continue expanding the use of cryoablation in patients with head and neck tumors that cannot be treated surgically.