Quantification of cerebral white matter hyperintensities (WMH) of presumed vascular origin is of key importance in many neurological research studies. Currently, measurements are often still obtained from manual segmentations on brain MR images, which is a laborious procedure. The automatic WMH segmentation methods exist, but a standardized comparison of the performance of such methods is lacking. We organized a scientific challenge, in which developers could evaluate their methods on a standardized multi-center/-scanner image dataset, giving an objective comparison: the WMH Segmentation Challenge. Sixty T1 + FLAIR images from three MR scanners were released with the manual WMH segmentations for training. A test set of 110 images from five MR scanners was used for evaluation. The segmentation methods had to be containerized and submitted to the challenge organizers. Five evaluation metrics were used to rank the methods: 1) Dice similarity coefficient; 2) modified Hausdorff distance (95th percentile); 3) absolute log-transformed volume difference; 4) sensitivity for detecting individual lesions; and 5) F1-score for individual lesions. In addition, the methods were ranked on their inter-scanner robustness; 20 participants submitted their methods for evaluation. This paper provides a detailed analysis of the results. In brief, there is a cluster of four methods that rank significantly better than the other methods, with one clear winner. The inter-scanner robustness ranking shows that not all the methods generalize to unseen scanners. The challenge remains open for future submissions and provides a public platform for method evaluation.
OBJECTIVE: This study aims for targeted biopsy validation of magnetic resonance fingerprinting (MRF) and diffusion mapping for characterizing peripheral zone (PZ) prostate cancer and noncancers.
MATERIALS AND METHODS: One hundred four PZ lesions in 85 patients who underwent magnetic resonance imaging were retrospectively analyzed with apparent diffusion coefficient (ADC) mapping, MRF, and targeted biopsy (cognitive or in-gantry). A radiologist blinded to pathology drew regions of interest on targeted lesions and visually normal peripheral zone on MRF and ADC maps. Mean T1, T2, and ADC were analyzed using linear mixed models. Generalized estimating equations logistic regression analyses were used to evaluate T1 and T2 relaxometry combined with ADC in differentiating pathologic groups.
RESULTS: Targeted biopsy revealed 63 cancers (low-grade cancer/Gleason score 6 = 10, clinically significant cancer/Gleason score ≥7 = 53), 15 prostatitis, and 26 negative biopsies. Prostate cancer T1, T2, and ADC (mean ± SD, 1660 ± 270 milliseconds, 56 ± 20 milliseconds, 0.70 × 10 ± 0.24 × 10 mm/s) were significantly lower than prostatitis (mean ± SD, 1730 ± 350 milliseconds, 77 ± 36 milliseconds, 1.00 × 10 ± 0.30 × 10 mm/s) and negative biopsies (mean ± SD, 1810 ± 250 milliseconds, 71 ± 37 milliseconds, 1.00 × 10 ± 0.33 × 10 mm/s). For cancer versus prostatitis, ADC was sensitive and T2 specific with comparable area under curve (AUC; (AUCT2 = 0.71, AUCADC = 0.79, difference between AUCs not significant P = 0.37). T1 + ADC (AUCT1 + ADC = 0.83) provided the best separation between cancer and negative biopsies. Low-grade cancer T2 and ADC (mean ± SD, 75 ± 29 milliseconds, 0.96 × 10 ± 0.34 × 10 mm/s) were significantly higher than clinically significant cancers (mean ± SD, 52 ± 16 milliseconds, 0.65 ± 0.18 × 10 mm/s), and T2 + ADC (AUCT2 + ADC = 0.91) provided the best separation.
CONCLUSIONS: T1 and T2 relaxometry combined with ADC mapping may be useful for quantitative characterization of prostate cancer grades and differentiating cancer from noncancers for PZ lesions seen on T2-weighted images.
This paper presents an efficient approach to quantifying image registration uncertainty based on a low-dimensional representation of geometric deformations. In contrast to previous methods, we develop a Bayesian diffeomorphic registration framework in a bandlimited space, rather than a high-dimensional image space. We show that a dense posterior distribution on deformation fields can be fully characterized by much fewer parameters, which dramatically reduces the computational complexity of model inferences. To further avoid heavy computation loads introduced by random sampling algorithms, we approximate a marginal posterior by using Laplace's method at the optimal solution of log-posterior distribution. Experimental results on both 2D synthetic data and real 3D brain magnetic resonance imaging (MRI) scans demonstrate that our method is significantly faster than the state-of-the-art diffeomorphic registration uncertainty quantification algorithms, while producing comparable results.
PURPOSE: Image guidance is crucial for percutaneous tumor ablations, enabling accurate needle-like applicator placement into target tumors while avoiding tissues that are sensitive to injury and/or correcting needle deflection. Although ultrasound (US) is widely used for image guidance, magnetic resonance (MR) is preferable due to its superior soft tissue contrast. The objective of this study was to develop and evaluate an MR and US multi-modal image-guided navigation system with a needle manipulator to enable US-guided applicator placement during MR imaging (MRI)-guided percutaneous tumor ablation. METHODS: The MRI-compatible needle manipulator with US probe was installed adjacent to a 3 Tesla MRI scanner patient table. Coordinate systems for the MR image, patient table, manipulator, and US probe were all registered using an optical tracking sensor. The patient was initially scanned in the MRI scanner bore for planning and then moved outside the bore for treatment. Needle insertion was guided by real-time US imaging fused with the reformatted static MR image to enhance soft tissue contrast. Feasibility, targeting accuracy, and MR compatibility of the system were evaluated using a bovine liver and agar phantoms. RESULTS: Targeting error for 50 needle insertions was 1.6 ± 0.6 mm (mean ± standard deviation). The experiment confirmed that fused MR and US images provided real-time needle localization against static MR images with soft tissue contrast. CONCLUSIONS: The proposed MR and US multi-modal image-guided navigation system using a needle manipulator enabled accurate needle insertion by taking advantage of static MR and real-time US images simultaneously. Real-time visualization helped determine needle depth, tissue monitoring surrounding the needle path, target organ shifts, and needle deviation from the path.
OBJECTIVE: The purpose of this article is to describe the use of MRI to safely monitor cryoablation for the treatment of spinal epidural malignancies. CONCLUSION: Use of MRI guidance to monitor percutaneous cryoablation allows ablation margins more distinct than those allowed by heat-based ablation modalities. MRI-guided cryoablation is a feasible option for treating epidural tumors involving the spinal canal, resulting in successful decompression of the tumor away from the spinal cord with regrowth of previously eroded bone around the spinal canal.
BACKGROUND AND PURPOSE: Functional magnetic resonance imaging (fMRI) is becoming widely recognized as a key component of preoperative neurosurgical planning, although intraoperative electrocortical stimulation (ECS) is considered the gold standard surgical brain mapping method. However, acquiring and interpreting ECS results can sometimes be challenging. This retrospective study assesses whether intraoperative availability of fMRI impacted surgical decision-making when ECS was problematic or unobtainable. METHODS: Records were reviewed for 191 patients who underwent presurgical fMRI with fMRI loaded into the neuronavigation system. Four patients were excluded as a bur-hole biopsy was performed. Imaging was acquired at 3 Tesla and analyzed using the general linear model with significantly activated pixels determined via individually determined thresholds. fMRI maps were displayed intraoperatively via commercial neuronavigation systems. RESULTS: Seventy-one cases were planned ECS; however, 18 (25.35%) of these procedures were either not attempted or aborted/limited due to: seizure (10), patient difficulty cooperating with the ECS mapping (4), scarring/limited dural opening (3), or dural bleeding (1). In all aborted/limited ECS cases, the surgeon continued surgery using fMRI to guide surgical decision-making. There was no significant difference in the incidence of postoperative deficits between cases with completed ECS and those with limited/aborted ECS. CONCLUSIONS: Preoperative fMRI allowed for continuation of surgery in over one-fourth of patients in which planned ECS was incomplete or impossible, without a significantly different incidence of postoperative deficits compared to the patients with completed ECS. This demonstrates additional value of fMRI beyond presurgical planning, as fMRI data served as a backup method to ECS.
MR elastography allows non-invasive quantification of the shear modulus of tissue, i.e. tissue stiffness and viscosity, information that offers the potential to guide presurgical planning for brain tumor resection. Here, we review brain tumor MRE studies with particular attention to clinical applications. Studies that investigated MRE in patients with intracranial tumors, both malignant and benign as well as primary and metastatic, were queried from the Pubmed/Medline database in August 2018. Reported tumor and normal appearing white matter stiffness values were extracted and compared as a function of tumor histopathological diagnosis and MRE vibration frequencies. Because different studies used different elastography hardware, pulse sequences, reconstruction inversion algorithms, and different symmetry assumptions about the mechanical properties of tissue, effort was directed to ensure that similar quantities were used when making inter-study comparisons. In addition, because different methodologies and processing pipelines will necessarily bias the results, when pooling data from different studies, whenever possible, tumor values were compared with the same subject's contralateral normal appearing white matter to minimize any study-dependent bias. The literature search yielded 10 studies with a total of 184 primary and metastatic brain tumor patients. The group mean tumor stiffness, as measured with MRE, correlated with intra-operatively assessed stiffness of meningiomas and pituitary adenomas. Pooled data analysis showed significant overlap between shear modulus values across brain tumor types. When adjusting for the same patient normal appearing white matter shear modulus values, meningiomas were the stiffest tumor-type. MRE is increasingly being examined for potential in brain tumor imaging and might have value for surgical planning. However, significant overlap of shear modulus values between a number of different tumor types limits applicability of MRE for diagnostic purposes. Thus, further rigorous studies are needed to determine specific clinical applications of MRE for surgical planning, disease monitoring and molecular stratification of brain tumors.
Matrix-assisted laser desorption/ionization mass spectrometry imaging (MALDI MSI) is a powerful technique for spatially resolved metabolomics. A variation on MALDI, termed metal oxide laser ionization (MOLI), capitalizes on the unique property of cerium(IV) oxide (CeO) to induce laser-catalyzed fatty acyl cleavage from lipids and has been utilized for bacterial identification. In this study, we present the development and utilization of CeO as an MSI catalyst. The method was developed using a MALDI TOF instrument in negative ion mode, equipped with a high frequency laser. Instrument parameters for MOLI MS fatty acid catalysis with CeO were optimized with phospholipid standards and fatty acid catalysis was confirmed using lipid extracts from reference bacterial strains, and sample preparation was optimized using mouse brain tissue. MOLI MSI was applied to the imaging of normal mouse brain revealing differentiable fatty acyl pools in myelinated and nonmyelinated regions. Similarly, MOLI MSI showed distinct fatty acyl composition in tumor regions of a patient derived xenograft mouse model of glioblastoma. To assess the potential of MOLI MSI to detect pathogens directly from tissue, a pseudoinfection model was prepared by spotting Escherichia coli lipid extracts on mouse brain tissue sections and imaged by MOLI MSI. The spotted regions were molecularly resolved from the supporting mouse brain tissue by the diagnostic odd-chained fatty acids and reflected control bacterial MOLI MS signatures. We describe MOLI MSI for the first time and highlight its potential for spatially resolved fatty acyl analysis, characterization of fatty acyl composition in tumors, and its potential for pathogen detection directly from tissue.
PURPOSE: Clinical exams typically involve acquiring many different image contrasts to help discriminate healthy from diseased states. Ideally, 3D quantitative maps of all of the main MR parameters would be obtained for improved tissue characterization. Using data from a 7-min whole-brain multi-pathway multi-echo (MPME) scan, we aimed to synthesize several 3D quantitative maps (T and T ) and qualitative contrasts (MPRAGE, FLAIR, T -weighted, T -weighted, and proton density [PD]-weighted). The ability of MPME acquisitions to capture large amounts of information in a relatively short amount of time suggests it may help reduce the duration of neuro MR exams. METHODS: Eight healthy volunteers were imaged at 3.0T using a 3D isotropic (1.2 mm) MPME sequence. Spin-echo, MPRAGE, and FLAIR scans were performed for training and validation. MPME signals were interpreted through neural networks for predictions of different quantitative and qualitative contrasts. Predictions were compared to reference values at voxel and region-of-interest levels. RESULTS: Mean absolute errors (MAEs) for T and T maps were 216 ms and 11 ms, respectively. In ROIs containing white matter (WM) and thalamus tissues, the mean T /T predicted values were 899/62 ms and 1139/58 ms, consistent with reference values of 850/66 ms and 1126/58 ms, respectively. For qualitative contrasts, signals were normalized to those of WM, and MAEs for MPRAGE, FLAIR, T -weighted, T -weighted, and PD-weighted contrasts were 0.14, 0.15, 0.13, 0.16, and 0.05, respectively. CONCLUSIONS: Using an MPME sequence and neural-network contrast translation, whole-brain results were obtained with a variety of quantitative and qualitative contrast in ~6.8 min.
The ability to handle outliers is essential for performing the perspective- n-point (P nP) approach in practical applications, but conventional RANSAC+P3P or P4P methods have high time complexities. We propose a fast P nP solution named R1PP nP to handle outliers by utilizing a soft re-weighting mechanism and the 1-point RANSAC scheme. We first present a P nP algorithm, which serves as the core of R1PP nP, for solving the P nP problem in outlier-free situations. The core algorithm is an optimal process minimizing an objective function conducted with a random control point. Then, to reduce the impact of outliers, we propose a reprojection error-based re-weighting method and integrate it into the core algorithm. Finally, we employ the 1-point RANSAC scheme to try different control points. Experiments with synthetic and real-world data demonstrate that R1PP nP is faster than RANSAC+P3P or P4P methods especially when the percentage of outliers is large, and is accurate. Besides, comparisons with outlier-free synthetic data show that R1PP nP is among the most accurate and fast P nP solutions, which usually serve as the final refinement step of RANSAC+P3P or P4P. Compared with REPP nP, which is the state-of-the-art P nP algorithm with an explicit outliers-handling mechanism, R1PP nP is slower but does not suffer from the percentage of outliers limitation as REPP nP.
BACKGROUND AND PURPOSE: MR imaging is not routinely used to image the extracranial facial nerve. The purpose of this study was to determine the extent to which this nerve can be visualized with a CISS sequence and to determine the feasibility of using that sequence for locating the nerve relative to tumor. MATERIALS AND METHODS: Thirty-two facial nerves in 16 healthy subjects and 4 facial nerves in 4 subjects with parotid gland tumors were imaged with an axial CISS sequence protocol that included 0.8-mm isotropic voxels on a 3T MR imaging system with a 64-channel head/neck coil. Four observers independently segmented the 32 healthy subject nerves. Segmentations were compared by calculating average Hausdorff distance values and Dice similarity coefficients. RESULTS: The primary bifurcation of the extracranial facial nerve into the superior temporofacial and inferior cervicofacial trunks was visible on all 128 segmentations. The mean of the average Hausdorff distances was 1.2 mm (range, 0.3-4.6 mm). Dice coefficients ranged from 0.40 to 0.82. The relative position of the facial nerve to the tumor could be inferred in all 4 tumor cases. CONCLUSIONS: The facial nerve can be seen on CISS images from the stylomastoid foramen to the temporofacial and cervicofacial trunks, proximal to the parotid plexus. Use of a CISS protocol is feasible in the clinical setting to determine the location of the facial nerve relative to tumor.
Estimating the uncertainty in (probabilistic) image registration enables, e.g., surgeons to assess the operative risk based on the trustworthiness of the registered image data. If surgeons receive inaccurately calculated registration uncertainty and misplace unwarranted confidence in the alignment solutions, severe consequences may result. For probabilistic image registration (PIR), the predominant way to quantify the registration uncertainty is using summary statistics of the distribution of transformation parameters. The majority of existing research focuses on trying out different summary statistics as well as means to exploit them. Distinctively, in this paper, we study two rarely examined topics: (1) whether those summary statistics of the transformation distribution most informatively represent the registration uncertainty; (2) Does utilizing the registration uncertainty always be beneficial. We show that there are two types of uncertainties: the transformation uncertainty, Ut, and label uncertainty Ul. The conventional way of using Ut to quantify Ul is inappropriate and can be misleading. By a real data experiment, we also share a potentially critical finding that making use of the registration uncertainty may not always be an improvement.
Computational biomechanics of the brain for neurosurgery is an emerging area of research recently gaining in importance and practical applications. This review paper presents the contributions of the Intelligent Systems for Medicine Laboratory and its collaborators to this field, discussing the modeling approaches adopted and the methods developed for obtaining the numerical solutions. We adopt a physics-based modeling approach and describe the brain deformation in mechanical terms (such as displacements, strains, and stresses), which can be computed using a biomechanical model, by solving a continuum mechanics problem. We present our modeling approaches related to geometry creation, boundary conditions, loading, and material properties. From the point of view of solution methods, we advocate the use of fully nonlinear modeling approaches, capable of capturing very large deformations and nonlinear material behavior. We discuss finite element and meshless domain discretization, the use of the total Lagrangian formulation of continuum mechanics, and explicit time integration for solving both time-accurate and steady-state problems. We present the methods developed for handling contacts and for warping 3D medical images using the results of our simulations. We present two examples to showcase these methods: brain shift estimation for image registration and brain deformation computation for neuronavigation in epilepsy treatment.
BACKGROUND AND PURPOSE: 3D reconstruction of a targeted area ("safe" triangle and Kambin triangle) may benefit the viability assessment of transforaminal epidural steroid injection, especially at the L5/S1 level. However, manual segmentation of lumbosacral nerves for 3D reconstruction is time-consuming. The aim of this study was to investigate the feasibility of deep learning-based segmentation of lumbosacral nerves on CT and the reconstruction of the safe triangle and Kambin triangle. MATERIALS AND METHODS: A total of 50 cases of spinal CT were manually labeled for lumbosacral nerves and bones using Slicer 4.8. The ratio of training/validation/testing was 32:8:10. A 3D U-Net was adopted to build the model SPINECT for automatic segmentations of lumbosacral structures. The Dice score, pixel accuracy, and Intersection over Union were computed to assess the segmentation performance of SPINECT. The areas of Kambin and safe triangles were measured to validate the 3D reconstruction. RESULTS: The results revealed successful segmentation of lumbosacral bone and nerve on CT. The average pixel accuracy for bone was 0.940, and for nerve, 0.918. The average Intersection over Union for bone was 0.897 and for nerve, 0.827. The Dice score for bone was 0.945, and for nerve, it was 0.905. There were no significant differences in the quantified Kambin triangle or safe triangle between manually segmented images and automatically segmented images ( > .05). CONCLUSIONS: Deep learning-based automatic segmentation of lumbosacral structures (nerves and bone) on routine CT is feasible, and SPINECT-based 3D reconstruction of safe and Kambin triangles is also validated.
Mastering detailed anatomy of the human deep brain in clinical neurosciences is challenging. Although numerous pioneering works have gathered a large dataset of structural and topographic information, it is still difficult to transfer this knowledge into practice, even with advanced magnetic resonance imaging techniques. Thus, classical histological atlases continue to be used to identify structures for stereotactic targeting in functional neurosurgery. Physicians mainly use these atlases as a template co-registered with the patient's brain. However, it is possible to directly identify stereotactic targets on MRI scans, enabling personalized targeting. In order to help clinicians directly identify deep brain structures relevant to present and future medical applications, we built a volumetric MRI atlas of the deep brain (MDBA) on a large scale (infra millimetric). Twelve hypothalamic, 39 subthalamic, 36 telencephalic, and 32 thalamic structures were identified, contoured, and labeled. Nineteen coronal, 18 axial, and 15 sagittal MRI plates were created. Although primarily designed for direct labeling, the anatomic space was also subdivided in twelfths of AC-PC distance, leading to proportional scaling in the coronal, axial, and sagittal planes. This extensive work is now available to clinicians and neuroscientists, offering another representation of the human deep brain ([https://hal.archives-ouvertes.fr/] [hal-02116633]). The atlas may also be used by computer scientists who are interested in deciphering the topography of this complex region.
This paper presents the development, preclinical evaluation, and preliminary clinical study of a robotic system for targeted transperineal prostate biopsy under direct interventional magnetic resonance imaging (MRI) guidance. The clinically integrated robotic system is developed based on a modular design approach, comprised of surgical navigation application, robot control software, MRI robot controller hardware, and robotic needle placement manipulator. The system provides enabling technologies for MRI-guided procedures. It can be easily transported and setup for supporting the clinical workflow of interventional procedures, and the system is readily extensible and reconfigurable to other clinical applications. Preclinical evaluation of the system is performed with phantom studies in a 3 Tesla MRI scanner, rehearsing the proposed clinical workflow, and demonstrating an in-plane targeting error of 1.5mm. The robotic system has been approved by the institutional review board (IRB) for clinical trials. A preliminary clinical study is conducted with the patient consent, demonstrating the targeting errors at two biopsy target sites to be 4.0 and 3.7, which is sufficient to target a clinically significant tumor foci. First-in-human trials to evaluate the system's effectiveness and accuracy for MR image-guide prostate biopsy are underway.
Intraoperative tissue deformation, known as brain shift, decreases the benefit of using preoperative images to guide neurosurgery. Non-rigid registration of preoperative magnetic resonance (MR) to intraoperative ultrasound (US) has been proposed as a means to compensate for brain shift. We focus on the initial registration from MR to predurotomy US. We present a method that builds on previous work to address the need for accuracy and generality of MR-iUS registration algorithms in multi-site clinical data. To improve accuracy of registration, we use high-dimensional texture attributes instead of image intensities and propose to replace the standard difference-based attribute matching with correlation-based attribute matching. We also present a strategy that deals explicitly with the large field-of-view mismatch between MR and iUS images. We optimize key parameters across independent MR-iUS brain tumor datasets acquired at three different institutions, with a total of 43 tumor patients and 758 corresponding landmarks to validate the registration algorithm. Despite differences in imaging protocols, patient demographics and landmark distributions, our algorithm was able to reduce landmark errors prior to registration in three data sets (5.37 ± 4.27, 4.18 ± 1.97 and 6.18 ± 3.38 mm, respectively) to a consistently low level (2.28 ± 0.71, 2.08 ± 0.37 and 2.24 ± 0.78 mm, respectively). Our algorithm is compared to 15 other algorithms that have been previously tested on MR-iUS registration and it is competitive with the state-of-the-art on multiple datasets. We show that our algorithm has one of the lowest errors in all datasets (accuracy), and this is achieved while sticking to a fixed set of parameters for multi-site data (generality). In contrast, other algorithms/tools of similar performance need per-dataset parameter tuning (high accuracy but lower generality), and those that stick to fixed parameters have larger errors or inconsistent performance (generality but not the top accuracy). We further characterized landmark errors according to brain regions and tumor types, a topic so far missing in the literature. We found that landmark errors were higher in high-grade than low-grade glioma patients, and higher in tumor regions than in other brain regions.
PURPOSE: Brain shift during tumor resection can progressively invalidate the accuracy of neuronavigation systems and affect neurosurgeons' ability to achieve optimal resections. This paper compares two methods that have been presented in the literature to compensate for brain shift: a thin-plate spline deformation model and a finite element method (FEM). For this comparison, both methods are driven by identical sparse data. Specifically, both methods are driven by displacements between automatically detected and matched feature points from intraoperative 3D ultrasound (iUS). Both methods have been shown to be fast enough for intraoperative brain shift correction (Machado et al. in Int J Comput Assist Radiol Surg 13(10):1525-1538, 2018; Luo et al. in J Med Imaging (Bellingham) 4(3):035003, 2017). However, the spline method requires no preprocessing and ignores physical properties of the brain while the FEM method requires significant preprocessing and incorporates patient-specific physical and geometric constraints. The goal of this work was to explore the relative merits of these methods on recent clinical data. METHODS: Data acquired during 19 sequential tumor resections in Brigham and Women's Hospital's Advanced Multi-modal Image-Guided Operating Suite between December 2017 and October 2018 were considered for this retrospective study. Of these, 15 cases and a total of 24 iUS to iUS image pairs met inclusion requirements. Automatic feature detection (Machado et al. in Int J Comput Assist Radiol Surg 13(10):1525-1538, 2018) was used to detect and match features in each pair of iUS images. Displacements between matched features were then used to drive both the spline model and the FEM method to compensate for brain shift between image acquisitions. The accuracies of the resultant deformation models were measured by comparing the displacements of manually identified landmarks before and after deformation. RESULTS: The mean initial subcortical registration error between preoperative MRI and the first iUS image averaged 5.3 ± 0.75 mm. The mean subcortical brain shift, measured using displacements between manually identified landmarks in pairs of iUS images, was 2.5 ± 1.3 mm. Our results showed that FEM was able to reduce subcortical registration error by a small but statistically significant amount (from 2.46 to 2.02 mm). A large variability in the results of the spline method prevented us from demonstrating either a statistically significant reduction in subcortical registration error after applying the spline method or a statistically significant difference between the results of the two methods. CONCLUSIONS: In this study, we observed less subcortical brain shift than has previously been reported in the literature (Frisken et al., in: Miller (ed) Biomechanics of the brain, Springer, Cham, 2019). This may be due to the fact that we separated out the initial misregistration between preoperative MRI and the first iUS image from our brain shift measurements or it may be due to modern neurosurgical practices designed to reduce brain shift, including reduced craniotomy sizes and better control of intracranial pressure with the use of mannitol and other medications. It appears that the FEM method and its use of geometric and biomechanical constraints provided more consistent brain shift correction and better correction farther from the driving feature displacements than the simple spline model. The spline-based method was simpler and tended to give better results for small deformations. However, large variability in the spline results and relatively small brain shift prevented this study from demonstrating a statistically significant difference between the results of the two methods.
PURPOSE: In image-guided surgery for glioma removal, neurosurgeons usually plan the resection on images acquired before surgery and use them for guidance during the subsequent intervention. However, after the surgical procedure has begun, the preplanning images become unreliable due to the brain shift phenomenon, caused by modifications of anatomical structures and imprecisions in the neuronavigation system. To obtain an updated view of the resection cavity, a solution is to collect intraoperative data, which can be additionally acquired at different stages of the procedure in order to provide a better understanding of the resection. A spatial mapping between structures identified in subsequent acquisitions would be beneficial. We propose here a fully automated segmentation-based registration method to register ultrasound (US) volumes acquired at multiple stages of neurosurgery. METHODS: We chose to segment sulci and falx cerebri in US volumes, which remain visible during resection. To automatically segment these elements, first we trained a convolutional neural network on manually annotated structures in volumes acquired before the opening of the dura mater and then we applied it to segment corresponding structures in different surgical phases. Finally, the obtained masks are used to register US volumes acquired at multiple resection stages. RESULTS: Our method reduces the mean target registration error (mTRE) between volumes acquired before the opening of the dura mater and during resection from 3.49 mm (± 1.55 mm) to 1.36 mm (± 0.61 mm). Moreover, the mTRE between volumes acquired before opening the dura mater and at the end of the resection is reduced from 3.54 mm (± 1.75 mm) to 2.05 mm (± 1.12 mm). CONCLUSION: The segmented structures demonstrated to be good candidates to register US volumes acquired at different neurosurgical phases. Therefore, our solution can compensate brain shift in neurosurgical procedures involving intraoperative US data.
Patient-mounted needle guide devices for percutaneous ablation are vulnerable to patient motion. The objective of this study is to develop and evaluate a software system for an MRI-compatible patient-mounted needle guide device that can adaptively compensate for displacement of the device due to patient motion using a novel image-based automatic device-to-image registration technique. We have developed a software system for an MRI-compatible patient-mounted needle guide device for percutaneous ablation. It features fully-automated image-based device-to-image registration to track the device position, and a device controller to adjust the needle trajectory to compensate for the displacement of the device. We performed: (a) a phantom study using a clinical MR scanner to evaluate registration performance; (b) simulations using intraoperative time-series MR data acquired in 20 clinical cases of MRI-guided renal cryoablations to assess its impact on motion compensation; and (c) a pilot clinical study in three patients to test its feasibility during the clinical procedure. FRE, TRE, and success rate of device-to-image registration were [Formula: see text] mm, [Formula: see text] mm, and 98.3% for the phantom images. The simulation study showed that the motion compensation reduced the targeting error for needle placement from 8.2 mm to 5.4 mm (p < 0.0005) in patients under general anesthesia (GA), and from 14.4 mm to 10.0 mm ([Formula: see text]) in patients under monitored anesthesia care (MAC). The pilot study showed that the software registered the device successfully in a clinical setting. Our simulation study demonstrated that the software system could significantly improve targeting accuracy in patients treated under both MAC and GA. Intraprocedural image-based device-to-image registration was feasible.
PURPOSE: To develop and evaluate an approach to estimate the respiratory-induced motion of lesions in the chest and abdomen. MATERIALS AND METHODS: The proposed approach uses the motion of an initial reference needle inserted into a moving organ to estimate the lesion (target) displacement that is caused by respiration. The needles position is measured using an inertial measurement unit (IMU) sensor externally attached to the hub of an initially placed reference needle. Data obtained from the IMU sensor and the target motion are used to train a learning-based approach to estimate the position of the moving target. An experimental platform was designed to mimic respiratory motion of the liver. Liver motion profiles of human subjects provided inputs to the experimental platform. Variables including the insertion angle, target depth, target motion velocity and target proximity to the reference needle were evaluated by measuring the error of the estimated target position and processing time. RESULTS: The mean error of estimation of the target position ranged between 0.86 and 1.29 mm. The processing maximum training and testing time was 5 ms which is suitable for real-time target motion estimation using the needle position sensor. CONCLUSION: The external motion of an initially placed reference needle inserted into a moving organ can be used as a surrogate, measurable and accessible signal to estimate in real-time the position of a moving target caused by respiration; this technique could then be used to guide the placement of subsequently inserted needles directly into the target.
Brain shift during tumor resection compromises the spatial validity of registered preoperative imaging data that is critical to image-guided procedures. One current clinical solution to mitigate the effects is to reimage using intraoperative magnetic resonance (iMR) imaging. Although iMR has demonstrated benefits in accounting for preoperative-to-intraoperative tissue changes, its cost and encumbrance have limited its widespread adoption. While iMR will likely continue to be employed for challenging cases, a cost-effective model-based brain shift compensation strategy is desirable as a complementary technology for standard resections. We performed a retrospective study of [Formula: see text] tumor resection cases, comparing iMR measurements with intraoperative brain shift compensation predicted by our model-based strategy, driven by sparse intraoperative cortical surface data. For quantitative assessment, homologous subsurface targets near the tumors were selected on preoperative MR and iMR images. Once rigidly registered, intraoperative shift measurements were determined and subsequently compared to model-predicted counterparts as estimated by the brain shift correction framework. When considering moderate and high shift ([Formula: see text], [Formula: see text] measurements per case), the alignment error due to brain shift reduced from [Formula: see text] to [Formula: see text], representing [Formula: see text] correction. These first steps toward validation are promising for model-based strategies.
OBJECTIVE: The purpose of this article is to report our intermediate to long-term outcomes with image-guided percutaneous hepatic tumor cryoablation and to evaluate its technical success, technique efficacy, local tumor progression, and adverse event rate. MATERIALS AND METHODS: Between 1998 and 2014, 299 hepatic tumors (243 metastases and 56 primary tumors; mean diameter, 2.5 cm; median diameter, 2.2 cm; range, 0.3-7.8 cm) in 186 patients (95 women; mean age, 60.9 years; range, 29-88 years) underwent cryoablation during 236 procedures using CT (n = 126), MRI (n = 100), or PET/CT (n = 10) guidance. Technical success, technique efficacy at 3 months, local tumor progression (mean follow-up, 2.5 years; range, 2 months to 14.6 years), and adverse event rates were calculated. RESULTS: The technical success rate was 94.6% (279/295). The technique efficacy rate was 89.5% (231/258) and was greater for tumors smaller than 4 cm (93.4%; 213/228) than for larger tumors (60.0%; 18/30) (p < 0.0001). Local tumor progression occurred in 23.3% (60/258) of tumors and was significantly more common after the treatment of tumors 4 cm or larger (63.3%; 19/30) compared with smaller tumors (18.0%; 41/228) (p < 0.0001). Adverse events followed 33.8% (80/236) of procedures and were grade 3-5 in 10.6% (25/236) of cases. Grade 3 or greater adverse events more commonly followed the treatment of larger tumors (19.5%; 8/41) compared with smaller tumors (8.7%; 17/195) (p = 0.04). CONCLUSION: Image-guided percutaneous cryoablation of hepatic tumors is efficacious; however, tumors smaller than 4 cm are more likely to be treated successfully and without an adverse event.
OBJECTIVE: We report nine consecutive percutaneous image-guided cryoablation procedures of head and neck tumors in seven patients (four men and three women; mean age, 68 years; age range, 50-78 years). Ablation of the entire tumor for local control or ablation of a region of tumor for pain relief or preservation of function was achieved in eight of nine procedures. One patient experienced intraprocedural bradycardia, and another developed a neopharyngeal abscess. There were no deaths, permanent neurologic or functional deficits, vascular complications, or adverse cosmetic sequelae due to the procedures. CONCLUSION: Percutaneous image-guided cryoablation offers a potentially less morbid minimally invasive treatment option than salvage head and neck surgery. The complications that we encountered may be avoidable with increased experience. Further work is needed to continue improving the safety and efficacy of cryoablation of head and neck tumors and to continue expanding the use of cryoablation in patients with head and neck tumors that cannot be treated surgically.