This article discusses intraoperative imaging techniques used during high-grade glioma surgery. Gliomas can be difficult to differentiate from surrounding tissue during surgery. Intraoperative imaging helps to alleviate problems encountered during glioma surgery, such as brain shift and residual tumor. There are a variety of modalities available all of which aim to give the surgeon more information, address brain shift, identify residual tumor, and increase the extent of surgical resection. The article starts with a brief introduction followed by a review of with the latest advances in intraoperative ultrasound, intraoperative MRI, and intraoperative computed tomography.
PURPOSE: Neurosurgeons can have a better understanding of surgical procedures by comparing ultrasound images obtained at different phases of the tumor resection. However, establishing a direct mapping between subsequent acquisitions is challenging due to the anatomical changes happening during surgery. We propose here a method to improve the registration of ultrasound volumes, by excluding the resection cavity from the registration process. METHODS: The first step of our approach includes the automatic segmentation of the resection cavities in ultrasound volumes, acquired during and after resection. We used a convolution neural network inspired by the 3D U-Net. Then, subsequent ultrasound volumes are registered by excluding the contribution of resection cavity. RESULTS: Regarding the segmentation of the resection cavity, the proposed method achieved a mean DICE index of 0.84 on 27 volumes. Concerning the registration of the subsequent ultrasound acquisitions, we reduced the mTRE of the volumes acquired before and during resection from 3.49 to 1.22 mm. For the set of volumes acquired before and after removal, the mTRE improved from 3.55 to 1.21 mm. CONCLUSIONS: We proposed an innovative registration algorithm to compensate the brain shift affecting ultrasound volumes obtained at subsequent phases of neurosurgical procedures. To the best of our knowledge, our method is the first to exclude automatically segmented resection cavities in the registration of ultrasound volumes in neurosurgery.
For many patients with intracranial tumors, accurate surgical resection is a mainstay of their treatment paradigm. During surgical resection, image guidance is used to aid in localization and resection. Intraoperative brain shift can invalidate these guidance systems. One cause of intraoperative brain shift is cavity collapse due to tumor resection, which will be referred to as "debulking." We developed an imaging-driven finite element model of debulking to create a comprehensive simulation data set to reflect possible intraoperative changes. The objective was to create a method to account for brain shift due to debulking for applications in image-guided neurosurgery. We hypothesized that accounting for tumor debulking in a deformation atlas data framework would improve brain shift predictions, which would enhance image-based surgical guidance. This was evaluated in a six-patient intracranial tumor resection intraoperative data set. The brain shift deformation atlas data framework consisted of simulated deformations to account for effects due to gravity-induced and hyperosmotic drug-induced brain shift, which reflects previous developments. An additional complement of deformations involving simulated tumor growth followed by debulking was created to capture observed intraoperative effects not previously included. In five of six patient cases evaluated, inclusion of debulking mechanics improved brain shift correction by capturing global mass effects resulting from the resected tumor. These findings suggest imaging-driven brain shift models used to create a deformation simulation data framework of observed intraoperative events can be used to assist in more accurate image-guided surgical navigation in the brain.
PURPOSE: Brain shift during tumor resection can progressively invalidate the accuracy of neuronavigation systems and affect neurosurgeons' ability to achieve optimal resections. This paper compares two methods that have been presented in the literature to compensate for brain shift: a thin-plate spline deformation model and a finite element method (FEM). For this comparison, both methods are driven by identical sparse data. Specifically, both methods are driven by displacements between automatically detected and matched feature points from intraoperative 3D ultrasound (iUS). Both methods have been shown to be fast enough for intraoperative brain shift correction (Machado et al. in Int J Comput Assist Radiol Surg 13(10):1525-1538, 2018; Luo et al. in J Med Imaging (Bellingham) 4(3):035003, 2017). However, the spline method requires no preprocessing and ignores physical properties of the brain while the FEM method requires significant preprocessing and incorporates patient-specific physical and geometric constraints. The goal of this work was to explore the relative merits of these methods on recent clinical data. METHODS: Data acquired during 19 sequential tumor resections in Brigham and Women's Hospital's Advanced Multi-modal Image-Guided Operating Suite between December 2017 and October 2018 were considered for this retrospective study. Of these, 15 cases and a total of 24 iUS to iUS image pairs met inclusion requirements. Automatic feature detection (Machado et al. in Int J Comput Assist Radiol Surg 13(10):1525-1538, 2018) was used to detect and match features in each pair of iUS images. Displacements between matched features were then used to drive both the spline model and the FEM method to compensate for brain shift between image acquisitions. The accuracies of the resultant deformation models were measured by comparing the displacements of manually identified landmarks before and after deformation. RESULTS: The mean initial subcortical registration error between preoperative MRI and the first iUS image averaged 5.3 ± 0.75 mm. The mean subcortical brain shift, measured using displacements between manually identified landmarks in pairs of iUS images, was 2.5 ± 1.3 mm. Our results showed that FEM was able to reduce subcortical registration error by a small but statistically significant amount (from 2.46 to 2.02 mm). A large variability in the results of the spline method prevented us from demonstrating either a statistically significant reduction in subcortical registration error after applying the spline method or a statistically significant difference between the results of the two methods. CONCLUSIONS: In this study, we observed less subcortical brain shift than has previously been reported in the literature (Frisken et al., in: Miller (ed) Biomechanics of the brain, Springer, Cham, 2019). This may be due to the fact that we separated out the initial misregistration between preoperative MRI and the first iUS image from our brain shift measurements or it may be due to modern neurosurgical practices designed to reduce brain shift, including reduced craniotomy sizes and better control of intracranial pressure with the use of mannitol and other medications. It appears that the FEM method and its use of geometric and biomechanical constraints provided more consistent brain shift correction and better correction farther from the driving feature displacements than the simple spline model. The spline-based method was simpler and tended to give better results for small deformations. However, large variability in the spline results and relatively small brain shift prevented this study from demonstrating a statistically significant difference between the results of the two methods.
PURPOSE: In image-guided surgery for glioma removal, neurosurgeons usually plan the resection on images acquired before surgery and use them for guidance during the subsequent intervention. However, after the surgical procedure has begun, the preplanning images become unreliable due to the brain shift phenomenon, caused by modifications of anatomical structures and imprecisions in the neuronavigation system. To obtain an updated view of the resection cavity, a solution is to collect intraoperative data, which can be additionally acquired at different stages of the procedure in order to provide a better understanding of the resection. A spatial mapping between structures identified in subsequent acquisitions would be beneficial. We propose here a fully automated segmentation-based registration method to register ultrasound (US) volumes acquired at multiple stages of neurosurgery. METHODS: We chose to segment sulci and falx cerebri in US volumes, which remain visible during resection. To automatically segment these elements, first we trained a convolutional neural network on manually annotated structures in volumes acquired before the opening of the dura mater and then we applied it to segment corresponding structures in different surgical phases. Finally, the obtained masks are used to register US volumes acquired at multiple resection stages. RESULTS: Our method reduces the mean target registration error (mTRE) between volumes acquired before the opening of the dura mater and during resection from 3.49 mm (± 1.55 mm) to 1.36 mm (± 0.61 mm). Moreover, the mTRE between volumes acquired before opening the dura mater and at the end of the resection is reduced from 3.54 mm (± 1.75 mm) to 2.05 mm (± 1.12 mm). CONCLUSION: The segmented structures demonstrated to be good candidates to register US volumes acquired at different neurosurgical phases. Therefore, our solution can compensate brain shift in neurosurgical procedures involving intraoperative US data.
Brain shift during tumor resection compromises the spatial validity of registered preoperative imaging data that is critical to image-guided procedures. One current clinical solution to mitigate the effects is to reimage using intraoperative magnetic resonance (iMR) imaging. Although iMR has demonstrated benefits in accounting for preoperative-to-intraoperative tissue changes, its cost and encumbrance have limited its widespread adoption. While iMR will likely continue to be employed for challenging cases, a cost-effective model-based brain shift compensation strategy is desirable as a complementary technology for standard resections. We performed a retrospective study of [Formula: see text] tumor resection cases, comparing iMR measurements with intraoperative brain shift compensation predicted by our model-based strategy, driven by sparse intraoperative cortical surface data. For quantitative assessment, homologous subsurface targets near the tumors were selected on preoperative MR and iMR images. Once rigidly registered, intraoperative shift measurements were determined and subsequently compared to model-predicted counterparts as estimated by the brain shift correction framework. When considering moderate and high shift ([Formula: see text], [Formula: see text] measurements per case), the alignment error due to brain shift reduced from [Formula: see text] to [Formula: see text], representing [Formula: see text] correction. These first steps toward validation are promising for model-based strategies.
Neurosurgery makes use of preoperative imaging to visualize pathology, inform surgical planning, and evaluate the safety of selected approaches. The utility of preoperative imaging for neuronavigation, however, is diminished by the well-characterized phenomenon of brain shift, in which the brain deforms intraoperatively as a result of craniotomy, swelling, gravity, tumor resection, cerebrospinal fluid (CSF) drainage, and many other factors. As such, there is a need for updated intraoperative information that accurately reflects intraoperative conditions. Since 1982, intraoperative ultrasound has allowed neurosurgeons to craft and update operative plans without ionizing radiation exposure or major workflow interruption. Continued evolution of ultrasound technology since its introduction has resulted in superior imaging quality, smaller probes, and more seamless integration with neuronavigation systems. Furthermore, the introduction of related imaging modalities, such as 3-dimensional ultrasound, contrast-enhanced ultrasound, high-frequency ultrasound, and ultrasound elastography, has dramatically expanded the options available to the neurosurgeon intraoperatively. In the context of these advances, we review the current state, potential, and challenges of intraoperative ultrasound for brain tumor resection. We begin by evaluating these ultrasound technologies and their relative advantages and disadvantages. We then review three specific applications of these ultrasound technologies to brain tumor resection: (1) intraoperative navigation, (2) assessment of extent of resection, and (3) brain shift monitoring and compensation. We conclude by identifying opportunities for future directions in the development of ultrasound technologies.
Background To achieve maximal resection with minimal risk of postoperative neurologic morbidity, different neurosurgical adjuncts are being used during low-grade glioma (LGG) surgery. Objectives To investigate the effect of pre- and intraoperative adjuncts on the extent of resection (EOR) of hemispheric LGGs. Methods Medical records were reviewed to identify patients of any sex, ≥ 18 years of age, who underwent LGG surgery at X Hospital between January 2005 and July 2013. Patients were divided into eight subgroups based on the use of various combinations of a neuronavigation system alone (NN), functional MRI-diffusion tensor imaging (fMRI-DTI) guided neuronavigation (FD), intraoperative MRI (MR), and direct electrical stimulation (DES). Initial and residual tumors were measured, and mean EOR was compared between groups. Results Of all 128 patients, gross total resection was achieved in 23.4%. Overall mean EOR was 81.3% ± 20.5%. Using DES in combination with fMRI-DTI (mean EOR: 86.7% ± 12.4%) on eloquent tumors improved mean EOR significantly after adjustment for potential confounders when compared with NN alone (mean EOR: 76.4% ± 25.5%; p = 0.001). Conclusions Using DES in combination with fMRI and DTI significantly improves EOR when LGGs are located in eloquent areas compared with craniotomies in which only NN was used.
Meningiomas are the most frequent intracranial tumors. The majority is benign slow-growing tumors but they can be difficult to treat depending on their location and size. While meningiomas are well delineated on magnetic resonance imaging by their uptake of contrast, surgical limitations still present themselves from not knowing the extent of invasion of the dura matter by meningioma cells. The development of tools to characterize tumor tissue in real or near real time could prevent recurrence after tumor resection by allowing for more precise surgery, i.e. removal of tumor with preservation of healthy tissue. The development of ambient ionization mass spectrometry for molecular characterization of tissue and its implementation in the surgical decision-making workflow carry the potential to fulfill this need. Here, we present the characterization of meningioma and dura mater by desorption electrospray ionization mass spectrometry to validate the technique for the molecular assessment of surgical margins and diagnosis of meningioma from surgical tissue in real-time. Nine stereotactically resected surgical samples and three autopsy samples were analyzed by standard histopathology and mass spectrometry imaging. All samples indicated a strong correlation between results from both techniques. We then highlight the value of desorption electrospray ionization mass spectrometry for the molecular subtyping/subgrouping of meningiomas from a series of forty genetically characterized specimens. The minimal sample preparation required for desorption electrospray ionization mass spectrometry offers a distinct advantage for applications relying on real-time information such as surgical decision-making. The technology here was tested to distinguish meningioma from dura mater as an approach to precisely define surgical margins. In addition we classify meningiomas into fibroblastic and meningothelial subtypes and more notably recognize meningiomas with NF2 genetic aberrations.
Distinguishing tumor from normal glandular breast tissue is an important step in breast-conserving surgery. Because this distinction can be challenging in the operative setting, up to 40% of patients require an additional operation when traditional approaches are used. Here, we present a proof-of-concept study to determine the feasibility of using desorption electrospray ionization mass spectrometry imaging (DESI-MSI) for identifying and differentiating tumor from normal breast tissue. We show that tumor margins can be identified using the spatial distributions and varying intensities of different lipids. Several fatty acids, including oleic acid, were more abundant in the cancerous tissue than in normal tissues. The cancer margins delineated by the molecular images from DESI-MSI were consistent with those margins obtained from histological staining. Our findings prove the feasibility of classifying cancerous and normal breast tissues using ambient ionization MSI. The results suggest that an MS-based method could be developed for the rapid intraoperative detection of residual cancer tissue during breast-conserving surgery.
For many intraoperative decisions surgeons depend on frozen section pathology, a technique developed over 150 y ago. Technical innovations that permit rapid molecular characterization of tissue samples at the time of surgery are needed. Here, using desorption electrospray ionization (DESI) MS, we rapidly detect the tumor metabolite 2-hydroxyglutarate (2-HG) from tissue sections of surgically resected gliomas, under ambient conditions and without complex or time-consuming preparation. With DESI MS, we identify isocitrate dehydrogenase 1-mutant tumors with both high sensitivity and specificity within minutes, immediately providing critical diagnostic, prognostic, and predictive information. Imaging tissue sections with DESI MS shows that the 2-HG signal overlaps with areas of tumor and that 2-HG levels correlate with tumor content, thereby indicating tumor margins. Mapping the 2-HG signal onto 3D MRI reconstructions of tumors allows the integration of molecular and radiologic information for enhanced clinical decision making. We also validate the methodology and its deployment in the operating room: We have installed a mass spectrometer in our Advanced Multimodality Image Guided Operating (AMIGO) suite and demonstrate the molecular analysis of surgical tissue during brain surgery. This work indicates that metabolite-imaging MS could transform many aspects of surgical care.
The main goal of brain tumor surgery is to maximize tumor resection while preserving brain function. However, existing imaging and surgical techniques do not offer the molecular information needed to delineate tumor boundaries. We have developed a system to rapidly analyze and classify brain tumors based on lipid information acquired by desorption electrospray ionization mass spectrometry (DESI-MS). In this study, a classifier was built to discriminate gliomas and meningiomas based on 36 glioma and 19 meningioma samples. The classifier was tested and results were validated for intraoperative use by analyzing and diagnosing tissue sections from 32 surgical specimens obtained from five research subjects who underwent brain tumor resection. The samples analyzed included oligodendroglioma, astrocytoma, and meningioma tumors of different histological grades and tumor cell concentrations. The molecular diagnosis derived from mass-spectrometry imaging corresponded to histopathology diagnosis with very few exceptions. Our work demonstrates that DESI-MS technology has the potential to identify the histology type of brain tumors. It provides information on glioma grade and, most importantly, may help define tumor margins by measuring the tumor cell concentration in a specimen. Results for stereotactically registered samples were correlated to preoperative MRI through neuronavigation, and visualized over segmented 3D MRI tumor volume reconstruction. Our findings demonstrate the potential of ambient mass spectrometry to guide brain tumor surgery by providing rapid diagnosis, and tumor margin assessment in near-real time.
OBJECTIVE: The purpose of this article is to report the translational process of an implantable microdevice platform with an emphasis on the technical and engineering adaptations for patient use, regulatory advances, and successful integration into clinical workflow. METHODS: We developed design adaptations for implantation and retrieval, established ongoing monitoring and testing, and facilitated regulatory advances that enabled the administration and examination of a large set of cancer therapies simultaneously in individual patients. RESULTS: Six applications for oncology studies have successfully proceeded to patient trials, with future applications in progress. CONCLUSION: First-in-human translation required engineering design changes to enable implantation and retrieval that fit with existing clinical workflows, a regulatory strategy that enabled both delivery and response measurement of up to 20 agents in a single patient, and establishment of novel testing and quality control processes for a drug/device combination product without clear precedents. SIGNIFICANCE: This manuscript provides a real-world account and roadmap on how to advance from animal proof-of-concept into the clinic, confronting the question of how to use research to benefit patients.
Optimal resection of breast tumors requires removing cancer with a rim of normal tissue while preserving uninvolved regions of the breast. Surgical and pathological techniques that permit rapid molecular characterization of tissue could facilitate such resections. Mass spectrometry (MS) is increasingly used in the research setting to detect and classify tumors and has the potential to detect cancer at surgical margins. Here, we describe the ex vivo intraoperative clinical application of MS using a liquid micro-junction surface sample probe (LMJ-SSP) to assess breast cancer margins. In a midpoint analysis of a registered clinical trial, surgical specimens from 21 women with treatment naïve invasive breast cancer were prospectively collected and analyzed at the time of surgery with subsequent histopathological determination. Normal and tumor breast specimens from the lumpectomy resected by the surgeon were smeared onto glass slides for rapid analysis. Lipidomic profiles were acquired from these specimens using LMJ-SSP MS in negative ionization mode within the operating suite and post-surgery analysis of the data revealed five candidate ions separating tumor from healthy tissue in this limited dataset. More data is required before considering the ions as candidate markers. Here, we present an application of ambient MS within the operating room to analyze breast cancer tissue and surgical margins. Lessons learned from these initial promising studies are being used to further evaluate the five candidate biomarkers and to further refine and optimize intraoperative MS as a tool for surgical guidance in breast cancer.
Introduction: Neuronavigation greatly improves the surgeons ability to approach, assess and operate on brain tumors, but tends to lose its accuracy as the surgery progresses and substantial brain shift and deformation occurs. Intraoperative MRI (iMRI) can partially address this problem but is resource intensive and workflow disruptive. Intraoperative ultrasound (iUS) provides real-time information that can be used to update neuronavigation and provide real-time information regarding the resection progress. We describe the intraoperative use of 3D iUS in relation to iMRI, and discuss the challenges and opportunities in its use in neurosurgical practice. Methods: We performed a retrospective evaluation of patients who underwent image-guided brain tumor resection in which both 3D iUS and iMRI were used. The study was conducted between June 2020 and December 2020 when an extension of a commercially available navigation software was introduced in our practice enabling 3D iUS volumes to be reconstructed from tracked 2D iUS images. For each patient, three or more 3D iUS images were acquired during the procedure, and one iMRI was acquired towards the end. The iUS images included an extradural ultrasound sweep acquired before dural incision (iUS-1), a post-dural opening iUS (iUS-2), and a third iUS acquired immediately before the iMRI acquisition (iUS-3). iUS-1 and preoperative MRI were compared to evaluate the ability of iUS to visualize tumor boundaries and critical anatomic landmarks; iUS-3 and iMRI were compared to evaluate the ability of iUS for predicting residual tumor. Results: Twenty-three patients were included in this study. Fifteen patients had tumors located in eloquent or near eloquent brain regions, the majority of patients had low grade gliomas (11), gross total resection was achieved in 12 patients, postoperative temporary deficits were observed in five patients. In twenty-two iUS was able to define tumor location, tumor margins, and was able to indicate relevant landmarks for orientation and guidance. In sixteen cases, white matter fiber tracts computed from preoperative dMRI were overlaid on the iUS images. In nineteen patients, the EOR (GTR or STR) was predicted by iUS and confirmed by iMRI. The remaining four patients where iUS was not able to evaluate the presence or absence of residual tumor were recurrent cases with a previous surgical cavity that hindered good contact between the US probe and the brainsurface. Conclusion: This recent experience at our institution illustrates the practical benefits, challenges, and opportunities of 3D iUS in relation to iMRI.
OBJECTIVE: Accurate biopsy sampling of the suspected lesions is critical for the diagnosis and clinical management of prostate cancer. Transperineal in-bore MRI-guided prostate biopsy (tpMRgBx) is a targeted biopsy technique that was shown to be safe, efficient, and accurate. Our goal was to develop an open source software platform to support evaluation, refinement, and translation of this biopsy approach. METHODS: We developed SliceTracker, a 3D Slicer extension to support tpMRgBx. We followed modular design of the implementation to enable customization of the interface and interchange of image segmentation and registration components to assess their effect on the processing time, precision, and accuracy of the biopsy needle placement. The platform and supporting documentation were developed to enable the use of software by an operator with minimal technical training to facilitate translation. Retrospective evaluation studied registration accuracy, effect of the prostate segmentation approach, and re-identification time of biopsy targets. Prospective evaluation focused on the total procedure time and biopsy targeting error (BTE). RESULTS: Evaluation utilized data from 73 retrospective and ten prospective tpMRgBx cases. Mean landmark registration error for retrospective evaluation was 1.88 ± 2.63 mm, and was not sensitive to the approach used for prostate gland segmentation. Prospectively, we observed target re-identification time of 4.60 ± 2.40 min and BTE of 2.40 ± 0.98 mm. CONCLUSION: SliceTracker is modular and extensible open source platform for supporting image processing aspects of the tpMRgBx procedure. It has been successfully utilized to support clinical research procedures at our site.
Patient-mounted needle guide devices for percutaneous ablation are vulnerable to patient motion. The objective of this study is to develop and evaluate a software system for an MRI-compatible patient-mounted needle guide device that can adaptively compensate for displacement of the device due to patient motion using a novel image-based automatic device-to-image registration technique. We have developed a software system for an MRI-compatible patient-mounted needle guide device for percutaneous ablation. It features fully-automated image-based device-to-image registration to track the device position, and a device controller to adjust the needle trajectory to compensate for the displacement of the device. We performed: (a) a phantom study using a clinical MR scanner to evaluate registration performance; (b) simulations using intraoperative time-series MR data acquired in 20 clinical cases of MRI-guided renal cryoablations to assess its impact on motion compensation; and (c) a pilot clinical study in three patients to test its feasibility during the clinical procedure. FRE, TRE, and success rate of device-to-image registration were [Formula: see text] mm, [Formula: see text] mm, and 98.3% for the phantom images. The simulation study showed that the motion compensation reduced the targeting error for needle placement from 8.2 mm to 5.4 mm (p < 0.0005) in patients under general anesthesia (GA), and from 14.4 mm to 10.0 mm ([Formula: see text]) in patients under monitored anesthesia care (MAC). The pilot study showed that the software registered the device successfully in a clinical setting. Our simulation study demonstrated that the software system could significantly improve targeting accuracy in patients treated under both MAC and GA. Intraprocedural image-based device-to-image registration was feasible.