Robust and semantic needle detection in 3D ultrasound using orthogonal-plane convolutional neural networks.

Abstract:

PURPOSE:During needle interventions, successful automated detection of the needle immediately after insertion is necessary to allow the physician identify and correct any misalignment of the needle and the target at early stages, which reduces needle passes and improves health outcomes. METHODS:We present a novel approach to localize partially inserted needles in 3D ultrasound volume with high precision using convolutional neural networks. We propose two methods based on patch classification and semantic segmentation of the needle from orthogonal 2D cross-sections extracted from the volume. For patch classification, each voxel is classified from locally extracted raw data of three orthogonal planes centered on it. We propose a bootstrap resampling approach to enhance the training in our highly imbalanced data. For semantic segmentation, parts of a needle are detected in cross-sections perpendicular to the lateral and elevational axes. We propose to exploit the structural information in the data with a novel thick-slice processing approach for efficient modeling of the context. RESULTS:Our introduced methods successfully detect 17 and 22 G needles with a single trained network, showing a robust generalized approach. Extensive ex-vivo evaluations on datasets of chicken breast and porcine leg show 80 and 84% F1-scores, respectively. Furthermore, very short needles are detected with tip localization errors of less than 0.7 mm for lengths of only 5 and 10 mm at 0.2 and 0.36 mm voxel sizes, respectively. CONCLUSION:Our method is able to accurately detect even very short needles, ensuring that the needle and its tip are maximally visible in the visualized plane during the entire intervention, thereby eliminating the need for advanced bi-manual coordination of the needle and transducer.

authors

Pourtaherian A,Ghazvinian Zanjani F,Zinger S,Mihajlovic N,Ng GC,Korsten HHM,de With PHN

doi

10.1007/s11548-018-1798-3

subject

Has Abstract

pub_date

2018-09-01 00:00:00

pages

1321-1333

issue

9

eissn

1861-6410

issn

1861-6429

pii

10.1007/s11548-018-1798-3

journal_volume

13

pub_type

杂志文章
  • Planning and simulation of microsurgical laser bone ablation.

    abstract:PURPOSE:Laser ablation of hard tissue is not completely understood until now and not modeled for computer-assisted microsurgery. A precise planning and simulation is an essential step toward the usage of microsurgical laser bone ablation in the operating room. METHODS:Planning the volume for laser bone ablation is bas...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-009-0303-4

    authors: Kahrs LA,Burgner J,Klenzner T,Raczkowsky J,Schipper J,Wörn H

    更新日期:2010-03-01 00:00:00

  • Analysis of the micro-migration of sliding hip screws by using point-based registration.

    abstract:PURPOSE:The favored treatment for many hip fractures is a sliding hip screw, and its usage is expected to increase in the future. Failures can be reduced, and complications detected earlier by semi-automated CT image analysis. The most frequent failure is due to the screw cut-out from the femoral head. METHODS:An imag...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-010-0498-4

    authors: Raudaschl P,Fritscher K,Roth T,Kammerlander C,Schubert R

    更新日期:2010-09-01 00:00:00

  • Automated identification and reduction of artifacts in cine four-dimensional computed tomography (4DCT) images using respiratory motion model.

    abstract:PURPOSE:Four-dimensional computed tomography (4DCT) images are often marred by artifacts that substantially degrade image quality and confound image interpretation. Human observation remains the standard method of 4DCT artifact evaluation, which is time-consuming and subjective. We develop a method to automatically ide...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-017-1538-0

    authors: Li M,Castillo SJ,Castillo R,Castillo E,Guerrero T,Xiao L,Zheng X

    更新日期:2017-09-01 00:00:00

  • FCNN-based axon segmentation for convection-enhanced delivery optimization.

    abstract:PURPOSE:Glioblastoma multiforme treatment is a challenging task in clinical oncology. Convection- enhanced delivery (CED) is showing encouraging but still suboptimal results due to drug leakages. Numerical models can predict drug distribution within the brain, but require retrieving brain physical properties, such as t...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-018-01911-z

    authors: Vidotto M,De Momi E,Gazzara M,Mattos LS,Ferrigno G,Moccia S

    更新日期:2019-03-01 00:00:00

  • Fusion of 3D real-time echocardiography and cine MRI using a saliency analysis.

    abstract:PURPOSE:This paper presents a novel 3D multimodal registration strategy to fuse 3D real-time echocardiography images with cardiac cine MRI images. This alignment is performed in a saliency space, which is designed to maximize similarity between the two imaging modalities. This fusion improves the quality of the availab...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-019-02087-w

    authors: Atehortúa A,Garreau M,Simon A,Donal E,Lederlin M,Romero E

    更新日期:2020-02-01 00:00:00

  • On-patient see-through augmented reality based on visual SLAM.

    abstract:PURPOSE:An augmented reality system to visualize a 3D preoperative anatomical model on intra-operative patient is proposed. The hardware requirement is commercial tablet-PC equipped with a camera. Thus, no external tracking device nor artificial landmarks on the patient are required. METHODS:We resort to visual SLAM t...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-016-1444-x

    authors: Mahmoud N,Grasa ÓG,Nicolau SA,Doignon C,Soler L,Marescaux J,Montiel JM

    更新日期:2017-01-01 00:00:00

  • A preregistered STAMP method for image-guided temporal bone surgery.

    abstract:OBJECTIVES:Image-guided otological surgeries require minimal invasiveness and high accuracy, and these two factors usually compete with each other. Our recently developed registration method, called the STAMP method, showed minimal invasiveness with accuracy comparable to that of the current more invasive registration ...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-013-0916-5

    authors: Oka M,Cho B,Matsumoto N,Hong J,Jinnouchi M,Ouchida R,Komune S,Hashizume M

    更新日期:2014-01-01 00:00:00

  • Temporal enhancement of 2D color Doppler echocardiography sequences by fragment-based frame reordering and refinement.

    abstract:PURPOSE:The goal of this study was to develop an algorithm that enhances the temporal resolution of two-dimensional color Doppler echocardiography (2D CDE) by reordering all the acquired frames and filtering out the frames corrupted by out-of-plane motion and arrhythmia. METHODS:The algorithm splits original frame seq...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-019-01926-0

    authors: Terentjev AB,Perrin DP,Settlemier SH,Zurakowski D,Smirnov PO,Del Nido PJ,Shturts IV,Vasilyev NV

    更新日期:2019-04-01 00:00:00

  • Patch-based classification of gallbladder wall vascularity from laparoscopic images using deep learning.

    abstract:PURPOSE:In this study, we propose a deep learning approach for assessment of gallbladder (GB) wall vascularity from images of laparoscopic cholecystectomy (LC). Difficulty in the visualization of GB wall vessels may be the result of fatty infiltration or increased thickening of the GB wall, potentially as a result of c...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-020-02285-x

    authors: Loukas C,Frountzas M,Schizas D

    更新日期:2021-01-01 00:00:00

  • Endoscopic scene labelling and augmentation using intraoperative pulsatile motion and colour appearance cues with preoperative anatomical priors.

    abstract:PURPOSE:Despite great advances in medical image segmentation, the accurate and automatic segmentation of endoscopic scenes remains a challenging problem. Two important aspects have to be considered in segmenting an endoscopic scene: (1) noise and clutter due to light reflection and smoke from cutting tissue, and (2) st...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-015-1331-x

    authors: Nosrati MS,Amir-Khalili A,Peyrat JM,Abinahed J,Al-Alao O,Al-Ansari A,Abugharbieh R,Hamarneh G

    更新日期:2016-08-01 00:00:00

  • Contour propagation using non-uniform cubic B-splines for lung tumor delineation in 4D-CT.

    abstract:PURPOSE:Accurate target delineation is a critical step in radiotherapy. In this study, a robust contour propagation method is proposed to help physicians delineate lung tumors in four-dimensional computer tomography (4D-CT) images efficiently and accurately. METHODS:The proposed method starts with manually delineated ...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-016-1457-5

    authors: Liu Y,Jin R,Chen M,Song E,Xu X,Zhang S,Hung CC

    更新日期:2016-12-01 00:00:00

  • Gain determination of feedback force for an ultrasound scanning robot using genetic algorithm.

    abstract:PURPOSE:The remote medical diagnosis system (RMDS) is for providing medical diagnosis to the patients located in remote sites. To apply to RMDS and medical automation, many master-slave type ultrasound scanning robots are being developed and researched. One of the important research issue of the master-slave type ultra...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-019-01915-3

    authors: Kim YJ,Park CK,Kim KG

    更新日期:2019-05-01 00:00:00

  • A deep learning framework for efficient analysis of breast volume and fibroglandular tissue using MR data with strong artifacts.

    abstract:PURPOSE:The main purpose of this work is to develop, apply, and evaluate an efficient approach for breast density estimation in magnetic resonance imaging data, which contain strong artifacts including intensity inhomogeneities. METHODS:We present a pipeline for breast density estimation, which consists of intensity i...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-019-01928-y

    authors: Ivanovska T,Jentschke TG,Daboul A,Hegenscheid K,Völzke H,Wörgötter F

    更新日期:2019-10-01 00:00:00

  • A vision-based system for fast and accurate laser scanning in robot-assisted phonomicrosurgery.

    abstract:PURPOSE:Surgical quality in phonomicrosurgery can be improved by open-loop laser control (e.g., high-speed scanning capabilities) with a robust and accurate closed-loop visual servoing systems. A new vision-based system for laser scanning control during robot-assisted phonomicrosurgery was developed and tested. METHOD...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-014-1078-9

    authors: Dagnino G,Mattos LS,Caldwell DG

    更新日期:2015-02-01 00:00:00

  • The effect of CyberDome, a novel 3-dimensional dome-shaped display system, on laparoscopic procedures.

    abstract:BACKGROUND:Laparoscopic surgeons require extended experience of cases to overcome the lack of depth perception on a two-dimensional (2D) display. Although a three-dimensional (3D) display was reported to be useful over two decades ago, 3D systems have not been widely used. Recently, we developed a novel 3D dome-shaped ...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-009-0282-5

    authors: Ohuchida K,Kenmotsu H,Yamamoto A,Sawada K,Hayami T,Morooka K,Hoshino H,Uemura M,Konishi K,Yoshida D,Maeda T,Ieiri S,Tanoue K,Tanaka M,Hashizume M

    更新日期:2009-03-01 00:00:00

  • Predicting underestimation of ductal carcinoma in situ: a comparison between radiomics and conventional approaches.

    abstract:PURPOSE:We aimed to investigate the feasibility of predicting invasion carcinoma from ductal carcinoma in situ (DCIS) lesions diagnosed by preoperative core needle biopsy using radiomics signatures, clinical imaging characteristics, and breast imaging reporting and data system (BI-RADS) descriptors on mammography. MET...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-018-1900-x

    authors: Li J,Song Y,Xu S,Wang J,Huang H,Ma W,Jiang X,Wu Y,Cai H,Li L

    更新日期:2019-04-01 00:00:00

  • Computational modeling of abdominal hernia laparoscopic repair with a surgical mesh.

    abstract:PURPOSE:Although new techniques and prostheses have been introduced in ventral hernia surgery, abdominal hernia repair still presents complications, such as recurrence, pain, and discomfort. Thus, this work implements a computational method aimed at evaluating biomechanical aspects of the abdominal hernia laparoscopic ...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-017-1681-7

    authors: Todros S,Pachera P,Baldan N,Pavan PG,Pianigiani S,Merigliano S,Natali AN

    更新日期:2018-01-01 00:00:00

  • Video-based computer navigation in knee arthroscopy for patient-specific ACL reconstruction.

    abstract:PURPOSE:The anterior cruciate ligament tear is a common medical condition that is treated using arthroscopy by pulling a tissue graft through a tunnel opened with a drill. The correct anatomical position and orientation of this tunnel are crucial for knee stability, and drilling an adequate bone tunnel is the most tech...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-019-02021-0

    authors: Raposo C,Barreto JP,Sousa C,Ribeiro L,Melo R,Oliveira JP,Marques P,Fonseca F,Barrett D

    更新日期:2019-09-01 00:00:00

  • Knee arthroscopic navigation using virtual-vision rendering and self-positioning technology.

    abstract:PURPOSE:Knee arthroscopy suffers from a lack of depth information and easy occlusion of the visual field. To solve these limitations, we propose an arthroscopic navigation system based on self-positioning technology, with the guidance of virtual-vision views. This system can work without any external tracking devices o...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-019-02099-6

    authors: Ma C,Cui X,Chen F,Ma L,Xin S,Liao H

    更新日期:2020-03-01 00:00:00

  • Segmentation-based registration of ultrasound volumes for glioma resection in image-guided neurosurgery.

    abstract:PURPOSE:In image-guided surgery for glioma removal, neurosurgeons usually plan the resection on images acquired before surgery and use them for guidance during the subsequent intervention. However, after the surgical procedure has begun, the preplanning images become unreliable due to the brain shift phenomenon, caused...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-019-02045-6

    authors: Canalini L,Klein J,Miller D,Kikinis R

    更新日期:2019-10-01 00:00:00

  • Computer-aided cephalometric landmark annotation for CBCT data.

    abstract:PURPOSE:Nowadays, with the increased diffusion of Cone Beam Computerized Tomography (CBCT) scanners in dental and maxillo-facial practice, 3D cephalometric analysis is emerging. Maxillofacial surgeons and dentists make wide use of cephalometric analysis in diagnosis, surgery and treatment planning. Accuracy and repeata...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-016-1453-9

    authors: Codari M,Caffini M,Tartaglia GM,Sforza C,Baselli G

    更新日期:2017-01-01 00:00:00

  • MINARO HD: control and evaluation of a handheld, highly dynamic surgical robot.

    abstract:PURPOSE:Current surgical robotic systems are either large serial arms, resulting in higher risks due to their high inertia and no inherent limitations of the working space, or they are bone-mounted, adding substantial additional task steps to the surgical workflow. The robot presented in this paper has a handy and ligh...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-020-02306-9

    authors: Vossel M,Müller M,Niesche A,Theisgen L,Radermacher K,de la Fuente M

    更新日期:2021-01-23 00:00:00

  • Toward a standard ontology of surgical process models.

    abstract:PURPOSE:The development of common ontologies has recently been identified as one of the key challenges in the emerging field of surgical data science (SDS). However, past and existing initiatives in the domain of surgery have mainly been focussing on individual groups and failed to achieve widespread international acce...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-018-1824-5

    authors: Gibaud B,Forestier G,Feldmann C,Ferrigno G,Gonçalves P,Haidegger T,Julliard C,Katić D,Kenngott H,Maier-Hein L,März K,de Momi E,Nagy DÁ,Nakawala H,Neumann J,Neumuth T,Rojas Balderrama J,Speidel S,Wagner M,Jannin P

    更新日期:2018-09-01 00:00:00

  • Automatic phase prediction from low-level surgical activities.

    abstract:PURPOSE:Analyzing surgical activities has received a growing interest in recent years. Several methods have been proposed to identify surgical activities and surgical phases from data acquired in operating rooms. These context-aware systems have multiple applications including: supporting the surgical team during the i...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-015-1195-0

    authors: Forestier G,Riffaud L,Jannin P

    更新日期:2015-06-01 00:00:00

  • Dual-robot ultrasound-guided needle placement: closing the planning-imaging-action loop.

    abstract:PURPOSE:Precise needle placement is an important task during several medical procedures. Ultrasound imaging is often used to guide the needle toward the target region in soft tissue. This task remains challenging due to the user's dependence on image quality, limited field of view, moving target, and moving needle. In ...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-016-1408-1

    authors: Kojcev R,Fuerst B,Zettinig O,Fotouhi J,Lee SC,Frisch B,Taylor R,Sinibaldi E,Navab N

    更新日期:2016-06-01 00:00:00

  • Myocardium tracking via matching distributions.

    abstract:OBJECTIVE:The goal of this study is to investigate automatic myocardium tracking in cardiac Magnetic Resonance (MR) sequences using global distribution matching via level-set curve evolution. Rather than relying on the pixelwise information as in existing approaches, distribution matching compares intensity distributio...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-008-0265-y

    authors: Ben Ayed I,Li S,Ross I,Islam A

    更新日期:2009-01-01 00:00:00

  • Preliminary study on magnetic tracking-based planar shape sensing and navigation for flexible surgical robots in transoral surgery: methods and phantom experiments.

    abstract:PURPOSE:Flexible surgical robot can work in confined and complex environments, which makes it a good option for minimally invasive surgery. In order to utilize flexible manipulators in complicated and constrained surgical environments, it is of great significance to monitor the position and shape of the curvilinear man...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-017-1672-8

    authors: Song S,Zhang C,Liu L,Meng MQ

    更新日期:2018-02-01 00:00:00

  • Fast, robust, and accurate monocular peer-to-peer tracking for surgical navigation.

    abstract:PURPOSE:This work presents a new monocular peer-to-peer tracking concept overcoming the distinction between tracking tools and tracked tools for optical navigation systems. A marker model concept based on marker triplets combined with a fast and robust algorithm for assigning image feature points to the corresponding m...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-019-02111-z

    authors: Strzeletz S,Hazubski S,Moctezuma JL,Hoppe H

    更新日期:2020-03-01 00:00:00

  • Brain tumor detection and segmentation in a CRF (conditional random fields) framework with pixel-pairwise affinity and superpixel-level features.

    abstract:PURPOSE:Detection and segmentation of a brain tumor such as glioblastoma multiforme (GBM) in magnetic resonance (MR) images are often challenging due to its intrinsically heterogeneous signal characteristics. A robust segmentation method for brain tumor MRI scans was developed and tested. METHODS:Simple thresholds and...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-013-0922-7

    authors: Wu W,Chen AY,Zhao L,Corso JJ

    更新日期:2014-03-01 00:00:00

  • MIDG-Emerging grid technologies for multi-site preclinical molecular imaging research communities.

    abstract:PURPOSE:Molecular imaging is the visualization and identification of specific molecules in anatomy for insight into metabolic pathways, tissue consistency, and tracing of solute transport mechanisms. This paper presents the Molecular Imaging Data Grid (MIDG) which utilizes emerging grid technologies in preclinical mole...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-010-0524-6

    authors: Lee J,Documet J,Liu B,Park R,Tank A,Huang HK

    更新日期:2011-03-01 00:00:00