Automatic needle tracking using Mask R-CNN for MRI-guided percutaneous interventions.

Abstract:

PURPOSE:Accurate needle tracking provides essential information for MRI-guided percutaneous interventions. Passive needle tracking using MR images is challenged by variations of the needle-induced signal void feature in different situations. This work aimed to develop an automatic needle tracking algorithm for MRI-guided interventions based on the Mask Region Proposal-Based Convolutional Neural Network (R-CNN). METHODS:Mask R-CNN was adapted and trained to segment the needle feature using 250 intra-procedural images from 85 MRI-guided prostate biopsy cases and 180 real-time images from MRI-guided needle insertion in ex vivo tissue. The segmentation masks were passed into the needle feature localization algorithm to extract the needle feature tip location and axis orientation. The proposed algorithm was tested using 208 intra-procedural images from 40 MRI-guided prostate biopsy cases, and 3 real-time MRI datasets in ex vivo tissue. The algorithm results were compared with human-annotated references. RESULTS:In prostate datasets, the proposed algorithm achieved needle feature tip localization error with median Euclidean distance (dxy) of 0.71 mm and median difference in axis orientation angle (dθ) of 1.28°, respectively. In 3 real-time MRI datasets, the proposed algorithm achieved consistent dynamic needle feature tracking performance with processing time of 75 ms/image: (a) median dxy = 0.90 mm, median dθ = 1.53°; (b) median dxy = 1.31 mm, median dθ = 1.9°; (c) median dxy = 1.09 mm, median dθ = 0.91°. CONCLUSIONS:The proposed algorithm using Mask R-CNN can accurately track the needle feature tip and axis on MR images from in vivo intra-procedural prostate biopsy cases and ex vivo real-time MRI experiments with a range of different conditions. The algorithm achieved pixel-level tracking accuracy in real time and has potential to assist MRI-guided percutaneous interventions.

authors

Li X,Young AS,Raman SS,Lu DS,Lee YH,Tsao TC,Wu HH

doi

10.1007/s11548-020-02226-8

subject

Has Abstract

pub_date

2020-10-01 00:00:00

pages

1673-1684

issue

10

eissn

1861-6410

issn

1861-6429

pii

10.1007/s11548-020-02226-8

journal_volume

15

pub_type

杂志文章
  • Average sound speed estimation using speckle analysis of medical ultrasound data.

    abstract:PURPOSE:Most ultrasound imaging systems assume a pre-determined sound propagation speed for imaging. However, a mismatch between assumed and real sound speeds can lead to spatial shift and defocus of ultrasound image, which may limit the applicability of ultrasound imaging. The estimation of real sound speed is importa...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-012-0690-9

    authors: Qu X,Azuma T,Liang JT,Nakajima Y

    更新日期:2012-11-01 00:00:00

  • Temporal enhancement of 2D color Doppler echocardiography sequences by fragment-based frame reordering and refinement.

    abstract:PURPOSE:The goal of this study was to develop an algorithm that enhances the temporal resolution of two-dimensional color Doppler echocardiography (2D CDE) by reordering all the acquired frames and filtering out the frames corrupted by out-of-plane motion and arrhythmia. METHODS:The algorithm splits original frame seq...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-019-01926-0

    authors: Terentjev AB,Perrin DP,Settlemier SH,Zurakowski D,Smirnov PO,Del Nido PJ,Shturts IV,Vasilyev NV

    更新日期:2019-04-01 00:00:00

  • Suspension laryngoscopy using a curved-frame trans-oral robotic system.

    abstract:PURPOSE:Suspension laryngoscopy has been employed for laryngeal diseases such as treatment for a polyp, cystoma, or granuloma. After securing a straight path with a laryngoscope, the surgeon inserts rigid instruments and examines the target lesion by using a microscope. However, many patients suffer from secondary comp...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-013-0944-1

    authors: Kwon YS,Tae K,Yi BJ

    更新日期:2014-07-01 00:00:00

  • Comparing calibration approaches for 3D ultrasound probes.

    abstract:OBJECTIVE:By adding a tracking sensor to a 3D ultrasound (US) probe and thus locating the probe in space, new applications within the fields of image guided surgery and radiation therapy are possible. To locate the US volume in space, a calibration is necessary to determine the mathematical transformation for mapping p...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-008-0258-x

    authors: Bergmeir C,Seitel M,Frank C,De Simone R,Meinzer HP,Wolf I

    更新日期:2009-03-01 00:00:00

  • Altered brain anatomical networks and disturbed connection density in brain tumor patients revealed by diffusion tensor tractography.

    abstract:PURPOSE:Brain tumor patients are usually accompanied by impairments in cognitive functions, and these dysfunctions arise from the altered diffusion tensor of water molecules and disrupted neuronal conduction in white matter. Diffusion tensor imaging (DTI) is a powerful noninvasive imaging technique that can reflect dif...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-015-1330-y

    authors: Yu Z,Tao L,Qian Z,Wu J,Liu H,Yu Y,Song J,Wang S,Sun J

    更新日期:2016-11-01 00:00:00

  • Temporal bone borehole accuracy for cochlear implantation influenced by drilling strategy: an in vitro study.

    abstract:PURPOSE:Minimally invasive cochlear implantation is a surgical technique which requires drilling a canal from the mastoid surface toward the basal turn of the cochlea. The choice of an appropriate drilling strategy is hypothesized to have significant influence on the achievable targeting accuracy. Therefore, a method i...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-014-0997-9

    authors: Kobler JP,Schoppe M,Lexow GJ,Rau TS,Majdani O,Kahrs LA,Ortmaier T

    更新日期:2014-11-01 00:00:00

  • A gesture-controlled projection display for CT-guided interventions.

    abstract:PURPOSE:The interaction with interventional imaging systems within a sterile environment is a challenging task for physicians. Direct physician-machine interaction during an intervention is rather limited because of sterility and workspace restrictions. METHODS:We present a gesture-controlled projection display that e...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-015-1215-0

    authors: Mewes A,Saalfeld P,Riabikin O,Skalej M,Hansen C

    更新日期:2016-01-01 00:00:00

  • Shot boundary detection in endoscopic surgery videos using a variational Bayesian framework.

    abstract:PURPOSE:Over the last decade, the demand for content management of video recordings of surgical procedures has greatly increased. Although a few research methods have been published toward this direction, the related literature is still in its infancy. In this paper, we address the problem of shot detection in endoscop...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-016-1431-2

    authors: Loukas C,Nikiteas N,Schizas D,Georgiou E

    更新日期:2016-11-01 00:00:00

  • System events: readily accessible features for surgical phase detection.

    abstract:PURPOSE:Surgical phase recognition using sensor data is challenging due to high variation in patient anatomy and surgeon-specific operating styles. Segmenting surgical procedures into constituent phases is of significant utility for resident training, education, self-review, and context-aware operating room technologie...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-016-1409-0

    authors: Malpani A,Lea C,Chen CC,Hager GD

    更新日期:2016-06-01 00:00:00

  • Robust calculation of the midsagittal plane in CT scans using the Kullback-Leibler's measure.

    abstract:OBJECTIVE:The identification of the interhemispheric fissure (IF) is important in clinical applications for brain landmark identification, registration, symmetry assessment, and pathology detection. The IF is usually approximated by the midsagittal plane (MSP) separating the brain into two hemispheres. We present a fas...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-009-0366-2

    authors: Puspitasari F,Volkau I,Ambrosius W,Nowinski WL

    更新日期:2009-11-01 00:00:00

  • The effect of CyberDome, a novel 3-dimensional dome-shaped display system, on laparoscopic procedures.

    abstract:BACKGROUND:Laparoscopic surgeons require extended experience of cases to overcome the lack of depth perception on a two-dimensional (2D) display. Although a three-dimensional (3D) display was reported to be useful over two decades ago, 3D systems have not been widely used. Recently, we developed a novel 3D dome-shaped ...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-009-0282-5

    authors: Ohuchida K,Kenmotsu H,Yamamoto A,Sawada K,Hayami T,Morooka K,Hoshino H,Uemura M,Konishi K,Yoshida D,Maeda T,Ieiri S,Tanoue K,Tanaka M,Hashizume M

    更新日期:2009-03-01 00:00:00

  • Data-driven spatio-temporal RGBD feature encoding for action recognition in operating rooms.

    abstract:PURPOSE:Context-aware systems for the operating room (OR) provide the possibility to significantly improve surgical workflow through various applications such as efficient OR scheduling, context-sensitive user interfaces, and automatic transcription of medical procedures. Being an essential element of such a system, su...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-015-1186-1

    authors: Twinanda AP,Alkan EO,Gangi A,de Mathelin M,Padoy N

    更新日期:2015-06-01 00:00:00

  • Automated objective surgical skill assessment in the operating room from unstructured tool motion in septoplasty.

    abstract:PURPOSE:Previous work on surgical skill assessment using intraoperative tool motion has focused on highly structured surgical tasks such as cholecystectomy and used generic motion metrics such as time and number of movements. Other statistical methods such as hidden Markov models (HMM) and descriptive curve coding (DCC...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-015-1194-1

    authors: Ahmidi N,Poddar P,Jones JD,Vedula SS,Ishii L,Hager GD,Ishii M

    更新日期:2015-06-01 00:00:00

  • On-patient see-through augmented reality based on visual SLAM.

    abstract:PURPOSE:An augmented reality system to visualize a 3D preoperative anatomical model on intra-operative patient is proposed. The hardware requirement is commercial tablet-PC equipped with a camera. Thus, no external tracking device nor artificial landmarks on the patient are required. METHODS:We resort to visual SLAM t...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-016-1444-x

    authors: Mahmoud N,Grasa ÓG,Nicolau SA,Doignon C,Soler L,Marescaux J,Montiel JM

    更新日期:2017-01-01 00:00:00

  • A technique for semiautomatic segmentation of echogenic structures in 3D ultrasound, applied to infant hip dysplasia.

    abstract:PURPOSE:Automatic segmentation of anatomical structures and lesions from medical ultrasound images is a formidable challenge in medical imaging due to image noise, blur and artifacts. In this paper we present a segmentation technique with features highly suited to use in noisy 3D ultrasound volumes and demonstrate its ...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-015-1239-5

    authors: Hareendranathan AR,Mabee M,Punithakumar K,Noga M,Jaremko JL

    更新日期:2016-01-01 00:00:00

  • Detection and modelling of contacts in explicit finite-element simulation of soft tissue biomechanics.

    abstract:PURPOSE:Realistic modelling of soft tissue biomechanics and mechanical interactions between tissues is an important part of biomechanically-informed surgical image-guidance and surgical simulation. This submission details a contact-modelling pipeline suitable for implementation in explicit matrix-free FEM solvers. Whil...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-014-1142-5

    authors: Johnsen SF,Taylor ZA,Han L,Hu Y,Clarkson MJ,Hawkes DJ,Ourselin S

    更新日期:2015-11-01 00:00:00

  • Robust GPU-based virtual reality simulation of radio-frequency ablations for various needle geometries and locations.

    abstract:PURPOSE:Radio-frequency ablations play an important role in the therapy of malignant liver lesions. The navigation of a needle to the lesion poses a challenge for both the trainees and intervening physicians. METHODS:This publication presents a new GPU-based, accurate method for the simulation of radio-frequency ablat...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-019-02033-w

    authors: Kath N,Handels H,Mastmeyer A

    更新日期:2019-11-01 00:00:00

  • Ultrasound imaging method for internal jugular vein measurement and estimation of circulating blood volume.

    abstract:PURPOSE:Evaluation of circulating blood volume is important in assessing the status of patients. Although some studies have suggested that ultrasound images of the internal jugular vein (IJV) can be used for the analysis of circulating blood volume, accurate extraction of IJV is necessary to reduce errors. Therefore, t...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-013-0921-8

    authors: Qian K,Ando T,Nakamura K,Liao H,Kobayashi E,Yahagi N,Sakuma I

    更新日期:2014-03-01 00:00:00

  • GRAPE: a graphical pipeline environment for image analysis in adaptive magnetic resonance imaging.

    abstract:PURPOSE:We present a platform, GRAphical Pipeline Environment (GRAPE), to facilitate the development of patient-adaptive magnetic resonance imaging (MRI) protocols. METHODS:GRAPE is an open-source project implemented in the Qt C++ framework to enable graphical creation, execution, and debugging of real-time image anal...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-016-1495-z

    authors: Gabr RE,Tefera GB,Allen WJ,Pednekar AS,Narayana PA

    更新日期:2017-03-01 00:00:00

  • Force estimation from OCT volumes using 3D CNNs.

    abstract:PURPOSE:Estimating the interaction forces of instruments and tissue is of interest, particularly to provide haptic feedback during robot-assisted minimally invasive interventions. Different approaches based on external and integrated force sensors have been proposed. These are hampered by friction, sensor size, and ste...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-018-1777-8

    authors: Gessert N,Beringhoff J,Otte C,Schlaefer A

    更新日期:2018-07-01 00:00:00

  • Automated aorta segmentation in low-dose chest CT images.

    abstract:PURPOSE:Abnormalities of aortic surface and aortic diameter can be related to cardiovascular disease and aortic aneurysm. Computer-based aortic segmentation and measurement may aid physicians in related disease diagnosis. This paper presents a fully automated algorithm for aorta segmentation in low-dose non-contrast CT...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-013-0924-5

    authors: Xie Y,Padgett J,Biancardi AM,Reeves AP

    更新日期:2014-03-01 00:00:00

  • A pre-operative planning framework for global registration of laparoscopic ultrasound to CT images.

    abstract:PURPOSE:Laparoscopic ultrasound (LUS) enhances the safety of laparoscopic liver resection by enabling real-time imaging of internal structures such as vessels. However, LUS probes can be difficult to use, and many tumours are iso-echoic and hence are not visible. Registration of LUS to a pre-operative CT or MR scan has...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-018-1799-2

    authors: Ramalhinho J,Robu MR,Thompson S,Gurusamy K,Davidson B,Hawkes D,Barratt D,Clarkson MJ

    更新日期:2018-08-01 00:00:00

  • Precise 3D/2D calibration between a RGB-D sensor and a C-arm fluoroscope.

    abstract:PURPOSE:Calibration and registration are the first steps for augmented reality and mixed reality applications. In the medical field, the calibration between an RGB-D camera and a C-arm fluoroscope is a new topic which introduces challenges. METHOD:A convenient and efficient calibration phantom is designed by combining...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-015-1347-2

    authors: Wang X,Habert S,Ma M,Huang CH,Fallavollita P,Navab N

    更新日期:2016-08-01 00:00:00

  • Automatic abdominal multi-organ segmentation using deep convolutional neural network and time-implicit level sets.

    abstract:PURPOSE:Multi-organ segmentation from CT images is an essential step for computer-aided diagnosis and surgery planning. However, manual delineation of the organs by radiologists is tedious, time-consuming and poorly reproducible. Therefore, we propose a fully automatic method for the segmentation of multiple organs fro...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-016-1501-5

    authors: Hu P,Wu F,Peng J,Bao Y,Chen F,Kong D

    更新日期:2017-03-01 00:00:00

  • Correction to: Automated measurement of bone scan index from a whole-body bone scintigram.

    abstract::The article Automated measurement of bone scan index from a whole-body bone scintigram. ...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 已发布勘误

    doi:10.1007/s11548-020-02119-w

    authors: Shimizu A,Wakabayashi H,Kanamori T,Saito A,Nishikawa K,Daisaki H,Higashiyama S,Kawabe J

    更新日期:2020-03-01 00:00:00

  • Automatic detection of perforator vessels using infrared thermography in reconstructive surgery.

    abstract:PURPOSE:Knowing the location of the blood vessels supplying the skin and subcutaneous tissue is a requirement during the planning of tissue transfer in reconstructive surgery. Commonly used imaging techniques such as computed tomography angiography and indocyanine green angiography expose the patient to radiation or a ...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-018-1892-6

    authors: Unger M,Markfort M,Halama D,Chalopin C

    更新日期:2019-03-01 00:00:00

  • Automated brain tumour detection and segmentation using superpixel-based extremely randomized trees in FLAIR MRI.

    abstract:PURPOSE:We propose a fully automated method for detection and segmentation of the abnormal tissue associated with brain tumour (tumour core and oedema) from Fluid- Attenuated Inversion Recovery (FLAIR) Magnetic Resonance Imaging (MRI). METHODS:The method is based on superpixel technique and classification of each supe...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-016-1483-3

    authors: Soltaninejad M,Yang G,Lambrou T,Allinson N,Jones TL,Barrick TR,Howe FA,Ye X

    更新日期:2017-02-01 00:00:00

  • Enhancement of bone shadow region using local phase-based ultrasound transmission maps.

    abstract:PURPOSE:Ultrasound is increasingly being employed in different orthopedic procedures as an imaging modality for real-time guidance. Nevertheless, low signal-to-noise-ratio and different imaging artifacts continue to hamper the success of ultrasound-based procedures. Bone shadow region is an important feature indicating...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-017-1556-y

    authors: Hacihaliloglu I

    更新日期:2017-06-01 00:00:00

  • Ultrasound thermal monitoring with an external ultrasound source for customized bipolar RF ablation shapes.

    abstract:PURPOSE:Thermotherapy is a clinical procedure which delivers thermal energy to a target, and it has been applied for various medical treatments. Temperature monitoring during thermotherapy is important to achieve precise and reproducible results. Medical ultrasound can be used for thermal monitoring and is an attractiv...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-018-1744-4

    authors: Kim Y,Audigier C,Ziegle J,Friebe M,Boctor EM

    更新日期:2018-06-01 00:00:00

  • Predicting surgical skill from the first N seconds of a task: value over task time using the isogony principle.

    abstract:PURPOSE:Most evaluations of surgical workflow or surgeon skill use simple, descriptive statistics (e.g., time) across whole procedures, thereby deemphasizing critical steps and potentially obscuring critical inefficiencies or skill deficiencies. In this work, we examine off-line, temporal clustering methods that chunk ...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-017-1606-5

    authors: French A,Lendvay TS,Sweet RM,Kowalewski TM

    更新日期:2017-07-01 00:00:00