Abstract:
PURPOSE:Accurate needle tracking provides essential information for MRI-guided percutaneous interventions. Passive needle tracking using MR images is challenged by variations of the needle-induced signal void feature in different situations. This work aimed to develop an automatic needle tracking algorithm for MRI-guided interventions based on the Mask Region Proposal-Based Convolutional Neural Network (R-CNN). METHODS:Mask R-CNN was adapted and trained to segment the needle feature using 250 intra-procedural images from 85 MRI-guided prostate biopsy cases and 180 real-time images from MRI-guided needle insertion in ex vivo tissue. The segmentation masks were passed into the needle feature localization algorithm to extract the needle feature tip location and axis orientation. The proposed algorithm was tested using 208 intra-procedural images from 40 MRI-guided prostate biopsy cases, and 3 real-time MRI datasets in ex vivo tissue. The algorithm results were compared with human-annotated references. RESULTS:In prostate datasets, the proposed algorithm achieved needle feature tip localization error with median Euclidean distance (dxy) of 0.71 mm and median difference in axis orientation angle (dθ) of 1.28°, respectively. In 3 real-time MRI datasets, the proposed algorithm achieved consistent dynamic needle feature tracking performance with processing time of 75 ms/image: (a) median dxy = 0.90 mm, median dθ = 1.53°; (b) median dxy = 1.31 mm, median dθ = 1.9°; (c) median dxy = 1.09 mm, median dθ = 0.91°. CONCLUSIONS:The proposed algorithm using Mask R-CNN can accurately track the needle feature tip and axis on MR images from in vivo intra-procedural prostate biopsy cases and ex vivo real-time MRI experiments with a range of different conditions. The algorithm achieved pixel-level tracking accuracy in real time and has potential to assist MRI-guided percutaneous interventions.
journal_name
Int J Comput Assist Radiol Surgauthors
Li X,Young AS,Raman SS,Lu DS,Lee YH,Tsao TC,Wu HHdoi
10.1007/s11548-020-02226-8subject
Has Abstractpub_date
2020-10-01 00:00:00pages
1673-1684issue
10eissn
1861-6410issn
1861-6429pii
10.1007/s11548-020-02226-8journal_volume
15pub_type
杂志文章abstract:PURPOSE:Most ultrasound imaging systems assume a pre-determined sound propagation speed for imaging. However, a mismatch between assumed and real sound speeds can lead to spatial shift and defocus of ultrasound image, which may limit the applicability of ultrasound imaging. The estimation of real sound speed is importa...
journal_title:International journal of computer assisted radiology and surgery
pub_type: 杂志文章
doi:10.1007/s11548-012-0690-9
更新日期:2012-11-01 00:00:00
abstract:PURPOSE:The goal of this study was to develop an algorithm that enhances the temporal resolution of two-dimensional color Doppler echocardiography (2D CDE) by reordering all the acquired frames and filtering out the frames corrupted by out-of-plane motion and arrhythmia. METHODS:The algorithm splits original frame seq...
journal_title:International journal of computer assisted radiology and surgery
pub_type: 杂志文章
doi:10.1007/s11548-019-01926-0
更新日期:2019-04-01 00:00:00
abstract:PURPOSE:Suspension laryngoscopy has been employed for laryngeal diseases such as treatment for a polyp, cystoma, or granuloma. After securing a straight path with a laryngoscope, the surgeon inserts rigid instruments and examines the target lesion by using a microscope. However, many patients suffer from secondary comp...
journal_title:International journal of computer assisted radiology and surgery
pub_type: 杂志文章
doi:10.1007/s11548-013-0944-1
更新日期:2014-07-01 00:00:00
abstract:OBJECTIVE:By adding a tracking sensor to a 3D ultrasound (US) probe and thus locating the probe in space, new applications within the fields of image guided surgery and radiation therapy are possible. To locate the US volume in space, a calibration is necessary to determine the mathematical transformation for mapping p...
journal_title:International journal of computer assisted radiology and surgery
pub_type: 杂志文章
doi:10.1007/s11548-008-0258-x
更新日期:2009-03-01 00:00:00
abstract:PURPOSE:Brain tumor patients are usually accompanied by impairments in cognitive functions, and these dysfunctions arise from the altered diffusion tensor of water molecules and disrupted neuronal conduction in white matter. Diffusion tensor imaging (DTI) is a powerful noninvasive imaging technique that can reflect dif...
journal_title:International journal of computer assisted radiology and surgery
pub_type: 杂志文章
doi:10.1007/s11548-015-1330-y
更新日期:2016-11-01 00:00:00
abstract:PURPOSE:Minimally invasive cochlear implantation is a surgical technique which requires drilling a canal from the mastoid surface toward the basal turn of the cochlea. The choice of an appropriate drilling strategy is hypothesized to have significant influence on the achievable targeting accuracy. Therefore, a method i...
journal_title:International journal of computer assisted radiology and surgery
pub_type: 杂志文章
doi:10.1007/s11548-014-0997-9
更新日期:2014-11-01 00:00:00
abstract:PURPOSE:The interaction with interventional imaging systems within a sterile environment is a challenging task for physicians. Direct physician-machine interaction during an intervention is rather limited because of sterility and workspace restrictions. METHODS:We present a gesture-controlled projection display that e...
journal_title:International journal of computer assisted radiology and surgery
pub_type: 杂志文章
doi:10.1007/s11548-015-1215-0
更新日期:2016-01-01 00:00:00
abstract:PURPOSE:Over the last decade, the demand for content management of video recordings of surgical procedures has greatly increased. Although a few research methods have been published toward this direction, the related literature is still in its infancy. In this paper, we address the problem of shot detection in endoscop...
journal_title:International journal of computer assisted radiology and surgery
pub_type: 杂志文章
doi:10.1007/s11548-016-1431-2
更新日期:2016-11-01 00:00:00
abstract:PURPOSE:Surgical phase recognition using sensor data is challenging due to high variation in patient anatomy and surgeon-specific operating styles. Segmenting surgical procedures into constituent phases is of significant utility for resident training, education, self-review, and context-aware operating room technologie...
journal_title:International journal of computer assisted radiology and surgery
pub_type: 杂志文章
doi:10.1007/s11548-016-1409-0
更新日期:2016-06-01 00:00:00
abstract:OBJECTIVE:The identification of the interhemispheric fissure (IF) is important in clinical applications for brain landmark identification, registration, symmetry assessment, and pathology detection. The IF is usually approximated by the midsagittal plane (MSP) separating the brain into two hemispheres. We present a fas...
journal_title:International journal of computer assisted radiology and surgery
pub_type: 杂志文章
doi:10.1007/s11548-009-0366-2
更新日期:2009-11-01 00:00:00
abstract:BACKGROUND:Laparoscopic surgeons require extended experience of cases to overcome the lack of depth perception on a two-dimensional (2D) display. Although a three-dimensional (3D) display was reported to be useful over two decades ago, 3D systems have not been widely used. Recently, we developed a novel 3D dome-shaped ...
journal_title:International journal of computer assisted radiology and surgery
pub_type: 杂志文章
doi:10.1007/s11548-009-0282-5
更新日期:2009-03-01 00:00:00
abstract:PURPOSE:Context-aware systems for the operating room (OR) provide the possibility to significantly improve surgical workflow through various applications such as efficient OR scheduling, context-sensitive user interfaces, and automatic transcription of medical procedures. Being an essential element of such a system, su...
journal_title:International journal of computer assisted radiology and surgery
pub_type: 杂志文章
doi:10.1007/s11548-015-1186-1
更新日期:2015-06-01 00:00:00
abstract:PURPOSE:Previous work on surgical skill assessment using intraoperative tool motion has focused on highly structured surgical tasks such as cholecystectomy and used generic motion metrics such as time and number of movements. Other statistical methods such as hidden Markov models (HMM) and descriptive curve coding (DCC...
journal_title:International journal of computer assisted radiology and surgery
pub_type: 杂志文章
doi:10.1007/s11548-015-1194-1
更新日期:2015-06-01 00:00:00
abstract:PURPOSE:An augmented reality system to visualize a 3D preoperative anatomical model on intra-operative patient is proposed. The hardware requirement is commercial tablet-PC equipped with a camera. Thus, no external tracking device nor artificial landmarks on the patient are required. METHODS:We resort to visual SLAM t...
journal_title:International journal of computer assisted radiology and surgery
pub_type: 杂志文章
doi:10.1007/s11548-016-1444-x
更新日期:2017-01-01 00:00:00
abstract:PURPOSE:Automatic segmentation of anatomical structures and lesions from medical ultrasound images is a formidable challenge in medical imaging due to image noise, blur and artifacts. In this paper we present a segmentation technique with features highly suited to use in noisy 3D ultrasound volumes and demonstrate its ...
journal_title:International journal of computer assisted radiology and surgery
pub_type: 杂志文章
doi:10.1007/s11548-015-1239-5
更新日期:2016-01-01 00:00:00
abstract:PURPOSE:Realistic modelling of soft tissue biomechanics and mechanical interactions between tissues is an important part of biomechanically-informed surgical image-guidance and surgical simulation. This submission details a contact-modelling pipeline suitable for implementation in explicit matrix-free FEM solvers. Whil...
journal_title:International journal of computer assisted radiology and surgery
pub_type: 杂志文章
doi:10.1007/s11548-014-1142-5
更新日期:2015-11-01 00:00:00
abstract:PURPOSE:Radio-frequency ablations play an important role in the therapy of malignant liver lesions. The navigation of a needle to the lesion poses a challenge for both the trainees and intervening physicians. METHODS:This publication presents a new GPU-based, accurate method for the simulation of radio-frequency ablat...
journal_title:International journal of computer assisted radiology and surgery
pub_type: 杂志文章
doi:10.1007/s11548-019-02033-w
更新日期:2019-11-01 00:00:00
abstract:PURPOSE:Evaluation of circulating blood volume is important in assessing the status of patients. Although some studies have suggested that ultrasound images of the internal jugular vein (IJV) can be used for the analysis of circulating blood volume, accurate extraction of IJV is necessary to reduce errors. Therefore, t...
journal_title:International journal of computer assisted radiology and surgery
pub_type: 杂志文章
doi:10.1007/s11548-013-0921-8
更新日期:2014-03-01 00:00:00
abstract:PURPOSE:We present a platform, GRAphical Pipeline Environment (GRAPE), to facilitate the development of patient-adaptive magnetic resonance imaging (MRI) protocols. METHODS:GRAPE is an open-source project implemented in the Qt C++ framework to enable graphical creation, execution, and debugging of real-time image anal...
journal_title:International journal of computer assisted radiology and surgery
pub_type: 杂志文章
doi:10.1007/s11548-016-1495-z
更新日期:2017-03-01 00:00:00
abstract:PURPOSE:Estimating the interaction forces of instruments and tissue is of interest, particularly to provide haptic feedback during robot-assisted minimally invasive interventions. Different approaches based on external and integrated force sensors have been proposed. These are hampered by friction, sensor size, and ste...
journal_title:International journal of computer assisted radiology and surgery
pub_type: 杂志文章
doi:10.1007/s11548-018-1777-8
更新日期:2018-07-01 00:00:00
abstract:PURPOSE:Abnormalities of aortic surface and aortic diameter can be related to cardiovascular disease and aortic aneurysm. Computer-based aortic segmentation and measurement may aid physicians in related disease diagnosis. This paper presents a fully automated algorithm for aorta segmentation in low-dose non-contrast CT...
journal_title:International journal of computer assisted radiology and surgery
pub_type: 杂志文章
doi:10.1007/s11548-013-0924-5
更新日期:2014-03-01 00:00:00
abstract:PURPOSE:Laparoscopic ultrasound (LUS) enhances the safety of laparoscopic liver resection by enabling real-time imaging of internal structures such as vessels. However, LUS probes can be difficult to use, and many tumours are iso-echoic and hence are not visible. Registration of LUS to a pre-operative CT or MR scan has...
journal_title:International journal of computer assisted radiology and surgery
pub_type: 杂志文章
doi:10.1007/s11548-018-1799-2
更新日期:2018-08-01 00:00:00
abstract:PURPOSE:Calibration and registration are the first steps for augmented reality and mixed reality applications. In the medical field, the calibration between an RGB-D camera and a C-arm fluoroscope is a new topic which introduces challenges. METHOD:A convenient and efficient calibration phantom is designed by combining...
journal_title:International journal of computer assisted radiology and surgery
pub_type: 杂志文章
doi:10.1007/s11548-015-1347-2
更新日期:2016-08-01 00:00:00
abstract:PURPOSE:Multi-organ segmentation from CT images is an essential step for computer-aided diagnosis and surgery planning. However, manual delineation of the organs by radiologists is tedious, time-consuming and poorly reproducible. Therefore, we propose a fully automatic method for the segmentation of multiple organs fro...
journal_title:International journal of computer assisted radiology and surgery
pub_type: 杂志文章
doi:10.1007/s11548-016-1501-5
更新日期:2017-03-01 00:00:00
abstract::The article Automated measurement of bone scan index from a whole-body bone scintigram. ...
journal_title:International journal of computer assisted radiology and surgery
pub_type: 已发布勘误
doi:10.1007/s11548-020-02119-w
更新日期:2020-03-01 00:00:00
abstract:PURPOSE:Knowing the location of the blood vessels supplying the skin and subcutaneous tissue is a requirement during the planning of tissue transfer in reconstructive surgery. Commonly used imaging techniques such as computed tomography angiography and indocyanine green angiography expose the patient to radiation or a ...
journal_title:International journal of computer assisted radiology and surgery
pub_type: 杂志文章
doi:10.1007/s11548-018-1892-6
更新日期:2019-03-01 00:00:00
abstract:PURPOSE:We propose a fully automated method for detection and segmentation of the abnormal tissue associated with brain tumour (tumour core and oedema) from Fluid- Attenuated Inversion Recovery (FLAIR) Magnetic Resonance Imaging (MRI). METHODS:The method is based on superpixel technique and classification of each supe...
journal_title:International journal of computer assisted radiology and surgery
pub_type: 杂志文章
doi:10.1007/s11548-016-1483-3
更新日期:2017-02-01 00:00:00
abstract:PURPOSE:Ultrasound is increasingly being employed in different orthopedic procedures as an imaging modality for real-time guidance. Nevertheless, low signal-to-noise-ratio and different imaging artifacts continue to hamper the success of ultrasound-based procedures. Bone shadow region is an important feature indicating...
journal_title:International journal of computer assisted radiology and surgery
pub_type: 杂志文章
doi:10.1007/s11548-017-1556-y
更新日期:2017-06-01 00:00:00
abstract:PURPOSE:Thermotherapy is a clinical procedure which delivers thermal energy to a target, and it has been applied for various medical treatments. Temperature monitoring during thermotherapy is important to achieve precise and reproducible results. Medical ultrasound can be used for thermal monitoring and is an attractiv...
journal_title:International journal of computer assisted radiology and surgery
pub_type: 杂志文章
doi:10.1007/s11548-018-1744-4
更新日期:2018-06-01 00:00:00
abstract:PURPOSE:Most evaluations of surgical workflow or surgeon skill use simple, descriptive statistics (e.g., time) across whole procedures, thereby deemphasizing critical steps and potentially obscuring critical inefficiencies or skill deficiencies. In this work, we examine off-line, temporal clustering methods that chunk ...
journal_title:International journal of computer assisted radiology and surgery
pub_type: 杂志文章
doi:10.1007/s11548-017-1606-5
更新日期:2017-07-01 00:00:00