Dual-robot ultrasound-guided needle placement: closing the planning-imaging-action loop.

Abstract:

PURPOSE:Precise needle placement is an important task during several medical procedures. Ultrasound imaging is often used to guide the needle toward the target region in soft tissue. This task remains challenging due to the user's dependence on image quality, limited field of view, moving target, and moving needle. In this paper, we present a novel dual-robot framework for robotic needle insertions under robotic ultrasound guidance. METHOD:We integrated force-controlled ultrasound image acquisition, registration of preoperative and intraoperative images, vision-based robot control, and target localization, in combination with a novel needle tracking algorithm. The framework allows robotic needle insertion to target a preoperatively defined region of interest while enabling real-time visualization and adaptive trajectory planning to provide safe and quick interactions. We assessed the framework by considering both static and moving targets embedded in water and tissue-mimicking gelatin. RESULTS:The presented dual-robot tracking algorithms allow for accurate needle placement, namely to target the region of interest with an error around 1 mm. CONCLUSION:To the best of our knowledge, we show the first use of two independent robots, one for imaging, the other for needle insertion, that are simultaneously controlled using image processing algorithms. Experimental results show the feasibility and demonstrate the accuracy and robustness of the process.

authors

Kojcev R,Fuerst B,Zettinig O,Fotouhi J,Lee SC,Frisch B,Taylor R,Sinibaldi E,Navab N

doi

10.1007/s11548-016-1408-1

subject

Has Abstract

pub_date

2016-06-01 00:00:00

pages

1173-81

issue

6

eissn

1861-6410

issn

1861-6429

pii

10.1007/s11548-016-1408-1

journal_volume

11

pub_type

杂志文章
  • A fully 3D work context for oral implant planning and simulation.

    abstract:PURPOSE:Most software systems for oral implantology are based on a two-dimensional multi-view approach, often accompanied with a surface rendered model. Usually they are affected by common errors like anisotropy of the volume and distortion on measurements. A more integrated and realistic 3D approach for implant surger...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-009-0394-y

    authors: Chiarelli T,Lamma E,Sansoni T

    更新日期:2010-01-01 00:00:00

  • Temporal enhancement of 2D color Doppler echocardiography sequences by fragment-based frame reordering and refinement.

    abstract:PURPOSE:The goal of this study was to develop an algorithm that enhances the temporal resolution of two-dimensional color Doppler echocardiography (2D CDE) by reordering all the acquired frames and filtering out the frames corrupted by out-of-plane motion and arrhythmia. METHODS:The algorithm splits original frame seq...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-019-01926-0

    authors: Terentjev AB,Perrin DP,Settlemier SH,Zurakowski D,Smirnov PO,Del Nido PJ,Shturts IV,Vasilyev NV

    更新日期:2019-04-01 00:00:00

  • FCNN-based axon segmentation for convection-enhanced delivery optimization.

    abstract:PURPOSE:Glioblastoma multiforme treatment is a challenging task in clinical oncology. Convection- enhanced delivery (CED) is showing encouraging but still suboptimal results due to drug leakages. Numerical models can predict drug distribution within the brain, but require retrieving brain physical properties, such as t...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-018-01911-z

    authors: Vidotto M,De Momi E,Gazzara M,Mattos LS,Ferrigno G,Moccia S

    更新日期:2019-03-01 00:00:00

  • Ultrasound texture-based CAD system for detecting neuromuscular diseases.

    abstract:PURPOSE:Diagnosis of neuromuscular diseases in ultrasonography is a challenging task since experts are often unable to discriminate between healthy and pathological cases. A computer-aided diagnosis (CAD) system for skeletal muscle ultrasonography was developed and tested for myositis detection in ultrasound images of ...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-014-1133-6

    authors: König T,Steffen J,Rak M,Neumann G,von Rohden L,Tönnies KD

    更新日期:2015-09-01 00:00:00

  • MIDG-Emerging grid technologies for multi-site preclinical molecular imaging research communities.

    abstract:PURPOSE:Molecular imaging is the visualization and identification of specific molecules in anatomy for insight into metabolic pathways, tissue consistency, and tracing of solute transport mechanisms. This paper presents the Molecular Imaging Data Grid (MIDG) which utilizes emerging grid technologies in preclinical mole...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-010-0524-6

    authors: Lee J,Documet J,Liu B,Park R,Tank A,Huang HK

    更新日期:2011-03-01 00:00:00

  • Fusion of 3D real-time echocardiography and cine MRI using a saliency analysis.

    abstract:PURPOSE:This paper presents a novel 3D multimodal registration strategy to fuse 3D real-time echocardiography images with cardiac cine MRI images. This alignment is performed in a saliency space, which is designed to maximize similarity between the two imaging modalities. This fusion improves the quality of the availab...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-019-02087-w

    authors: Atehortúa A,Garreau M,Simon A,Donal E,Lederlin M,Romero E

    更新日期:2020-02-01 00:00:00

  • Simulation of mammographic breast compression in 3D MR images using ICP-based B-spline deformation for multimodality breast cancer diagnosis.

    abstract:PURPOSE:Multimodality mammography using conventional 2D mammography and dynamic contrast-enhanced 3D magnetic resonance imaging (DCE-MRI) is frequently performed for breast cancer detection and diagnosis. Combination of both imaging modalities requires superimposition of corresponding structures in mammograms and MR im...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-014-0976-1

    authors: Krüger J,Ehrhardt J,Bischof A,Handels H

    更新日期:2014-05-01 00:00:00

  • Development and evaluation of a prototype detector for an intraoperative laparoscopic coincidence imaging system with PET tracers.

    abstract:PURPOSE:Conventional positron emission tomography can be used only preoperatively to identify lymph node metastases, and hence, these growths are difficult to locate intraoperatively. Previously, an intraoperative laparoscopic coincidence imaging system, with an external fixed detector array and a detector probe that c...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-020-02282-0

    authors: Liyanaarachchi MR,Shimazoe K,Takahashi H,Nakagawa K,Kobayashi E,Sakuma I

    更新日期:2021-01-01 00:00:00

  • Four-dimensional radiotherapeutic dose calculation using biomechanical respiratory motion description.

    abstract:PURPOSE:Organ motion due to patient breathing introduces a technical challenge for dosimetry and lung tumor treatment by hadron therapy. Accurate dose distribution estimation requires patient-specific information on tumor position, size, and shape as well as information regarding the material density and stopping power...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-013-0935-2

    authors: Manescu P,Ladjal H,Azencot J,Beuve M,Testa E,Shariat B

    更新日期:2014-05-01 00:00:00

  • Pre-clinical evaluation of an image-guided in-situ Raman spectroscopy navigation system for targeted prostate cancer interventions.

    abstract:PURPOSE:Transrectal ultrasound (TRUS) image guidance is the standard of care for diagnostic and therapeutic interventions in prostate cancer (PCa) patients, but can lead to high false-negative rates, compromising downstream effectiveness of therapeutic choices. A promising approach to improve in-situ detection of PCa l...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-020-02136-9

    authors: Shams R,Picot F,Grajales D,Sheehy G,Dallaire F,Birlea M,Saad F,Trudel D,Menard C,Leblond F,Kadoury S

    更新日期:2020-05-01 00:00:00

  • Automatic airway tree segmentation based on multi-scale context information.

    abstract:PURPOSE:Airway tree segmentation plays a pivotal role in chest computed tomography (CT) analysis tasks such as lesion localization, surgical planning, and intra-operative guidance. The remaining challenge is to identify small bronchi correctly, which facilitates further segmentation of the pulmonary anatomies. METHODS...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-020-02293-x

    authors: Zhou K,Chen N,Xu X,Wang Z,Guo J,Liu L,Yi Z

    更新日期:2021-01-19 00:00:00

  • Four-dimensional computed tomography angiography analysis of internal carotid arteries opacification at the skull base to detect delayed cerebral ischemia: a feasibility study.

    abstract:PURPOSE:Delayed cerebral ischemia represents a significant cause of poor functional outcome for patients with vasospasm after subarachnoid hemorrhage. We investigated whether delayed cerebral ischemia could be detected by the arterial opacification of internal carotid artery at the level of the skull base. METHODS:In ...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-020-02268-y

    authors: Ognard J,Cheddad El Aouni M,Dissaux B,Jomaah R,Rousseau PY,Burdin V,Ben Salem D,Gentric JC

    更新日期:2020-12-01 00:00:00

  • Knee arthroscopic navigation using virtual-vision rendering and self-positioning technology.

    abstract:PURPOSE:Knee arthroscopy suffers from a lack of depth information and easy occlusion of the visual field. To solve these limitations, we propose an arthroscopic navigation system based on self-positioning technology, with the guidance of virtual-vision views. This system can work without any external tracking devices o...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-019-02099-6

    authors: Ma C,Cui X,Chen F,Ma L,Xin S,Liao H

    更新日期:2020-03-01 00:00:00

  • Generative multi-adversarial network for striking the right balance in abdominal image segmentation.

    abstract::Purpose The identification of abnormalities that are relatively rare within otherwise normal anatomy is a major challenge for deep learning in the semantic segmentation of medical images. The small number of samples of the minority classes in the training data makes the learning of optimal classification challenging, ...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-020-02254-4

    authors: Rezaei M,Näppi JJ,Lippert C,Meinel C,Yoshida H

    更新日期:2020-11-01 00:00:00

  • Toward a standard ontology of surgical process models.

    abstract:PURPOSE:The development of common ontologies has recently been identified as one of the key challenges in the emerging field of surgical data science (SDS). However, past and existing initiatives in the domain of surgery have mainly been focussing on individual groups and failed to achieve widespread international acce...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-018-1824-5

    authors: Gibaud B,Forestier G,Feldmann C,Ferrigno G,Gonçalves P,Haidegger T,Julliard C,Katić D,Kenngott H,Maier-Hein L,März K,de Momi E,Nagy DÁ,Nakawala H,Neumann J,Neumuth T,Rojas Balderrama J,Speidel S,Wagner M,Jannin P

    更新日期:2018-09-01 00:00:00

  • Evaluation of a marker-less, intra-operative, augmented reality guidance system for robot-assisted laparoscopic radical prostatectomy.

    abstract:PURPOSE:Robot-assisted laparoscopic radical prostatectomy (RALRP) using the da Vinci surgical robot is a common treatment for organ-confined prostate cancer. Augmented reality (AR) can help during RALRP by showing the surgeon the location of anatomical structures and tumors from preoperative imaging. Previously, we pro...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-020-02181-4

    authors: Kalia M,Mathur P,Tsang K,Black P,Navab N,Salcudean S

    更新日期:2020-07-01 00:00:00

  • A preregistered STAMP method for image-guided temporal bone surgery.

    abstract:OBJECTIVES:Image-guided otological surgeries require minimal invasiveness and high accuracy, and these two factors usually compete with each other. Our recently developed registration method, called the STAMP method, showed minimal invasiveness with accuracy comparable to that of the current more invasive registration ...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-013-0916-5

    authors: Oka M,Cho B,Matsumoto N,Hong J,Jinnouchi M,Ouchida R,Komune S,Hashizume M

    更新日期:2014-01-01 00:00:00

  • Segmentation of the placenta and its vascular tree in Doppler ultrasound for fetal surgery planning.

    abstract:PURPOSE:Twin-to-twin transfusion syndrome (TTTS) is a serious condition that occurs in about 10-15% of monochorionic twin pregnancies. In most instances, the blood flow is unevenly distributed throughout the placenta anastomoses leading to the death of both fetuses if no surgical procedure is performed. Fetoscopic lase...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-020-02256-2

    authors: Perera-Bel E,Ceresa M,Torrents-Barrena J,Masoller N,Valenzuela-Alcaraz B,Gratacós E,Eixarch E,González Ballester MA

    更新日期:2020-11-01 00:00:00

  • Predicting underestimation of ductal carcinoma in situ: a comparison between radiomics and conventional approaches.

    abstract:PURPOSE:We aimed to investigate the feasibility of predicting invasion carcinoma from ductal carcinoma in situ (DCIS) lesions diagnosed by preoperative core needle biopsy using radiomics signatures, clinical imaging characteristics, and breast imaging reporting and data system (BI-RADS) descriptors on mammography. MET...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-018-1900-x

    authors: Li J,Song Y,Xu S,Wang J,Huang H,Ma W,Jiang X,Wu Y,Cai H,Li L

    更新日期:2019-04-01 00:00:00

  • Automatic abdominal multi-organ segmentation using deep convolutional neural network and time-implicit level sets.

    abstract:PURPOSE:Multi-organ segmentation from CT images is an essential step for computer-aided diagnosis and surgery planning. However, manual delineation of the organs by radiologists is tedious, time-consuming and poorly reproducible. Therefore, we propose a fully automatic method for the segmentation of multiple organs fro...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-016-1501-5

    authors: Hu P,Wu F,Peng J,Bao Y,Chen F,Kong D

    更新日期:2017-03-01 00:00:00

  • Automated muscle segmentation from CT images of the hip and thigh using a hierarchical multi-atlas method.

    abstract:PURPOSE:Patient-specific quantitative assessments of muscle mass and biomechanical musculoskeletal simulations require segmentation of the muscles from medical images. The objective of this work is to automate muscle segmentation from CT data of the hip and thigh. METHOD:We propose a hierarchical multi-atlas method in...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-018-1758-y

    authors: Yokota F,Otake Y,Takao M,Ogawa T,Okada T,Sugano N,Sato Y

    更新日期:2018-07-01 00:00:00

  • Design considerations for a novel MRI compatible manipulator for prostate cryoablation.

    abstract:PURPOSE:Prostate carcinoma is a commonly diagnosed cancer in men. Nonsurgical treatment of early stage prostate cancer is an important alternative. The use of MRI for tumor cryoablation is of particular interest: it offers lower morbidity compared with other localized techniques. However, the current manual procedure i...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-011-0558-4

    authors: Abdelaziz S,Esteveny L,Renaud P,Bayle B,Barbé L,De Mathelin M,Gangi A

    更新日期:2011-11-01 00:00:00

  • Orbital volume analysis: validation of a semi-automatic software segmentation method.

    abstract:PURPOSE:The purpose of this study was to validate a quick, accurate and reproducible (semi-) automatic software segmentation method to measure orbital volume in the unaffected bony orbit. Precise volume measurement of the orbital cavity is a useful addition to pre-operative planning and intraoperative navigation in orb...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-015-1254-6

    authors: Jansen J,Schreurs R,Dubois L,Maal TJ,Gooris PJ,Becking AG

    更新日期:2016-01-01 00:00:00

  • Model-based registration of preprocedure MR and intraprocedure US of the lumbar spine.

    abstract:PURPOSE:Epidural and spinal needle insertions, as well as facet joint denervation and injections are widely performed procedures on the lumbar spine for delivering anesthesia and analgesia. Ultrasound (US)-based approaches have gained popularity for accurate needle placement, as they use a non-ionizing, inexpensive and...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-017-1552-2

    authors: Behnami D,Sedghi A,Anas EMA,Rasoulian A,Seitel A,Lessoway V,Ungi T,Yen D,Osborn J,Mousavi P,Rohling R,Abolmaesumi P

    更新日期:2017-06-01 00:00:00

  • Fast, robust, and accurate monocular peer-to-peer tracking for surgical navigation.

    abstract:PURPOSE:This work presents a new monocular peer-to-peer tracking concept overcoming the distinction between tracking tools and tracked tools for optical navigation systems. A marker model concept based on marker triplets combined with a fast and robust algorithm for assigning image feature points to the corresponding m...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-019-02111-z

    authors: Strzeletz S,Hazubski S,Moctezuma JL,Hoppe H

    更新日期:2020-03-01 00:00:00

  • [¹¹C]acetate and PET/CT assessment of muscle activation in rat studies.

    abstract:PURPOSE:The purpose of the present study is to apply kinetic analysis to investigate exercise-related changes in the metabolism of the skeletal muscle of the rat hindlimb by [[Formula: see text]]acetate positron emission tomography and computed tomography (PET/CT). METHODS:Contractions were induced in Wistar rats' lef...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-015-1260-8

    authors: Trombella S,García D,Colin DJ,Germain S,Seimbille Y,Ratib O

    更新日期:2016-05-01 00:00:00

  • Cost-effective, personalized, 3D-printed liver model for preoperative planning before laparoscopic liver hemihepatectomy for colorectal cancer metastases.

    abstract:PURPOSE:Three-dimensional (3D) printing for preoperative planning has been intensively developed in the recent years. However, the implementation of these solutions in hospitals is still difficult due to high costs, extremely expensive industrial-grade printers, and software that is difficult to obtain and learn along ...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-017-1527-3

    authors: Witowski JS,Pędziwiatr M,Major P,Budzyński A

    更新日期:2017-12-01 00:00:00

  • Designing and validating a PVA liver phantom with respiratory motion for needle-based interventions.

    abstract:PURPOSE:The purpose is to design and validate an anthropomorphic polyvinyl alcohol (PVA) liver phantom with respiratory motion to simulate needle-based interventions. Such a system can, for example, be used as a validation tool for novel needles. METHODS:Image segmentations of CT scans of four patients during inspirat...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-019-02029-6

    authors: de Jong TL,Moelker A,Dankelman J,van den Dobbelsteen JJ

    更新日期:2019-12-01 00:00:00

  • A visual odometry base-tracking system for intraoperative C-arm guidance.

    abstract:PURPOSE:C-arms are portable X-ray devices used to generate radiographic images in orthopedic surgical procedures. Evidence suggests that scouting images, which are used to aid in C-arm positioning, result in increased operation time and excess radiation exposure. C-arms are also primarily used qualitatively to view ima...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-020-02229-5

    authors: Haliburton L,Esfandiari H,Guy P,Anglin C,Hodgson A

    更新日期:2020-10-01 00:00:00

  • Automatic 3D liver location and segmentation via convolutional neural network and graph cut.

    abstract:PURPOSE:Segmentation of the liver from abdominal computed tomography (CT) images is an essential step in some computer-assisted clinical interventions, such as surgery planning for living donor liver transplant, radiotherapy and volume measurement. In this work, we develop a deep learning algorithm with graph cut refin...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-016-1467-3

    authors: Lu F,Wu F,Hu P,Peng Z,Kong D

    更新日期:2017-02-01 00:00:00