Precise 3D/2D calibration between a RGB-D sensor and a C-arm fluoroscope.

Abstract:

PURPOSE:Calibration and registration are the first steps for augmented reality and mixed reality applications. In the medical field, the calibration between an RGB-D camera and a C-arm fluoroscope is a new topic which introduces challenges. METHOD:A convenient and efficient calibration phantom is designed by combining the traditional calibration object of X-ray images with a checkerboard plane. After the localization of the 2D marker points in the X-ray images and the corresponding 3D points from the RGB-D images, we calculate the projection matrix from the RGB-D sensor coordinates to the X-ray, instead of estimating the extrinsic and intrinsic parameters simultaneously. VALIDATION:In order to evaluate the effect of every step of our calibration process, we performed five experiments by combining different steps leading to the calibration. We also compared our calibration method to Tsai's method to evaluate the advancement of our solution. At last, we simulated the process of estimating the rotation movement of the RGB-D camera using MATLAB and demonstrate that calculating the projection matrix can reduce the angle error of the rotation. RESULTS:A RMS reprojection error of 0.5 mm is achieved using our calibration method which is promising for surgical applications. Our calibration method is more accurate when compared to Tsai's method. Lastly, the simulation result shows that using a projection matrix has a lower error than using intrinsic and extrinsic parameters in the rotation estimation. CONCLUSIONS:We designed and evaluated a 3D/2D calibration method for the combination of a RGB-D camera and a C-arm fluoroscope.

authors

Wang X,Habert S,Ma M,Huang CH,Fallavollita P,Navab N

doi

10.1007/s11548-015-1347-2

subject

Has Abstract

pub_date

2016-08-01 00:00:00

pages

1385-95

issue

8

eissn

1861-6410

issn

1861-6429

pii

10.1007/s11548-015-1347-2

journal_volume

11

pub_type

杂志文章
  • Hybrid simulation using mixed reality for interventional ultrasound imaging training.

    abstract:PURPOSE:Ultrasound (US) imaging offers advantages over other imaging modalities and has become the most widespread modality for many diagnostic and interventional procedures. However, traditional 2D US requires a long training period, especially to learn how to manipulate the probe. A hybrid interactive system based on...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-014-1113-x

    authors: Freschi C,Parrini S,Dinelli N,Ferrari M,Ferrari V

    更新日期:2015-07-01 00:00:00

  • Automatic bone segmentation in whole-body CT images.

    abstract:PURPOSE:Many diagnostic or treatment planning applications critically depend on the successful localization of bony structures in CT images. Manual or semiautomatic bone segmentation is tedious, however, and often not practical in clinical routine. In this paper, we present a reliable and fully automatic bone segmentat...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-018-1883-7

    authors: Klein A,Warszawski J,Hillengaß J,Maier-Hein KH

    更新日期:2019-01-01 00:00:00

  • Assessment of two 3-D fluoroscopic systems for articular fracture reduction: a cadaver study.

    abstract:OBJECTIVE:The most commonly used imaging device for assessment of fracture reduction is the two-dimensional X-ray fluoroscope. Two recently introduced 3D fluoroscopic devices, the Siremobil ISO-C3D (Siemens) and the C-InSight (Mazor Surgical Technologies), enable the surgeon to obtain spatial information for the assess...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-011-0548-6

    authors: Weil YA,Liebergall M,Mosheiff R,Singer SB,Joskowicz L,Khoury A

    更新日期:2011-09-01 00:00:00

  • Breast masses detection using phase portrait analysis and fuzzy inference systems.

    abstract:PURPOSE:Breast masses exhibit variability in margins, shapes, and dimensions, so their detection is a difficult task in mammographic computer-aided diagnosis. Mass detection is usually a two-step procedure: mass identification and false-positive reduction. A new method to automatically detect mass lesions in mammograph...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-011-0659-0

    authors: Mencattini A,Salmeri M

    更新日期:2012-07-01 00:00:00

  • Articular surface remodeling of the hip after periacetabular osteotomy.

    abstract:PURPOSE:Periacetabular osteotomies are a family of surgical procedures used to treat hip dysplasia. In a periacetabular osteotomy, the operating surgeon aims to increase acetabular coverage of the femoral head. The surgical correction has mechanical goals of increasing the stability of the joint and to improving the pr...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-011-0641-x

    authors: Rasquinha BJ,Sayani J,Rudan JF,Wood GC,Ellis RE

    更新日期:2012-03-01 00:00:00

  • Accurate two-dimensional cardiac strain calculation using adaptive windowed Fourier transform and Gabor wavelet transform.

    abstract:PURPOSE:Cardiac strain calculated from tagged magnetic resonance (MR) images provides clinicians information about abnormalities of heart-wall motion in patients. It is important to develop an accurate method to determine the cardiac strain efficiently. An adaptive windowed harmonic phase (AWHARP) method is proposed fo...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-012-0689-2

    authors: Fu YB,Chui CK,Teo CL

    更新日期:2013-01-01 00:00:00

  • FCNN-based axon segmentation for convection-enhanced delivery optimization.

    abstract:PURPOSE:Glioblastoma multiforme treatment is a challenging task in clinical oncology. Convection- enhanced delivery (CED) is showing encouraging but still suboptimal results due to drug leakages. Numerical models can predict drug distribution within the brain, but require retrieving brain physical properties, such as t...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-018-01911-z

    authors: Vidotto M,De Momi E,Gazzara M,Mattos LS,Ferrigno G,Moccia S

    更新日期:2019-03-01 00:00:00

  • MINARO HD: control and evaluation of a handheld, highly dynamic surgical robot.

    abstract:PURPOSE:Current surgical robotic systems are either large serial arms, resulting in higher risks due to their high inertia and no inherent limitations of the working space, or they are bone-mounted, adding substantial additional task steps to the surgical workflow. The robot presented in this paper has a handy and ligh...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-020-02306-9

    authors: Vossel M,Müller M,Niesche A,Theisgen L,Radermacher K,de la Fuente M

    更新日期:2021-01-23 00:00:00

  • Image-based laparoscopic bowel measurement.

    abstract:PURPOSE:Minimally invasive interventions offer benefits for patients, while also entailing drawbacks for surgeons, such as the loss of depth perception. Thus estimating distances, which is of particular importance in gastric bypasses, becomes difficult. In this paper, we propose an approach based on stereo endoscopy th...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-015-1291-1

    authors: Bodenstedt S,Wagner M,Mayer B,Stemmer K,Kenngott H,Müller-Stich B,Dillmann R,Speidel S

    更新日期:2016-03-01 00:00:00

  • Planning nonlinear access paths for temporal bone surgery.

    abstract:PURPOSE:Interventions at the otobasis operate in the narrow region of the temporal bone where several highly sensitive organs define obstacles with minimal clearance for surgical instruments. Nonlinear trajectories for potential minimally invasive interventions can provide larger distances to risk structures and optimi...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-018-1712-z

    authors: Fauser J,Sakas G,Mukhopadhyay A

    更新日期:2018-05-01 00:00:00

  • Unravelling the effect of data augmentation transformations in polyp segmentation.

    abstract:PURPOSE:Data augmentation is a common technique to overcome the lack of large annotated databases, a usual situation when applying deep learning to medical imaging problems. Nevertheless, there is no consensus on which transformations to apply for a particular field. This work aims at identifying the effect of differen...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-020-02262-4

    authors: Sánchez-Peralta LF,Picón A,Sánchez-Margallo FM,Pagador JB

    更新日期:2020-12-01 00:00:00

  • Simulation of mammographic breast compression in 3D MR images using ICP-based B-spline deformation for multimodality breast cancer diagnosis.

    abstract:PURPOSE:Multimodality mammography using conventional 2D mammography and dynamic contrast-enhanced 3D magnetic resonance imaging (DCE-MRI) is frequently performed for breast cancer detection and diagnosis. Combination of both imaging modalities requires superimposition of corresponding structures in mammograms and MR im...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-014-0976-1

    authors: Krüger J,Ehrhardt J,Bischof A,Handels H

    更新日期:2014-05-01 00:00:00

  • Use the force: deformation correction in robotic 3D ultrasound.

    abstract:PURPOSE:Ultrasound acquisitions are typically affected by deformations due to the pressure applied onto the contact surface. While a certain amount of pressure is necessary to ensure good acoustic coupling and visibility of the anatomy under examination, the caused deformations hinder accurate localization and geometri...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-018-1716-8

    authors: Virga S,Göbl R,Baust M,Navab N,Hennersperger C

    更新日期:2018-05-01 00:00:00

  • Real-time marker-free patient registration for electromagnetic navigated bronchoscopy: a phantom study.

    abstract:PURPOSE:To perform bronchoscopy safely and smoothly, it is very important to develop a bronchoscopic guidance system. Transbronchial lung biopsy (TBLB) with a bronchoscopic guidance system especially should permit safe image-guided procedures. Recently, electromagnetic tracking (EMT) is utilized to track the tip of the...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-011-0626-9

    authors: Deguchi D,Feuerstein M,Kitasaka T,Suenaga Y,Ide I,Murase H,Imaizumi K,Hasegawa Y,Mori K

    更新日期:2012-05-01 00:00:00

  • Decision support system for the planning of minimally invasive aortic valve replacement surgery.

    abstract:PURPOSE:Minimally invasive aortic valve replacement (MIAVR) procedures remain more complex and technically challenging compared to conventional full sternotomy surgery. This technique involves a restricted surgical field and a limited workspace, which is, at present, strictly reserved for the most experienced surgeons....

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-018-1725-7

    authors: Li H,Castro M,Haigron P,Verhoye JP,Ruggieri VG

    更新日期:2018-08-01 00:00:00

  • Segmentation of the placenta and its vascular tree in Doppler ultrasound for fetal surgery planning.

    abstract:PURPOSE:Twin-to-twin transfusion syndrome (TTTS) is a serious condition that occurs in about 10-15% of monochorionic twin pregnancies. In most instances, the blood flow is unevenly distributed throughout the placenta anastomoses leading to the death of both fetuses if no surgical procedure is performed. Fetoscopic lase...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-020-02256-2

    authors: Perera-Bel E,Ceresa M,Torrents-Barrena J,Masoller N,Valenzuela-Alcaraz B,Gratacós E,Eixarch E,González Ballester MA

    更新日期:2020-11-01 00:00:00

  • Translatory hip kinematics measured with optoelectronic surgical navigation.

    abstract:PURPOSE:An optoelectronic surgical navigation system was used to detect small but measurable translational motion of human hip cadavers in high-range passive motions. Kinematic data were also examined to demonstrate the role of soft tissues in constraining hip translation. METHODS:Twelve cadaver hips were scanned usin...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-017-1629-y

    authors: Zakani S,Rudan JF,Ellis RE

    更新日期:2017-08-01 00:00:00

  • Incorporating prior shape knowledge via data-driven loss model to improve 3D liver segmentation in deep CNNs.

    abstract:PURPOSE:Convolutional neural networks (CNNs) have obtained enormous success in liver segmentation. However, there are several challenges, including low-contrast images, and large variations in the shape, and appearance of the liver. Incorporating prior knowledge in deep CNN models improves their performance and general...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-019-02085-y

    authors: Mohagheghi S,Foruzan AH

    更新日期:2020-02-01 00:00:00

  • Evaluation of a marker-less, intra-operative, augmented reality guidance system for robot-assisted laparoscopic radical prostatectomy.

    abstract:PURPOSE:Robot-assisted laparoscopic radical prostatectomy (RALRP) using the da Vinci surgical robot is a common treatment for organ-confined prostate cancer. Augmented reality (AR) can help during RALRP by showing the surgeon the location of anatomical structures and tumors from preoperative imaging. Previously, we pro...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-020-02181-4

    authors: Kalia M,Mathur P,Tsang K,Black P,Navab N,Salcudean S

    更新日期:2020-07-01 00:00:00

  • A CAD of fully automated colonic polyp detection for contrasted and non-contrasted CT scans.

    abstract:PURPOSE:Computer-aided detection (CAD) systems are developed to help radiologists detect colonic polyps over CT scans. It is possible to reduce the detection time and increase the detection accuracy rates by using CAD systems. In this paper, we aimed to develop a fully integrated CAD system for automated detection of p...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-017-1521-9

    authors: Tulum G,Bolat B,Osman O

    更新日期:2017-04-01 00:00:00

  • Automatic 3D liver location and segmentation via convolutional neural network and graph cut.

    abstract:PURPOSE:Segmentation of the liver from abdominal computed tomography (CT) images is an essential step in some computer-assisted clinical interventions, such as surgery planning for living donor liver transplant, radiotherapy and volume measurement. In this work, we develop a deep learning algorithm with graph cut refin...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-016-1467-3

    authors: Lu F,Wu F,Hu P,Peng Z,Kong D

    更新日期:2017-02-01 00:00:00

  • Multistage segmentation model and SVM-ensemble for precise lung nodule detection.

    abstract:PURPOSE:Lung cancer detection at its initial stages increases the survival chances of patients. Automatic detection of lung nodules facilitates radiologists during the diagnosis. However, there is a challenge of false positives in automated systems which may lead to wrong findings. Precise segmentation facilitates to a...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-018-1715-9

    authors: Naqi SM,Sharif M,Yasmin M

    更新日期:2018-07-01 00:00:00

  • Anatomy-driven multiple trajectory planning (ADMTP) of intracranial electrodes for epilepsy surgery.

    abstract:PURPOSE:Epilepsy is potentially curable with resective surgery if the epileptogenic zone (EZ) can be identified. If non-invasive imaging is unable to elucidate the EZ, intracranial electrodes may be implanted to identify the EZ as well as map cortical function. In current clinical practice, each electrode trajectory is...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-017-1628-z

    authors: Sparks R,Vakharia V,Rodionov R,Vos SB,Diehl B,Wehner T,Miserocchi A,McEvoy AW,Duncan JS,Ourselin S

    更新日期:2017-08-01 00:00:00

  • Enhancement of bone shadow region using local phase-based ultrasound transmission maps.

    abstract:PURPOSE:Ultrasound is increasingly being employed in different orthopedic procedures as an imaging modality for real-time guidance. Nevertheless, low signal-to-noise-ratio and different imaging artifacts continue to hamper the success of ultrasound-based procedures. Bone shadow region is an important feature indicating...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-017-1556-y

    authors: Hacihaliloglu I

    更新日期:2017-06-01 00:00:00

  • MITK-US: real-time ultrasound support within MITK.

    abstract:PURPOSE:Intra-procedural acquisition of the patient anatomy is a key technique in the context of computer-assisted interventions (CAI). Ultrasound (US) offers major advantages as an interventional imaging modality because it is real time and low cost and does not expose the patient or physician to harmful radiation. To...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-013-0962-z

    authors: März K,Franz AM,Seitel A,Winterstein A,Bendl R,Zelzer S,Nolden M,Meinzer HP,Maier-Hein L

    更新日期:2014-05-01 00:00:00

  • Learned optical flow for intra-operative tracking of the retinal fundus.

    abstract:PURPOSE:Sustained delivery of regenerative retinal therapies by robotic systems requires intra-operative tracking of the retinal fundus. We propose a supervised deep convolutional neural network to densely predict semantic segmentation and optical flow of the retina as mutually supportive tasks, implicitly inpainting r...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-020-02160-9

    authors: Ravasio CS,Pissas T,Bloch E,Flores B,Jalali S,Stoyanov D,Cardoso JM,Da Cruz L,Bergeles C

    更新日期:2020-05-01 00:00:00

  • Projection-based visual guidance for robot-aided RF needle insertion.

    abstract:PURPOSE:The use of projector-based augmented reality (AR) in surgery may enable surgeons to directly view anatomical models and surgical data from the patient's surface (skin). It has the advantages of a consistent viewing focus on the patient, an extended field of view and augmented interaction. This paper presents an...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-013-0897-4

    authors: Wen R,Chui CK,Ong SH,Lim KB,Chang SK

    更新日期:2013-11-01 00:00:00

  • Generative multi-adversarial network for striking the right balance in abdominal image segmentation.

    abstract::Purpose The identification of abnormalities that are relatively rare within otherwise normal anatomy is a major challenge for deep learning in the semantic segmentation of medical images. The small number of samples of the minority classes in the training data makes the learning of optimal classification challenging, ...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-020-02254-4

    authors: Rezaei M,Näppi JJ,Lippert C,Meinel C,Yoshida H

    更新日期:2020-11-01 00:00:00

  • Development of a shoulder-mounted robot for MRI-guided needle placement: phantom study.

    abstract:PURPOSE:This paper presents new quantitative data on a signal-to-noise ratio (SNR) study, distortion study, and targeting accuracy phantom study for our patient-mounted robot (called Arthrobot). Arthrobot was developed as an MRI-guided needle placement device for diagnostic and interventional procedures such as arthrog...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-018-1839-y

    authors: Monfaredi R,Iordachita I,Wilson E,Sze R,Sharma K,Krieger A,Fricke S,Cleary K

    更新日期:2018-11-01 00:00:00

  • Cost-effective, personalized, 3D-printed liver model for preoperative planning before laparoscopic liver hemihepatectomy for colorectal cancer metastases.

    abstract:PURPOSE:Three-dimensional (3D) printing for preoperative planning has been intensively developed in the recent years. However, the implementation of these solutions in hospitals is still difficult due to high costs, extremely expensive industrial-grade printers, and software that is difficult to obtain and learn along ...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-017-1527-3

    authors: Witowski JS,Pędziwiatr M,Major P,Budzyński A

    更新日期:2017-12-01 00:00:00