A practical marker-less image registration method for augmented reality oral and maxillofacial surgery.

Abstract:

BACKGROUND:Image registration lies in the core of augmented reality (AR), which aligns the virtual scene with the reality. In AR surgical navigation, the performance of image registration is vital to the surgical outcome. METHODS:This paper presents a practical marker-less image registration method for AR-guided oral and maxillofacial surgery where a virtual scene is generated and mixed with reality to guide surgical operation or provide surgical outcome visualization in the manner of video see-through overlay. An intraoral 3D scanner is employed to acquire the patient's teeth shape model intraoperatively. The shape model is then registered with a custom-made stereo camera system using a novel 3D stereo matching algorithm and with the patient's CT-derived 3D model using an iterative closest point scheme, respectively. By leveraging the intraoral 3D scanner, the CT space and the stereo camera space are associated so that surrounding anatomical models and virtual implants could be overlaid on the camera's view to achieve AR surgical navigation. RESULTS:Jaw phantom experiments were performed to evaluate the target registration error of the overlay, which yielded an average error of less than 0.50 mm with the time cost less than 0.5 s. Volunteer trial was also conducted to show the clinical feasibility. CONCLUSIONS:The proposed registration method does not rely on any external fiducial markers attached to the patient. It performs automatically so as to maintain a correct AR scene, overcoming the misalignment difficulty caused by patient's movement. Therefore, it is noninvasive and practical in oral and maxillofacial surgery.

authors

Wang J,Shen Y,Yang S

doi

10.1007/s11548-019-01921-5

subject

Has Abstract

pub_date

2019-05-01 00:00:00

pages

763-773

issue

5

eissn

1861-6410

issn

1861-6429

pii

10.1007/s11548-019-01921-5

journal_volume

14

pub_type

杂志文章
  • Segmentation of the placenta and its vascular tree in Doppler ultrasound for fetal surgery planning.

    abstract:PURPOSE:Twin-to-twin transfusion syndrome (TTTS) is a serious condition that occurs in about 10-15% of monochorionic twin pregnancies. In most instances, the blood flow is unevenly distributed throughout the placenta anastomoses leading to the death of both fetuses if no surgical procedure is performed. Fetoscopic lase...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-020-02256-2

    authors: Perera-Bel E,Ceresa M,Torrents-Barrena J,Masoller N,Valenzuela-Alcaraz B,Gratacós E,Eixarch E,González Ballester MA

    更新日期:2020-11-01 00:00:00

  • A pre-operative planning framework for global registration of laparoscopic ultrasound to CT images.

    abstract:PURPOSE:Laparoscopic ultrasound (LUS) enhances the safety of laparoscopic liver resection by enabling real-time imaging of internal structures such as vessels. However, LUS probes can be difficult to use, and many tumours are iso-echoic and hence are not visible. Registration of LUS to a pre-operative CT or MR scan has...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-018-1799-2

    authors: Ramalhinho J,Robu MR,Thompson S,Gurusamy K,Davidson B,Hawkes D,Barratt D,Clarkson MJ

    更新日期:2018-08-01 00:00:00

  • Automatic detection of perforator vessels using infrared thermography in reconstructive surgery.

    abstract:PURPOSE:Knowing the location of the blood vessels supplying the skin and subcutaneous tissue is a requirement during the planning of tissue transfer in reconstructive surgery. Commonly used imaging techniques such as computed tomography angiography and indocyanine green angiography expose the patient to radiation or a ...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-018-1892-6

    authors: Unger M,Markfort M,Halama D,Chalopin C

    更新日期:2019-03-01 00:00:00

  • Gain determination of feedback force for an ultrasound scanning robot using genetic algorithm.

    abstract:PURPOSE:The remote medical diagnosis system (RMDS) is for providing medical diagnosis to the patients located in remote sites. To apply to RMDS and medical automation, many master-slave type ultrasound scanning robots are being developed and researched. One of the important research issue of the master-slave type ultra...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-019-01915-3

    authors: Kim YJ,Park CK,Kim KG

    更新日期:2019-05-01 00:00:00

  • BEM-based simulation of lung respiratory deformation for CT-guided biopsy.

    abstract:PURPOSE:Accurate and real-time prediction of the lung and lung tumor deformation during respiration are important considerations when performing a peripheral biopsy procedure. However, most existing work focused on offline whole lung simulation using 4D image data, which is not applicable in real-time image-guided biop...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-017-1603-8

    authors: Chen D,Chen W,Huang L,Feng X,Peters T,Gu L

    更新日期:2017-09-01 00:00:00

  • Interactive navigation of segmented MR angiograms using simultaneous curved planar and volume visualizations.

    abstract:PURPOSE:Interactive visualization is required to inspect and monitor the automatic segmentation of vessels derived from contrast-enhanced magnetic resonance angiography (CE-MRA). A dual-view visualization scheme consisting of curved planar reformation (CPR) and direct volume rendering (DVR) was developed for this purpo...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-010-0534-4

    authors: van Schooten BW,van Dijk EM,Suinesiaputra A,Reiber JH

    更新日期:2011-09-01 00:00:00

  • Estimating needle tip deflection in biological tissue from a single transverse ultrasound image: application to brachytherapy.

    abstract:PURPOSE:This paper proposes a method to predict the deflection of a flexible needle inserted into soft tissue based on the observation of deflection at a single point along the needle shaft. METHODS:We model the needle-tissue as a discretized structure composed of several virtual, weightless, rigid links connected by ...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-015-1329-4

    authors: Rossa C,Sloboda R,Usmani N,Tavakoli M

    更新日期:2016-07-01 00:00:00

  • Ultrasound texture-based CAD system for detecting neuromuscular diseases.

    abstract:PURPOSE:Diagnosis of neuromuscular diseases in ultrasonography is a challenging task since experts are often unable to discriminate between healthy and pathological cases. A computer-aided diagnosis (CAD) system for skeletal muscle ultrasonography was developed and tested for myositis detection in ultrasound images of ...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-014-1133-6

    authors: König T,Steffen J,Rak M,Neumann G,von Rohden L,Tönnies KD

    更新日期:2015-09-01 00:00:00

  • Temporal enhancement of 2D color Doppler echocardiography sequences by fragment-based frame reordering and refinement.

    abstract:PURPOSE:The goal of this study was to develop an algorithm that enhances the temporal resolution of two-dimensional color Doppler echocardiography (2D CDE) by reordering all the acquired frames and filtering out the frames corrupted by out-of-plane motion and arrhythmia. METHODS:The algorithm splits original frame seq...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-019-01926-0

    authors: Terentjev AB,Perrin DP,Settlemier SH,Zurakowski D,Smirnov PO,Del Nido PJ,Shturts IV,Vasilyev NV

    更新日期:2019-04-01 00:00:00

  • Segmentation-based registration of ultrasound volumes for glioma resection in image-guided neurosurgery.

    abstract:PURPOSE:In image-guided surgery for glioma removal, neurosurgeons usually plan the resection on images acquired before surgery and use them for guidance during the subsequent intervention. However, after the surgical procedure has begun, the preplanning images become unreliable due to the brain shift phenomenon, caused...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-019-02045-6

    authors: Canalini L,Klein J,Miller D,Kikinis R

    更新日期:2019-10-01 00:00:00

  • Automatic needle tracking using Mask R-CNN for MRI-guided percutaneous interventions.

    abstract:PURPOSE:Accurate needle tracking provides essential information for MRI-guided percutaneous interventions. Passive needle tracking using MR images is challenged by variations of the needle-induced signal void feature in different situations. This work aimed to develop an automatic needle tracking algorithm for MRI-guid...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-020-02226-8

    authors: Li X,Young AS,Raman SS,Lu DS,Lee YH,Tsao TC,Wu HH

    更新日期:2020-10-01 00:00:00

  • Augmented reality patient-specific reconstruction plate design for pelvic and acetabular fracture surgery.

    abstract:PURPOSE:The objective of this work is to develop a preoperative reconstruction plate design system for unilateral pelvic and acetabular fracture reduction and internal fixation surgery, using computer graphics and augmented reality (AR) techniques, in order to respect the patient-specific morphology and to reduce surgi...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-012-0775-5

    authors: Shen F,Chen B,Guo Q,Qi Y,Shen Y

    更新日期:2013-03-01 00:00:00

  • Generative multi-adversarial network for striking the right balance in abdominal image segmentation.

    abstract::Purpose The identification of abnormalities that are relatively rare within otherwise normal anatomy is a major challenge for deep learning in the semantic segmentation of medical images. The small number of samples of the minority classes in the training data makes the learning of optimal classification challenging, ...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-020-02254-4

    authors: Rezaei M,Näppi JJ,Lippert C,Meinel C,Yoshida H

    更新日期:2020-11-01 00:00:00

  • Designing and validating a PVA liver phantom with respiratory motion for needle-based interventions.

    abstract:PURPOSE:The purpose is to design and validate an anthropomorphic polyvinyl alcohol (PVA) liver phantom with respiratory motion to simulate needle-based interventions. Such a system can, for example, be used as a validation tool for novel needles. METHODS:Image segmentations of CT scans of four patients during inspirat...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-019-02029-6

    authors: de Jong TL,Moelker A,Dankelman J,van den Dobbelsteen JJ

    更新日期:2019-12-01 00:00:00

  • Automatic cardiac ventricle segmentation in MR images: a validation study.

    abstract:PURPOSE:Segmenting the cardiac ventricles in magnetic resonance (MR) images is required for cardiac function assessment. Numerous segmentation methods have been developed and applied to MR ventriculography. Quantitative validation of these segmentation methods with ground truth is needed prior to clinical use, but requ...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-010-0532-6

    authors: Grosgeorge D,Petitjean C,Caudron J,Fares J,Dacher JN

    更新日期:2011-09-01 00:00:00

  • A projected landmark method for reduction of registration error in image-guided surgery systems.

    abstract:PURPOSE:Image-guided surgery systems are limited by registration error, so practical and effective methods to improve accuracy are necessary. A projection point-based method for reducing the surface registration error in image-guided surgery was developed and tested. METHODS:Checkerboard patterns are projected on visi...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-014-1075-z

    authors: Serej ND,Ahmadian A,Mohagheghi S,Sadrehosseini SM

    更新日期:2015-05-01 00:00:00

  • MRI-compatible positioning device for guiding a focused ultrasound system for transrectal treatment of prostate cancer.

    abstract:BACKGROUND:High-intensity focused ultrasound (HIFU) is a promising treatment method for many common cancers, including prostate cancer. Magnetic resonance image (MRI) guidance of HIFU permits targeting and monitoring of therapy. A prototype MRI-compatible positioning device that navigates a HIFU transducer was designed...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-013-0964-x

    authors: Yiallouras C,Mylonas N,Damianou C

    更新日期:2014-07-01 00:00:00

  • Decision support system for the planning of minimally invasive aortic valve replacement surgery.

    abstract:PURPOSE:Minimally invasive aortic valve replacement (MIAVR) procedures remain more complex and technically challenging compared to conventional full sternotomy surgery. This technique involves a restricted surgical field and a limited workspace, which is, at present, strictly reserved for the most experienced surgeons....

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-018-1725-7

    authors: Li H,Castro M,Haigron P,Verhoye JP,Ruggieri VG

    更新日期:2018-08-01 00:00:00

  • Brain tumor detection and segmentation in a CRF (conditional random fields) framework with pixel-pairwise affinity and superpixel-level features.

    abstract:PURPOSE:Detection and segmentation of a brain tumor such as glioblastoma multiforme (GBM) in magnetic resonance (MR) images are often challenging due to its intrinsically heterogeneous signal characteristics. A robust segmentation method for brain tumor MRI scans was developed and tested. METHODS:Simple thresholds and...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-013-0922-7

    authors: Wu W,Chen AY,Zhao L,Corso JJ

    更新日期:2014-03-01 00:00:00

  • Differential geometry-based techniques for characterization of boundary roughness of pulmonary nodules in CT images.

    abstract:PURPOSE:Boundary roughness of a pulmonary nodule is an important indication of its malignancy. The irregularity of the shape of a nodule is represented in terms of a few diagnostic characteristics such as spiculation, lobulation, and sphericity. Quantitative characterization of these diagnostic characteristics is essen...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-015-1284-0

    authors: Dhara AK,Mukhopadhyay S,Saha P,Garg M,Khandelwal N

    更新日期:2016-03-01 00:00:00

  • FCNN-based axon segmentation for convection-enhanced delivery optimization.

    abstract:PURPOSE:Glioblastoma multiforme treatment is a challenging task in clinical oncology. Convection- enhanced delivery (CED) is showing encouraging but still suboptimal results due to drug leakages. Numerical models can predict drug distribution within the brain, but require retrieving brain physical properties, such as t...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-018-01911-z

    authors: Vidotto M,De Momi E,Gazzara M,Mattos LS,Ferrigno G,Moccia S

    更新日期:2019-03-01 00:00:00

  • Design considerations for a novel MRI compatible manipulator for prostate cryoablation.

    abstract:PURPOSE:Prostate carcinoma is a commonly diagnosed cancer in men. Nonsurgical treatment of early stage prostate cancer is an important alternative. The use of MRI for tumor cryoablation is of particular interest: it offers lower morbidity compared with other localized techniques. However, the current manual procedure i...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-011-0558-4

    authors: Abdelaziz S,Esteveny L,Renaud P,Bayle B,Barbé L,De Mathelin M,Gangi A

    更新日期:2011-11-01 00:00:00

  • Pre-clinical evaluation of an image-guided in-situ Raman spectroscopy navigation system for targeted prostate cancer interventions.

    abstract:PURPOSE:Transrectal ultrasound (TRUS) image guidance is the standard of care for diagnostic and therapeutic interventions in prostate cancer (PCa) patients, but can lead to high false-negative rates, compromising downstream effectiveness of therapeutic choices. A promising approach to improve in-situ detection of PCa l...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-020-02136-9

    authors: Shams R,Picot F,Grajales D,Sheehy G,Dallaire F,Birlea M,Saad F,Trudel D,Menard C,Leblond F,Kadoury S

    更新日期:2020-05-01 00:00:00

  • Translatory hip kinematics measured with optoelectronic surgical navigation.

    abstract:PURPOSE:An optoelectronic surgical navigation system was used to detect small but measurable translational motion of human hip cadavers in high-range passive motions. Kinematic data were also examined to demonstrate the role of soft tissues in constraining hip translation. METHODS:Twelve cadaver hips were scanned usin...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-017-1629-y

    authors: Zakani S,Rudan JF,Ellis RE

    更新日期:2017-08-01 00:00:00

  • Simulation of mammographic breast compression in 3D MR images using ICP-based B-spline deformation for multimodality breast cancer diagnosis.

    abstract:PURPOSE:Multimodality mammography using conventional 2D mammography and dynamic contrast-enhanced 3D magnetic resonance imaging (DCE-MRI) is frequently performed for breast cancer detection and diagnosis. Combination of both imaging modalities requires superimposition of corresponding structures in mammograms and MR im...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-014-0976-1

    authors: Krüger J,Ehrhardt J,Bischof A,Handels H

    更新日期:2014-05-01 00:00:00

  • A deep learning framework for efficient analysis of breast volume and fibroglandular tissue using MR data with strong artifacts.

    abstract:PURPOSE:The main purpose of this work is to develop, apply, and evaluate an efficient approach for breast density estimation in magnetic resonance imaging data, which contain strong artifacts including intensity inhomogeneities. METHODS:We present a pipeline for breast density estimation, which consists of intensity i...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-019-01928-y

    authors: Ivanovska T,Jentschke TG,Daboul A,Hegenscheid K,Völzke H,Wörgötter F

    更新日期:2019-10-01 00:00:00

  • System events: readily accessible features for surgical phase detection.

    abstract:PURPOSE:Surgical phase recognition using sensor data is challenging due to high variation in patient anatomy and surgeon-specific operating styles. Segmenting surgical procedures into constituent phases is of significant utility for resident training, education, self-review, and context-aware operating room technologie...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-016-1409-0

    authors: Malpani A,Lea C,Chen CC,Hager GD

    更新日期:2016-06-01 00:00:00

  • Statistical model based analysis of bone mineral density of lumbar spine.

    abstract:OBJECTIVE:For planning surgical interventions at the spine affected by osteoporosis, accurate information about the local bone quality in terms of anchorage strength for implants is very important. Based on previous work on automated bone quality assessment on the proximal femur with a completely automated model-based ...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-009-0287-0

    authors: Leber S,Fritscher KD,Schmoelz W,Schubert R

    更新日期:2009-05-01 00:00:00

  • Four-dimensional fully convolutional residual network-based liver segmentation in Gd-EOB-DTPA-enhanced MRI.

    abstract:PURPOSE:Gadolinium-ethoxybenzyl-diethylenetriamine pentaacetic acid (Gd-EOB-DTPA)-enhanced magnetic resonance imaging (MRI) tends to show higher diagnostic accuracy than other modalities. There is a demand for computer-assisted detection (CAD) software for Gd-EOB-DTPA-enhanced MRI. Segmentation with high accuracy is im...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-019-01935-z

    authors: Takenaga T,Hanaoka S,Nomura Y,Nemoto M,Murata M,Nakao T,Miki S,Yoshikawa T,Hayashi N,Abe O

    更新日期:2019-08-01 00:00:00

  • Real-time inextensible surgical thread simulation.

    abstract:PURPOSE:This paper discusses a real-time simulation method of inextensible surgical thread based on the Cosserat rod theory using position-based dynamics (PBD). The method realizes stable twining and knotting of surgical thread while including inextensibility, bending, twisting and coupling effects. METHODS:The Cosser...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-018-1739-1

    authors: Xu L,Liu Q

    更新日期:2018-07-01 00:00:00