Learned optical flow for intra-operative tracking of the retinal fundus.

Abstract:

PURPOSE:Sustained delivery of regenerative retinal therapies by robotic systems requires intra-operative tracking of the retinal fundus. We propose a supervised deep convolutional neural network to densely predict semantic segmentation and optical flow of the retina as mutually supportive tasks, implicitly inpainting retinal flow information missing due to occlusion by surgical tools. METHODS:As manual annotation of optical flow is infeasible, we propose a flexible algorithm for generation of large synthetic training datasets on the basis of given intra-operative retinal images. We evaluate optical flow estimation by tracking a grid and sparsely annotated ground truth points on a benchmark of challenging real intra-operative clips obtained from an extensive internally acquired dataset encompassing representative vitreoretinal surgical cases. RESULTS:The U-Net-based network trained on the synthetic dataset is shown to generalise well to the benchmark of real surgical videos. When used to track retinal points of interest, our flow estimation outperforms variational baseline methods on clips containing tool motions which occlude the points of interest, as is routinely observed in intra-operatively recorded surgery videos. CONCLUSIONS:The results indicate that complex synthetic training datasets can be used to specifically guide optical flow estimation. Our proposed algorithm therefore lays the foundation for a robust system which can assist with intra-operative tracking of moving surgical targets even when occluded.

authors

Ravasio CS,Pissas T,Bloch E,Flores B,Jalali S,Stoyanov D,Cardoso JM,Da Cruz L,Bergeles C

doi

10.1007/s11548-020-02160-9

subject

Has Abstract

pub_date

2020-05-01 00:00:00

pages

827-836

issue

5

eissn

1861-6410

issn

1861-6429

pii

10.1007/s11548-020-02160-9

journal_volume

15

pub_type

杂志文章
  • A visual odometry base-tracking system for intraoperative C-arm guidance.

    abstract:PURPOSE:C-arms are portable X-ray devices used to generate radiographic images in orthopedic surgical procedures. Evidence suggests that scouting images, which are used to aid in C-arm positioning, result in increased operation time and excess radiation exposure. C-arms are also primarily used qualitatively to view ima...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-020-02229-5

    authors: Haliburton L,Esfandiari H,Guy P,Anglin C,Hodgson A

    更新日期:2020-10-01 00:00:00

  • Dynamic infrared thermography (DIRT) for assessment of skin blood perfusion in cranioplasty: a proof of concept for qualitative comparison with the standard indocyanine green video angiography (ICGA).

    abstract:PURPOSE:Complications in wound healing after neurosurgical operations occur often due to scarred dehiscence with skin blood perfusion disturbance. The standard imaging method for intraoperative skin perfusion assessment is the invasive indocyanine green video angiography (ICGA). The noninvasive dynamic infrared thermog...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-017-1683-5

    authors: Rathmann P,Chalopin C,Halama D,Giri P,Meixensberger J,Lindner D

    更新日期:2018-03-01 00:00:00

  • Comparison of the application of B-mode and strain elastography ultrasound in the estimation of lymph node metastasis of papillary thyroid carcinoma based on a radiomics approach.

    abstract:PURPOSE:B-mode ultrasound (B-US) and strain elastography ultrasound (SE-US) images have a potential to distinguish thyroid tumor with different lymph node (LN) status. The purpose of our study is to investigate whether the application of multi-modality images including B-US and SE-US can improve the discriminability of...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-018-1796-5

    authors: Liu T,Ge X,Yu J,Guo Y,Wang Y,Wang W,Cui L

    更新日期:2018-10-01 00:00:00

  • Interactive navigation of segmented MR angiograms using simultaneous curved planar and volume visualizations.

    abstract:PURPOSE:Interactive visualization is required to inspect and monitor the automatic segmentation of vessels derived from contrast-enhanced magnetic resonance angiography (CE-MRA). A dual-view visualization scheme consisting of curved planar reformation (CPR) and direct volume rendering (DVR) was developed for this purpo...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-010-0534-4

    authors: van Schooten BW,van Dijk EM,Suinesiaputra A,Reiber JH

    更新日期:2011-09-01 00:00:00

  • Analytical derivation of elasticity in breast phantoms for deformation tracking.

    abstract:PURPOSE:Patient-specific biomedical modeling of the breast is of interest for medical applications such as image registration, image guided procedures and the alignment for biopsy or surgery purposes. The computation of elastic properties is essential to simulate deformations in a realistic way. This study presents an ...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-018-1803-x

    authors: Groenhuis V,Visentin F,Siepel FJ,Maris BM,Dall'alba D,Fiorini P,Stramigioli S

    更新日期:2018-10-01 00:00:00

  • Dual-robot ultrasound-guided needle placement: closing the planning-imaging-action loop.

    abstract:PURPOSE:Precise needle placement is an important task during several medical procedures. Ultrasound imaging is often used to guide the needle toward the target region in soft tissue. This task remains challenging due to the user's dependence on image quality, limited field of view, moving target, and moving needle. In ...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-016-1408-1

    authors: Kojcev R,Fuerst B,Zettinig O,Fotouhi J,Lee SC,Frisch B,Taylor R,Sinibaldi E,Navab N

    更新日期:2016-06-01 00:00:00

  • Designing and validating a PVA liver phantom with respiratory motion for needle-based interventions.

    abstract:PURPOSE:The purpose is to design and validate an anthropomorphic polyvinyl alcohol (PVA) liver phantom with respiratory motion to simulate needle-based interventions. Such a system can, for example, be used as a validation tool for novel needles. METHODS:Image segmentations of CT scans of four patients during inspirat...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-019-02029-6

    authors: de Jong TL,Moelker A,Dankelman J,van den Dobbelsteen JJ

    更新日期:2019-12-01 00:00:00

  • Pre-clinical evaluation of an image-guided in-situ Raman spectroscopy navigation system for targeted prostate cancer interventions.

    abstract:PURPOSE:Transrectal ultrasound (TRUS) image guidance is the standard of care for diagnostic and therapeutic interventions in prostate cancer (PCa) patients, but can lead to high false-negative rates, compromising downstream effectiveness of therapeutic choices. A promising approach to improve in-situ detection of PCa l...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-020-02136-9

    authors: Shams R,Picot F,Grajales D,Sheehy G,Dallaire F,Birlea M,Saad F,Trudel D,Menard C,Leblond F,Kadoury S

    更新日期:2020-05-01 00:00:00

  • Path generator control system and virtual compliance calculator for maxillofacial massage robots.

    abstract:PURPOSE:Oral disorders such as temporomandibular joint disorders (TMD) and dry mouth are common and often require treatment. Maxillofacial massage is used as a complementary and alternative therapy for these disorders. We developed an oral rehabilitation robot that massages the maxillofacial tissues for this purpose. I...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-009-0383-1

    authors: Ishii H,Koga H,Obokawa Y,Solis J,Takanishi A,Katsumata A

    更新日期:2010-01-01 00:00:00

  • Scaled, patient-specific 3D vertebral model reconstruction based on 2D lateral fluoroscopy.

    abstract:BACKGROUNDS:Accurate three-dimensional (3D) models of lumbar vertebrae are required for image-based 3D kinematics analysis. MRI or CT datasets are frequently used to derive 3D models but have the disadvantages that they are expensive, time-consuming or involving ionizing radiation (e.g., CT acquisition). An alternative...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-010-0515-7

    authors: Zheng G,Nolte LP,Ferguson SJ

    更新日期:2011-05-01 00:00:00

  • Statistical model based analysis of bone mineral density of lumbar spine.

    abstract:OBJECTIVE:For planning surgical interventions at the spine affected by osteoporosis, accurate information about the local bone quality in terms of anchorage strength for implants is very important. Based on previous work on automated bone quality assessment on the proximal femur with a completely automated model-based ...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-009-0287-0

    authors: Leber S,Fritscher KD,Schmoelz W,Schubert R

    更新日期:2009-05-01 00:00:00

  • A gesture-controlled projection display for CT-guided interventions.

    abstract:PURPOSE:The interaction with interventional imaging systems within a sterile environment is a challenging task for physicians. Direct physician-machine interaction during an intervention is rather limited because of sterility and workspace restrictions. METHODS:We present a gesture-controlled projection display that e...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-015-1215-0

    authors: Mewes A,Saalfeld P,Riabikin O,Skalej M,Hansen C

    更新日期:2016-01-01 00:00:00

  • A pre-operative planning framework for global registration of laparoscopic ultrasound to CT images.

    abstract:PURPOSE:Laparoscopic ultrasound (LUS) enhances the safety of laparoscopic liver resection by enabling real-time imaging of internal structures such as vessels. However, LUS probes can be difficult to use, and many tumours are iso-echoic and hence are not visible. Registration of LUS to a pre-operative CT or MR scan has...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-018-1799-2

    authors: Ramalhinho J,Robu MR,Thompson S,Gurusamy K,Davidson B,Hawkes D,Barratt D,Clarkson MJ

    更新日期:2018-08-01 00:00:00

  • A method for segmentation of dental implants and crestal bone.

    abstract:PURPOSE:Medical imaging and in particular digital radiographic images offer a great deal of information to dentists in the clinical diagnosis and treatment processes on a daily basis. This paper presents a new method aimed to produce an accurate segmentation of dental implants and the crestal bone line in radiographic ...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-012-0802-6

    authors: Cunha P,Guevara MA,Messias A,Rocha S,Reis R,Nicolau PM

    更新日期:2013-09-01 00:00:00

  • Translatory hip kinematics measured with optoelectronic surgical navigation.

    abstract:PURPOSE:An optoelectronic surgical navigation system was used to detect small but measurable translational motion of human hip cadavers in high-range passive motions. Kinematic data were also examined to demonstrate the role of soft tissues in constraining hip translation. METHODS:Twelve cadaver hips were scanned usin...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-017-1629-y

    authors: Zakani S,Rudan JF,Ellis RE

    更新日期:2017-08-01 00:00:00

  • Unravelling the effect of data augmentation transformations in polyp segmentation.

    abstract:PURPOSE:Data augmentation is a common technique to overcome the lack of large annotated databases, a usual situation when applying deep learning to medical imaging problems. Nevertheless, there is no consensus on which transformations to apply for a particular field. This work aims at identifying the effect of differen...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-020-02262-4

    authors: Sánchez-Peralta LF,Picón A,Sánchez-Margallo FM,Pagador JB

    更新日期:2020-12-01 00:00:00

  • Myocardium tracking via matching distributions.

    abstract:OBJECTIVE:The goal of this study is to investigate automatic myocardium tracking in cardiac Magnetic Resonance (MR) sequences using global distribution matching via level-set curve evolution. Rather than relying on the pixelwise information as in existing approaches, distribution matching compares intensity distributio...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-008-0265-y

    authors: Ben Ayed I,Li S,Ross I,Islam A

    更新日期:2009-01-01 00:00:00

  • A computer vision technique for automated assessment of surgical performance using surgeons' console-feed videos.

    abstract:PURPOSE:To develop and validate an automated assessment of surgical performance (AASP) system for objective and computerized assessment of pelvic lymph node dissection (PLND) as an integral part of robot-assisted radical cystectomy (RARC) using console-feed videos recorded during live surgery. METHODS:Video recordings...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-018-1881-9

    authors: Baghdadi A,Hussein AA,Ahmed Y,Cavuoto LA,Guru KA

    更新日期:2019-04-01 00:00:00

  • A projected landmark method for reduction of registration error in image-guided surgery systems.

    abstract:PURPOSE:Image-guided surgery systems are limited by registration error, so practical and effective methods to improve accuracy are necessary. A projection point-based method for reducing the surface registration error in image-guided surgery was developed and tested. METHODS:Checkerboard patterns are projected on visi...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-014-1075-z

    authors: Serej ND,Ahmadian A,Mohagheghi S,Sadrehosseini SM

    更新日期:2015-05-01 00:00:00

  • Multi-input deep learning architecture for predicting breast tumor response to chemotherapy using quantitative MR images.

    abstract:PURPOSE:Neoadjuvant chemotherapy (NAC) aims to minimize the tumor size before surgery. Predicting response to NAC could reduce toxicity and delays to effective intervention. Computational analysis of dynamic contrast-enhanced magnetic resonance images (DCE-MRI) through deep convolution neural network (CNN) has shown a ...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-020-02209-9

    authors: El Adoui M,Drisis S,Benjelloun M

    更新日期:2020-09-01 00:00:00

  • MITK-US: real-time ultrasound support within MITK.

    abstract:PURPOSE:Intra-procedural acquisition of the patient anatomy is a key technique in the context of computer-assisted interventions (CAI). Ultrasound (US) offers major advantages as an interventional imaging modality because it is real time and low cost and does not expose the patient or physician to harmful radiation. To...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-013-0962-z

    authors: März K,Franz AM,Seitel A,Winterstein A,Bendl R,Zelzer S,Nolden M,Meinzer HP,Maier-Hein L

    更新日期:2014-05-01 00:00:00

  • Automatic needle tracking using Mask R-CNN for MRI-guided percutaneous interventions.

    abstract:PURPOSE:Accurate needle tracking provides essential information for MRI-guided percutaneous interventions. Passive needle tracking using MR images is challenged by variations of the needle-induced signal void feature in different situations. This work aimed to develop an automatic needle tracking algorithm for MRI-guid...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-020-02226-8

    authors: Li X,Young AS,Raman SS,Lu DS,Lee YH,Tsao TC,Wu HH

    更新日期:2020-10-01 00:00:00

  • Robust and semantic needle detection in 3D ultrasound using orthogonal-plane convolutional neural networks.

    abstract:PURPOSE:During needle interventions, successful automated detection of the needle immediately after insertion is necessary to allow the physician identify and correct any misalignment of the needle and the target at early stages, which reduces needle passes and improves health outcomes. METHODS:We present a novel appr...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-018-1798-3

    authors: Pourtaherian A,Ghazvinian Zanjani F,Zinger S,Mihajlovic N,Ng GC,Korsten HHM,de With PHN

    更新日期:2018-09-01 00:00:00

  • Shot boundary detection in endoscopic surgery videos using a variational Bayesian framework.

    abstract:PURPOSE:Over the last decade, the demand for content management of video recordings of surgical procedures has greatly increased. Although a few research methods have been published toward this direction, the related literature is still in its infancy. In this paper, we address the problem of shot detection in endoscop...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-016-1431-2

    authors: Loukas C,Nikiteas N,Schizas D,Georgiou E

    更新日期:2016-11-01 00:00:00

  • Video-based computer navigation in knee arthroscopy for patient-specific ACL reconstruction.

    abstract:PURPOSE:The anterior cruciate ligament tear is a common medical condition that is treated using arthroscopy by pulling a tissue graft through a tunnel opened with a drill. The correct anatomical position and orientation of this tunnel are crucial for knee stability, and drilling an adequate bone tunnel is the most tech...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-019-02021-0

    authors: Raposo C,Barreto JP,Sousa C,Ribeiro L,Melo R,Oliveira JP,Marques P,Fonseca F,Barrett D

    更新日期:2019-09-01 00:00:00

  • A low-cost tracked C-arm (TC-arm) upgrade system for versatile quantitative intraoperative imaging.

    abstract:PURPOSE:C-arm fluoroscopy is frequently used in clinical applications as a low-cost and mobile real-time qualitative assessment tool. C-arms, however, are not widely accepted for applications involving quantitative assessments, mainly due to the lack of reliable and low-cost position tracking methods, as well as adequa...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-013-0957-9

    authors: Amiri S,Wilson DR,Masri BA,Anglin C

    更新日期:2014-07-01 00:00:00

  • Automatic bone segmentation in whole-body CT images.

    abstract:PURPOSE:Many diagnostic or treatment planning applications critically depend on the successful localization of bony structures in CT images. Manual or semiautomatic bone segmentation is tedious, however, and often not practical in clinical routine. In this paper, we present a reliable and fully automatic bone segmentat...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-018-1883-7

    authors: Klein A,Warszawski J,Hillengaß J,Maier-Hein KH

    更新日期:2019-01-01 00:00:00

  • Automatic abdominal multi-organ segmentation using deep convolutional neural network and time-implicit level sets.

    abstract:PURPOSE:Multi-organ segmentation from CT images is an essential step for computer-aided diagnosis and surgery planning. However, manual delineation of the organs by radiologists is tedious, time-consuming and poorly reproducible. Therefore, we propose a fully automatic method for the segmentation of multiple organs fro...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-016-1501-5

    authors: Hu P,Wu F,Peng J,Bao Y,Chen F,Kong D

    更新日期:2017-03-01 00:00:00

  • Meaningful Assessment of Robotic Surgical Style using the Wisdom of Crowds.

    abstract:OBJECTIVE:Quantitative assessment of surgical skills is an important aspect of surgical training; however, the proposed metrics are sometimes difficult to interpret and may not capture the stylistic characteristics that define expertise. This study proposes a methodology for evaluating the surgical skill, based on metr...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-018-1738-2

    authors: Ershad M,Rege R,Fey AM

    更新日期:2018-07-01 00:00:00

  • Augmented reality patient-specific reconstruction plate design for pelvic and acetabular fracture surgery.

    abstract:PURPOSE:The objective of this work is to develop a preoperative reconstruction plate design system for unilateral pelvic and acetabular fracture reduction and internal fixation surgery, using computer graphics and augmented reality (AR) techniques, in order to respect the patient-specific morphology and to reduce surgi...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-012-0775-5

    authors: Shen F,Chen B,Guo Q,Qi Y,Shen Y

    更新日期:2013-03-01 00:00:00