Abstract:
PURPOSE:Despite great advances in medical image segmentation, the accurate and automatic segmentation of endoscopic scenes remains a challenging problem. Two important aspects have to be considered in segmenting an endoscopic scene: (1) noise and clutter due to light reflection and smoke from cutting tissue, and (2) structure occlusion (e.g. vessels occluded by fat, or endophytic tumours occluded by healthy kidney tissue). METHODS:In this paper, we propose a variational technique to augment a surgeon's endoscopic view by segmenting visible as well as occluded structures in the intraoperative endoscopic view. Our method estimates the 3D pose and deformation of anatomical structures segmented from 3D preoperative data in order to align to and segment corresponding structures in 2D intraoperative endoscopic views. Our preoperative to intraoperative alignment is driven by, first, spatio-temporal, signal processing based vessel pulsation cues and, second, machine learning based analysis of colour and textural visual cues. To our knowledge, this is the first work that utilizes vascular pulsation cues for guiding preoperative to intraoperative registration. In addition, we incorporate a tissue-specific (i.e. heterogeneous) physically based deformation model into our framework to cope with the non-rigid deformation of structures that occurs during the intervention. RESULTS:We validated the utility of our technique on fifteen challenging clinical cases with 45 % improvements in accuracy compared to the state-of-the-art method. CONCLUSIONS:A new technique for localizing both visible and occluded structures in an endoscopic view was proposed and tested. This method leverages both preoperative data, as a source of patient-specific prior knowledge, as well as vasculature pulsation and endoscopic visual cues in order to accurately segment the highly noisy and cluttered environment of an endoscopic video. Our results on in vivo clinical cases of partial nephrectomy illustrate the potential of the proposed framework for augmented reality applications in minimally invasive surgeries.
journal_name
Int J Comput Assist Radiol Surgauthors
Nosrati MS,Amir-Khalili A,Peyrat JM,Abinahed J,Al-Alao O,Al-Ansari A,Abugharbieh R,Hamarneh Gdoi
10.1007/s11548-015-1331-xsubject
Has Abstractpub_date
2016-08-01 00:00:00pages
1409-18issue
8eissn
1861-6410issn
1861-6429pii
10.1007/s11548-015-1331-xjournal_volume
11pub_type
杂志文章abstract:OBJECTIVES:Image-guided otological surgeries require minimal invasiveness and high accuracy, and these two factors usually compete with each other. Our recently developed registration method, called the STAMP method, showed minimal invasiveness with accuracy comparable to that of the current more invasive registration ...
journal_title:International journal of computer assisted radiology and surgery
pub_type: 杂志文章
doi:10.1007/s11548-013-0916-5
更新日期:2014-01-01 00:00:00
abstract:PURPOSE:A personalized estimation of the cochlear shape can be used to create computational anatomical models to aid cochlear implant (CI) surgery and CI audio processor programming ultimately resulting in improved hearing restoration. The purpose of this work is to develop and test a method for estimation of the detai...
journal_title:International journal of computer assisted radiology and surgery
pub_type: 杂志文章
doi:10.1007/s11548-017-1701-7
更新日期:2018-03-01 00:00:00
abstract:PURPOSE:Computer-aided detection (CAD) systems are developed to help radiologists detect colonic polyps over CT scans. It is possible to reduce the detection time and increase the detection accuracy rates by using CAD systems. In this paper, we aimed to develop a fully integrated CAD system for automated detection of p...
journal_title:International journal of computer assisted radiology and surgery
pub_type: 杂志文章
doi:10.1007/s11548-017-1521-9
更新日期:2017-04-01 00:00:00
abstract:PURPOSE:Previous work on surgical skill assessment using intraoperative tool motion has focused on highly structured surgical tasks such as cholecystectomy and used generic motion metrics such as time and number of movements. Other statistical methods such as hidden Markov models (HMM) and descriptive curve coding (DCC...
journal_title:International journal of computer assisted radiology and surgery
pub_type: 杂志文章
doi:10.1007/s11548-015-1194-1
更新日期:2015-06-01 00:00:00
abstract:PURPOSE:Thermotherapy is a clinical procedure which delivers thermal energy to a target, and it has been applied for various medical treatments. Temperature monitoring during thermotherapy is important to achieve precise and reproducible results. Medical ultrasound can be used for thermal monitoring and is an attractiv...
journal_title:International journal of computer assisted radiology and surgery
pub_type: 杂志文章
doi:10.1007/s11548-018-1744-4
更新日期:2018-06-01 00:00:00
abstract:OBJECTIVE:Software-based devices have increasingly become an important part of several clinical scenarios. Due to their critical impact on human life, medical devices have very strict safety requirements. It is therefore necessary to apply verification methods to ensure that the safety requirements are met. Verificatio...
journal_title:International journal of computer assisted radiology and surgery
pub_type: 杂志文章
doi:10.1007/s11548-013-0919-2
更新日期:2014-01-01 00:00:00
abstract:PURPOSE:The interaction with interventional imaging systems within a sterile environment is a challenging task for physicians. Direct physician-machine interaction during an intervention is rather limited because of sterility and workspace restrictions. METHODS:We present a gesture-controlled projection display that e...
journal_title:International journal of computer assisted radiology and surgery
pub_type: 杂志文章
doi:10.1007/s11548-015-1215-0
更新日期:2016-01-01 00:00:00
abstract:PURPOSE:Surgical phase recognition using sensor data is challenging due to high variation in patient anatomy and surgeon-specific operating styles. Segmenting surgical procedures into constituent phases is of significant utility for resident training, education, self-review, and context-aware operating room technologie...
journal_title:International journal of computer assisted radiology and surgery
pub_type: 杂志文章
doi:10.1007/s11548-016-1409-0
更新日期:2016-06-01 00:00:00
abstract:PURPOSE:Multimodality mammography using conventional 2D mammography and dynamic contrast-enhanced 3D magnetic resonance imaging (DCE-MRI) is frequently performed for breast cancer detection and diagnosis. Combination of both imaging modalities requires superimposition of corresponding structures in mammograms and MR im...
journal_title:International journal of computer assisted radiology and surgery
pub_type: 杂志文章
doi:10.1007/s11548-014-0976-1
更新日期:2014-05-01 00:00:00
abstract:PURPOSE:Laparoscopic ultrasound (LUS) enhances the safety of laparoscopic liver resection by enabling real-time imaging of internal structures such as vessels. However, LUS probes can be difficult to use, and many tumours are iso-echoic and hence are not visible. Registration of LUS to a pre-operative CT or MR scan has...
journal_title:International journal of computer assisted radiology and surgery
pub_type: 杂志文章
doi:10.1007/s11548-018-1799-2
更新日期:2018-08-01 00:00:00
abstract:PURPOSE:A retrospective evaluation of the ability of computer-aided detection (CAD) ability to identify breast carcinoma in standard mammographic projections. MATERIALS AND METHODS:Forty-five biopsy proven lesions in 44 patients imaged digitally with CAD applied at examination were reviewed. Forty-four screening BIRAD...
journal_title:International journal of computer assisted radiology and surgery
pub_type: 杂志文章
doi:10.1007/s11548-009-0300-7
更新日期:2009-06-01 00:00:00
abstract:PURPOSE:Four-dimensional computed tomography (4DCT) images are often marred by artifacts that substantially degrade image quality and confound image interpretation. Human observation remains the standard method of 4DCT artifact evaluation, which is time-consuming and subjective. We develop a method to automatically ide...
journal_title:International journal of computer assisted radiology and surgery
pub_type: 杂志文章
doi:10.1007/s11548-017-1538-0
更新日期:2017-09-01 00:00:00
abstract:PURPOSE:The purpose of the present study is to apply kinetic analysis to investigate exercise-related changes in the metabolism of the skeletal muscle of the rat hindlimb by [[Formula: see text]]acetate positron emission tomography and computed tomography (PET/CT). METHODS:Contractions were induced in Wistar rats' lef...
journal_title:International journal of computer assisted radiology and surgery
pub_type: 杂志文章
doi:10.1007/s11548-015-1260-8
更新日期:2016-05-01 00:00:00
abstract:PURPOSE:Realistic modelling of soft tissue biomechanics and mechanical interactions between tissues is an important part of biomechanically-informed surgical image-guidance and surgical simulation. This submission details a contact-modelling pipeline suitable for implementation in explicit matrix-free FEM solvers. Whil...
journal_title:International journal of computer assisted radiology and surgery
pub_type: 杂志文章
doi:10.1007/s11548-014-1142-5
更新日期:2015-11-01 00:00:00
abstract:PURPOSE:Minimally invasive aortic valve replacement (MIAVR) procedures remain more complex and technically challenging compared to conventional full sternotomy surgery. This technique involves a restricted surgical field and a limited workspace, which is, at present, strictly reserved for the most experienced surgeons....
journal_title:International journal of computer assisted radiology and surgery
pub_type: 杂志文章
doi:10.1007/s11548-018-1725-7
更新日期:2018-08-01 00:00:00
abstract:PURPOSE:Statistical shape and appearance models play an important role in reducing the segmentation processing time of a vertebra and in improving results for 3D model development. Here, we describe the different steps in generating a statistical shape model (SSM) of the second cervical vertebra (C2) and provide the sh...
journal_title:International journal of computer assisted radiology and surgery
pub_type: 杂志文章
doi:10.1007/s11548-014-1121-x
更新日期:2015-07-01 00:00:00
abstract:PURPOSE:Oral disorders such as temporomandibular joint disorders (TMD) and dry mouth are common and often require treatment. Maxillofacial massage is used as a complementary and alternative therapy for these disorders. We developed an oral rehabilitation robot that massages the maxillofacial tissues for this purpose. I...
journal_title:International journal of computer assisted radiology and surgery
pub_type: 杂志文章
doi:10.1007/s11548-009-0383-1
更新日期:2010-01-01 00:00:00
abstract:PURPOSE:The favored treatment for many hip fractures is a sliding hip screw, and its usage is expected to increase in the future. Failures can be reduced, and complications detected earlier by semi-automated CT image analysis. The most frequent failure is due to the screw cut-out from the femoral head. METHODS:An imag...
journal_title:International journal of computer assisted radiology and surgery
pub_type: 杂志文章
doi:10.1007/s11548-010-0498-4
更新日期:2010-09-01 00:00:00
abstract:OBJECTIVE:Complex oncologic interventions in the liver require an extensive and careful preoperative analysis. Particularly the achievement of an optimal safety margin around tumors remains a difficult task for surgeons. METHODS:We present new methods for evaluating different safety margins and their effect on the ass...
journal_title:International journal of computer assisted radiology and surgery
pub_type: 杂志文章
doi:10.1007/s11548-009-0359-1
更新日期:2009-09-01 00:00:00
abstract:OBJECTIVE:By adding a tracking sensor to a 3D ultrasound (US) probe and thus locating the probe in space, new applications within the fields of image guided surgery and radiation therapy are possible. To locate the US volume in space, a calibration is necessary to determine the mathematical transformation for mapping p...
journal_title:International journal of computer assisted radiology and surgery
pub_type: 杂志文章
doi:10.1007/s11548-008-0258-x
更新日期:2009-03-01 00:00:00
abstract:PURPOSE:We propose a fully automated method for detection and segmentation of the abnormal tissue associated with brain tumour (tumour core and oedema) from Fluid- Attenuated Inversion Recovery (FLAIR) Magnetic Resonance Imaging (MRI). METHODS:The method is based on superpixel technique and classification of each supe...
journal_title:International journal of computer assisted radiology and surgery
pub_type: 杂志文章
doi:10.1007/s11548-016-1483-3
更新日期:2017-02-01 00:00:00
abstract:PURPOSE:Knowing the location of the blood vessels supplying the skin and subcutaneous tissue is a requirement during the planning of tissue transfer in reconstructive surgery. Commonly used imaging techniques such as computed tomography angiography and indocyanine green angiography expose the patient to radiation or a ...
journal_title:International journal of computer assisted radiology and surgery
pub_type: 杂志文章
doi:10.1007/s11548-018-1892-6
更新日期:2019-03-01 00:00:00
abstract:PURPOSE:Minimally invasive treatment of solid cancers, especially in the breast and liver, remains clinically challenging, despite a variety of treatment modalities, including radiofrequency ablation (RFA), microwave ablation or high-intensity focused ultrasound. Each treatment modality has advantages and disadvantages...
journal_title:International journal of computer assisted radiology and surgery
pub_type: 杂志文章
doi:10.1007/s11548-012-0769-3
更新日期:2012-11-01 00:00:00
abstract:PURPOSE:Patient-specific quantitative assessments of muscle mass and biomechanical musculoskeletal simulations require segmentation of the muscles from medical images. The objective of this work is to automate muscle segmentation from CT data of the hip and thigh. METHOD:We propose a hierarchical multi-atlas method in...
journal_title:International journal of computer assisted radiology and surgery
pub_type: 杂志文章
doi:10.1007/s11548-018-1758-y
更新日期:2018-07-01 00:00:00
abstract:PURPOSE:Laparoscopic techniques have nowadays become a gold standard in many surgical procedures, but they imply a more difficult learning skills process. Simulators have a fundamental role in the formative stage of new surgeons. This paper presents the construct and face validity of SINERGIA laparoscopic virtual reali...
journal_title:International journal of computer assisted radiology and surgery
pub_type: 杂志文章
doi:10.1007/s11548-010-0425-8
更新日期:2010-07-01 00:00:00
abstract:PURPOSE:This paper discusses a real-time simulation method of inextensible surgical thread based on the Cosserat rod theory using position-based dynamics (PBD). The method realizes stable twining and knotting of surgical thread while including inextensibility, bending, twisting and coupling effects. METHODS:The Cosser...
journal_title:International journal of computer assisted radiology and surgery
pub_type: 杂志文章
doi:10.1007/s11548-018-1739-1
更新日期:2018-07-01 00:00:00
abstract:PURPOSE:Neoadjuvant chemotherapy (NAC) aims to minimize the tumor size before surgery. Predicting response to NAC could reduce toxicity and delays to effective intervention. Computational analysis of dynamic contrast-enhanced magnetic resonance images (DCE-MRI) through deep convolution neural network (CNN) has shown a ...
journal_title:International journal of computer assisted radiology and surgery
pub_type: 杂志文章
doi:10.1007/s11548-020-02209-9
更新日期:2020-09-01 00:00:00
abstract:PURPOSE:Current surgical robotic systems are either large serial arms, resulting in higher risks due to their high inertia and no inherent limitations of the working space, or they are bone-mounted, adding substantial additional task steps to the surgical workflow. The robot presented in this paper has a handy and ligh...
journal_title:International journal of computer assisted radiology and surgery
pub_type: 杂志文章
doi:10.1007/s11548-020-02306-9
更新日期:2021-01-23 00:00:00
abstract::Purpose The identification of abnormalities that are relatively rare within otherwise normal anatomy is a major challenge for deep learning in the semantic segmentation of medical images. The small number of samples of the minority classes in the training data makes the learning of optimal classification challenging, ...
journal_title:International journal of computer assisted radiology and surgery
pub_type: 杂志文章
doi:10.1007/s11548-020-02254-4
更新日期:2020-11-01 00:00:00
abstract:PURPOSE:Minimally invasive cochlear implantation is a surgical technique which requires drilling a canal from the mastoid surface toward the basal turn of the cochlea. The choice of an appropriate drilling strategy is hypothesized to have significant influence on the achievable targeting accuracy. Therefore, a method i...
journal_title:International journal of computer assisted radiology and surgery
pub_type: 杂志文章
doi:10.1007/s11548-014-0997-9
更新日期:2014-11-01 00:00:00