Multi-input deep learning architecture for predicting breast tumor response to chemotherapy using quantitative MR images.

Abstract:

PURPOSE:Neoadjuvant chemotherapy (NAC) aims to minimize the tumor size before surgery. Predicting response to NAC could reduce toxicity and delays to effective intervention. Computational analysis of dynamic contrast-enhanced magnetic resonance images (DCE-MRI) through deep convolution neural network (CNN) has shown a significant performance to distinguish responders and no responder's patients. This study intends to present a new deep learning (DL) model predicting the breast cancer response to NAC based on multiple MRI inputs. METHODS:A cohort of 723 axial slices extracted from 42 breast cancer patients who underwent NAC therapy was used to train and validate the developed DL model. This dataset was provided by our collaborator institute of radiology in Brussels. Fourteen external cases were used to validate the best obtained model to predict pCR based on pre- and post-chemotherapy DCE-MRI. The model performance was assessed by area under the receiver operating characteristic curve (AUC), accuracy, sensitivity, specificity, and feature map visualization. RESULTS:The developed multi-inputs deep learning architecture was able to predict the pCR to NAC treatment in the validation dataset with an AUC of 0.91 using combined pre- and post-NAC images. The visual results showed that the most important extracted features from non-pCR tumors are in the peripheral region. The proposed method was more productive than the previous ones. CONCLUSION:Even with a limited training dataset size, the proposed and developed CNN model using DCE-MR images acquired before and after the first chemotherapy was able to classify pCR and non-pCR patients with substantial accuracy. This model could be used hereafter in clinical analysis after its evaluation based on more extra data.

authors

El Adoui M,Drisis S,Benjelloun M

doi

10.1007/s11548-020-02209-9

subject

Has Abstract

pub_date

2020-09-01 00:00:00

pages

1491-1500

issue

9

eissn

1861-6410

issn

1861-6429

pii

10.1007/s11548-020-02209-9

journal_volume

15

pub_type

杂志文章
  • Computer-aided cephalometric landmark annotation for CBCT data.

    abstract:PURPOSE:Nowadays, with the increased diffusion of Cone Beam Computerized Tomography (CBCT) scanners in dental and maxillo-facial practice, 3D cephalometric analysis is emerging. Maxillofacial surgeons and dentists make wide use of cephalometric analysis in diagnosis, surgery and treatment planning. Accuracy and repeata...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-016-1453-9

    authors: Codari M,Caffini M,Tartaglia GM,Sforza C,Baselli G

    更新日期:2017-01-01 00:00:00

  • Articular surface remodeling of the hip after periacetabular osteotomy.

    abstract:PURPOSE:Periacetabular osteotomies are a family of surgical procedures used to treat hip dysplasia. In a periacetabular osteotomy, the operating surgeon aims to increase acetabular coverage of the femoral head. The surgical correction has mechanical goals of increasing the stability of the joint and to improving the pr...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-011-0641-x

    authors: Rasquinha BJ,Sayani J,Rudan JF,Wood GC,Ellis RE

    更新日期:2012-03-01 00:00:00

  • Path generator control system and virtual compliance calculator for maxillofacial massage robots.

    abstract:PURPOSE:Oral disorders such as temporomandibular joint disorders (TMD) and dry mouth are common and often require treatment. Maxillofacial massage is used as a complementary and alternative therapy for these disorders. We developed an oral rehabilitation robot that massages the maxillofacial tissues for this purpose. I...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-009-0383-1

    authors: Ishii H,Koga H,Obokawa Y,Solis J,Takanishi A,Katsumata A

    更新日期:2010-01-01 00:00:00

  • Development of a shoulder-mounted robot for MRI-guided needle placement: phantom study.

    abstract:PURPOSE:This paper presents new quantitative data on a signal-to-noise ratio (SNR) study, distortion study, and targeting accuracy phantom study for our patient-mounted robot (called Arthrobot). Arthrobot was developed as an MRI-guided needle placement device for diagnostic and interventional procedures such as arthrog...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-018-1839-y

    authors: Monfaredi R,Iordachita I,Wilson E,Sze R,Sharma K,Krieger A,Fricke S,Cleary K

    更新日期:2018-11-01 00:00:00

  • Development of preoperative planning software for transforaminal endoscopic surgery and the guidance for clinical applications.

    abstract:PURPOSE:Preoperative planning is of great importance for transforaminal endoscopic techniques applied in percutaneous endoscopic lumbar discectomy. In this study, a modular preoperative planning software for transforaminal endoscopic surgery was developed and demonstrated. METHODS:The path searching method is based on...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-015-1282-2

    authors: Chen X,Cheng J,Gu X,Sun Y,Politis C

    更新日期:2016-04-01 00:00:00

  • Toward a standard ontology of surgical process models.

    abstract:PURPOSE:The development of common ontologies has recently been identified as one of the key challenges in the emerging field of surgical data science (SDS). However, past and existing initiatives in the domain of surgery have mainly been focussing on individual groups and failed to achieve widespread international acce...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-018-1824-5

    authors: Gibaud B,Forestier G,Feldmann C,Ferrigno G,Gonçalves P,Haidegger T,Julliard C,Katić D,Kenngott H,Maier-Hein L,März K,de Momi E,Nagy DÁ,Nakawala H,Neumann J,Neumuth T,Rojas Balderrama J,Speidel S,Wagner M,Jannin P

    更新日期:2018-09-01 00:00:00

  • Real-time marker-free patient registration for electromagnetic navigated bronchoscopy: a phantom study.

    abstract:PURPOSE:To perform bronchoscopy safely and smoothly, it is very important to develop a bronchoscopic guidance system. Transbronchial lung biopsy (TBLB) with a bronchoscopic guidance system especially should permit safe image-guided procedures. Recently, electromagnetic tracking (EMT) is utilized to track the tip of the...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-011-0626-9

    authors: Deguchi D,Feuerstein M,Kitasaka T,Suenaga Y,Ide I,Murase H,Imaizumi K,Hasegawa Y,Mori K

    更新日期:2012-05-01 00:00:00

  • Interactive bone drilling using a 2D pointing device to support Microendoscopic Discectomy planning.

    abstract:PURPOSE:To support preoperative planning of bone drilling for Microendoscopic Discectomy, we present a set of interactive bone-drilling methods using a general 2D pointing device. METHODS:Unlike the existing methods, our framework has the following features: (1) the user can directly cut away arbitrary 3D regions on t...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-010-0413-z

    authors: Imanishi K,Nakao M,Kioka M,Mori M,Yoshida M,Takahashi T,Minato K

    更新日期:2010-09-01 00:00:00

  • Temporal enhancement of 2D color Doppler echocardiography sequences by fragment-based frame reordering and refinement.

    abstract:PURPOSE:The goal of this study was to develop an algorithm that enhances the temporal resolution of two-dimensional color Doppler echocardiography (2D CDE) by reordering all the acquired frames and filtering out the frames corrupted by out-of-plane motion and arrhythmia. METHODS:The algorithm splits original frame seq...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-019-01926-0

    authors: Terentjev AB,Perrin DP,Settlemier SH,Zurakowski D,Smirnov PO,Del Nido PJ,Shturts IV,Vasilyev NV

    更新日期:2019-04-01 00:00:00

  • Robust motion tracking in liver from 2D ultrasound images using supporters.

    abstract:PURPOSE:Effectiveness of image-guided radiation therapy with precise dose delivery depends highly on accurate target localization, which may involve motion during treatment due to, e.g., breathing and drift. Therefore, it is important to track the motion and adjust the radiation delivery accordingly. Tracking generally...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-017-1559-8

    authors: Ozkan E,Tanner C,Kastelic M,Mattausch O,Makhinya M,Goksel O

    更新日期:2017-06-01 00:00:00

  • Computer-aided detection of breast carcinoma in standard mammographic projections with digital mammography.

    abstract:PURPOSE:A retrospective evaluation of the ability of computer-aided detection (CAD) ability to identify breast carcinoma in standard mammographic projections. MATERIALS AND METHODS:Forty-five biopsy proven lesions in 44 patients imaged digitally with CAD applied at examination were reviewed. Forty-four screening BIRAD...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-009-0300-7

    authors: Destounis S,Hanson S,Morgan R,Murphy P,Somerville P,Seifert P,Andolina V,Arieno A,Skolny M,Logan-Young W

    更新日期:2009-06-01 00:00:00

  • Predicting surgical skill from the first N seconds of a task: value over task time using the isogony principle.

    abstract:PURPOSE:Most evaluations of surgical workflow or surgeon skill use simple, descriptive statistics (e.g., time) across whole procedures, thereby deemphasizing critical steps and potentially obscuring critical inefficiencies or skill deficiencies. In this work, we examine off-line, temporal clustering methods that chunk ...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-017-1606-5

    authors: French A,Lendvay TS,Sweet RM,Kowalewski TM

    更新日期:2017-07-01 00:00:00

  • Suspension laryngoscopy using a curved-frame trans-oral robotic system.

    abstract:PURPOSE:Suspension laryngoscopy has been employed for laryngeal diseases such as treatment for a polyp, cystoma, or granuloma. After securing a straight path with a laryngoscope, the surgeon inserts rigid instruments and examines the target lesion by using a microscope. However, many patients suffer from secondary comp...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-013-0944-1

    authors: Kwon YS,Tae K,Yi BJ

    更新日期:2014-07-01 00:00:00

  • Precise 3D/2D calibration between a RGB-D sensor and a C-arm fluoroscope.

    abstract:PURPOSE:Calibration and registration are the first steps for augmented reality and mixed reality applications. In the medical field, the calibration between an RGB-D camera and a C-arm fluoroscope is a new topic which introduces challenges. METHOD:A convenient and efficient calibration phantom is designed by combining...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-015-1347-2

    authors: Wang X,Habert S,Ma M,Huang CH,Fallavollita P,Navab N

    更新日期:2016-08-01 00:00:00

  • Designing and validating a PVA liver phantom with respiratory motion for needle-based interventions.

    abstract:PURPOSE:The purpose is to design and validate an anthropomorphic polyvinyl alcohol (PVA) liver phantom with respiratory motion to simulate needle-based interventions. Such a system can, for example, be used as a validation tool for novel needles. METHODS:Image segmentations of CT scans of four patients during inspirat...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-019-02029-6

    authors: de Jong TL,Moelker A,Dankelman J,van den Dobbelsteen JJ

    更新日期:2019-12-01 00:00:00

  • A gesture-controlled projection display for CT-guided interventions.

    abstract:PURPOSE:The interaction with interventional imaging systems within a sterile environment is a challenging task for physicians. Direct physician-machine interaction during an intervention is rather limited because of sterility and workspace restrictions. METHODS:We present a gesture-controlled projection display that e...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-015-1215-0

    authors: Mewes A,Saalfeld P,Riabikin O,Skalej M,Hansen C

    更新日期:2016-01-01 00:00:00

  • Contour propagation using non-uniform cubic B-splines for lung tumor delineation in 4D-CT.

    abstract:PURPOSE:Accurate target delineation is a critical step in radiotherapy. In this study, a robust contour propagation method is proposed to help physicians delineate lung tumors in four-dimensional computer tomography (4D-CT) images efficiently and accurately. METHODS:The proposed method starts with manually delineated ...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-016-1457-5

    authors: Liu Y,Jin R,Chen M,Song E,Xu X,Zhang S,Hung CC

    更新日期:2016-12-01 00:00:00

  • Simulation of mammographic breast compression in 3D MR images using ICP-based B-spline deformation for multimodality breast cancer diagnosis.

    abstract:PURPOSE:Multimodality mammography using conventional 2D mammography and dynamic contrast-enhanced 3D magnetic resonance imaging (DCE-MRI) is frequently performed for breast cancer detection and diagnosis. Combination of both imaging modalities requires superimposition of corresponding structures in mammograms and MR im...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-014-0976-1

    authors: Krüger J,Ehrhardt J,Bischof A,Handels H

    更新日期:2014-05-01 00:00:00

  • Meaningful Assessment of Robotic Surgical Style using the Wisdom of Crowds.

    abstract:OBJECTIVE:Quantitative assessment of surgical skills is an important aspect of surgical training; however, the proposed metrics are sometimes difficult to interpret and may not capture the stylistic characteristics that define expertise. This study proposes a methodology for evaluating the surgical skill, based on metr...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-018-1738-2

    authors: Ershad M,Rege R,Fey AM

    更新日期:2018-07-01 00:00:00

  • A computer analysis method for correlating knee X-rays with continuous indicators.

    abstract:PURPOSE:To develop an image analysis method that can automatically find correlations between a set of plain radiographs and continuous clinical or physiological indicators. METHODS:Knee X-rays taken from the Baltimore Longitudinal Study of Aging are used in this study. The computer analysis method is based on the WND-...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-011-0550-z

    authors: Shamir L

    更新日期:2011-09-01 00:00:00

  • Video-based computer navigation in knee arthroscopy for patient-specific ACL reconstruction.

    abstract:PURPOSE:The anterior cruciate ligament tear is a common medical condition that is treated using arthroscopy by pulling a tissue graft through a tunnel opened with a drill. The correct anatomical position and orientation of this tunnel are crucial for knee stability, and drilling an adequate bone tunnel is the most tech...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-019-02021-0

    authors: Raposo C,Barreto JP,Sousa C,Ribeiro L,Melo R,Oliveira JP,Marques P,Fonseca F,Barrett D

    更新日期:2019-09-01 00:00:00

  • Long-term experience with setup and implementation of an IHE-based image management and distribution system in intersectoral clinical routine.

    abstract:PURPOSE:Sharing of medical data is crucial for the proper treatment of patients as it could reduce the risk of duplicated medical tests and speed up the care process if all documents are readily available. Despite great technical progress, sharing patient data while maintaining full control over the process in an inter...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-018-1819-2

    authors: Schwind F,Münch H,Schröter A,Brandner R,Kutscha U,Brandner A,Heinze O,Bergh B,Engelmann U

    更新日期:2018-11-01 00:00:00

  • Hybrid simulation using mixed reality for interventional ultrasound imaging training.

    abstract:PURPOSE:Ultrasound (US) imaging offers advantages over other imaging modalities and has become the most widespread modality for many diagnostic and interventional procedures. However, traditional 2D US requires a long training period, especially to learn how to manipulate the probe. A hybrid interactive system based on...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-014-1113-x

    authors: Freschi C,Parrini S,Dinelli N,Ferrari M,Ferrari V

    更新日期:2015-07-01 00:00:00

  • Shot boundary detection in endoscopic surgery videos using a variational Bayesian framework.

    abstract:PURPOSE:Over the last decade, the demand for content management of video recordings of surgical procedures has greatly increased. Although a few research methods have been published toward this direction, the related literature is still in its infancy. In this paper, we address the problem of shot detection in endoscop...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-016-1431-2

    authors: Loukas C,Nikiteas N,Schizas D,Georgiou E

    更新日期:2016-11-01 00:00:00

  • On-patient see-through augmented reality based on visual SLAM.

    abstract:PURPOSE:An augmented reality system to visualize a 3D preoperative anatomical model on intra-operative patient is proposed. The hardware requirement is commercial tablet-PC equipped with a camera. Thus, no external tracking device nor artificial landmarks on the patient are required. METHODS:We resort to visual SLAM t...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-016-1444-x

    authors: Mahmoud N,Grasa ÓG,Nicolau SA,Doignon C,Soler L,Marescaux J,Montiel JM

    更新日期:2017-01-01 00:00:00

  • Automated objective surgical skill assessment in the operating room from unstructured tool motion in septoplasty.

    abstract:PURPOSE:Previous work on surgical skill assessment using intraoperative tool motion has focused on highly structured surgical tasks such as cholecystectomy and used generic motion metrics such as time and number of movements. Other statistical methods such as hidden Markov models (HMM) and descriptive curve coding (DCC...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-015-1194-1

    authors: Ahmidi N,Poddar P,Jones JD,Vedula SS,Ishii L,Hager GD,Ishii M

    更新日期:2015-06-01 00:00:00

  • Formal verification of software-based medical devices considering medical guidelines.

    abstract:OBJECTIVE:Software-based devices have increasingly become an important part of several clinical scenarios. Due to their critical impact on human life, medical devices have very strict safety requirements. It is therefore necessary to apply verification methods to ensure that the safety requirements are met. Verificatio...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-013-0919-2

    authors: Daw Z,Cleaveland R,Vetter M

    更新日期:2014-01-01 00:00:00

  • Endoscopic scene labelling and augmentation using intraoperative pulsatile motion and colour appearance cues with preoperative anatomical priors.

    abstract:PURPOSE:Despite great advances in medical image segmentation, the accurate and automatic segmentation of endoscopic scenes remains a challenging problem. Two important aspects have to be considered in segmenting an endoscopic scene: (1) noise and clutter due to light reflection and smoke from cutting tissue, and (2) st...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-015-1331-x

    authors: Nosrati MS,Amir-Khalili A,Peyrat JM,Abinahed J,Al-Alao O,Al-Ansari A,Abugharbieh R,Hamarneh G

    更新日期:2016-08-01 00:00:00

  • A computer vision technique for automated assessment of surgical performance using surgeons' console-feed videos.

    abstract:PURPOSE:To develop and validate an automated assessment of surgical performance (AASP) system for objective and computerized assessment of pelvic lymph node dissection (PLND) as an integral part of robot-assisted radical cystectomy (RARC) using console-feed videos recorded during live surgery. METHODS:Video recordings...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-018-1881-9

    authors: Baghdadi A,Hussein AA,Ahmed Y,Cavuoto LA,Guru KA

    更新日期:2019-04-01 00:00:00

  • Preliminary study on magnetic tracking-based planar shape sensing and navigation for flexible surgical robots in transoral surgery: methods and phantom experiments.

    abstract:PURPOSE:Flexible surgical robot can work in confined and complex environments, which makes it a good option for minimally invasive surgery. In order to utilize flexible manipulators in complicated and constrained surgical environments, it is of great significance to monitor the position and shape of the curvilinear man...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-017-1672-8

    authors: Song S,Zhang C,Liu L,Meng MQ

    更新日期:2018-02-01 00:00:00