A Survey of auditory display in image-guided interventions.

Abstract:

PURPOSE:This article investigates the current state of the art of the use of auditory display in image-guided medical interventions. Auditory display is a means of conveying information using sound, and we review the use of this approach to support navigated interventions. We discuss the benefits and drawbacks of published systems and outline directions for future investigation. METHODS:We undertook a review of scientific articles on the topic of auditory rendering in image-guided intervention. This includes methods for avoidance of risk structures and instrument placement and manipulation. The review did not include auditory display for status monitoring, for instance in anesthesia. RESULTS:We identified 15 publications in the course of the search. Most of the literature (60%) investigates the use of auditory display to convey distance of a tracked instrument to an object using proximity or safety margins. The remainder discuss continuous guidance for navigated instrument placement. Four of the articles present clinical evaluations, 11 present laboratory evaluations, and 3 present informal evaluation (2 present both laboratory and clinical evaluations). CONCLUSION:Auditory display is a growing field that has been largely neglected in research in image-guided intervention. Despite benefits of auditory displays reported in both the reviewed literature and non-medical fields, adoption in medicine has been slow. Future challenges include increasing interdisciplinary cooperation with auditory display investigators to develop more meaningful auditory display designs and comprehensive evaluations which target the benefits and drawbacks of auditory display in image guidance.

authors

Black D,Hansen C,Nabavi A,Kikinis R,Hahn H

doi

10.1007/s11548-017-1547-z

subject

Has Abstract

pub_date

2017-10-01 00:00:00

pages

1665-1676

issue

10

eissn

1861-6410

issn

1861-6429

pii

10.1007/s11548-017-1547-z

journal_volume

12

pub_type

杂志文章,评审
  • Projection-based visual guidance for robot-aided RF needle insertion.

    abstract:PURPOSE:The use of projector-based augmented reality (AR) in surgery may enable surgeons to directly view anatomical models and surgical data from the patient's surface (skin). It has the advantages of a consistent viewing focus on the patient, an extended field of view and augmented interaction. This paper presents an...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-013-0897-4

    authors: Wen R,Chui CK,Ong SH,Lim KB,Chang SK

    更新日期:2013-11-01 00:00:00

  • Force estimation from OCT volumes using 3D CNNs.

    abstract:PURPOSE:Estimating the interaction forces of instruments and tissue is of interest, particularly to provide haptic feedback during robot-assisted minimally invasive interventions. Different approaches based on external and integrated force sensors have been proposed. These are hampered by friction, sensor size, and ste...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-018-1777-8

    authors: Gessert N,Beringhoff J,Otte C,Schlaefer A

    更新日期:2018-07-01 00:00:00

  • Finger-attachment device for the feedback of gripping and pulling force in a manipulating system for brain tumor resection.

    abstract:PURPOSE:Development and evaluation of an effective attachment device for a bilateral brain tumor resection robotic surgery system based on the sensory performance of the human index finger in order to precisely detect gripping- and pulling-force feedback. METHODS:First, a basic test was conducted to investigate the pe...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-017-1640-3

    authors: Chinbe H,Yoneyama T,Watanabe T,Miyashita K,Nakada M

    更新日期:2018-01-01 00:00:00

  • Accuracy of 3D cephalometric measurements based on an automatic knowledge-based landmark detection algorithm.

    abstract:PURPOSE:To evaluate the accuracy of three-dimensional cephalometric measurements obtained through an automatic landmark detection algorithm compared to those obtained through manual identification. METHODS:The study demonstrates a comparison of 51 cephalometric measurements (28 linear, 16 angles and 7 ratios) on 30 CB...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-015-1334-7

    authors: Gupta A,Kharbanda OP,Sardana V,Balachandran R,Sardana HK

    更新日期:2016-07-01 00:00:00

  • A visual odometry base-tracking system for intraoperative C-arm guidance.

    abstract:PURPOSE:C-arms are portable X-ray devices used to generate radiographic images in orthopedic surgical procedures. Evidence suggests that scouting images, which are used to aid in C-arm positioning, result in increased operation time and excess radiation exposure. C-arms are also primarily used qualitatively to view ima...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-020-02229-5

    authors: Haliburton L,Esfandiari H,Guy P,Anglin C,Hodgson A

    更新日期:2020-10-01 00:00:00

  • Learned optical flow for intra-operative tracking of the retinal fundus.

    abstract:PURPOSE:Sustained delivery of regenerative retinal therapies by robotic systems requires intra-operative tracking of the retinal fundus. We propose a supervised deep convolutional neural network to densely predict semantic segmentation and optical flow of the retina as mutually supportive tasks, implicitly inpainting r...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-020-02160-9

    authors: Ravasio CS,Pissas T,Bloch E,Flores B,Jalali S,Stoyanov D,Cardoso JM,Da Cruz L,Bergeles C

    更新日期:2020-05-01 00:00:00

  • Robust GPU-based virtual reality simulation of radio-frequency ablations for various needle geometries and locations.

    abstract:PURPOSE:Radio-frequency ablations play an important role in the therapy of malignant liver lesions. The navigation of a needle to the lesion poses a challenge for both the trainees and intervening physicians. METHODS:This publication presents a new GPU-based, accurate method for the simulation of radio-frequency ablat...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-019-02033-w

    authors: Kath N,Handels H,Mastmeyer A

    更新日期:2019-11-01 00:00:00

  • Estimating needle tip deflection in biological tissue from a single transverse ultrasound image: application to brachytherapy.

    abstract:PURPOSE:This paper proposes a method to predict the deflection of a flexible needle inserted into soft tissue based on the observation of deflection at a single point along the needle shaft. METHODS:We model the needle-tissue as a discretized structure composed of several virtual, weightless, rigid links connected by ...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-015-1329-4

    authors: Rossa C,Sloboda R,Usmani N,Tavakoli M

    更新日期:2016-07-01 00:00:00

  • Robust calculation of the midsagittal plane in CT scans using the Kullback-Leibler's measure.

    abstract:OBJECTIVE:The identification of the interhemispheric fissure (IF) is important in clinical applications for brain landmark identification, registration, symmetry assessment, and pathology detection. The IF is usually approximated by the midsagittal plane (MSP) separating the brain into two hemispheres. We present a fas...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-009-0366-2

    authors: Puspitasari F,Volkau I,Ambrosius W,Nowinski WL

    更新日期:2009-11-01 00:00:00

  • Comparison of the application of B-mode and strain elastography ultrasound in the estimation of lymph node metastasis of papillary thyroid carcinoma based on a radiomics approach.

    abstract:PURPOSE:B-mode ultrasound (B-US) and strain elastography ultrasound (SE-US) images have a potential to distinguish thyroid tumor with different lymph node (LN) status. The purpose of our study is to investigate whether the application of multi-modality images including B-US and SE-US can improve the discriminability of...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-018-1796-5

    authors: Liu T,Ge X,Yu J,Guo Y,Wang Y,Wang W,Cui L

    更新日期:2018-10-01 00:00:00

  • Robust and semantic needle detection in 3D ultrasound using orthogonal-plane convolutional neural networks.

    abstract:PURPOSE:During needle interventions, successful automated detection of the needle immediately after insertion is necessary to allow the physician identify and correct any misalignment of the needle and the target at early stages, which reduces needle passes and improves health outcomes. METHODS:We present a novel appr...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-018-1798-3

    authors: Pourtaherian A,Ghazvinian Zanjani F,Zinger S,Mihajlovic N,Ng GC,Korsten HHM,de With PHN

    更新日期:2018-09-01 00:00:00

  • Planning and simulation of microsurgical laser bone ablation.

    abstract:PURPOSE:Laser ablation of hard tissue is not completely understood until now and not modeled for computer-assisted microsurgery. A precise planning and simulation is an essential step toward the usage of microsurgical laser bone ablation in the operating room. METHODS:Planning the volume for laser bone ablation is bas...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-009-0303-4

    authors: Kahrs LA,Burgner J,Klenzner T,Raczkowsky J,Schipper J,Wörn H

    更新日期:2010-03-01 00:00:00

  • Learning soft tissue behavior of organs for surgical navigation with convolutional neural networks.

    abstract:PURPOSE:In surgical navigation, pre-operative organ models are presented to surgeons during the intervention to help them in efficiently finding their target. In the case of soft tissue, these models need to be deformed and adapted to the current situation by using intra-operative sensor data. A promising method to rea...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-019-01965-7

    authors: Pfeiffer M,Riediger C,Weitz J,Speidel S

    更新日期:2019-07-01 00:00:00

  • Model-based segmentation in orbital volume measurement with cone beam computed tomography and evaluation against current concepts.

    abstract:PURPOSE:Objective determination of the orbital volume is important in the diagnostic process and in evaluating the efficacy of medical and/or surgical treatment of orbital diseases. Tools designed to measure orbital volume with computed tomography (CT) often cannot be used with cone beam CT (CBCT) because of inferior t...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-015-1228-8

    authors: Wagner ME,Gellrich NC,Friese KI,Becker M,Wolter FE,Lichtenstein JT,Stoetzer M,Rana M,Essig H

    更新日期:2016-01-01 00:00:00

  • Automatic phase prediction from low-level surgical activities.

    abstract:PURPOSE:Analyzing surgical activities has received a growing interest in recent years. Several methods have been proposed to identify surgical activities and surgical phases from data acquired in operating rooms. These context-aware systems have multiple applications including: supporting the surgical team during the i...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-015-1195-0

    authors: Forestier G,Riffaud L,Jannin P

    更新日期:2015-06-01 00:00:00

  • PyDBS: an automated image processing workflow for deep brain stimulation surgery.

    abstract:PURPOSE:Deep brain stimulation (DBS) is a surgical procedure for treating motor-related neurological disorders. DBS clinical efficacy hinges on precise surgical planning and accurate electrode placement, which in turn call upon several image processing and visualization tasks, such as image registration, image segmenta...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-014-1007-y

    authors: D'Albis T,Haegelen C,Essert C,Fernández-Vidal S,Lalys F,Jannin P

    更新日期:2015-02-01 00:00:00

  • Within-brain classification for brain tumor segmentation.

    abstract:PURPOSE:In this paper, we investigate a framework for interactive brain tumor segmentation which, at its core, treats the problem of interactive brain tumor segmentation as a machine learning problem. METHODS:This method has an advantage over typical machine learning methods for this task where generalization is made ...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-015-1311-1

    authors: Havaei M,Larochelle H,Poulin P,Jodoin PM

    更新日期:2016-05-01 00:00:00

  • Automatic thalamus and hippocampus segmentation from MP2RAGE: comparison of publicly available methods and implications for DTI quantification.

    abstract:PURPOSE:In both structural and functional MRI, there is a need for accurate and reliable automatic segmentation of brain regions. Inconsistent segmentation reduces sensitivity and may bias results in clinical studies. The current study compares the performance of publicly available segmentation tools and their impact o...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-016-1433-0

    authors: Næss-Schmidt E,Tietze A,Blicher JU,Petersen M,Mikkelsen IK,Coupé P,Manjón JV,Eskildsen SF

    更新日期:2016-11-01 00:00:00

  • Dynamic contrast-enhanced computed tomography diagnosis of primary liver cancers using transfer learning of pretrained convolutional neural networks: Is registration of multiphasic images necessary?

    abstract:PURPOSE:To evaluate the effect of image registration on the diagnostic performance of transfer learning (TL) using pretrained convolutional neural networks (CNNs) and three-phasic dynamic contrast-enhanced computed tomography (DCE-CT) for primary liver cancers. METHODS:We retrospectively evaluated 215 consecutive pati...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-019-01987-1

    authors: Yamada A,Oyama K,Fujita S,Yoshizawa E,Ichinohe F,Komatsu D,Fujinaga Y

    更新日期:2019-08-01 00:00:00

  • Computational modeling of abdominal hernia laparoscopic repair with a surgical mesh.

    abstract:PURPOSE:Although new techniques and prostheses have been introduced in ventral hernia surgery, abdominal hernia repair still presents complications, such as recurrence, pain, and discomfort. Thus, this work implements a computational method aimed at evaluating biomechanical aspects of the abdominal hernia laparoscopic ...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-017-1681-7

    authors: Todros S,Pachera P,Baldan N,Pavan PG,Pianigiani S,Merigliano S,Natali AN

    更新日期:2018-01-01 00:00:00

  • A low-cost tracked C-arm (TC-arm) upgrade system for versatile quantitative intraoperative imaging.

    abstract:PURPOSE:C-arm fluoroscopy is frequently used in clinical applications as a low-cost and mobile real-time qualitative assessment tool. C-arms, however, are not widely accepted for applications involving quantitative assessments, mainly due to the lack of reliable and low-cost position tracking methods, as well as adequa...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-013-0957-9

    authors: Amiri S,Wilson DR,Masri BA,Anglin C

    更新日期:2014-07-01 00:00:00

  • Simulation of mammographic breast compression in 3D MR images using ICP-based B-spline deformation for multimodality breast cancer diagnosis.

    abstract:PURPOSE:Multimodality mammography using conventional 2D mammography and dynamic contrast-enhanced 3D magnetic resonance imaging (DCE-MRI) is frequently performed for breast cancer detection and diagnosis. Combination of both imaging modalities requires superimposition of corresponding structures in mammograms and MR im...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-014-0976-1

    authors: Krüger J,Ehrhardt J,Bischof A,Handels H

    更新日期:2014-05-01 00:00:00

  • Contour propagation using non-uniform cubic B-splines for lung tumor delineation in 4D-CT.

    abstract:PURPOSE:Accurate target delineation is a critical step in radiotherapy. In this study, a robust contour propagation method is proposed to help physicians delineate lung tumors in four-dimensional computer tomography (4D-CT) images efficiently and accurately. METHODS:The proposed method starts with manually delineated ...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-016-1457-5

    authors: Liu Y,Jin R,Chen M,Song E,Xu X,Zhang S,Hung CC

    更新日期:2016-12-01 00:00:00

  • Automated pulmonary nodule CT image characterization in lung cancer screening.

    abstract:PURPOSE:In lung cancer screening, pulmonary nodules are first identified in low-dose chest CT images. Costly follow-up procedures could be avoided if it were possible to establish the malignancy status of these nodules from these initial images. Preliminary computer methods have been proposed to characterize the malign...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-015-1245-7

    authors: Reeves AP,Xie Y,Jirapatnakul A

    更新日期:2016-01-01 00:00:00

  • Predicting surgical skill from the first N seconds of a task: value over task time using the isogony principle.

    abstract:PURPOSE:Most evaluations of surgical workflow or surgeon skill use simple, descriptive statistics (e.g., time) across whole procedures, thereby deemphasizing critical steps and potentially obscuring critical inefficiencies or skill deficiencies. In this work, we examine off-line, temporal clustering methods that chunk ...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-017-1606-5

    authors: French A,Lendvay TS,Sweet RM,Kowalewski TM

    更新日期:2017-07-01 00:00:00

  • A vision-based system for fast and accurate laser scanning in robot-assisted phonomicrosurgery.

    abstract:PURPOSE:Surgical quality in phonomicrosurgery can be improved by open-loop laser control (e.g., high-speed scanning capabilities) with a robust and accurate closed-loop visual servoing systems. A new vision-based system for laser scanning control during robot-assisted phonomicrosurgery was developed and tested. METHOD...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-014-1078-9

    authors: Dagnino G,Mattos LS,Caldwell DG

    更新日期:2015-02-01 00:00:00

  • Enhancement of bone shadow region using local phase-based ultrasound transmission maps.

    abstract:PURPOSE:Ultrasound is increasingly being employed in different orthopedic procedures as an imaging modality for real-time guidance. Nevertheless, low signal-to-noise-ratio and different imaging artifacts continue to hamper the success of ultrasound-based procedures. Bone shadow region is an important feature indicating...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-017-1556-y

    authors: Hacihaliloglu I

    更新日期:2017-06-01 00:00:00

  • Regional infarction identification from cardiac CT images: a computer-aided biomechanical approach.

    abstract:PURPOSE:Regional infarction identification is important for heart disease diagnosis and management, and myocardial deformation has been shown to be effective for this purpose. Although tagged and strain-encoded MR images can provide such measurements, they are uncommon in clinical routine. On the contrary, cardiac CT i...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章,评审

    doi:10.1007/s11548-016-1404-5

    authors: Wong KC,Tee M,Chen M,Bluemke DA,Summers RM,Yao J

    更新日期:2016-09-01 00:00:00

  • Fast, robust, and accurate monocular peer-to-peer tracking for surgical navigation.

    abstract:PURPOSE:This work presents a new monocular peer-to-peer tracking concept overcoming the distinction between tracking tools and tracked tools for optical navigation systems. A marker model concept based on marker triplets combined with a fast and robust algorithm for assigning image feature points to the corresponding m...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-019-02111-z

    authors: Strzeletz S,Hazubski S,Moctezuma JL,Hoppe H

    更新日期:2020-03-01 00:00:00

  • Data-driven spatio-temporal RGBD feature encoding for action recognition in operating rooms.

    abstract:PURPOSE:Context-aware systems for the operating room (OR) provide the possibility to significantly improve surgical workflow through various applications such as efficient OR scheduling, context-sensitive user interfaces, and automatic transcription of medical procedures. Being an essential element of such a system, su...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-015-1186-1

    authors: Twinanda AP,Alkan EO,Gangi A,de Mathelin M,Padoy N

    更新日期:2015-06-01 00:00:00