A gesture-controlled projection display for CT-guided interventions.

Abstract:

PURPOSE:The interaction with interventional imaging systems within a sterile environment is a challenging task for physicians. Direct physician-machine interaction during an intervention is rather limited because of sterility and workspace restrictions. METHODS:We present a gesture-controlled projection display that enables a direct and natural physician-machine interaction during computed tomography (CT)-based interventions. Therefore, a graphical user interface is projected on a radiation shield located in front of the physician. Hand gestures in front of this display are captured and classified using a leap motion controller. We propose a gesture set to control basic functions of intervention software such as gestures for 2D image exploration, 3D object manipulation and selection. Our methods were evaluated in a clinically oriented user study with 12 participants. RESULTS:The results of the performed user study confirm that the display and the underlying interaction concept are accepted by clinical users. The recognition of the gestures is robust, although there is potential for improvements. The gesture training times are less than 10 min, but vary heavily between the participants of the study. The developed gestures are connected logically to the intervention software and intuitive to use. CONCLUSIONS:The proposed gesture-controlled projection display counters current thinking, namely it gives the radiologist complete control of the intervention software. It opens new possibilities for direct physician-machine interaction during CT-based interventions and is well suited to become an integral part of future interventional suites.

authors

Mewes A,Saalfeld P,Riabikin O,Skalej M,Hansen C

doi

10.1007/s11548-015-1215-0

subject

Has Abstract

pub_date

2016-01-01 00:00:00

pages

157-64

issue

1

eissn

1861-6410

issn

1861-6429

pii

10.1007/s11548-015-1215-0

journal_volume

11

pub_type

杂志文章
  • Automatic bone segmentation in whole-body CT images.

    abstract:PURPOSE:Many diagnostic or treatment planning applications critically depend on the successful localization of bony structures in CT images. Manual or semiautomatic bone segmentation is tedious, however, and often not practical in clinical routine. In this paper, we present a reliable and fully automatic bone segmentat...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-018-1883-7

    authors: Klein A,Warszawski J,Hillengaß J,Maier-Hein KH

    更新日期:2019-01-01 00:00:00

  • Edge map analysis in chest X-rays for automatic pulmonary abnormality screening.

    abstract:PURPOSE:Our particular motivator is the need for screening HIV+ populations in resource-constrained regions for the evidence of tuberculosis, using posteroanterior chest radiographs (CXRs). METHOD:The proposed method is motivated by the observation that abnormal CXRs tend to exhibit corrupted and/or deformed thoracic ...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-016-1359-6

    authors: Santosh KC,Vajda S,Antani S,Thoma GR

    更新日期:2016-09-01 00:00:00

  • Toward a standard ontology of surgical process models.

    abstract:PURPOSE:The development of common ontologies has recently been identified as one of the key challenges in the emerging field of surgical data science (SDS). However, past and existing initiatives in the domain of surgery have mainly been focussing on individual groups and failed to achieve widespread international acce...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-018-1824-5

    authors: Gibaud B,Forestier G,Feldmann C,Ferrigno G,Gonçalves P,Haidegger T,Julliard C,Katić D,Kenngott H,Maier-Hein L,März K,de Momi E,Nagy DÁ,Nakawala H,Neumann J,Neumuth T,Rojas Balderrama J,Speidel S,Wagner M,Jannin P

    更新日期:2018-09-01 00:00:00

  • Deep neural maps for unsupervised visualization of high-grade cancer in prostate biopsies.

    abstract::Prostate cancer (PCa) is the most frequent noncutaneous cancer in men. Early detection of PCa is essential for clinical decision making, and reducing metastasis and mortality rates. The current approach for PCa diagnosis is histopathologic analysis of core biopsies taken under transrectal ultrasound guidance (TRUS-gui...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-019-01950-0

    authors: Sedghi A,Pesteie M,Javadi G,Azizi S,Yan P,Kwak JT,Xu S,Turkbey B,Choyke P,Pinto P,Wood B,Rohling R,Abolmaesumi P,Mousavi P

    更新日期:2019-06-01 00:00:00

  • Comparison of different grid of tags detection methods in tagged cardiac MR imaging.

    abstract:PURPOSE:Non-invasive imaging assessment of cardiac function is important in cardiovascular disease diagnosis, especially for evaluation of local cardiac motion. Tagged cardiac MRI has been developed for this purpose, but evaluation of the results requires quantification and automation. METHODS:Two methods utilizing ac...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-010-0495-7

    authors: Histace A,Portefaix C,Matuszewski B

    更新日期:2011-03-01 00:00:00

  • Accuracy and reliability of computer-assisted semi-automated morphological analysis of intracranial aneurysms: an experimental study with digital phantoms and clinical aneurysm cases.

    abstract:PURPOSE:Morphological parameters are very important for predicting aneurysm rupture. However, due to geometric radiographic distortion and plane/angle selection bias, the traditional manual measurements (MM) of aneurysm morphology are inaccurate and suffer from severe variability. Our study is to evaluate the accuracy ...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-020-02218-8

    authors: Geng J,Hu P,Ji Z,Li C,Li L,Shen J,Feng X,Wang W,Yang G,Li J,Zhang H

    更新日期:2020-10-01 00:00:00

  • A dataset of laryngeal endoscopic images with comparative study on convolution neural network-based semantic segmentation.

    abstract:PURPOSE:Automated segmentation of anatomical structures in medical image analysis is a prerequisite for autonomous diagnosis as well as various computer- and robot-aided interventions. Recent methods based on deep convolutional neural networks (CNN) have outperformed former heuristic methods. However, those methods wer...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-018-01910-0

    authors: Laves MH,Bicker J,Kahrs LA,Ortmaier T

    更新日期:2019-03-01 00:00:00

  • Learned optical flow for intra-operative tracking of the retinal fundus.

    abstract:PURPOSE:Sustained delivery of regenerative retinal therapies by robotic systems requires intra-operative tracking of the retinal fundus. We propose a supervised deep convolutional neural network to densely predict semantic segmentation and optical flow of the retina as mutually supportive tasks, implicitly inpainting r...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-020-02160-9

    authors: Ravasio CS,Pissas T,Bloch E,Flores B,Jalali S,Stoyanov D,Cardoso JM,Da Cruz L,Bergeles C

    更新日期:2020-05-01 00:00:00

  • MRI-compatible positioning device for guiding a focused ultrasound system for transrectal treatment of prostate cancer.

    abstract:BACKGROUND:High-intensity focused ultrasound (HIFU) is a promising treatment method for many common cancers, including prostate cancer. Magnetic resonance image (MRI) guidance of HIFU permits targeting and monitoring of therapy. A prototype MRI-compatible positioning device that navigates a HIFU transducer was designed...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-013-0964-x

    authors: Yiallouras C,Mylonas N,Damianou C

    更新日期:2014-07-01 00:00:00

  • Language-based translation and prediction of surgical navigation steps for endoscopic wayfinding assistance in minimally invasive surgery.

    abstract:PURPOSE:In the context of aviation and automotive navigation technology, assistance functions are associated with predictive planning and wayfinding tasks. In endoscopic minimally invasive surgery, however, assistance so far relies primarily on image-based localization and classification. We show that navigation workfl...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-020-02264-2

    authors: Bieck R,Heuermann K,Pirlich M,Neumann J,Neumuth T

    更新日期:2020-12-01 00:00:00

  • Augmented reality patient-specific reconstruction plate design for pelvic and acetabular fracture surgery.

    abstract:PURPOSE:The objective of this work is to develop a preoperative reconstruction plate design system for unilateral pelvic and acetabular fracture reduction and internal fixation surgery, using computer graphics and augmented reality (AR) techniques, in order to respect the patient-specific morphology and to reduce surgi...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-012-0775-5

    authors: Shen F,Chen B,Guo Q,Qi Y,Shen Y

    更新日期:2013-03-01 00:00:00

  • Regional infarction identification from cardiac CT images: a computer-aided biomechanical approach.

    abstract:PURPOSE:Regional infarction identification is important for heart disease diagnosis and management, and myocardial deformation has been shown to be effective for this purpose. Although tagged and strain-encoded MR images can provide such measurements, they are uncommon in clinical routine. On the contrary, cardiac CT i...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章,评审

    doi:10.1007/s11548-016-1404-5

    authors: Wong KC,Tee M,Chen M,Bluemke DA,Summers RM,Yao J

    更新日期:2016-09-01 00:00:00

  • Multi-input deep learning architecture for predicting breast tumor response to chemotherapy using quantitative MR images.

    abstract:PURPOSE:Neoadjuvant chemotherapy (NAC) aims to minimize the tumor size before surgery. Predicting response to NAC could reduce toxicity and delays to effective intervention. Computational analysis of dynamic contrast-enhanced magnetic resonance images (DCE-MRI) through deep convolution neural network (CNN) has shown a ...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-020-02209-9

    authors: El Adoui M,Drisis S,Benjelloun M

    更新日期:2020-09-01 00:00:00

  • A fully 3D work context for oral implant planning and simulation.

    abstract:PURPOSE:Most software systems for oral implantology are based on a two-dimensional multi-view approach, often accompanied with a surface rendered model. Usually they are affected by common errors like anisotropy of the volume and distortion on measurements. A more integrated and realistic 3D approach for implant surger...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-009-0394-y

    authors: Chiarelli T,Lamma E,Sansoni T

    更新日期:2010-01-01 00:00:00

  • Model-based registration of preprocedure MR and intraprocedure US of the lumbar spine.

    abstract:PURPOSE:Epidural and spinal needle insertions, as well as facet joint denervation and injections are widely performed procedures on the lumbar spine for delivering anesthesia and analgesia. Ultrasound (US)-based approaches have gained popularity for accurate needle placement, as they use a non-ionizing, inexpensive and...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-017-1552-2

    authors: Behnami D,Sedghi A,Anas EMA,Rasoulian A,Seitel A,Lessoway V,Ungi T,Yen D,Osborn J,Mousavi P,Rohling R,Abolmaesumi P

    更新日期:2017-06-01 00:00:00

  • Learning soft tissue behavior of organs for surgical navigation with convolutional neural networks.

    abstract:PURPOSE:In surgical navigation, pre-operative organ models are presented to surgeons during the intervention to help them in efficiently finding their target. In the case of soft tissue, these models need to be deformed and adapted to the current situation by using intra-operative sensor data. A promising method to rea...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-019-01965-7

    authors: Pfeiffer M,Riediger C,Weitz J,Speidel S

    更新日期:2019-07-01 00:00:00

  • Computational modeling of abdominal hernia laparoscopic repair with a surgical mesh.

    abstract:PURPOSE:Although new techniques and prostheses have been introduced in ventral hernia surgery, abdominal hernia repair still presents complications, such as recurrence, pain, and discomfort. Thus, this work implements a computational method aimed at evaluating biomechanical aspects of the abdominal hernia laparoscopic ...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-017-1681-7

    authors: Todros S,Pachera P,Baldan N,Pavan PG,Pianigiani S,Merigliano S,Natali AN

    更新日期:2018-01-01 00:00:00

  • Construct and face validity of SINERGIA laparoscopic virtual reality simulator.

    abstract:PURPOSE:Laparoscopic techniques have nowadays become a gold standard in many surgical procedures, but they imply a more difficult learning skills process. Simulators have a fundamental role in the formative stage of new surgeons. This paper presents the construct and face validity of SINERGIA laparoscopic virtual reali...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-010-0425-8

    authors: Sánchez-Peralta LF,Sánchez-Margallo FM,Moyano-Cuevas JL,Pagador JB,Enciso-Sanz S,Sánchez-González P,Gómez-Aguilera EJ,Usón-Gargallo J

    更新日期:2010-07-01 00:00:00

  • Enhancement of bone shadow region using local phase-based ultrasound transmission maps.

    abstract:PURPOSE:Ultrasound is increasingly being employed in different orthopedic procedures as an imaging modality for real-time guidance. Nevertheless, low signal-to-noise-ratio and different imaging artifacts continue to hamper the success of ultrasound-based procedures. Bone shadow region is an important feature indicating...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-017-1556-y

    authors: Hacihaliloglu I

    更新日期:2017-06-01 00:00:00

  • Four-dimensional computed tomography angiography analysis of internal carotid arteries opacification at the skull base to detect delayed cerebral ischemia: a feasibility study.

    abstract:PURPOSE:Delayed cerebral ischemia represents a significant cause of poor functional outcome for patients with vasospasm after subarachnoid hemorrhage. We investigated whether delayed cerebral ischemia could be detected by the arterial opacification of internal carotid artery at the level of the skull base. METHODS:In ...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-020-02268-y

    authors: Ognard J,Cheddad El Aouni M,Dissaux B,Jomaah R,Rousseau PY,Burdin V,Ben Salem D,Gentric JC

    更新日期:2020-12-01 00:00:00

  • Patient-specific catheter shaping for the minimally invasive closure of the left atrial appendage.

    abstract:PURPOSE:The minimally invasive closure of the left atrial appendage is a promising alternative to anticoagulation for stroke prevention in patients suffering from atrial fibrillation. One of the challenges of this procedure is the correct positioning and the coaxial alignment of the tip of the catheter sheath to the im...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-018-1752-4

    authors: Graf EC,Ott I,Praceus J,Bourier F,Lueth TC

    更新日期:2018-06-01 00:00:00

  • Development and evaluation of a prototype detector for an intraoperative laparoscopic coincidence imaging system with PET tracers.

    abstract:PURPOSE:Conventional positron emission tomography can be used only preoperatively to identify lymph node metastases, and hence, these growths are difficult to locate intraoperatively. Previously, an intraoperative laparoscopic coincidence imaging system, with an external fixed detector array and a detector probe that c...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-020-02282-0

    authors: Liyanaarachchi MR,Shimazoe K,Takahashi H,Nakagawa K,Kobayashi E,Sakuma I

    更新日期:2021-01-01 00:00:00

  • Interactive navigation of segmented MR angiograms using simultaneous curved planar and volume visualizations.

    abstract:PURPOSE:Interactive visualization is required to inspect and monitor the automatic segmentation of vessels derived from contrast-enhanced magnetic resonance angiography (CE-MRA). A dual-view visualization scheme consisting of curved planar reformation (CPR) and direct volume rendering (DVR) was developed for this purpo...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-010-0534-4

    authors: van Schooten BW,van Dijk EM,Suinesiaputra A,Reiber JH

    更新日期:2011-09-01 00:00:00

  • Force estimation from OCT volumes using 3D CNNs.

    abstract:PURPOSE:Estimating the interaction forces of instruments and tissue is of interest, particularly to provide haptic feedback during robot-assisted minimally invasive interventions. Different approaches based on external and integrated force sensors have been proposed. These are hampered by friction, sensor size, and ste...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-018-1777-8

    authors: Gessert N,Beringhoff J,Otte C,Schlaefer A

    更新日期:2018-07-01 00:00:00

  • Shared control of a medical robot with haptic guidance.

    abstract:PURPOSE:Tele-operation of robotic surgery reduces the radiation exposure during the interventional radiological operations. However, endoscope vision without force feedback on the surgical tool increases the difficulty for precise manipulation and the risk of tissue damage. The shared control of vision and force provid...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-016-1425-0

    authors: Xiong L,Chng CB,Chui CK,Yu P,Li Y

    更新日期:2017-01-01 00:00:00

  • Planning nonlinear access paths for temporal bone surgery.

    abstract:PURPOSE:Interventions at the otobasis operate in the narrow region of the temporal bone where several highly sensitive organs define obstacles with minimal clearance for surgical instruments. Nonlinear trajectories for potential minimally invasive interventions can provide larger distances to risk structures and optimi...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-018-1712-z

    authors: Fauser J,Sakas G,Mukhopadhyay A

    更新日期:2018-05-01 00:00:00

  • Ultrasound imaging method for internal jugular vein measurement and estimation of circulating blood volume.

    abstract:PURPOSE:Evaluation of circulating blood volume is important in assessing the status of patients. Although some studies have suggested that ultrasound images of the internal jugular vein (IJV) can be used for the analysis of circulating blood volume, accurate extraction of IJV is necessary to reduce errors. Therefore, t...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-013-0921-8

    authors: Qian K,Ando T,Nakamura K,Liao H,Kobayashi E,Yahagi N,Sakuma I

    更新日期:2014-03-01 00:00:00

  • Brain tumor detection and segmentation in a CRF (conditional random fields) framework with pixel-pairwise affinity and superpixel-level features.

    abstract:PURPOSE:Detection and segmentation of a brain tumor such as glioblastoma multiforme (GBM) in magnetic resonance (MR) images are often challenging due to its intrinsically heterogeneous signal characteristics. A robust segmentation method for brain tumor MRI scans was developed and tested. METHODS:Simple thresholds and...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-013-0922-7

    authors: Wu W,Chen AY,Zhao L,Corso JJ

    更新日期:2014-03-01 00:00:00

  • Multimodal mixed reality visualisation for intraoperative surgical guidance.

    abstract:PURPOSE:In the last decade, there has been a great effort to bring mixed reality (MR) into the operating room to assist surgeons intraoperatively. However, progress towards this goal is still at an early stage. The aim of this paper is to propose a MR visualisation platform which projects multiple imaging modalities to...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-020-02165-4

    authors: Cartucho J,Shapira D,Ashrafian H,Giannarou S

    更新日期:2020-05-01 00:00:00

  • Development of preoperative planning software for transforaminal endoscopic surgery and the guidance for clinical applications.

    abstract:PURPOSE:Preoperative planning is of great importance for transforaminal endoscopic techniques applied in percutaneous endoscopic lumbar discectomy. In this study, a modular preoperative planning software for transforaminal endoscopic surgery was developed and demonstrated. METHODS:The path searching method is based on...

    journal_title:International journal of computer assisted radiology and surgery

    pub_type: 杂志文章

    doi:10.1007/s11548-015-1282-2

    authors: Chen X,Cheng J,Gu X,Sun Y,Politis C

    更新日期:2016-04-01 00:00:00