Applying Modern Virtual and Augmented Reality Technologies to Medical Images and Models.

Abstract:

:Recent technological innovations have created new opportunities for the increased adoption of virtual reality (VR) and augmented reality (AR) applications in medicine. While medical applications of VR have historically seen greater adoption from patient-as-user applications, the new era of VR/AR technology has created the conditions for wider adoption of clinician-as-user applications. Historically, adoption to clinical use has been limited in part by the ability of the technology to achieve a sufficient quality of experience. This article reviews the definitions of virtual and augmented reality and briefly covers the history of their development. Currently available options for consumer-level virtual and augmented reality systems are presented, along with a discussion of technical considerations for their adoption in the clinical environment. Finally, a brief review of the literature of medical VR/AR applications is presented prior to introducing a comprehensive conceptual framework for the viewing and manipulation of medical images in virtual and augmented reality. Using this framework, we outline considerations for placing these methods directly into a radiology-based workflow and show how it can be applied to a variety of clinical scenarios.

journal_name

J Digit Imaging

authors

Sutherland J,Belec J,Sheikh A,Chepelev L,Althobaity W,Chow BJW,Mitsouras D,Christensen A,Rybicki FJ,La Russa DJ

doi

10.1007/s10278-018-0122-7

subject

Has Abstract

pub_date

2019-02-01 00:00:00

pages

38-53

issue

1

eissn

0897-1889

issn

1618-727X

pii

10.1007/s10278-018-0122-7

journal_volume

32

pub_type

杂志文章,评审
  • Comparative performance analysis of state-of-the-art classification algorithms applied to lung tissue categorization.

    abstract::In this paper, we compare five common classifier families in their ability to categorize six lung tissue patterns in high-resolution computed tomography (HRCT) images of patients affected with interstitial lung diseases (ILD) and with healthy tissue. The evaluated classifiers are naive Bayes, k-nearest neighbor, J48 d...

    journal_title:Journal of digital imaging

    pub_type: 杂志文章

    doi:10.1007/s10278-008-9158-4

    authors: Depeursinge A,Iavindrasana J,Hidki A,Cohen G,Geissbuhler A,Platon A,Poletti PA,Müller H

    更新日期:2010-02-01 00:00:00

  • Local and Non-local Regularization Techniques in Emission (PET/SPECT) Tomographic Image Reconstruction Methods.

    abstract::Emission tomographic image reconstruction is an ill-posed problem due to limited and noisy data and various image-degrading effects affecting the data and leads to noisy reconstructions. Explicit regularization, through iterative reconstruction methods, is considered better to compensate for reconstruction-based noise...

    journal_title:Journal of digital imaging

    pub_type: 杂志文章,评审

    doi:10.1007/s10278-015-9853-x

    authors: Ahmad M,Shahzad T,Masood K,Rashid K,Tanveer M,Iqbal R,Hussain N,Shahid A,Fazal-E-Aleem

    更新日期:2016-06-01 00:00:00

  • Segmentation by evolution for visualization of the lower extremity of the Visible Man.

    abstract::Medical image segmentation is the crucial process for three-dimensional (3D) modeling. Many studies have claimed to suggest more accurate ways of segmentation. However, such research seems to have the drawback that it works against the parsimony principle. These methods have to resegment the regions of interest (ROIs)...

    journal_title:Journal of digital imaging

    pub_type: 杂志文章

    doi:10.1007/BF03190342

    authors: Lee JW,Lee J,Kim D,Kim JH,Park KS,Kang HS

    更新日期:2001-06-01 00:00:00

  • A new family of distance functions for perceptual similarity retrieval of medical images.

    abstract::A long-standing challenge of content-based image retrieval (CBIR) systems is the definition of a suitable distance function to measure the similarity between images in an application context which complies with the human perception of similarity. In this paper, we present a new family of distance functions, called att...

    journal_title:Journal of digital imaging

    pub_type: 杂志文章,评审

    doi:10.1007/s10278-007-9084-x

    authors: Felipe JC,Traina C Jr,Traina AJ

    更新日期:2009-04-01 00:00:00

  • Acceptance testing of integrated picture archiving and communications systems.

    abstract::An integrated picture archiving and communication system (PACS) is a large investment in both money and resources. With all of the components and systems contained in the PACS, a methodical set of protocols and procedures must be developed to test all aspects of the PACS within the short time allocated for contract co...

    journal_title:Journal of digital imaging

    pub_type: 杂志文章

    doi:10.1007/BF03168789

    authors: Lewis TE,Horton MC,Kinsey TV,Shelton PD

    更新日期:1999-05-01 00:00:00

  • A filmless radiology teaching conference system for pertinent displaying and image searching.

    abstract::To solve the problems of image displays in filmless radiology conferences for the purpose of teaching, we made an experimental design of a conference system with dual 50-in. plasma monitors for displaying larger images and a shared folder containing shortcuts to images for quick display during conferences on the deskt...

    journal_title:Journal of digital imaging

    pub_type: 杂志文章

    doi:10.1007/s10278-007-9095-7

    authors: Abe K,Narata M,Tanaka I,Takahashi M,Igarashi A,Sasaki T,Matsuyama K,Tohi N,Kosuda S

    更新日期:2009-12-01 00:00:00

  • Three monochrome displays from a single, true color video display controller.

    abstract::Some nuclear medicine computer displays, as well as many image processing workstations are "true color" machines characterized by independent memory and grey scale mapping for each of the red, green and blue color channels. Other color image display systems produce a color image from a single grey scale map composed o...

    journal_title:Journal of digital imaging

    pub_type: 杂志文章

    doi:10.1007/BF03173872

    authors: Raff U,Spitzer VM

    更新日期:1991-02-01 00:00:00

  • Toward Automatic Detection of Radiation-Induced Cerebral Microbleeds Using a 3D Deep Residual Network.

    abstract::Cerebral microbleeds, which are small focal hemorrhages in the brain that are prevalent in many diseases, are gaining increasing attention due to their potential as surrogate markers of disease burden, clinical outcomes, and delayed effects of therapy. Manual detection is laborious and automatic detection and labeling...

    journal_title:Journal of digital imaging

    pub_type: 杂志文章

    doi:10.1007/s10278-018-0146-z

    authors: Chen Y,Villanueva-Meyer JE,Morrison MA,Lupo JM

    更新日期:2019-10-01 00:00:00

  • Diagnosis of Autism Spectrum Disorders in Young Children Based on Resting-State Functional Magnetic Resonance Imaging Data Using Convolutional Neural Networks.

    abstract::Statistics show that the risk of autism spectrum disorder (ASD) is increasing in the world. Early diagnosis is most important factor in treatment of ASD. Thus far, the childhood diagnosis of ASD has been done based on clinical interviews and behavioral observations. There is a significant need to reduce the use of tra...

    journal_title:Journal of digital imaging

    pub_type: 杂志文章

    doi:10.1007/s10278-019-00196-1

    authors: Aghdam MA,Sharifi A,Pedram MM

    更新日期:2019-12-01 00:00:00

  • Automated hands-free image manipulation and viewing: a useful macro feature that assists radiologists in the viewing of chest and extremity digital radiographs.

    abstract::The authors present an adaptation of the macro recording feature on the Siemens Magic View 1000 workstation, which, with the click of one button, launches a macro that performs 3 clinically useful image manipulations. Using a Magic View 1004 Siemens unix workstation, the following Macro sequence was programmed: (1) se...

    journal_title:Journal of digital imaging

    pub_type: 杂志文章

    doi:10.1007/s10278-002-5078-x

    authors: Koenker RM,Grover SA

    更新日期:2002-01-01 00:00:00

  • One Night in the ED.

    abstract::Radiology 2.0: One Night in the ED is an app that presents users with scrollable CT images for common scenarios found in any Emergency Department (ED). A great tool for a junior resident before starting call, it allows the user to build confidence by experiencing a simulated environment of viewing all images of a case...

    journal_title:Journal of digital imaging

    pub_type: 杂志文章,评审

    doi:10.1007/s10278-015-9797-1

    authors: Drexler IR

    更新日期:2015-08-01 00:00:00

  • Enhancement of storage phosphor plate images: a C-language program.

    abstract::A C-language software program has been developed for emulating the image enhancement processing of a storage phosphor plate system. This software has been implemented on a VAX 3400 computer. There are 2,100 lines of C-language code in the program. There are seven parameters used to specify the degree of enhancement. T...

    journal_title:Journal of digital imaging

    pub_type: 杂志文章

    doi:10.1007/BF03167825

    authors: Templeton AW,Wetzel LH,Cook LT,Harrison LA,Eckard DA,Anderson WH,Hensley KS

    更新日期:1992-02-01 00:00:00

  • How to create radiology papers and presentations in Windows with Open-Source software.

    abstract::To illustrate the availability, effectiveness, and practical use of Open-Source tools in developing a radiology paper from its beginning to its presentation and publication. Practical use of a complete set of Open-Source applications for writing, e-mail corresponding, slide show, image retrieval, and manipulation is s...

    journal_title:Journal of digital imaging

    pub_type: 杂志文章

    doi:10.1007/s10278-008-9159-3

    authors: Faccioli N,Perandini S,Barillari M,D'Onofrio M,Mucelli RP

    更新日期:2009-12-01 00:00:00

  • Novel computer-aided diagnosis algorithms on ultrasound image: effects on solid breast masses discrimination.

    abstract::The objective of this study is to retrospectively investigate whether using the newly developed algorithms would improve radiologists' accuracy for discriminating malignant masses from benign ones on ultrasonographic (US) images. Five radiologists blinded to the histological results and clinical history independently ...

    journal_title:Journal of digital imaging

    pub_type: 杂志文章

    doi:10.1007/s10278-009-9245-1

    authors: Wang Y,Wang H,Guo Y,Ning C,Liu B,Cheng HD,Tian J

    更新日期:2010-10-01 00:00:00

  • Research and teaching access to a large clinical picture archiving and communication system.

    abstract:PURPOSE:To identify practical issues surrounding delivering digital images from picture archiving and communication systems (PACS) for research and teaching purposes. The complexity of Digital Imaging and Communications in Medicine (DICOM) access methods, security, patient confidentiality, PACS database integrity, port...

    journal_title:Journal of digital imaging

    pub_type: 杂志文章

    doi:10.1007/BF03190313

    authors: Harrison M,Koh J,Tran S,Mongkolwat P,Channin DS

    更新日期:2001-06-01 00:00:00

  • A novel medical image quality index.

    abstract::A novel medical image quality index using grey relational coefficient calculation is proposed in this study. Three medical modalities, DR, CT and MRI, using 30 or 60 images with a total of 120 images used for experimentation. These images were first compressed at ten different compression ratios (10 ∼ 100) using a med...

    journal_title:Journal of digital imaging

    pub_type: 杂志文章

    doi:10.1007/s10278-010-9353-y

    authors: Lin SC,Lin YC,Feng WS,Wu JM,Chen TJ

    更新日期:2011-10-01 00:00:00

  • Stereoscopic interpretation of low-dose breast tomosynthesis projection images.

    abstract::The purpose of this study was to evaluate stereoscopic perception of low-dose breast tomosynthesis projection images. In this Institutional Review Board exempt study, craniocaudal breast tomosynthesis cases (N = 47), consisting of 23 biopsy-proven malignant mass cases and 24 normal cases, were retrospectively reviewed...

    journal_title:Journal of digital imaging

    pub_type: 杂志文章

    doi:10.1007/s10278-013-9648-x

    authors: Muralidhar GS,Markey MK,Bovik AC,Haygood TM,Stephens TW,Geiser WR,Garg N,Adrada BE,Dogan BE,Carkaci S,Khisty R,Whitman GJ

    更新日期:2014-04-01 00:00:00

  • Endowing a Content-Based Medical Image Retrieval System with Perceptual Similarity Using Ensemble Strategy.

    abstract::Content-based medical image retrieval (CBMIR) is a powerful resource to improve differential computer-aided diagnosis. The major problem with CBMIR applications is the semantic gap, a situation in which the system does not follow the users' sense of similarity. This gap can be bridged by the adequate modeling of simil...

    journal_title:Journal of digital imaging

    pub_type: 杂志文章

    doi:10.1007/s10278-015-9809-1

    authors: Bedo MV,Pereira Dos Santos D,Ponciano-Silva M,de Azevedo-Marques PM,Ferreira de Carvalho AP,Traina C Jr

    更新日期:2016-02-01 00:00:00

  • Integrating patient digital photographs with medical imaging examinations.

    abstract::We introduce the concept, benefits, and general architecture for acquiring, storing, and displaying digital photographs along with medical imaging examinations. We also discuss a specific implementation built around an Android-based system for simultaneously acquiring digital photographs along with portable radiograph...

    journal_title:Journal of digital imaging

    pub_type: 杂志文章,评审

    doi:10.1007/s10278-013-9579-6

    authors: Ramamurthy S,Bhatti P,Arepalli CD,Salama M,Provenzale JM,Tridandapani S

    更新日期:2013-10-01 00:00:00

  • Medical applications of digital image morphing.

    abstract::The authors present a unique medical technical application for illustrating the success and/or failure of the physiological healing process as a dynamically morphed video. Two examples used in this report include the healing of a severely fractured humerus from an explosion in Iraq and the other of dramatic tissue des...

    journal_title:Journal of digital imaging

    pub_type: 杂志文章

    doi:10.1007/s10278-006-1050-5

    authors: Penska K,Folio L,Bunger R

    更新日期:2007-09-01 00:00:00

  • Classification of breast masses using selected shape, edge-sharpness, and texture features with linear and kernel-based classifiers.

    abstract::Breast masses due to benign disease and malignant tumors related to breast cancer differ in terms of shape, edge-sharpness, and texture characteristics. In this study, we evaluate a set of 22 features including 5 shape factors, 3 edge-sharpness measures, and 14 texture features computed from 111 regions in mammograms,...

    journal_title:Journal of digital imaging

    pub_type: 杂志文章

    doi:10.1007/s10278-007-9102-z

    authors: Mu T,Nandi AK,Rangayyan RM

    更新日期:2008-06-01 00:00:00

  • Detection of microcalcifications by means of multiscale methods and statistical techniques.

    abstract::The detection of clustered microcalcifications can help the radiologist to detect early breast cancer. Microcalcifications exhibit some important characteristics, such as small size and high luminosity. Use of a computer-aided diagnosis (CAD) method can prevent them being overlooked. In this report, a multiresolution ...

    journal_title:Journal of digital imaging

    pub_type: 杂志文章

    doi:10.1007/BF03167672

    authors: Mata Campos R,Vidal EM,Nava E,Martínez-Morillo M,Sendra F

    更新日期:2000-05-01 00:00:00

  • Automated detection of z-axis coverage with abdomen-pelvis computed tomography examinations.

    abstract::Excessive cephalocaudal anatomic (Z-axis) coverage can lead to unnecessary radiation exposure to a patient. In this study, an automated computing model was developed for identifying instances of potentially excessive Z-axis coverage with abdomen-pelvis examinations. Eight patient and imaging attributes including patie...

    journal_title:Journal of digital imaging

    pub_type: 杂志文章

    doi:10.1007/s10278-014-9743-7

    authors: Zhang M,Wellnitz C,Cui C,Pavlicek W,Wu T

    更新日期:2015-06-01 00:00:00

  • Stereotactic neurosurgery planning on a personal-computer-based work station.

    abstract::Stereotactic surgery requires knowledge of cerebral structures derived from more than one image source. We have developed a PC-AT-based workstation that accepts patient images, made with the stereotactic frame in place, from CT, MRI, and DSA modalities. Reference markers on the frame are identified in the images to es...

    journal_title:Journal of digital imaging

    pub_type: 杂志文章

    doi:10.1007/BF03168023

    authors: Peters TM,Clark JA,Pike GB,Henri C,Collins L,Leksell D,Jeppsson O

    更新日期:1989-05-01 00:00:00

  • Defining the role of a PACS technologist.

    abstract::As hospitals convert from conventional image processing to picture archiving and communication systems (PACS) technology, new job opportunities arose for PACS analysts, PACS system administrators, PACS operators, and PACS trainers. To support a PACS, these positions require education in computer information systems an...

    journal_title:Journal of digital imaging

    pub_type: 杂志文章

    doi:10.1007/s10278-002-5095-9

    authors: Cabrera A

    更新日期:2002-01-01 00:00:00

  • Displaying radiologic images on personal computers.

    abstract::This is the second article of our series for radiologists and imaging scientists on displaying, manipulating, and analyzing radiologic images on personal computers (PCs). The first article discussed the digital image data file, standard PC graphic file formats, and various methods for importing radiologic images into ...

    journal_title:Journal of digital imaging

    pub_type: 杂志文章

    doi:10.1007/BF03168488

    authors: Gillespy T 3rd,Rowberg AH

    更新日期:1993-08-01 00:00:00

  • Evaluation of irreversible JPEG compression for a clinical ultrasound practice.

    abstract::A prior ultrasound study indicated that images with low to moderate levels of JPEG and wavelet compression were acceptable for diagnostic purposes. The purpose of this study is to validate this prior finding using the Joint Photographic Experts Group (JPEG) baseline compression algorithm, at a compression ratio of app...

    journal_title:Journal of digital imaging

    pub_type: 杂志文章

    doi:10.1007/s10278-002-0003-x

    authors: Persons KR,Hangiandreou NJ,Charboneau NT,Charboneau J,James E,Douglas BR,Salmon AP,Knudsen JM,Erickson BJ

    更新日期:2002-03-01 00:00:00

  • Characterization of radiologists' search strategies for lung nodule detection: slice-based versus volumetric displays.

    abstract::The goal of this study was to assess whether radiologists' search paths for lung nodule detection in chest computed tomography (CT) between different rendering and display schemes have reliable properties that can be exploited as an indicator of ergonomic efficiency for the purpose of comparing different display parad...

    journal_title:Journal of digital imaging

    pub_type: 杂志文章

    doi:10.1007/s10278-007-9076-x

    authors: Wang XH,Durick JE,Lu A,Herbert DL,Golla SK,Foley K,Piracha CS,Shinde DD,Shindel BE,Fuhrman CR,Britton CA,Strollo DC,Shang SS,Lacomis JM,Good WF

    更新日期:2008-10-01 00:00:00

  • A Feasibility Study of Smartphone-Based Telesonography for Evaluating Cardiac Dynamic Function and Diagnosing Acute Appendicitis with Control of the Image Quality of the Transmitted Videos.

    abstract::Our aim was to prove the feasibility of the remote interpretation of real-time transmitted ultrasound videos of dynamic and static organs using a smartphone with control of the image quality given a limited internet connection speed. For this study, 100 cases of echocardiography videos (dynamic organ)-50 with an eject...

    journal_title:Journal of digital imaging

    pub_type: 杂志文章

    doi:10.1007/s10278-015-9849-6

    authors: Kim C,Cha H,Kang BS,Choi HJ,Lim TH,Oh J

    更新日期:2016-06-01 00:00:00

  • Estimates of Patient Radiation Doses in Digital Radiography Using DICOM Information at a Large Teaching Hospital in Oman.

    abstract::In this study, we sought to estimate the patient radiation doses in the digital radiography X-ray examinations conducted in a large hospital. The patient exposure factors and kerma-area product (PKA) were retrospectively recorded via the Digital Imaging and Communications in Medicine (DICOM) header for 547 patients. T...

    journal_title:Journal of digital imaging

    pub_type: 杂志文章

    doi:10.1007/s10278-019-00199-y

    authors: Suliman II

    更新日期:2020-02-01 00:00:00