Virtual organelle self-coding for fluorescence imaging via adversarial learning.

Abstract:

SIGNIFICANCE:Our study introduces an application of deep learning to virtually generate fluorescence images to reduce the burdens of cost and time from considerable effort in sample preparation related to chemical fixation and staining. AIM:The objective of our work was to determine how successfully deep learning methods perform on fluorescence prediction that depends on structural and/or a functional relationship between input labels and output labels. APPROACH:We present a virtual-fluorescence-staining method based on deep neural networks (VirFluoNet) to transform co-registered images of cells into subcellular compartment-specific molecular fluorescence labels in the same field-of-view. An algorithm based on conditional generative adversarial networks was developed and trained on microscopy datasets from breast-cancer and bone-osteosarcoma cell lines: MDA-MB-231 and U2OS, respectively. Several established performance metrics-the mean absolute error (MAE), peak-signal-to-noise ratio (PSNR), and structural-similarity-index (SSIM)-as well as a novel performance metric, the tolerance level, were measured and compared for the same algorithm and input data. RESULTS:For the MDA-MB-231 cells, F-actin signal performed the fluorescent antibody staining of vinculin prediction better than phase-contrast as an input. For the U2OS cells, satisfactory metrics of performance were archieved in comparison with ground truth. MAE is <0.005, 0.017, 0.012; PSNR is >40  /  34  /  33  dB; and SSIM is >0.925  /  0.926  /  0.925 for 4',6-diamidino-2-phenylindole/hoechst, endoplasmic reticulum, and mitochondria prediction, respectively, from channels of nucleoli and cytoplasmic RNA, Golgi plasma membrane, and F-actin. CONCLUSIONS:These findings contribute to the understanding of the utility and limitations of deep learning image-regression to predict fluorescence microscopy datasets of biological cells. We infer that predicted image labels must have either a structural and/or a functional relationship to input labels. Furthermore, the approach introduced here holds promise for modeling the internal spatial relationships between organelles and biomolecules within living cells, leading to detection and quantification of alterations from a standard training dataset.

journal_name

J Biomed Opt

authors

Nguyen T,Bui V,Thai A,Lam V,Raub C,Chang LC,Nehmetallah G

doi

10.1117/1.JBO.25.9.096009

subject

Has Abstract

pub_date

2020-09-01 00:00:00

issue

9

eissn

1083-3668

issn

1560-2281

pii

JBO-200126RR

journal_volume

25

pub_type

杂志文章
  • Band analysis of hydrated human skin stratum corneum attenuated total reflectance fourier transform infrared spectra in vivo.

    abstract::Water content is an important factor for skin condition. The determination of the hydration state of the skin is necessary to obtain basic knowledge about the penetration and loss of water in the skin stratum corneum. Attenuated total reflectance Fourier transform infrared (ATR-FTIR) spectroscopy is used to measure hy...

    journal_title:Journal of biomedical optics

    pub_type: 杂志文章

    doi:10.1117/1.429890

    authors: Lucassen GW,van Veen GN,Jansen JA

    更新日期:1998-07-01 00:00:00

  • Optically sectioned in vivo imaging with speckle illumination HiLo microscopy.

    abstract::We present a simple wide-field imaging technique, called HiLo microscopy, that is capable of producing optically sectioned images in real time, comparable in quality to confocal laser scanning microscopy. The technique is based on the fusion of two raw images, one acquired with speckle illumination and another with st...

    journal_title:Journal of biomedical optics

    pub_type: 杂志文章

    doi:10.1117/1.3528656

    authors: Lim D,Ford TN,Chu KK,Mertz J

    更新日期:2011-01-01 00:00:00

  • Classifying structural alterations of the cytoskeleton by spectrum enhancement and descriptor fusion.

    abstract::A classifier capable of ranking structural alterations of the cytoskeleton is developed. Images of cytoskeletal microtubules obtained from the epifluorescence microscopy of primary culture rat hepatocytes are analyzed. Morphological descriptors are extracted by contour and mass fractal analysis, direct methods, and sp...

    journal_title:Journal of biomedical optics

    pub_type: 杂志文章

    doi:10.1117/1.2187423

    authors: Crosta GF,Urani C,Fumarola L

    更新日期:2006-03-01 00:00:00

  • Assessment of inflow and washout of indocyanine green in the adult human brain by monitoring of diffuse reflectance at large source-detector separation.

    abstract::Recently, it was shown in measurements carried out on humans that time-resolved near-infrared reflectometry and fluorescence spectroscopy may allow for discrimination of information originating directly from the brain avoiding influence of contaminating signals related to the perfusion of extracerebral tissues. We rep...

    journal_title:Journal of biomedical optics

    pub_type: 杂志文章

    doi:10.1117/1.3574018

    authors: Liebert A,Sawosz P,Milej D,Kacprzak M,Weigl W,Botwicz M,Maczewska J,Fronczewska K,Mayzner-Zawadzka E,Królicki L,Maniewski R

    更新日期:2011-04-01 00:00:00

  • Raman spectroscopy of in vivo cutaneous melanin.

    abstract::We successfully acquire the in vivo Raman spectrum of melanin from human skin using a rapid near-infrared (NIR) Raman spectrometer. The Raman signals of in vivo cutaneous melanin are similar to those observed from natural and synthetic eumelanins. The melanin Raman spectrum is dominated by two intense and broad peaks ...

    journal_title:Journal of biomedical optics

    pub_type: 杂志文章

    doi:10.1117/1.1805553

    authors: Huang Z,Lui H,Chen XK,Alajlan A,McLean DI,Zeng H

    更新日期:2004-11-01 00:00:00

  • In-vivo Fourier domain optical coherence tomography as a new tool for investigation of vasodynamics in the mouse model.

    abstract::In-vivo imaging of the vascular system can provide novel insight into the dynamics of vasoconstriction and vasodilation. Fourier domain optical coherence tomography (FD-OCT) is an optical, noncontact imaging technique based on interferometry of short-coherent near-infrared light with axial resolution of less than 10 m...

    journal_title:Journal of biomedical optics

    pub_type: 杂志文章

    doi:10.1117/1.3149865

    authors: Meissner S,Müller G,Walther J,Morawietz H,Koch E

    更新日期:2009-05-01 00:00:00

  • Low-frequency wide-field fluorescence lifetime imaging using a high-power near-infrared light-emitting diode light source.

    abstract::Fluorescence lifetime imaging (FLi) could potentially improve exogenous near-infrared (NIR) fluorescence imaging, because it offers the capability of discriminating a signal of interest from background, provides real-time monitoring of a chemical environment, and permits the use of several different fluorescent dyes h...

    journal_title:Journal of biomedical optics

    pub_type: 杂志文章

    doi:10.1117/1.3368997

    authors: Gioux S,Lomnes SJ,Choi HS,Frangioni JV

    更新日期:2010-03-01 00:00:00

  • Deep learning-level melanoma detection by interpretable machine learning and imaging biomarker cues.

    abstract:SIGNIFICANCE:Melanoma is a deadly cancer that physicians struggle to diagnose early because they lack the knowledge to differentiate benign from malignant lesions. Deep machine learning approaches to image analysis offer promise but lack the transparency to be widely adopted as stand-alone diagnostics. AIM:We aimed to...

    journal_title:Journal of biomedical optics

    pub_type: 杂志文章

    doi:10.1117/1.JBO.25.11.112906

    authors: Gareau DS,Browning J,Correa Da Rosa J,Suarez-Farinas M,Lish S,Zong AM,Firester B,Vrattos C,Renert-Yuval Y,Gamboa M,Vallone MG,Barragán-Estudillo ZF,Tamez-Peña AL,Montoya J,Jesús-Silva MA,Carrera C,Malvehy J,Puig S,Mar

    更新日期:2020-11-01 00:00:00

  • Monitoring of drug and stimulation induced cerebral blood flow velocity changes in rat sensory cortex using spectral domain Doppler optical coherence tomography.

    abstract::Doppler optical coherence tomography (DOCT) provides a novel method to measure blood flow velocity in vessels with diameter at micrometer scale. In this study, a developed spectral domain DOCT system is applied to monitor cerebral blood flow velocity changes in a rat. An animal model with a cranial window is used, and...

    journal_title:Journal of biomedical optics

    pub_type: 杂志文章

    doi:10.1117/1.3560286

    authors: Wang C,Yang Y,Ding Z,Meng J,Wang K,Yang W,Xu Y

    更新日期:2011-04-01 00:00:00

  • Perfusion assessment in rat spinal cord tissue using photoplethysmography and laser Doppler flux measurements.

    abstract::Animal models are widely used to investigate the pathological mechanisms of spinal cord injury (SCI), most commonly in rats. It is well known that compromised blood flow caused by mechanical disruption of the vasculature can produce irreversible damage and cell death in hypoperfused tissue regions and spinal cord tiss...

    journal_title:Journal of biomedical optics

    pub_type: 杂志文章

    doi:10.1117/1.JBO.18.3.037005

    authors: Phillips JP,Cibert-Goton V,Langford RM,Shortland PJ

    更新日期:2013-03-01 00:00:00

  • Digital phantoms generated by spectral and spatial light modulators.

    abstract::A hyperspectral image projector (HIP) based on liquid crystal on silicon spatial light modulators is explained and demonstrated to generate data cubes. The HIP-constructed data cubes are three-dimensional images of the spatial distribution of spectrally resolved abundances of intracellular light-absorbing oxyhemoglobi...

    journal_title:Journal of biomedical optics

    pub_type: 杂志文章,收录出版

    doi:10.1117/1.JBO.20.11.111215

    authors: Chon B,Tokumasu F,Lee JY,Allen DW,Rice JP,Hwang J

    更新日期:2015-01-01 00:00:00

  • Time-resolved diffuse optical tomography and its application to in vitro and in vivo imaging.

    abstract::This work reviews our research during the past several years on time-resolved (TR) near-infrared diffuse optical tomography (DOT). Following an introduction of the measuring modes, two proposed schemes of image reconstruction in TR-DOT are described: one utilizes the full TR data, and the other, referred to as the mod...

    journal_title:Journal of biomedical optics

    pub_type: 杂志文章,评审

    doi:10.1117/1.2815724

    authors: Zhao H,Gao F,Tanikawa Y,Yamada Y

    更新日期:2007-11-01 00:00:00

  • Multiphoton fluorescence lifetime imaging of chemotherapy distribution in solid tumors.

    abstract::Doxorubicin is a commonly used chemotherapeutic employed to treat multiple human cancers, including numerous sarcomas and carcinomas. Furthermore, doxorubicin possesses strong fluorescent properties that make it an ideal reagent for modeling drug delivery by examining its distribution in cells and tissues. However, wh...

    journal_title:Journal of biomedical optics

    pub_type: 杂志文章

    doi:10.1117/1.JBO.22.11.116010

    authors: Carlson M,Watson AL,Anderson L,Largaespada DA,Provenzano PP

    更新日期:2017-11-01 00:00:00

  • Molecular imaging of epidermal growth factor receptor in live cells with refractive index sensitivity using dark-field microspectroscopy and immunotargeted nanoparticles.

    abstract::We present a study using plasmonic nanoparticles (NPs) to image epidermal growth factor receptor (EGFR) in live cells. Through detailed analysis of the NP scattering spectra, we determine the intracellular refractive index (RI) within attoliter volumes inside of the living cells. Molecular imaging is demonstrated usin...

    journal_title:Journal of biomedical optics

    pub_type: 杂志文章

    doi:10.1117/1.2837450

    authors: Curry AC,Crow M,Wax A

    更新日期:2008-01-01 00:00:00

  • Coregistered photoacoustic and ultrasound imaging and classification of ovarian cancer: ex vivo and in vivo studies.

    abstract::Most ovarian cancers are diagnosed at advanced stages due to the lack of efficacious screening techniques. Photoacoustic tomography (PAT) has a potential to image tumor angiogenesis and detect early neovascular changes of the ovary. We have developed a coregistered PAT and ultrasound (US) prototype system for real-tim...

    journal_title:Journal of biomedical optics

    pub_type: 杂志文章

    doi:10.1117/1.JBO.21.4.046006

    authors: Salehi HS,Li H,Merkulov A,Kumavor PD,Vavadi H,Sanders M,Kueck A,Brewer MA,Zhu Q

    更新日期:2016-04-30 00:00:00

  • Correlation of in vivo photosensitizer fluorescence and photodynamic-therapy-induced depth of necrosis in a murine tumor model.

    abstract::We compared light-induced fluorescence (LIF) to nominal injected drug dose for predicting the depth of necrosis response to photodynamic therapy (PDT) in a murine tumor model. Mice were implanted with radiation-induced fibrosarcoma (RIF) and were injected with 0, 5, or 10 mg/kg Photofrin. 630-nm light (30 J/cm(2), 75 ...

    journal_title:Journal of biomedical optics

    pub_type: 杂志文章

    doi:10.1117/1.1560011

    authors: Cheung R,Solonenko M,Busch TM,Del Piero F,Putt ME,Hahn SM,Yodh AG

    更新日期:2003-04-01 00:00:00

  • Potential of optical microangiography to monitor cerebral blood perfusion and vascular plasticity following traumatic brain injury in mice in vivo.

    abstract::Optical microanglography (OMAG) is a recently developed imaging modality capable of volumetric imaging of dynamic blood perfusion, down to capillary level resolution, with an imaging depth up to 2.00 mm beneath the tissue surface. We report the use of OMAG to monitor the cerebral blood flow (CBF) over the cortex of mo...

    journal_title:Journal of biomedical optics

    pub_type: 信件

    doi:10.1117/1.3207121

    authors: Jia Y,Alkayed N,Wang RK

    更新日期:2009-07-01 00:00:00

  • Analysis of blood coagulation process based on fractality and dynamic characteristic of laser speckle pattern.

    abstract::The reflection and transmission of coherent light from a biological system can yield information about its condition. In the case of blood exposed to the air, there is a change in the properties of the speckle patterns observed in the coagulation process. This can be studied by means of the rate of temporal variation,...

    journal_title:Journal of biomedical optics

    pub_type: 杂志文章

    doi:10.1117/1.JBO.24.3.031018

    authors: Yokoi N,Aizu Y,Uozumi J

    更新日期:2018-12-01 00:00:00

  • Analysis of sampling volume and tissue heterogeneity on the in vivo detection of fluorescence.

    abstract::The effect of sampling region size and tissue heterogeneity is examined using fluorescence histogram assessment in a rat prostate tumor model with benzoporphyrin derivative fluorophore. Spatial heterogeneity in the fluorescence signal occurs on both macroscopic and microscopic scales. The periphery of the tumor is mor...

    journal_title:Journal of biomedical optics

    pub_type: 杂志文章

    doi:10.1117/1.2002978

    authors: Pogue BW,Chen B,Zhou X,Hoopes PJ

    更新日期:2005-07-01 00:00:00

  • Effect of noise on modulation amplitude and phase in frequency-domain diffusive imaging.

    abstract::We theoretically investigate the effect of noise on frequency-domain heterodyne and/or homodyne measurements of intensity-modulated beams propagating through diffusive media, such as a photon density wave. We assumed that the attenuated amplitude and delayed phase are estimated by taking the Fourier transform of the n...

    journal_title:Journal of biomedical optics

    pub_type: 杂志文章

    doi:10.1117/1.JBO.17.1.016010

    authors: Kang D,Kupinski MA

    更新日期:2012-01-01 00:00:00

  • Study of the influence of over-the-counter vitamin supplement intake on urine fluorescence to optimize cancer detection by fluorescence cystoscopy.

    abstract::Fluorescence cystoscopy (FC) efficiently enhances the detection and improves the therapeutic management of early bladder cancer. During an FC, about 150 ml of water is needed to inflate the bladder. The water is quickly diluted by urine which can be fluorescent. If this bladder washout fluid (BWF) becomes fluorescent,...

    journal_title:Journal of biomedical optics

    pub_type: 杂志文章

    doi:10.1117/1.JBO.20.6.066011

    authors: Zellweger M,Martoccia C,Mengin M,Iselin C,van den Bergh H,Wagnières G

    更新日期:2015-06-01 00:00:00

  • Study of the inhibition effect of thiazone on muscle optical clearing.

    abstract::We investigated the effect of thiazone, a widely used penetration enhancer, on in vitro porcine skin and muscle tissue by single-integrating sphere technique during optical clearing (OC) treatment. The results showed that thiazone induced an increase on the total transmittance of skin which led to a reduction in that ...

    journal_title:Journal of biomedical optics

    pub_type: 杂志文章

    doi:10.1117/1.JBO.21.10.105004

    authors: Jin X,Deng Z,Wang J,Ye Q,Mei J,Zhou W,Zhang C,Tian J

    更新日期:2016-10-01 00:00:00

  • Integration of a Raman spectroscopy system to a robotic-assisted surgical system for real-time tissue characterization during radical prostatectomy procedures.

    abstract::Surgical excision of the whole prostate through a radical prostatectomy procedure is part of the standard of care for prostate cancer. Positive surgical margins (cancer cells having spread into surrounding nonresected tissue) occur in as many as 1 in 5 cases and strongly correlate with disease recurrence and the requi...

    journal_title:Journal of biomedical optics

    pub_type: 杂志文章

    doi:10.1117/1.JBO.24.2.025001

    authors: Pinto M,Zorn KC,Tremblay JP,Desroches J,Dallaire F,Aubertin K,Marple E,Kent C,Leblond F,Trudel D,Lesage F

    更新日期:2019-02-01 00:00:00

  • In vivo photoacoustic imaging of mouse embryos.

    abstract::The ability to noninvasively image embryonic vascular anatomy in mouse models is an important requirement for characterizing the development of the normal cardiovascular system and malformations in the heart and vascular supply. Photoacoustic imaging, which can provide high resolution non invasive images of the vascul...

    journal_title:Journal of biomedical optics

    pub_type: 杂志文章

    doi:10.1117/1.JBO.17.6.061220

    authors: Laufer J,Norris F,Cleary J,Zhang E,Treeby B,Cox B,Johnson P,Scambler P,Lythgoe M,Beard P

    更新日期:2012-06-01 00:00:00

  • Imaging performance of a miniature integrated microendoscope.

    abstract::An integrated miniature multi-modal microscope (4M device) for microendoscopy was built and tested. Imaging performance is evaluated and imaging results are presented for both fluorescence and reflectance samples. Images of biological samples show successful imaging of both thin layers of fixed cells prepared on a sli...

    journal_title:Journal of biomedical optics

    pub_type: 杂志文章

    doi:10.1117/1.2978060

    authors: Rogers JD,Landau S,Tkaczyk TS,Descour MR,Rahman MS,Richards-Kortum R,Kärkäinen AH,Christenson T

    更新日期:2008-09-01 00:00:00

  • Classification of skin moles from optical spectropolarimetric images: a pilot study.

    abstract::A new skin-imaging method, which was developed recently, gives an informative image data about skin moles by collecting scattered polarized light reflected from their tissue area at different wavelengths and polarizations. This method is called as optical rotational spectropolarimetric imaging (ORSI), which scans the ...

    journal_title:Journal of biomedical optics

    pub_type: 杂志文章

    doi:10.1117/1.JBO.18.11.111403

    authors: Graham L,Yitzhaky Y,Abdulhalim I

    更新日期:2013-11-01 00:00:00

  • Filter-based method for background removal in high-sensitivity wide-field-surface-enhanced Raman scattering imaging in vivo.

    abstract::As molecular imaging moves towards lower detection limits, the elimination of endogenous background signals becomes imperative. We present a facile background-suppression technique that specifically segregates the signal from surface-enhanced Raman scattering (SERS)-active nanoparticles (NPs) from the tissue autofluor...

    journal_title:Journal of biomedical optics

    pub_type: 杂志文章

    doi:10.1117/1.JBO.17.7.076017

    authors: Mallia RJ,McVeigh PZ,Veilleux I,Wilson BC

    更新日期:2012-07-01 00:00:00

  • Noninvasive measurements of carotenoids in bovine udder by reflection spectroscopy.

    abstract::For a long time, the antioxidative status in cattle has been discussed as an indicator for stress conditions resulting from disease or exertion. Until now, invasive approaches have been necessary to obtain blood samples or biopsy materials and gain insights into the antioxidative status of cattle. Due to these efforts...

    journal_title:Journal of biomedical optics

    pub_type: 杂志文章

    doi:10.1117/1.JBO.17.10.101514

    authors: Klein J,Darvin ME,Müller KE,Lademann J

    更新日期:2012-10-01 00:00:00

  • Photochemical decontamination of red cell concentrates with the silicon phthalocyanine pc 4 and red light.

    abstract::Virus inactivation in red blood cell concentrates (RBCC) is being studied in order to increase the safety of the blood supply. For this purpose we have been studying the silicon phthalocyanine (Pc 4), a photosensitizer activated with red light. Two approaches were used to achieve enhanced selectivity of Pc 4 for virus...

    journal_title:Journal of biomedical optics

    pub_type: 杂志文章

    doi:10.1117/1.429931

    authors: Ben-Hur E,Zuk MM,Oetjen J,Chan WS,Lenny L,Horowitz B

    更新日期:1999-07-01 00:00:00

  • Analysis of the efficiency of hair removal by different optical methods: comparison of Trichoscan, reflectance confocal microscopy, and optical coherence tomography.

    abstract::Noninvasive diagnostic tools, such as Trichoscan®, reflectance confocal microscopy (RCM), and optical coherence tomography (OCT), are efficient methods of hair shaft and growth evaluation. The aim of this study was to carry out a comparative assessment of these three medical procedures by measuring the hair shaft and ...

    journal_title:Journal of biomedical optics

    pub_type: 杂志文章,随机对照试验

    doi:10.1117/1.JBO.17.10.101504

    authors: Kuck M,Schanzer S,Ulrich M,Garcia Bartels N,Meinke MC,Fluhr J,Krah M,Blume-Peytavi U,Stockfleth E,Lademann J

    更新日期:2012-10-01 00:00:00