Computational modeling of human reasoning processes for interpretable visual knowledge: a case study with radiographers.

Abstract:

:Visual reasoning is critical in many complex visual tasks in medicine such as radiology or pathology. It is challenging to explicitly explain reasoning processes due to the dynamic nature of real-time human cognition. A deeper understanding of such reasoning processes is necessary for improving diagnostic accuracy and computational tools. Most computational analysis methods for visual attention utilize black-box algorithms which lack explainability and are therefore limited in understanding the visual reasoning processes. In this paper, we propose a computational method to quantify and dissect visual reasoning. The method characterizes spatial and temporal features and identifies common and contrast visual reasoning patterns to extract significant gaze activities. The visual reasoning patterns are explainable and can be compared among different groups to discover strategy differences. Experiments with radiographers of varied levels of expertise on 10 levels of visual tasks were conducted. Our empirical observations show that the method can capture the temporal and spatial features of human visual attention and distinguish expertise level. The extracted patterns are further examined and interpreted to showcase key differences between expertise levels in the visual reasoning processes. By revealing task-related reasoning processes, this method demonstrates potential for explaining human visual understanding.

journal_name

Sci Rep

journal_title

Scientific reports

authors

Li Y,Cao H,Allen CM,Wang X,Erdelez S,Shyu CR

doi

10.1038/s41598-020-77550-9

subject

Has Abstract

pub_date

2020-12-10 00:00:00

pages

21620

issue

1

issn

2045-2322

pii

10.1038/s41598-020-77550-9

journal_volume

10

pub_type

杂志文章
  • Author Correction: Flotillin-2 promotes metastasis of nasopharyngeal carcinoma by activating NF-κB and PI3K/Akt3 signaling pathways.

    abstract::An amendment to this paper has been published and can be accessed via a link at the top of the paper. ...

    journal_title:Scientific reports

    pub_type: 已发布勘误

    doi:10.1038/s41598-020-63750-w

    authors: Liu J,Huang W,Ren C,Wen Q,Liu W,Yang X,Wang L,Zhu B,Zeng L,Feng X,Zhang C,Chen H,Jia W,Zhang L,Xia X,Chen Y

    更新日期:2020-04-20 00:00:00

  • Polychlorinated biphenyls target Notch/Dll and VEGF R2 in the mouse placenta and human trophoblast cell lines for their anti-angiogenic effects.

    abstract::The intrauterine environment is particularly vulnerable to environmental exposures. We previously established a mouse model that provided evidence for pregnancy complications and placental anti-angiogenesis in response to Aroclor 1254 (A-1254), a mixture of polychlorinated biphenyls (PCBs). Importantly, these effects ...

    journal_title:Scientific reports

    pub_type: 杂志文章

    doi:10.1038/srep39885

    authors: Kalkunte S,Huang Z,Lippe E,Kumar S,Robertson LW,Sharma S

    更新日期:2017-01-10 00:00:00

  • Differential experiences of embodiment between body-powered and myoelectric prosthesis users.

    abstract::Prosthesis embodiment, the perception of a prosthesis as part of one's body, may be an important component of functional recovery for individuals with upper limb absence. This work determined whether embodiment differs between body-powered and myoelectric prosthesis users. In a sample of nine individuals with transrad...

    journal_title:Scientific reports

    pub_type: 杂志文章

    doi:10.1038/s41598-020-72470-0

    authors: Engdahl SM,Meehan SK,Gates DH

    更新日期:2020-09-22 00:00:00

  • First anatomical network analysis of fore- and hindlimb musculoskeletal modularity in bonobos, common chimpanzees, and humans.

    abstract::Studies of morphological integration and modularity, and of anatomical complexity in human evolution typically focus on skeletal tissues. Here we provide the first network analysis of the musculoskeletal anatomy of both the fore- and hindlimbs of the two species of chimpanzee and humans. Contra long-accepted ideas, ne...

    journal_title:Scientific reports

    pub_type: 杂志文章

    doi:10.1038/s41598-018-25262-6

    authors: Diogo R,Molnar JL,Rolian C,Esteve-Altava B

    更新日期:2018-05-02 00:00:00

  • Using static method to measure tolmetin solubility at different pressures and temperatures in supercritical carbon dioxide.

    abstract::Tolmetin is a non-steroidal anti-inflammatory drug being used to decrease the level of hormones which are the reasons for pain, swelling, tiredness, and stiffness for osteoarthritis and rheumatoid arthritis cases. We evaluated its solubility in supercritical carbon dioxide (SC-CO2) with the aim of drug nanonization, c...

    journal_title:Scientific reports

    pub_type: 杂志文章

    doi:10.1038/s41598-020-76330-9

    authors: Pishnamazi M,Zabihi S,Sarafzadeh P,Borousan F,Marjani A,Pelalak R,Shirazian S

    更新日期:2020-11-11 00:00:00

  • Deficient Vitamin E Uptake During Development Impairs Neural Tube Closure in Mice Lacking Lipoprotein Receptor SR-BI.

    abstract::SR-BI is the main receptor for high density lipoproteins (HDL) and mediates the bidirectional transport of lipids, such as cholesterol and vitamin E, between these particles and cells. During early development, SR-BI is expressed in extraembryonic tissue, specifically in trophoblast giant cells in the parietal yolk sa...

    journal_title:Scientific reports

    pub_type: 杂志文章

    doi:10.1038/s41598-017-05422-w

    authors: Santander N,Lizama C,Parga MJ,Quiroz A,Pérez D,Echeverría G,Ulloa L,Palma V,Rigotti A,Busso D

    更新日期:2017-07-12 00:00:00

  • Effects of spatial consistency and individual difference on touch-induced visual suppression effect.

    abstract::Crossmodal studies have reported not only facilitatory but also inhibitory perceptual interactions. For instance, tactile stimulation to the index finger of a hand leads to the degradation of visual discrimination performance (touch-induced visual suppression, TIVS). It has been suggested that the magnitude of TIVS de...

    journal_title:Scientific reports

    pub_type: 杂志文章

    doi:10.1038/s41598-018-35302-w

    authors: Hidaka S,Suzuishi Y,Ide M,Wada M

    更新日期:2018-11-19 00:00:00

  • Modulation of the Mesenchymal Stem Cell Secretome Using Computer-Controlled Bioreactors: Impact on Neuronal Cell Proliferation, Survival and Differentiation.

    abstract::In recent years it has been shown that the therapeutic benefits of human mesenchymal stem/stromal cells (hMSCs) in the Central Nervous System (CNS) are mainly attributed to their secretome. The implementation of computer-controlled suspension bioreactors has shown to be a viable route for the expansion of these cells ...

    journal_title:Scientific reports

    pub_type: 杂志文章

    doi:10.1038/srep27791

    authors: Teixeira FG,Panchalingam KM,Assunção-Silva R,Serra SC,Mendes-Pinheiro B,Patrício P,Jung S,Anjo SI,Manadas B,Pinto L,Sousa N,Behie LA,Salgado AJ

    更新日期:2016-06-15 00:00:00

  • Human Defensin-5 Blocks Ethanol and Colitis-Induced Dysbiosis, Tight Junction Disruption and Inflammation in Mouse Intestine.

    abstract::Alcohol consumption has been shown to cause dysbiosis, but the mechanism involved in it is unknown. Recurrent colitis is known to induce expression of α-defensins in the colon, but the effect of alcohol consumption on it is not known. We investigated the effect of ethanol on α-defensin expression in the small intestin...

    journal_title:Scientific reports

    pub_type: 杂志文章

    doi:10.1038/s41598-018-34263-4

    authors: Shukla PK,Meena AS,Rao V,Rao RG,Balazs L,Rao R

    更新日期:2018-11-02 00:00:00

  • Molecular cloning, expression and the adjuvant effects of interleukin-8 of channel catfish (Ictalurus Punctatus) against Streptococcus iniae.

    abstract::Interleukin-8 (IL-8) as an important cytokine involving in inflammatory and immune response, has been studied as effective adjuvants for vaccines in mammals. However, there are fewer reports about the characterization and adjuvant effects of IL-8 in fish. In this study, cloning and sequence analysis of IL-8 coding reg...

    journal_title:Scientific reports

    pub_type: 杂志文章

    doi:10.1038/srep29310

    authors: Wang E,Wang J,Long B,Wang K,He Y,Yang Q,Chen D,Geng Y,Huang X,Ouyang P,Lai W

    更新日期:2016-07-04 00:00:00

  • Coordination chemistry in magnesium battery electrolytes: how ligands affect their performance.

    abstract::Magnesium battery is potentially a safe, cost-effective, and high energy density technology for large scale energy storage. However, the development of magnesium battery has been hindered by the limited performance and the lack of fundamental understandings of electrolytes. Here, we present a study in understanding co...

    journal_title:Scientific reports

    pub_type: 杂志文章

    doi:10.1038/srep03130

    authors: Shao Y,Liu T,Li G,Gu M,Nie Z,Engelhard M,Xiao J,Lv D,Wang C,Zhang JG,Liu J

    更新日期:2013-11-04 00:00:00

  • Neurological complications and risk factors of cardiopulmonary failure of EV-A71-related hand, foot and mouth disease.

    abstract::From 2010 to 2012, large outbreaks of EV-A71-related- hand foot and mouth disease (HFMD) occurred annually in China. Some cases had neurological complications and were closely associated with fatal cardiopulmonary collapse, but not all children with central nervous system (CNS) involvement demonstrated a poor prognosi...

    journal_title:Scientific reports

    pub_type: 杂志文章

    doi:10.1038/srep23444

    authors: Long L,Xu L,Xiao Z,Hu S,Luo R,Wang H,Lu X,Xu Z,Yao X,Zhou L,Long H,Gong J,Song Y,Zhao L,Luo K,Zhang M,Feng L,Yang L,Sheng X,Fan X,Xiao B

    更新日期:2016-03-22 00:00:00

  • Whole Exome Sequencing reveals new candidate genes in host genomic susceptibility to Respiratory Syncytial Virus Disease.

    abstract::Respiratory syncytial virus (RSV) is an important cause of serious lower respiratory tract disease in infants. Several studies have shown evidence pointing to the genome of the host as an important factor determining susceptibility to respiratory disease caused by RSV. We sequenced the complete exomes of 54 patients i...

    journal_title:Scientific reports

    pub_type: 杂志文章

    doi:10.1038/s41598-017-15752-4

    authors: Salas A,Pardo-Seco J,Cebey-López M,Gómez-Carballa A,Obando-Pacheco P,Rivero-Calle I,Currás-Tuala MJ,Amigo J,Gómez-Rial J,Martinón-Torres F,GENDRES network.

    更新日期:2017-11-21 00:00:00

  • Marine alkaloid monanchoxymycalin C: a new specific activator of JNK1/2 kinase with anticancer properties.

    abstract::Monanchoxymycalin C (MomC) is a new marine pentacyclic guanidine alkaloid, recently isolated from marine sponge Monanchora pulchra by us. Here, anticancer activity and mechanism of action was investigated for the first time using a human prostate cancer (PCa) model. MomC was active in all PCa cell lines at low micromo...

    journal_title:Scientific reports

    pub_type: 杂志文章

    doi:10.1038/s41598-020-69751-z

    authors: Dyshlovoy SA,Kaune M,Kriegs M,Hauschild J,Busenbender T,Shubina LK,Makarieva TN,Hoffer K,Bokemeyer C,Graefen M,Stonik VA,von Amsberg G

    更新日期:2020-08-06 00:00:00

  • Transcriptome profiles of hypothalamus and adrenal gland linked to haplotype related to coping behavior in pigs.

    abstract::The hypothalamic-pituitary-adrenal (HPA) axis is an important component of neuroendocrine stress regulation and coping behavior. Transcriptome profiles of the hypothalamus and adrenal gland were assessed to identify molecular pathways and candidate genes for coping behavior in pigs. Ten each of high- (HR) and low- (LR...

    journal_title:Scientific reports

    pub_type: 杂志文章

    doi:10.1038/s41598-019-49521-2

    authors: Gley K,Murani E,Trakooljul N,Zebunke M,Puppe B,Wimmers K,Ponsuksili S

    更新日期:2019-09-10 00:00:00

  • Origin of Symmetric Dimer Images of Si(001) Observed by Low-Temperature Scanning Tunneling Microscopy.

    abstract::It has been a long-standing puzzle why buckled dimers of the Si(001) surface appeared symmetric below ~20 K in scanning tunneling microscopy (STM) experiments. Although such symmetric dimer images were concluded to be due to an artifact induced by STM measurements, its underlying mechanism is still veiled. Here, we de...

    journal_title:Scientific reports

    pub_type: 杂志文章

    doi:10.1038/srep27868

    authors: Ren XY,Kim HJ,Niu CY,Jia Y,Cho JH

    更新日期:2016-06-13 00:00:00

  • Laparoscopic Resection of Residual Retroperitoneal Tumor Mass in Advanced Nonseminomatous Testicular Germ Cell Tumors; a Feasible and Safe Oncological Procedure.

    abstract::Ten-year oncological experience of the University Medical Center Groningen with conventional laparotomy (C-RRRTM) and laparoscopy (L-RRRTM) is described concerning resection of residual retroperitoneal tumor masses (RRTM) in a large series of patients with advanced nonseminomatous testicular germ cell tumors (NSTGCT)....

    journal_title:Scientific reports

    pub_type: 杂志文章

    doi:10.1038/s41598-019-52109-5

    authors: Öztürk Ç,Been LB,van Ginkel RJ,Gietema JA,Hoekstra HJ

    更新日期:2019-11-01 00:00:00

  • Development of a comprehensive set of tools for genome engineering in a cold- and thermo-tolerant Kluyveromyces marxianus yeast strain.

    abstract::Kluyveromyces marxianus, a non-conventional thermotolerant yeast, is potentially useful for production of ethanol and other products. This species has a strong tendency to randomly integrate transforming DNA fragments, making necessary the development of more precise methods for gene targeting. In this study, we first...

    journal_title:Scientific reports

    pub_type: 杂志文章

    doi:10.1038/s41598-017-08356-5

    authors: Nambu-Nishida Y,Nishida K,Hasunuma T,Kondo A

    更新日期:2017-08-21 00:00:00

  • Factors associated with smoking susceptibility among high school students in western Spain.

    abstract::The Expanded Susceptibility to Smoking Index (ESSI) is based on the combination of susceptibility to smoking and curiosity about smoking. The ESSI can identify young people who are at risk of starting to smoke cigarettes and related products. The objective of this study was to analyse the ESSI results and to examine f...

    journal_title:Scientific reports

    pub_type: 杂志文章

    doi:10.1038/s41598-021-81723-5

    authors: Santano-Mogena E,Franco-Antonio C,Chimento-Díaz S,Rico-Martín S,Cordovilla-Guardia S

    更新日期:2021-01-21 00:00:00

  • Support for the Microgenderome: Associations in a Human Clinical Population.

    abstract::The 'microgenderome' provides a paradigm shift that highlights the role of sex differences in the host-microbiota interaction relevant for autoimmune and neuro-immune conditions. Analysis of cross-sectional self-report and faecal microbial data from 274 patients with Myalgic Encephalomyelitis/Chronic Fatigue Syndrome ...

    journal_title:Scientific reports

    pub_type: 杂志文章

    doi:10.1038/srep19171

    authors: Wallis A,Butt H,Ball M,Lewis DP,Bruck D

    更新日期:2016-01-13 00:00:00

  • Permeability-driven selection in a semi-empirical protocell model: the roots of prebiotic systems evolution.

    abstract::The origin-of-life problem has been traditionally conceived as the chemical challenge to find the type of molecule and free-solution reaction dynamics that could have started Darwinian evolution. Different autocatalytic and 'self-replicative' molecular species have been extensively investigated, together with plausibl...

    journal_title:Scientific reports

    pub_type: 杂志文章

    doi:10.1038/s41598-017-02799-6

    authors: Piedrafita G,Monnard PA,Mavelli F,Ruiz-Mirazo K

    更新日期:2017-06-09 00:00:00

  • A missing color area extraction approach from high-resolution statue images for cultural heritage documentation.

    abstract::Ancient statues are usually fragile and have a tendency to deteriorate over time, developing cracks, corrosion, and losing color. Before any intervention on the object of art, a conservator must map degradation and take measurements. Deterioration mapping is an extremely long process, as the conservator or restorer mu...

    journal_title:Scientific reports

    pub_type: 杂志文章

    doi:10.1038/s41598-020-78254-w

    authors: Nasri A,Huang X

    更新日期:2020-12-14 00:00:00

  • Long non-coding RNA PARTICLE bridges histone and DNA methylation.

    abstract::PARTICLE (Gene PARTICL- 'Promoter of MAT2A-Antisense RadiaTion Induced Circulating LncRNA) expression is transiently elevated following low dose irradiation typically encountered in the workplace and from natural sources. This long non-coding RNA recruits epigenetic silencers for cis-acting repression of its neighbour...

    journal_title:Scientific reports

    pub_type: 杂志文章

    doi:10.1038/s41598-017-01875-1

    authors: O'Leary VB,Hain S,Maugg D,Smida J,Azimzadeh O,Tapio S,Ovsepian SV,Atkinson MJ

    更新日期:2017-05-11 00:00:00

  • Pyrazine ring-based Na+/H+ exchanger (NHE) inhibitors potently inhibit cancer cell growth in 3D culture, independent of NHE1.

    abstract::The Na+/H+ exchanger-1 (NHE1) supports tumour growth, making NHE1 inhibitors of interest in anticancer therapy, yet their molecular effects are incompletely characterized. Here, we demonstrate that widely used pyrazinoylguanidine-type NHE1 inhibitors potently inhibit growth and survival of cancer cell spheroids, in a ...

    journal_title:Scientific reports

    pub_type: 杂志文章

    doi:10.1038/s41598-020-62430-z

    authors: Rolver MG,Elingaard-Larsen LO,Andersen AP,Counillon L,Pedersen SF

    更新日期:2020-04-02 00:00:00

  • Novel ZnO hollow-nanocarriers containing paclitaxel targeting folate-receptors in a malignant pH-microenvironment for effective monitoring and promoting breast tumor regression.

    abstract::Low pH in the tumor micromilieu is a recognized pathological feature of cancer. This attribute of cancerous cells has been targeted herein for the controlled release of chemotherapeutics at the tumour site, while sparing healthy tissues. To this end, pH-sensitive, hollow ZnO-nanocarriers loaded with paclitaxel were sy...

    journal_title:Scientific reports

    pub_type: 杂志文章

    doi:10.1038/srep11760

    authors: Puvvada N,Rajput S,Kumar BNP,Sarkar S,Konar S,Brunt KR,Rao RR,Mazumdar A,Das SK,Basu R,Fisher PB,Mandal M,Pathak A

    更新日期:2015-07-06 00:00:00

  • Nutrient allocation strategies of woody plants: an approach from the scaling of nitrogen and phosphorus between twig stems and leaves.

    abstract::Allocation of limited nutrients, such as nitrogen (N) and phosphorus (P), among plant organs reflects the influences of evolutionary and ecological processes on functional traits of plants, and thus is related to functional groups and environmental conditions. In this study, we tested this hypothesis by exploring the ...

    journal_title:Scientific reports

    pub_type: 杂志文章

    doi:10.1038/srep20099

    authors: Yan Z,Li P,Chen Y,Han W,Fang J

    更新日期:2016-02-05 00:00:00

  • Electrophysiological evidence of inhibited orthographic regularity effect on the recognition of real Chinese characters.

    abstract::Orthographic regularity is important for processing Chinese characters. However, the issues how orthographic regularity influences the visual recognition of real Chinese characters and whether common processes related to the potential effect exist between successive (SUCC) and concurrent (CONC) conditions with asynchr...

    journal_title:Scientific reports

    pub_type: 杂志文章

    doi:10.1038/srep23275

    authors: He W,Fan C,Ren J,Liu T,Zhang M,Luo W

    更新日期:2016-03-23 00:00:00

  • Giant Faraday Rotation in Metal-Fluoride Nanogranular Films.

    abstract::Magneto-optical Faraday effect is widely applied in optical devices and is indispensable for optical communications and advanced information technology. However, the bismuth garnet Bi-YIG is only the Faraday material since 1972. Here we introduce (Fe, FeCo)-(Al-,Y-fluoride) nanogranular films exhibiting giant Faraday ...

    journal_title:Scientific reports

    pub_type: 杂志文章

    doi:10.1038/s41598-018-23128-5

    authors: Kobayashi N,Ikeda K,Gu B,Takahashi S,Masumoto H,Maekawa S

    更新日期:2018-03-21 00:00:00

  • Fluorometric evaluation of CYP3A4 expression using improved transgenic HepaRG cells carrying a dual-colour reporter for CYP3A4 and CYP3A7.

    abstract::Primary human hepatocytes are necessary to evaluate cytotoxicity, drug metabolism, and drug-drug interactions for candidate compounds in early-phase drug discovery and development. However, these analyses are often hampered by limited resources and functional or genetic variation among lots. HepaRG human hepatocellula...

    journal_title:Scientific reports

    pub_type: 杂志文章

    doi:10.1038/s41598-017-03146-5

    authors: Ueyama T,Tsuji S,Sugiyama T,Tada M

    更新日期:2017-06-06 00:00:00

  • Relationships of Haptoglobin Phenotypes with Systemic Inflammation and the Severity of Chronic Obstructive Pulmonary Disease.

    abstract::Chronic obstructive pulmonary disease (COPD) is caused by chronic inflammation. Many inflammatory mediators induce the low grade systemic inflammation of COPD. Haptoglobin (Hp) is synthesized in the liver and by lung epithelial and alveolar macrophage cells. However, associations of the serum concentration and phenoty...

    journal_title:Scientific reports

    pub_type: 杂志文章

    doi:10.1038/s41598-018-37406-9

    authors: Lee PL,Lee KY,Cheng TM,Chuang HC,Wu SM,Feng PH,Liu WT,Chen KY,Ho SC

    更新日期:2019-01-17 00:00:00