Boosting medical diagnostics by pooling independent judgments.

Abstract:

:Collective intelligence refers to the ability of groups to outperform individual decision makers when solving complex cognitive problems. Despite its potential to revolutionize decision making in a wide range of domains, including medical, economic, and political decision making, at present, little is known about the conditions underlying collective intelligence in real-world contexts. We here focus on two key areas of medical diagnostics, breast and skin cancer detection. Using a simulation study that draws on large real-world datasets, involving more than 140 doctors making more than 20,000 diagnoses, we investigate when combining the independent judgments of multiple doctors outperforms the best doctor in a group. We find that similarity in diagnostic accuracy is a key condition for collective intelligence: Aggregating the independent judgments of doctors outperforms the best doctor in a group whenever the diagnostic accuracy of doctors is relatively similar, but not when doctors' diagnostic accuracy differs too much. This intriguingly simple result is highly robust and holds across different group sizes, performance levels of the best doctor, and collective intelligence rules. The enabling role of similarity, in turn, is explained by its systematic effects on the number of correct and incorrect decisions of the best doctor that are overruled by the collective. By identifying a key factor underlying collective intelligence in two important real-world contexts, our findings pave the way for innovative and more effective approaches to complex real-world decision making, and to the scientific analyses of those approaches.

authors

Kurvers RH,Herzog SM,Hertwig R,Krause J,Carney PA,Bogart A,Argenziano G,Zalaudek I,Wolf M

doi

10.1073/pnas.1601827113

subject

Has Abstract

pub_date

2016-08-02 00:00:00

pages

8777-82

issue

31

eissn

0027-8424

issn

1091-6490

pii

1601827113

journal_volume

113

pub_type

杂志文章
  • Negative control elements and cAMP responsive sequences in the tissue-specific expression of mouse renin genes.

    abstract::The 5' flanking regions of the mouse renin genes (Ren1d and Ren2d) contain putative negative control and cAMP responsive elements. Sequence analysis shows additionally that these putative control elements in the Ren2d gene are interrupted by a 160-base-pair insertion. To document the functions of these elements, we is...

    journal_title:Proceedings of the National Academy of Sciences of the United States of America

    pub_type: 杂志文章

    doi:10.1073/pnas.86.1.56

    authors: Nakamura N,Burt DW,Paul M,Dzau VJ

    更新日期:1989-01-01 00:00:00

  • Expression of two X-linked genes in human hair follicles of double heterozygotes.

    abstract::Expression of the two X-linked loci glucose-6-phosphate dehydrogenase (G6PD; EC 1.1.1.49) and hypoxanthine:guanine phosphoribosyltransferase (HGPRT; EC 2.4.2.8) was studied in single hair follicles of two females who were heterozygous for both of these genes (double heterozygotes). The coupling phase for these two loc...

    journal_title:Proceedings of the National Academy of Sciences of the United States of America

    pub_type: 杂志文章

    doi:10.1073/pnas.68.7.1425

    authors: Goldstein JL,Marks JF,Gartler SM

    更新日期:1971-07-01 00:00:00

  • Noncovalent interaction of the NH2-terminal fragment of human somatotropin with the COOH-terminal fragment of human choriomammotropin to generate growth-promoting activity.

    abstract::Complementation of the plasmin fragments of reduced-carbamoylmethylated (Cam) human somatotropin (hGH) with those of reduced-carbamoylmethylated human chorionic somatomammotropin (hCS) have been investigated. It was found that the recombinant obtained by noncovalent interaction of [Cys(Cam)53]hGH-(1-134) with [Cys(Cam...

    journal_title:Proceedings of the National Academy of Sciences of the United States of America

    pub_type: 杂志文章

    doi:10.1073/pnas.75.4.1700

    authors: Li CH

    更新日期:1978-04-01 00:00:00

  • The sigma factor sigma s affects antibiotic production and biological control activity of Pseudomonas fluorescens Pf-5.

    abstract::Pseudomonas fluorescens Pf-5, a rhizosphere-inhabiting bacterium that suppresses several soilborne pathogens of plants, produces the antibiotics pyrrolnitrin, pyoluteorin, and 2,4-diacetylphloroglucinol. A gene necessary for pyrrolnitrin production by Pf-5 was identified as rpoS, which encodes the stationary-phase sig...

    journal_title:Proceedings of the National Academy of Sciences of the United States of America

    pub_type: 杂志文章

    doi:10.1073/pnas.92.26.12255

    authors: Sarniguet A,Kraus J,Henkels MD,Muehlchen AM,Loper JE

    更新日期:1995-12-19 00:00:00

  • Decadal predictability without ocean dynamics.

    abstract::This paper shows that the most predictable components of internal variability in coupled atmosphere-ocean models are remarkably similar to the most predictable components of climate models without interactive ocean dynamics (i.e., models whose ocean is represented by a 50-m-deep slab ocean mixed layer with no interact...

    journal_title:Proceedings of the National Academy of Sciences of the United States of America

    pub_type: 杂志文章

    doi:10.1073/pnas.1614085114

    authors: Srivastava A,DelSole T

    更新日期:2017-02-28 00:00:00

  • Pulsed growth of fungal hyphal tips.

    abstract::Somatic fungal hyphae are generally assumed to elongate at steady linear rates when grown under constant environmental conditions with ample nutrients. However, patterns of pulsed hyphal elongation were detected during apparent steady growth of hyphal tips in fungi from several major taxonomic groups (Oomycetes, Pythi...

    journal_title:Proceedings of the National Academy of Sciences of the United States of America

    pub_type: 杂志文章

    doi:10.1073/pnas.91.25.12228

    authors: López-Franco R,Bartnicki-Garcia S,Bracker CE

    更新日期:1994-12-06 00:00:00

  • Subcortical differentiation of stop consonants relates to reading and speech-in-noise perception.

    abstract::Children with reading impairments have deficits in phonological awareness, phonemic categorization, speech-in-noise perception, and psychophysical tasks such as frequency and temporal discrimination. Many of these children also exhibit abnormal encoding of speech stimuli in the auditory brainstem, even though response...

    journal_title:Proceedings of the National Academy of Sciences of the United States of America

    pub_type: 杂志文章

    doi:10.1073/pnas.0901123106

    authors: Hornickel J,Skoe E,Nicol T,Zecker S,Kraus N

    更新日期:2009-08-04 00:00:00

  • cAMP-dependent protein kinase phosphorylation of the acid-sensing ion channel-1 regulates its binding to the protein interacting with C-kinase-1.

    abstract::The acid-sensing ion channel-1 (ASIC1) contributes to synaptic plasticity and may influence the response to cerebral ischemia and acidosis. We found that cAMP-dependent protein kinase phosphorylated heterologously expressed ASIC1 and endogenous ASIC1 in brain slices. ASIC1 also showed significant phosphorylation under...

    journal_title:Proceedings of the National Academy of Sciences of the United States of America

    pub_type: 杂志文章

    doi:10.1073/pnas.252782799

    authors: Leonard AS,Yermolaieva O,Hruska-Hageman A,Askwith CC,Price MP,Wemmie JA,Welsh MJ

    更新日期:2003-02-18 00:00:00

  • The fossil record of phenotypic integration and modularity: A deep-time perspective on developmental and evolutionary dynamics.

    abstract::Variation is the raw material for natural selection, but the factors shaping variation are still poorly understood. Genetic and developmental interactions can direct variation, but there has been little synthesis of these effects with the extrinsic factors that can shape biodiversity over large scales. The study of ph...

    journal_title:Proceedings of the National Academy of Sciences of the United States of America

    pub_type: 杂志文章

    doi:10.1073/pnas.1403667112

    authors: Goswami A,Binder WJ,Meachen J,O'Keefe FR

    更新日期:2015-04-21 00:00:00

  • Cholinergic agonists stimulate secretion of soluble full-length amyloid precursor protein in neuroendocrine cells.

    abstract::The Abeta peptide of Alzheimer disease is derived from the proteolytic processing of the amyloid precursor proteins (APP), which are considered type I transmembrane glycoproteins. Recently, however, soluble forms of full-length APP were also detected in several systems including chromaffin granules. In this report we ...

    journal_title:Proceedings of the National Academy of Sciences of the United States of America

    pub_type: 杂志文章

    doi:10.1073/pnas.93.15.8046

    authors: Efthimiopoulos S,Vassilacopoulou D,Ripellino JA,Tezapsidis N,Robakis NK

    更新日期:1996-07-23 00:00:00

  • Nonlinear threshold behavior during the loss of Arctic sea ice.

    abstract::In light of the rapid recent retreat of Arctic sea ice, a number of studies have discussed the possibility of a critical threshold (or "tipping point") beyond which the ice-albedo feedback causes the ice cover to melt away in an irreversible process. The focus has typically been centered on the annual minimum (Septemb...

    journal_title:Proceedings of the National Academy of Sciences of the United States of America

    pub_type: 杂志文章

    doi:10.1073/pnas.0806887106

    authors: Eisenman I,Wettlaufer JS

    更新日期:2009-01-06 00:00:00

  • Presynaptic serotonin 2A receptors modulate thalamocortical plasticity and associative learning.

    abstract::Higher-level cognitive processes strongly depend on a complex interplay between mediodorsal thalamus nuclei and the prefrontal cortex (PFC). Alteration of thalamofrontal connectivity has been involved in cognitive deficits of schizophrenia. Prefrontal serotonin (5-HT)2A receptors play an essential role in cortical net...

    journal_title:Proceedings of the National Academy of Sciences of the United States of America

    pub_type: 杂志文章

    doi:10.1073/pnas.1525586113

    authors: Barre A,Berthoux C,De Bundel D,Valjent E,Bockaert J,Marin P,Bécamel C

    更新日期:2016-03-08 00:00:00

  • Ribosome-induced tuning of GTP hydrolysis by a translational GTPase.

    abstract::GTP hydrolysis by elongation factor Tu (EF-Tu), a translational GTPase that delivers aminoacyl-tRNAs to the ribosome, plays a crucial role in decoding and translational fidelity. The basic reaction mechanism and the way the ribosome contributes to catalysis are a matter of debate. Here we use mutational analysis in co...

    journal_title:Proceedings of the National Academy of Sciences of the United States of America

    pub_type: 杂志文章

    doi:10.1073/pnas.1412676111

    authors: Maracci C,Peske F,Dannies E,Pohl C,Rodnina MV

    更新日期:2014-10-07 00:00:00

  • Cap-dependent RNA splicing in a HeLa nuclear extract.

    abstract::We have studied the involvement of the 5' cap structure in the splicing of precursor mRNAs in a HeLa nuclear extract. We show that precursor mRNAs are spliced efficiently only when they possess a cap structure and that preincubation of a HeLa nuclear extract rendered the splicing reaction highly sensitive to inhibitio...

    journal_title:Proceedings of the National Academy of Sciences of the United States of America

    pub_type: 杂志文章

    doi:10.1073/pnas.82.22.7590

    authors: Edery I,Sonenberg N

    更新日期:1985-11-01 00:00:00

  • Homosynaptic long-term depression in area CA1 of hippocampus and effects of N-methyl-D-aspartate receptor blockade.

    abstract::We tested a theoretical prediction that patterns of excitatory input activity that consistently fail to activate target neurons sufficiently to induce synaptic potentiation will instead cause a specific synaptic depression. To realize this situation experimentally, the Schaffer collateral projection to area CA1 in rat...

    journal_title:Proceedings of the National Academy of Sciences of the United States of America

    pub_type: 杂志文章

    doi:10.1073/pnas.89.10.4363

    authors: Dudek SM,Bear MF

    更新日期:1992-05-15 00:00:00

  • Vasoactive intestinal polypeptide and cholinergic mechanisms in cat nasal mucosa: studies on choline acetyltransferase and release of vasoactive intestinal polypeptide.

    abstract::Quantitative immunohistochemical analysis of the sphenopalatine ganglion in normal cats revealed that virtually all ganglion cells (98.5%) were immunoreactive to vasoactive intestinal polypeptide (VIP). After surgical removal of this ganglion, the content of both VIP and choline acetyltransferase (acetyl-CoA:choline O...

    journal_title:Proceedings of the National Academy of Sciences of the United States of America

    pub_type: 杂志文章

    doi:10.1073/pnas.78.8.5255

    authors: Lundberg JM,Anggård A,Emson P,Fahrenkrug J,Hökfelt T

    更新日期:1981-08-01 00:00:00

  • Phylogeny of protein-folding trajectories reveals a unique pathway to native structure.

    abstract::To scrutinize how a protein folds at atomic resolution, we performed 200 molecular dynamics simulations (each of 50 ns) of the miniprotein Trp-cage on the computational grid. Within the trajectories, 58 folding and 31 unfolding events were identified and subjected to extensive comparison and classification. Based on a...

    journal_title:Proceedings of the National Academy of Sciences of the United States of America

    pub_type: 杂志文章

    doi:10.1073/pnas.0407015102

    authors: Ota M,Ikeguchi M,Kidera A

    更新日期:2004-12-21 00:00:00

  • Disruption of the M80-Fe ligation stimulates the translocation of cytochrome c to the cytoplasm and nucleus in nonapoptotic cells.

    abstract::Native cytochrome c (cyt c) has a compact tertiary structure with a hexacoordinated heme iron and functions in electron transport in mitochondria and apoptosis in the cytoplasm. However, the possibility that protein modifications confer additional functions to cyt c has not been explored. Disruption of methionine 80 (...

    journal_title:Proceedings of the National Academy of Sciences of the United States of America

    pub_type: 杂志文章

    doi:10.1073/pnas.0809279106

    authors: Godoy LC,Muñoz-Pinedo C,Castro L,Cardaci S,Schonhoff CM,King M,Tórtora V,Marín M,Miao Q,Jiang JF,Kapralov A,Jemmerson R,Silkstone GG,Patel JN,Evans JE,Wilson MT,Green DR,Kagan VE,Radi R,Mannick JB

    更新日期:2009-02-24 00:00:00

  • Mapping of multiple susceptibility variants within the MHC region for 7 immune-mediated diseases.

    abstract::The human MHC represents the strongest susceptibility locus for autoimmune diseases. However, the identification of the true predisposing gene(s) has been handicapped by the strong linkage disequilibrium across the region. Furthermore, most studies to date have been limited to the examination of a subset of the HLA an...

    journal_title:Proceedings of the National Academy of Sciences of the United States of America

    pub_type: 杂志文章

    doi:10.1073/pnas.0909307106

    authors: International MHC and Autoimmunity Genetics Network.,Rioux JD,Goyette P,Vyse TJ,Hammarström L,Fernando MM,Green T,De Jager PL,Foisy S,Wang J,de Bakker PI,Leslie S,McVean G,Padyukov L,Alfredsson L,Annese V,Hafler DA,Pan-

    更新日期:2009-11-03 00:00:00

  • Sharing of T cell receptors in antigen-specific responses is driven by convergent recombination.

    abstract::Public responses where identical T cell receptors (TCRs) are clonally dominant and shared between different individuals are a common characteristic of CD8(+) T cell-mediated immunity. Focusing on TCR sharing, we analyzed approximately 3,400 TCR beta chains (TCRbetas) from mouse CD8(+) T cells responding to the influen...

    journal_title:Proceedings of the National Academy of Sciences of the United States of America

    pub_type: 杂志文章

    doi:10.1073/pnas.0608907103

    authors: Venturi V,Kedzierska K,Price DA,Doherty PC,Douek DC,Turner SJ,Davenport MP

    更新日期:2006-12-05 00:00:00

  • Coupling of RNA displacement and intrinsic termination in transcription from synthetic RNA.DNA bubble duplex constructs.

    abstract::Functional transcription elongation complexes can be formed by adding RNA polymerase in trans to a preformed nucleic acid construct. This construct consists of a double-stranded DNA fragment that contains a noncomplementary (permanent DNA bubble) region into which an RNA primer oligonucleotide has been hybridized. By ...

    journal_title:Proceedings of the National Academy of Sciences of the United States of America

    pub_type: 杂志文章

    doi:10.1073/pnas.91.20.9539

    authors: Daube SS,Hart CR,von Hippel PH

    更新日期:1994-09-27 00:00:00

  • Extracellular vesicle-associated VEGF-C promotes lymphangiogenesis and immune cells infiltration in endometriosis.

    abstract::Endometriosis is a highly prevalent gynecological disease with severe negative impacts on life quality and financial burden. Unfortunately, there is no cure for this disease, which highlights the need for further investigation about the pathophysiology of this disease to provide clues for developing novel therapeutic ...

    journal_title:Proceedings of the National Academy of Sciences of the United States of America

    pub_type: 杂志文章

    doi:10.1073/pnas.1920037117

    authors: Li WN,Hsiao KY,Wang CA,Chang N,Hsu PL,Sun CH,Wu SR,Wu MH,Tsai SJ

    更新日期:2020-10-13 00:00:00

  • Beta oscillations reflect supramodal information during perceptual judgment.

    abstract::Previous work on perceptual decision making in the sensorimotor system has shown population dynamics in the beta band, corresponding to the encoding of stimulus properties and the final decision outcome. Here, we asked how oscillatory dynamics in the medial premotor cortex (MPC) contribute to supramodal perceptual dec...

    journal_title:Proceedings of the National Academy of Sciences of the United States of America

    pub_type: 杂志文章

    doi:10.1073/pnas.1714633115

    authors: Haegens S,Vergara J,Rossi-Pool R,Lemus L,Romo R

    更新日期:2017-12-26 00:00:00

  • Visual responses of neurons in somatosensory cortex of hamsters with experimentally induced retinal projections to somatosensory thalamus.

    abstract::These experiments investigate the capacity of thalamic and cortical structures in a sensory system to process information of a modality normally associated with another system. Retinal ganglion cells in newborn Syrian hamsters were made to project permanently to the main thalamic somatosensory (ventrobasal) nucleus. W...

    journal_title:Proceedings of the National Academy of Sciences of the United States of America

    pub_type: 杂志文章

    doi:10.1073/pnas.86.1.357

    authors: Métin C,Frost DO

    更新日期:1989-01-01 00:00:00

  • Recruitment of the p97 ATPase and ubiquitin ligases to the site of retrotranslocation at the endoplasmic reticulum membrane.

    abstract::Misfolded proteins are eliminated from the endoplasmic reticulum (ER) by retrotranslocation into the cytosol, a pathway hijacked by certain viruses to destroy MHC class I heavy chains. The translocation of polypeptides across the ER membrane requires their polyubiquitination and subsequent extraction from the membrane...

    journal_title:Proceedings of the National Academy of Sciences of the United States of America

    pub_type: 杂志文章

    doi:10.1073/pnas.0505006102

    authors: Ye Y,Shibata Y,Kikkert M,van Voorden S,Wiertz E,Rapoport TA

    更新日期:2005-10-04 00:00:00

  • Peptide design by artificial neural networks and computer-based evolutionary search.

    abstract::A technique for systematic peptide variation by a combination of rational and evolutionary approaches is presented. The design scheme consists of five consecutive steps: (i) identification of a "seed peptide" with a desired activity, (ii) generation of variants selected from a physicochemical space around the seed pep...

    journal_title:Proceedings of the National Academy of Sciences of the United States of America

    pub_type: 杂志文章

    doi:10.1073/pnas.95.21.12179

    authors: Schneider G,Schrödl W,Wallukat G,Müller J,Nissen E,Rönspeck W,Wrede P,Kunze R

    更新日期:1998-10-13 00:00:00

  • Alcohol action on a neuronal membrane receptor: evidence for a direct interaction with the receptor protein.

    abstract::For almost a century, alcohols have been thought to produce their effects by actions on the membrane lipids of central nervous system neurons--the well known "lipid theory" of alcohol action. The rationale for this theory is the correlation of potency with oil/water or membrane/buffer partition coefficient. Although a...

    journal_title:Proceedings of the National Academy of Sciences of the United States of America

    pub_type: 杂志文章

    doi:10.1073/pnas.91.17.8200

    authors: Li C,Peoples RW,Weight FF

    更新日期:1994-08-16 00:00:00

  • Molecular heterogeneity of variant isovaleryl-CoA dehydrogenase from cultured isovaleric acidemia fibroblasts.

    abstract::Variants of isovaleryl-CoA dehydrogenase (IVDHase, EC 1.3.99.10) in 15 isovaleric acidemia fibroblast lines were analyzed using [35S]methionine labeling, immunoprecipitation with anti-rat IVDHase antiserum, and NaDodSo4/polyacrylamide gel electrophoresis. Five distinct variants of IVDHase were detected. The molecular ...

    journal_title:Proceedings of the National Academy of Sciences of the United States of America

    pub_type: 杂志文章

    doi:10.1073/pnas.82.20.7081

    authors: Ikeda Y,Keese SM,Tanaka K

    更新日期:1985-10-01 00:00:00

  • Oxidative stress is tightly regulated by cytochrome c phosphorylation and respirasome factors in mitochondria.

    abstract::Respiratory cytochrome c has been found to be phosphorylated at tyrosine 97 in the postischemic brain upon neuroprotective insulin treatment, but how such posttranslational modification affects mitochondrial metabolism is unclear. Here, we report the structural features and functional behavior of a phosphomimetic cyto...

    journal_title:Proceedings of the National Academy of Sciences of the United States of America

    pub_type: 杂志文章

    doi:10.1073/pnas.1806833115

    authors: Guerra-Castellano A,Díaz-Quintana A,Pérez-Mejías G,Elena-Real CA,González-Arzola K,García-Mauriño SM,De la Rosa MA,Díaz-Moreno I

    更新日期:2018-07-31 00:00:00

  • Hybridoma-derived antibody with immunodiagnostic potential for schistosomiasis japonica.

    abstract::A murine hybridoma-derived antibody (IPH.134) has been produced which has apparent high binding specificity for an extract of Schistosoma japonicum adult worms. No binding was detected to extracts of S. japonicum eggs or to extracts from other adult trematodes (Fasciola hepatica, Paragonimus westermanii, Clonorchis si...

    journal_title:Proceedings of the National Academy of Sciences of the United States of America

    pub_type: 杂志文章

    doi:10.1073/pnas.78.5.3165

    authors: Mitchell GF,Cruise KM,Garcia EG,Anders RF

    更新日期:1981-05-01 00:00:00