Artificial intelligence framework for simulating clinical decision-making: a Markov decision process approach.

Abstract:

OBJECTIVE:In the modern healthcare system, rapidly expanding costs/complexity, the growing myriad of treatment options, and exploding information streams that often do not effectively reach the front lines hinder the ability to choose optimal treatment decisions over time. The goal in this paper is to develop a general purpose (non-disease-specific) computational/artificial intelligence (AI) framework to address these challenges. This framework serves two potential functions: (1) a simulation environment for exploring various healthcare policies, payment methodologies, etc., and (2) the basis for clinical artificial intelligence - an AI that can "think like a doctor". METHODS:This approach combines Markov decision processes and dynamic decision networks to learn from clinical data and develop complex plans via simulation of alternative sequential decision paths while capturing the sometimes conflicting, sometimes synergistic interactions of various components in the healthcare system. It can operate in partially observable environments (in the case of missing observations or data) by maintaining belief states about patient health status and functions as an online agent that plans and re-plans as actions are performed and new observations are obtained. This framework was evaluated using real patient data from an electronic health record. RESULTS:The results demonstrate the feasibility of this approach; such an AI framework easily outperforms the current treatment-as-usual (TAU) case-rate/fee-for-service models of healthcare. The cost per unit of outcome change (CPUC) was $189 vs. $497 for AI vs. TAU (where lower is considered optimal) - while at the same time the AI approach could obtain a 30-35% increase in patient outcomes. Tweaking certain AI model parameters could further enhance this advantage, obtaining approximately 50% more improvement (outcome change) for roughly half the costs. CONCLUSION:Given careful design and problem formulation, an AI simulation framework can approximate optimal decisions even in complex and uncertain environments. Future work is described that outlines potential lines of research and integration of machine learning algorithms for personalized medicine.

journal_name

Artif Intell Med

authors

Bennett CC,Hauser K

doi

10.1016/j.artmed.2012.12.003

subject

Has Abstract

pub_date

2013-01-01 00:00:00

pages

9-19

issue

1

eissn

0933-3657

issn

1873-2860

pii

S0933-3657(12)00151-0

journal_volume

57

pub_type

杂志文章
  • Indoor location identification of patients for directing virtual care: An AI approach using machine learning and knowledge-based methods.

    abstract::In a digitally enabled healthcare setting, we posit that an individual's current location is pivotal for supporting many virtual care services-such as tailoring educational content towards an individual's current location, and, hence, current stage in an acute care process; improving activity recognition for supportin...

    journal_title:Artificial intelligence in medicine

    pub_type: 杂志文章

    doi:10.1016/j.artmed.2020.101931

    authors: Van Woensel W,Roy PC,Abidi SSR,Abidi SR

    更新日期:2020-08-01 00:00:00

  • Non-invasive estimate of blood glucose and blood pressure from a photoplethysmograph by means of machine learning techniques.

    abstract:OBJECTIVE:This work presents a system for a simultaneous non-invasive estimate of the blood glucose level (BGL) and the systolic (SBP) and diastolic (DBP) blood pressure, using a photoplethysmograph (PPG) and machine learning techniques. The method is independent of the person whose values are being measured and does n...

    journal_title:Artificial intelligence in medicine

    pub_type: 杂志文章

    doi:10.1016/j.artmed.2011.05.001

    authors: Monte-Moreno E

    更新日期:2011-10-01 00:00:00

  • Predicting ICU readmission using grouped physiological and medication trends.

    abstract:BACKGROUND:Patients who are readmitted to an intensive care unit (ICU) usually have a high risk of mortality and an increased length of stay. ICU readmission risk prediction may help physicians to re-evaluate the patient's physical conditions before patients are discharged and avoid preventable readmissions. ICU readmi...

    journal_title:Artificial intelligence in medicine

    pub_type: 杂志文章

    doi:10.1016/j.artmed.2018.08.004

    authors: Xue Y,Klabjan D,Luo Y

    更新日期:2019-04-01 00:00:00

  • User-defined functions in the Arden Syntax: An extension proposal.

    abstract:BACKGROUND:The Arden Syntax is a knowledge-encoding standard, started in 1989, and now in its 10th revision, maintained by the health level seven (HL7) organization. It has constructs borrowed from several language concepts that were available at that time (mainly the HELP hospital information system and the Regenstrie...

    journal_title:Artificial intelligence in medicine

    pub_type: 杂志文章

    doi:10.1016/j.artmed.2015.11.003

    authors: Karadimas H,Ebrahiminia V,Lepage E

    更新日期:2018-11-01 00:00:00

  • Continual planning and scheduling for managing patient tests in hospital laboratories.

    abstract::Hospital laboratories perform examination tests upon patients, in order to assist medical diagnosis or therapy progress. Planning and scheduling patient requests for examination tests is a complicated problem because it concerns both minimization of patient stay in hospital and maximization of laboratory resources uti...

    journal_title:Artificial intelligence in medicine

    pub_type: 杂志文章

    doi:10.1016/s0933-3657(00)00061-0

    authors: Marinagi CC,Spyropoulos CD,Papatheodorou C,Kokkotos S

    更新日期:2000-10-01 00:00:00

  • Case-based distance measurements for the selection of controls in case-matched studies: application in coronary interventions.

    abstract::In case-based studies, controls are retrospectively assigned to patients in order to permit a statistical evaluation of the study results through a comparison of the main outcome measures for the patient and retrieved control groups. Inappropriate selection of the controls by using false retrieval parameters or a fals...

    journal_title:Artificial intelligence in medicine

    pub_type: 杂志文章

    doi:10.1016/s0933-3657(02)00084-2

    authors: Gyöngyösi M,Ploner M,Porenta G,Sperker W,Wexberg P,Strehblow C,Glogar D

    更新日期:2002-11-01 00:00:00

  • Approximate dynamic programming approaches for appointment scheduling with patient preferences.

    abstract::During the appointment booking process in out-patient departments, the level of patient satisfaction can be affected by whether or not their preferences can be met, including the choice of physicians and preferred time slot. In addition, because the appointments are sequential, considering future possible requests is ...

    journal_title:Artificial intelligence in medicine

    pub_type: 杂志文章

    doi:10.1016/j.artmed.2018.02.001

    authors: Li X,Wang J,Fung RYK

    更新日期:2018-04-01 00:00:00

  • Exploring the relationship between rationality and bounded rationality in medical knowledge-based systems.

    abstract::If our goal in Artificial Intelligence in Medicine (AIM) is to engineer systems health-care providers will both use and, in the process, improve their performance, we must concentrate on the development of causal theories of knowledge and problem solving. One broad direction in pursuing this goal is understanding the ...

    journal_title:Artificial intelligence in medicine

    pub_type: 杂志文章,评审

    doi:10.1016/0933-3657(93)90013-s

    authors: Smith JW Jr,Bayazitoglu A

    更新日期:1993-04-01 00:00:00

  • Identification of the optic nerve head with genetic algorithms.

    abstract:OBJECTIVE:This work proposes creating an automatic system to locate and segment the optic nerve head (ONH) in eye fundus photographic images using genetic algorithms. METHODS AND MATERIAL:Domain knowledge is used to create a set of heuristics that guide the various steps involved in the process. Initially, using an ey...

    journal_title:Artificial intelligence in medicine

    pub_type: 杂志文章

    doi:10.1016/j.artmed.2008.04.005

    authors: Carmona EJ,Rincón M,García-Feijoó J,Martínez-de-la-Casa JM

    更新日期:2008-07-01 00:00:00

  • Selection of patients for clinical trials: an interactive web-based system.

    abstract::The purpose of a clinical trial is to evaluate a new treatment procedure. When medical researchers conduct a trial, they recruit participants with appropriate health problems and medical histories. To select participants, they analyze medical records of the available patients, which has traditionally been a manual pro...

    journal_title:Artificial intelligence in medicine

    pub_type: 杂志文章

    doi:10.1016/j.artmed.2004.01.017

    authors: Fink E,Kokku PK,Nikiforou S,Hall LO,Goldgof DB,Krischer JP

    更新日期:2004-07-01 00:00:00

  • Evolving artificial neural networks for screening features from mammograms.

    abstract::Disagreement or inconsistencies in mammographic interpretation motivates utilizing computerized pattern recognition algorithms to aid the assessment of radiographic features. We have studied the potential for using artificial neural networks (ANNs) to analyze interpreted radiographic features from film screen mammogra...

    journal_title:Artificial intelligence in medicine

    pub_type: 杂志文章

    doi:10.1016/s0933-3657(98)00040-2

    authors: Fogel DB,Wasson EC 3rd,Boughton EM,Porto VW

    更新日期:1998-11-01 00:00:00

  • A novel, direct spatio-temporal approach for analyzing fMRI experiments.

    abstract::We introduce a novel approach to couple temporal similarity with spatial neighborhood information. This is achieved by concatenating the K nearest, spatially contiguous neighbors of a pixel time-course (TC) of T time-instances. This produces a new TC of (K+1)T time instances. Depending on how "nearest" is defined, we ...

    journal_title:Artificial intelligence in medicine

    pub_type: 杂志文章

    doi:10.1016/s0933-3657(02)00005-2

    authors: Somorjai RL,Vivanco R,Pizzi N

    更新日期:2002-05-01 00:00:00

  • Measuring the effects of confounders in medical supervised classification problems: the Confounding Index (CI).

    abstract::Over the years, there has been growing interest in using machine learning techniques for biomedical data processing. When tackling these tasks, one needs to bear in mind that biomedical data depends on a variety of characteristics, such as demographic aspects (age, gender, etc.) or the acquisition technology, which mi...

    journal_title:Artificial intelligence in medicine

    pub_type: 杂志文章

    doi:10.1016/j.artmed.2020.101804

    authors: Ferrari E,Retico A,Bacciu D

    更新日期:2020-03-01 00:00:00

  • An implicit approach to deal with periodically repeated medical data.

    abstract:CONTEXT:Temporal information plays a crucial role in medicine, so that in medical informatics there is an increasing awareness that suitable database approaches are needed to store and support it. Specifically, a great amount of clinical data (e.g., therapeutic data) are periodically repeated. Although an explicit trea...

    journal_title:Artificial intelligence in medicine

    pub_type: 杂志文章

    doi:10.1016/j.artmed.2012.03.002

    authors: Stantic B,Terenziani P,Governatori G,Bottrighi A,Sattar A

    更新日期:2012-07-01 00:00:00

  • Logarithmic simulated annealing for X-ray diagnosis.

    abstract::We present a new stochastic learning algorithm and first results of computational experiments on fragments of liver CT images. The algorithm is designed to compute a depth-three threshold circuit, where the first layer is calculated by an extension of the Perceptron algorithm by a special type of simulated annealing. ...

    journal_title:Artificial intelligence in medicine

    pub_type: 杂志文章

    doi:10.1016/s0933-3657(00)00112-3

    authors: Albrecht A,Steinhöfel K,Taupitz M,Wong CK

    更新日期:2001-06-01 00:00:00

  • Development and comparison of four sleep spindle detection methods.

    abstract:OBJECTIVE:The objective of the present work was to develop and compare methods for automatic detection of bilateral sleep spindles. METHODS AND MATERIALS:All-night sleep electroencephalographic (EEG) recordings of 12 healthy subjects with a median age of 40 years were studied. The data contained 6043 visually scored b...

    journal_title:Artificial intelligence in medicine

    pub_type: 杂志文章

    doi:10.1016/j.artmed.2007.04.003

    authors: Huupponen E,Gómez-Herrero G,Saastamoinen A,Värri A,Hasan J,Himanen SL

    更新日期:2007-07-01 00:00:00

  • A novel deep mining model for effective knowledge discovery from omics data.

    abstract::Knowledge discovery from omics data has become a common goal of current approaches to personalised cancer medicine and understanding cancer genotype and phenotype. However, high-throughput biomedical datasets are characterised by high dimensionality and relatively small sample sizes with small signal-to-noise ratios. ...

    journal_title:Artificial intelligence in medicine

    pub_type: 杂志文章

    doi:10.1016/j.artmed.2020.101821

    authors: Alzubaidi A,Tepper J,Lotfi A

    更新日期:2020-04-01 00:00:00

  • Symptoms and medications change patterns for Parkinson's disease patients stratification.

    abstract::Quality of life of patients with Parkinson's disease degrades significantly with disease progression. This paper presents a step towards personalized management of Parkinson's disease patients, based on discovering groups of similar patients. Similarity is based on patients' medical conditions and changes in the presc...

    journal_title:Artificial intelligence in medicine

    pub_type: 杂志文章

    doi:10.1016/j.artmed.2018.04.010

    authors: Valmarska A,Miljkovic D,Konitsiotis S,Gatsios D,Lavrač N,Robnik-Šikonja M

    更新日期:2018-09-01 00:00:00

  • Automatic classification of epilepsy types using ontology-based and genetics-based machine learning.

    abstract:OBJECTIVES:In the presurgical analysis for drug-resistant focal epilepsies, the definition of the epileptogenic zone, which is the cortical area where ictal discharges originate, is usually carried out by using clinical, electrophysiological and neuroimaging data analysis. Clinical evaluation is based on the visual det...

    journal_title:Artificial intelligence in medicine

    pub_type: 杂志文章

    doi:10.1016/j.artmed.2014.03.001

    authors: Kassahun Y,Perrone R,De Momi E,Berghöfer E,Tassi L,Canevini MP,Spreafico R,Ferrigno G,Kirchner F

    更新日期:2014-06-01 00:00:00

  • A multiple classifier system for early melanoma diagnosis.

    abstract::Melanoma is the most dangerous skin cancer and early diagnosis is the key factor in its successful treatment. Well-trained dermatologists reach a diagnosis via visual inspection, and reach sensitivity and specificity levels of about 80%. Several computerised diagnostic systems were reported in the literature using dif...

    journal_title:Artificial intelligence in medicine

    pub_type: 杂志文章

    doi:10.1016/s0933-3657(02)00087-8

    authors: Sboner A,Eccher C,Blanzieri E,Bauer P,Cristofolini M,Zumiani G,Forti S

    更新日期:2003-01-01 00:00:00

  • Bridge and brick network motifs: identifying significant building blocks from complex biological systems.

    abstract:OBJECTIVE:A major focus in computational system biology research is defining organizing principles that govern complex biological network formation and evolution. The task is considered a major challenge because network behavior and function prediction requires the identification of functionally and statistically impor...

    journal_title:Artificial intelligence in medicine

    pub_type: 杂志文章

    doi:10.1016/j.artmed.2007.07.006

    authors: Huang CY,Cheng CY,Sun CT

    更新日期:2007-10-01 00:00:00

  • An adaptive large neighborhood search procedure applied to the dynamic patient admission scheduling problem.

    abstract:OBJECTIVE:The aim of this paper is to provide an improved method for solving the so-called dynamic patient admission scheduling (DPAS) problem. This is a complex scheduling problem that involves assigning a set of patients to hospital beds over a given time horizon in such a way that several quality measures reflecting...

    journal_title:Artificial intelligence in medicine

    pub_type: 杂志文章

    doi:10.1016/j.artmed.2016.10.002

    authors: Lusby RM,Schwierz M,Range TM,Larsen J

    更新日期:2016-11-01 00:00:00

  • Pattern identification of biomedical images with time series: Contrasting THz pulse imaging with DCE-MRIs.

    abstract:OBJECTIVE:We provide a survey of recent advances in biomedical image analysis and classification from emergent imaging modalities such as terahertz (THz) pulse imaging (TPI) and dynamic contrast-enhanced magnetic resonance images (DCE-MRIs) and identification of their underlining commonalities. METHODS:Both time and f...

    journal_title:Artificial intelligence in medicine

    pub_type: 杂志文章

    doi:10.1016/j.artmed.2016.01.005

    authors: Yin XX,Hadjiloucas S,Zhang Y,Su MY,Miao Y,Abbott D

    更新日期:2016-02-01 00:00:00

  • From an expert-driven paper guideline to a user-centred decision support system: a usability comparison study.

    abstract:OBJECTIVE:To assess whether a user-centred prototype clinical decision support system (CDSS) providing patient-specific advice better supports healthcare practitioners in terms of (a) types of usability problems detected and (b) effective and efficient retrieval of childhood cancer survivor's follow-up screening proced...

    journal_title:Artificial intelligence in medicine

    pub_type: 杂志文章

    doi:10.1016/j.artmed.2013.04.004

    authors: Kilsdonk E,Peute LW,Riezebos RJ,Kremer LC,Jaspers MW

    更新日期:2013-09-01 00:00:00

  • Pulmonary nodule detection on chest radiographs using balanced convolutional neural network and classic candidate detection.

    abstract::Computer-aided detection (CADe) systems play a crucial role in pulmonary nodule detection via chest radiographs (CXRs). A two-stage CADe scheme usually includes nodule candidate detection and false positive reduction. A pure deep learning model, such as faster region convolutional neural network (faster R-CNN), has be...

    journal_title:Artificial intelligence in medicine

    pub_type: 杂志文章

    doi:10.1016/j.artmed.2020.101881

    authors: Chen S,Han Y,Lin J,Zhao X,Kong P

    更新日期:2020-07-01 00:00:00

  • HepatoConsult: a knowledge-based second opinion and documentation system.

    abstract::HepatoConsult is a publicly available knowledge-based second opinion and documentation system aiding in the diagnosis of liver diseases. The positive results of a prospective diagnostic evaluation study encouraged its use in clinical routine, although the available hardware infrastructure was not optimal. The comments...

    journal_title:Artificial intelligence in medicine

    pub_type: 杂志文章

    doi:10.1016/s0933-3657(01)00104-x

    authors: Buscher HP,Engler Ch,Führer A,Kirschke S,Puppe F

    更新日期:2002-03-01 00:00:00

  • Brain-controlled applications using dynamic P300 speller matrices.

    abstract:OBJECTIVES:Access to the world wide web and multimedia content is an important aspect of life. We present a web browser and a multimedia user interface adapted for control with a brain-computer interface (BCI) which can be used by severely motor impaired persons. METHODS:The web browser dynamically determines the most...

    journal_title:Artificial intelligence in medicine

    pub_type: 杂志文章

    doi:10.1016/j.artmed.2014.12.001

    authors: Halder S,Pinegger A,Käthner I,Wriessnegger SC,Faller J,Pires Antunes JB,Müller-Putz GR,Kübler A

    更新日期:2015-01-01 00:00:00

  • State recognition of decompressive laminectomy with multiple information in robot-assisted surgery.

    abstract::The decompressive laminectomy is a common operation for treatment of lumbar spinal stenosis. The tools for grinding and drilling are used for fenestration and internal fixation, respectively. The state recognition is one of the main technologies in robot-assisted surgery, especially in tele-surgery, because surgeons h...

    journal_title:Artificial intelligence in medicine

    pub_type: 杂志文章

    doi:10.1016/j.artmed.2019.101763

    authors: Sun Y,Wang L,Jiang Z,Li B,Hu Y,Tian W

    更新日期:2020-01-01 00:00:00

  • Information extraction from multi-institutional radiology reports.

    abstract:OBJECTIVES:The radiology report is the most important source of clinical imaging information. It documents critical information about the patient's health and the radiologist's interpretation of medical findings. It also communicates information to the referring physicians and records that information for future clinic...

    journal_title:Artificial intelligence in medicine

    pub_type: 杂志文章,多中心研究

    doi:10.1016/j.artmed.2015.09.007

    authors: Hassanpour S,Langlotz CP

    更新日期:2016-01-01 00:00:00

  • Transferring brain-computer interfaces beyond the laboratory: successful application control for motor-disabled users.

    abstract:OBJECTIVES:Brain-computer interfaces (BCIs) are no longer only used by healthy participants under controlled conditions in laboratory environments, but also by patients and end-users, controlling applications in their homes or clinics, without the BCI experts around. But are the technology and the field mature enough f...

    journal_title:Artificial intelligence in medicine

    pub_type: 杂志文章

    doi:10.1016/j.artmed.2013.08.004

    authors: Leeb R,Perdikis S,Tonin L,Biasiucci A,Tavella M,Creatura M,Molina A,Al-Khodairy A,Carlson T,Millán JD

    更新日期:2013-10-01 00:00:00