Evaluating predictive modeling algorithms to assess patient eligibility for clinical trials from routine data.

Abstract:

BACKGROUND:The necessity to translate eligibility criteria from free text into decision rules that are compatible with data from the electronic health record (EHR) constitutes the main challenge when developing and deploying clinical trial recruitment support systems. Recruitment decisions based on case-based reasoning, i.e. using past cases rather than explicit rules, could dispense with the need for translating eligibility criteria and could also be implemented largely independently from the terminology of the EHR's database. We evaluated the feasibility of predictive modeling to assess the eligibility of patients for clinical trials and report on a prototype's performance for different system configurations. METHODS:The prototype worked by using existing basic patient data of manually assessed eligible and ineligible patients to induce prediction models. Performance was measured retrospectively for three clinical trials by plotting receiver operating characteristic curves and comparing the area under the curve (ROC-AUC) for different prediction algorithms, different sizes of the learning set and different numbers and aggregation levels of the patient attributes. RESULTS:Random forests were generally among the best performing models with a maximum ROC-AUC of 0.81 (CI: 0.72-0.88) for trial A, 0.96 (CI: 0.95-0.97) for trial B and 0.99 (CI: 0.98-0.99) for trial C. The full potential of this algorithm was reached after learning from approximately 200 manually screened patients (eligible and ineligible). Neither block- nor category-level aggregation of diagnosis and procedure codes influenced the algorithms' performance substantially. CONCLUSIONS:Our results indicate that predictive modeling is a feasible approach to support patient recruitment into clinical trials. Its major advantages over the commonly applied rule-based systems are its independency from the concrete representation of eligibility criteria and EHR data and its potential for automation.

authors

Köpcke F,Lubgan D,Fietkau R,Scholler A,Nau C,Stürzl M,Croner R,Prokosch HU,Toddenroth D

doi

10.1186/1472-6947-13-134

subject

Has Abstract

pub_date

2013-12-09 00:00:00

pages

134

issn

1472-6947

pii

1472-6947-13-134

journal_volume

13

pub_type

杂志文章
  • Cost effectiveness of a computer-delivered intervention to improve HIV medication adherence.

    abstract:BACKGROUND:High levels of adherence to medications for HIV infection are essential for optimal clinical outcomes and to reduce viral transmission, but many patients do not achieve required levels. Clinician-delivered interventions can improve patients' adherence, but usually require substantial effort by trained indivi...

    journal_title:BMC medical informatics and decision making

    pub_type: 临床试验,杂志文章

    doi:10.1186/1472-6947-13-29

    authors: Ownby RL,Waldrop-Valverde D,Jacobs RJ,Acevedo A,Caballero J

    更新日期:2013-02-28 00:00:00

  • Implementation of informatics for integrating biology and the bedside (i2b2) platform as Docker containers.

    abstract:BACKGROUND:Informatics for Integrating Biology and the Bedside (i2b2) is an open source clinical data analytics platform used at over 200 healthcare institutions for querying patient data. The i2b2 platform has several components with numerous dependencies and configuration parameters, which renders the task of install...

    journal_title:BMC medical informatics and decision making

    pub_type: 杂志文章

    doi:10.1186/s12911-018-0646-2

    authors: Wagholikar KB,Dessai P,Sanz J,Mendis ME,Bell DS,Murphy SN

    更新日期:2018-07-16 00:00:00

  • An automated pipeline for analyzing medication event reports in clinical settings.

    abstract:BACKGROUND:Medication events in clinical settings are significant threats to patient safety. Analyzing and learning from the medication event reports is an important way to prevent the recurrence of these events. Currently, the analysis of medication event reports is ineffective and requires heavy workloads for clinici...

    journal_title:BMC medical informatics and decision making

    pub_type: 杂志文章

    doi:10.1186/s12911-018-0687-6

    authors: Zhou S,Kang H,Yao B,Gong Y

    更新日期:2018-12-07 00:00:00

  • Adaptation of a web-based, open source electronic medical record system platform to support a large study of tuberculosis epidemiology.

    abstract:BACKGROUND:In 2006, we were funded by the US National Institutes of Health to implement a study of tuberculosis epidemiology in Peru. The study required a secure information system to manage data from a target goal of 16,000 subjects who needed to be followed for at least one year. With previous experience in the devel...

    journal_title:BMC medical informatics and decision making

    pub_type: 杂志文章

    doi:10.1186/1472-6947-12-125

    authors: Fraser HS,Thomas D,Tomaylla J,Garcia N,Lecca L,Murray M,Becerra MC

    更新日期:2012-11-07 00:00:00

  • Formative evaluation of a telemedicine model for delivering clinical neurophysiology services part II: the referring clinician and patient perspective.

    abstract:BACKGROUND:Feedback from service users will provide insight into opportunities for improvement so that performance can be optimised. In the context of a formative evaluation referring clinician and patient satisfaction with a teleneurophysiology service was examined during a 20 week pilot period. METHODS:Questionnaire...

    journal_title:BMC medical informatics and decision making

    pub_type: 杂志文章

    doi:10.1186/1472-6947-10-49

    authors: Breen P,Murphy K,Browne G,Molloy F,Reid V,Doherty C,Delanty N,Connolly S,Fitzsimons M

    更新日期:2010-09-15 00:00:00

  • Understanding factors affecting patient and public engagement and recruitment to digital health interventions: a systematic review of qualitative studies.

    abstract:BACKGROUND:Numerous types of digital health interventions (DHIs) are available to patients and the public but many factors affect their ability to engage and enrol in them. This systematic review aims to identify and synthesise the qualitative literature on barriers and facilitators to engagement and recruitment to DHI...

    journal_title:BMC medical informatics and decision making

    pub_type: 杂志文章,评审

    doi:10.1186/s12911-016-0359-3

    authors: O'Connor S,Hanlon P,O'Donnell CA,Garcia S,Glanville J,Mair FS

    更新日期:2016-09-15 00:00:00

  • Process evaluation of discharge planning implementation in healthcare using normalization process theory.

    abstract:BACKGROUND:Discharge planning is a care process that aims to secure the transfer of care for the patient at transition from home to the hospital and back home. Information exchange and collaboration between care providers are essential, but deficits are common. A wide range of initiatives to improve the discharge plann...

    journal_title:BMC medical informatics and decision making

    pub_type: 杂志文章

    doi:10.1186/s12911-016-0285-4

    authors: Nordmark S,Zingmark K,Lindberg I

    更新日期:2016-04-27 00:00:00

  • Correction to: The International Conference on Intelligent Biology and Medicine 2019: computational methods for drug interactions.

    abstract::After publication of this supplement article [1], it is requested the grant ID in the Funding section should be corrected from NSF grant IIS-7811367 to NSF grant IIS-1902617. ...

    journal_title:BMC medical informatics and decision making

    pub_type: 杂志文章,已发布勘误

    doi:10.1186/s12911-020-1096-1

    authors: Ning X,Zhang C,Wang K,Zhao Z,Mathé E

    更新日期:2020-04-28 00:00:00

  • Health numeracy in Japan: measures of basic numeracy account for framing bias in a highly numerate population.

    abstract:BACKGROUND:Health numeracy is an important factor in how well people make decisions based on medical risk information. However, in many countries, including Japan, numeracy studies have been limited. METHODS:To fill this gap, we evaluated health numeracy levels in a sample of Japanese adults by translating two well-kn...

    journal_title:BMC medical informatics and decision making

    pub_type: 杂志文章

    doi:10.1186/1472-6947-12-104

    authors: Okamoto M,Kyutoku Y,Sawada M,Clowney L,Watanabe E,Dan I,Kawamoto K

    更新日期:2012-09-11 00:00:00

  • Accuracy validation of adjuvant! online in Taiwanese breast cancer patients--a 10-year analysis.

    abstract:BACKGROUND:Adjuvant! Online ( http://www.adjuvantonline.com) is an Internet-based software program that allows clinicians to make predictions about the benefits of adjuvant therapy and 10-year survival probability for early-stage breast cancer patients. This model has been validated in Western countries such as the Uni...

    journal_title:BMC medical informatics and decision making

    pub_type: 杂志文章

    doi:10.1186/1472-6947-12-108

    authors: Yao-Lung K,Dar-Ren C,Tsai-Wang C

    更新日期:2012-09-17 00:00:00

  • Factors influencing the surgery intentions and choices of women with early breast cancer: the predictive utility of an extended theory of planned behaviour.

    abstract:BACKGROUND:Women diagnosed with early breast cancer (stage I or II) can be offered the choice between mastectomy or breast conservation surgery with radiotherapy due to equivalence in survival rates. A wide variation in the surgical management of breast cancer and a lack of theoretically guided research on this issue h...

    journal_title:BMC medical informatics and decision making

    pub_type: 杂志文章

    doi:10.1186/1472-6947-13-92

    authors: Sivell S,Elwyn G,Edwards A,Manstead AS,BresDex group.

    更新日期:2013-08-20 00:00:00

  • Locating previously unknown patterns in data-mining results: a dual data- and knowledge-mining method.

    abstract:BACKGROUND:Data mining can be utilized to automate analysis of substantial amounts of data produced in many organizations. However, data mining produces large numbers of rules and patterns, many of which are not useful. Existing methods for pruning uninteresting patterns have only begun to automate the knowledge acquis...

    journal_title:BMC medical informatics and decision making

    pub_type: 杂志文章

    doi:10.1186/1472-6947-6-13

    authors: Siadaty MS,Knaus WA

    更新日期:2006-03-07 00:00:00

  • Electronic reminders to facilitate longitudinal care: a mixed-methods study in general practices.

    abstract:BACKGROUND:Longitudinal, patient-centered care represents a challenge for general practitioners (GPs), and in this context, reminder systems can offer targeted support. This study aimed to identify details of such reminders: (1) contents of care addressed, (2) their mode of display in the electronic health record (EHR)...

    journal_title:BMC medical informatics and decision making

    pub_type: 临床试验,杂志文章

    doi:10.1186/s12911-016-0387-z

    authors: Kersting C,Weltermann B

    更新日期:2016-11-24 00:00:00

  • Quantile-based fecal hemoglobin concentration for assessing colorectal neoplasms with 1,263,717 Taiwanese screenees.

    abstract:BACKGROUND:Although fecal hemoglobin concentration (f-Hb) was highly associated with the risk of colorectal neoplasms, current studies on this subject are hampered by skewedness of the data and the ordinal property of f-Hb has not been well studied yet. Our aim was to develop a quantile-based method to estimate adjuste...

    journal_title:BMC medical informatics and decision making

    pub_type: 杂志文章

    doi:10.1186/s12911-019-0812-1

    authors: Peng SM,Chiu HM,Jen HH,Hsu CY,Chen SL,Chiu SY,Yen AM,Fann JC,Lee YC,Chen HH

    更新日期:2019-05-02 00:00:00

  • Attention-based deep residual learning network for entity relation extraction in Chinese EMRs.

    abstract:BACKGROUND:Electronic medical records (EMRs) contain a variety of valuable medical concepts and relations. The ability to recognize relations between medical concepts described in EMRs enables the automatic processing of clinical texts, resulting in an improved quality of health-related data analysis. Driven by the 201...

    journal_title:BMC medical informatics and decision making

    pub_type: 杂志文章

    doi:10.1186/s12911-019-0769-0

    authors: Zhang Z,Zhou T,Zhang Y,Pang Y

    更新日期:2019-04-09 00:00:00

  • Clinical records anonymisation and text extraction (CRATE): an open-source software system.

    abstract:BACKGROUND:Electronic medical records contain information of value for research, but contain identifiable and often highly sensitive confidential information. Patient-identifiable information cannot in general be shared outside clinical care teams without explicit consent, but anonymisation/de-identification allows res...

    journal_title:BMC medical informatics and decision making

    pub_type: 杂志文章,评审

    doi:10.1186/s12911-017-0437-1

    authors: Cardinal RN

    更新日期:2017-04-26 00:00:00

  • Implementation of automated reporting of estimated glomerular filtration rate among Veterans Affairs laboratories: a retrospective study.

    abstract:BACKGROUND:Automated reporting of estimated glomerular filtration rate (eGFR) is a recent advance in laboratory information technology (IT) that generates a measure of kidney function with chemistry laboratory results to aid early detection of chronic kidney disease (CKD). Because accurate diagnosis of CKD is critical ...

    journal_title:BMC medical informatics and decision making

    pub_type: 杂志文章

    doi:10.1186/1472-6947-12-69

    authors: Hall RK,Wang V,Jackson GL,Hammill BG,Maciejewski ML,Yano EM,Svetkey LP,Patel UD

    更新日期:2012-07-12 00:00:00

  • A clustering approach for detecting implausible observation values in electronic health records data.

    abstract:BACKGROUND:Identifying implausible clinical observations (e.g., laboratory test and vital sign values) in Electronic Health Record (EHR) data using rule-based procedures is challenging. Anomaly/outlier detection methods can be applied as an alternative algorithmic approach to flagging such implausible values in EHRs. ...

    journal_title:BMC medical informatics and decision making

    pub_type: 杂志文章

    doi:10.1186/s12911-019-0852-6

    authors: Estiri H,Klann JG,Murphy SN

    更新日期:2019-07-23 00:00:00

  • Evidence-based medicine among internal medicine residents in a community hospital program using smart phones.

    abstract:BACKGROUND:This study implemented and evaluated a point-of-care, wireless Internet access using smart phones for information retrieval during daily clinical rounds and academic activities of internal medicine residents in a community hospital. We did the project to assess the feasibility of using smart phones as an alt...

    journal_title:BMC medical informatics and decision making

    pub_type: 杂志文章

    doi:10.1186/1472-6947-7-5

    authors: León SA,Fontelo P,Green L,Ackerman M,Liu F

    更新日期:2007-02-21 00:00:00

  • Application of biomedical informatics to chronic pediatric diseases: a systematic review.

    abstract:BACKGROUND:Chronic diseases affect millions of children worldwide leading to substantial disease burden to the children and their families as well as escalating health care costs. The increasing trend in the prevalence of complex pediatric chronic diseases requires innovative and optimal delivery of care. Biomedical in...

    journal_title:BMC medical informatics and decision making

    pub_type: 杂志文章,评审

    doi:10.1186/1472-6947-9-22

    authors: Moeinedin F,Moineddin R,Jadad AR,Hamid JS,To T,Beyene J

    更新日期:2009-05-05 00:00:00

  • Visual AIDS for multimodal treatment options to support decision making of patients with colorectal cancer.

    abstract:BACKGROUND:A variety of multimodal treatment options are available for colorectal cancer and many patients want to be involved in decisions about their therapies. However, their desire for autonomy is limited by lack of disease-specific knowledge. Visual aids may be helpful tools to present complex data in an easy-to-u...

    journal_title:BMC medical informatics and decision making

    pub_type: 杂志文章,随机对照试验

    doi:10.1186/1472-6947-12-118

    authors: Hofmann S,Vetter J,Wachter C,Henne-Bruns D,Porzsolt F,Kornmann M

    更新日期:2012-10-23 00:00:00

  • Modeling healthcare authorization and claim submissions using the openEHR dual-model approach.

    abstract:BACKGROUND:The TISS standard is a set of mandatory forms and electronic messages for healthcare authorization and claim submissions among healthcare plans and providers in Brazil. It is not based on formal models as the new generation of health informatics standards suggests. The objective of this paper is to model the...

    journal_title:BMC medical informatics and decision making

    pub_type: 杂志文章

    doi:10.1186/1472-6947-11-60

    authors: Dias RD,Cook TW,Freire SM

    更新日期:2011-10-12 00:00:00

  • Utility-preserving anonymization for health data publishing.

    abstract:BACKGROUND:Publishing raw electronic health records (EHRs) may be considered as a breach of the privacy of individuals because they usually contain sensitive information. A common practice for the privacy-preserving data publishing is to anonymize the data before publishing, and thus satisfy privacy models such as k-an...

    journal_title:BMC medical informatics and decision making

    pub_type: 杂志文章

    doi:10.1186/s12911-017-0499-0

    authors: Lee H,Kim S,Kim JW,Chung YD

    更新日期:2017-07-11 00:00:00

  • Non-redundant association rules between diseases and medications: an automated method for knowledge base construction.

    abstract:BACKGROUND:The widespread use of electronic health records (EHRs) has generated massive clinical data storage. Association rules mining is a feasible technique to convert this large amount of data into usable knowledge for clinical decision making, research or billing. We present a data driven method to create a knowle...

    journal_title:BMC medical informatics and decision making

    pub_type: 杂志文章

    doi:10.1186/s12911-015-0151-9

    authors: Séverac F,Sauleau EA,Meyer N,Lefèvre H,Nisand G,Jay N

    更新日期:2015-04-15 00:00:00

  • Increasing utilization of Internet-based resources following efforts to promote evidence-based medicine: a national study in Taiwan.

    abstract:BACKGROUND:Since the beginning of 2007, the National Health Research Institutes has been promoting the dissemination of evidence-based medicine (EBM). The current study examined longitudinal trends of behaviors in how hospital-based physicians and nurses have searched for medical information during the spread of EBM. ...

    journal_title:BMC medical informatics and decision making

    pub_type: 杂志文章

    doi:10.1186/1472-6947-13-4

    authors: Weng YH,Kuo KN,Yang CY,Lo HL,Shih YH,Chen C,Chiu YW

    更新日期:2013-01-07 00:00:00

  • Integral strategy to supportive care in breast cancer survivors through occupational therapy and a m-health system: design of a randomized clinical trial.

    abstract:BACKGROUND:Technological support using e-health mobile applications (m-health) is a promising strategy to improve the adherence to healthy lifestyles in breast cancer survivors (excess in energy intake or low physical activity are determinants of the risk of recurrence, second cancers and cancer mortality). Moreover, c...

    journal_title:BMC medical informatics and decision making

    pub_type: 杂志文章,随机对照试验

    doi:10.1186/s12911-016-0394-0

    authors: Lozano-Lozano M,Martín-Martín L,Galiano-Castillo N,Álvarez-Salvago F,Cantarero-Villanueva I,Fernández-Lao C,Sánchez-Salado C,Arroyo-Morales M

    更新日期:2016-11-25 00:00:00

  • Temporal aggregation impacts on epidemiological simulations employing microcontact data.

    abstract:BACKGROUND:Microcontact datasets gathered automatically by electronic devices have the potential augment the study of the spread of contagious disease by providing detailed representations of the study population's contact dynamics. However, the impact of data collection experimental design on the subsequent simulation...

    journal_title:BMC medical informatics and decision making

    pub_type: 杂志文章

    doi:10.1186/1472-6947-12-132

    authors: Hashemian M,Qian W,Stanley KG,Osgood ND

    更新日期:2012-11-15 00:00:00

  • The relationship between hospital and ehr vendor market dynamics on health information organization presence and participation.

    abstract:BACKGROUND:Health Information Organizations (HIOs) are third party organizations that facilitate electronic health information exchange (HIE) between providers in a geographic area. Despite benefits from HIE, HIOs have struggled to form and subsequently gain broad provider participation. We sought to assess whether mar...

    journal_title:BMC medical informatics and decision making

    pub_type: 杂志文章

    doi:10.1186/s12911-018-0605-y

    authors: Lin SC,Adler-Milstein J

    更新日期:2018-05-08 00:00:00

  • Are cancer-related decision aids appropriate for socially disadvantaged patients? A systematic review of US randomized controlled trials.

    abstract:BACKGROUND:Shared decision-making (SDM) is considered a key component of high quality cancer care and may be supported by patient decision aids (PtDAs). Many patients, however, face multiple social disadvantages that may influence their ability to fully participate in SDM or to use PtDAs; additionally, these social dis...

    journal_title:BMC medical informatics and decision making

    pub_type: 杂志文章

    doi:10.1186/s12911-016-0303-6

    authors: Enard KR,Dolan Mullen P,Kamath GR,Dixon NM,Volk RJ

    更新日期:2016-06-06 00:00:00

  • Data-driven approach for creating synthetic electronic medical records.

    abstract:BACKGROUND:New algorithms for disease outbreak detection are being developed to take advantage of full electronic medical records (EMRs) that contain a wealth of patient information. However, due to privacy concerns, even anonymized EMRs cannot be shared among researchers, resulting in great difficulty in comparing the...

    journal_title:BMC medical informatics and decision making

    pub_type: 杂志文章

    doi:10.1186/1472-6947-10-59

    authors: Buczak AL,Babin S,Moniz L

    更新日期:2010-10-14 00:00:00