Reinforcement learning design for cancer clinical trials.

Abstract:

:We develop reinforcement learning trials for discovering individualized treatment regimens for life-threatening diseases such as cancer. A temporal-difference learning method called Q-learning is utilized that involves learning an optimal policy from a single training set of finite longitudinal patient trajectories. Approximating the Q-function with time-indexed parameters can be achieved by using support vector regression or extremely randomized trees. Within this framework, we demonstrate that the procedure can extract optimal strategies directly from clinical data without relying on the identification of any accurate mathematical models, unlike approaches based on adaptive design. We show that reinforcement learning has tremendous potential in clinical research because it can select actions that improve outcomes by taking into account delayed effects even when the relationship between actions and outcomes is not fully known. To support our claims, the methodology's practical utility is illustrated in a simulation analysis. In the immediate future, we will apply this general strategy to studying and identifying new treatments for advanced metastatic stage IIIB/IV non-small cell lung cancer, which usually includes multiple lines of chemotherapy treatment. Moreover, there is significant potential of the proposed methodology for developing personalized treatment strategies in other cancers, in cystic fibrosis, and in other life-threatening diseases.

journal_name

Stat Med

journal_title

Statistics in medicine

authors

Zhao Y,Kosorok MR,Zeng D

doi

10.1002/sim.3720

subject

Has Abstract

pub_date

2009-11-20 00:00:00

pages

3294-315

issue

26

eissn

0277-6715

issn

1097-0258

journal_volume

28

pub_type

杂志文章
  • A comparison of group sequential methods for binary longitudinal data.

    abstract::Interim analyses are conducted to allow for early termination of the trial, for ethical as well as economical reasons. Here we consider interim analyses in repeated measurements studies where the measurements are binary. Two methods for analysing this kind of data are compared according to their operating characterist...

    journal_title:Statistics in medicine

    pub_type: 杂志文章

    doi:10.1002/sim.1361

    authors: Spiessens B,Lesaffre E,Verbeke G

    更新日期:2003-02-28 00:00:00

  • Assessing the incremental predictive performance of novel biomarkers over standard predictors.

    abstract::It is unclear to what extent the incremental predictive performance of a novel biomarker is impacted by the method used to control for standard predictors. We investigated whether adding a biomarker to a model with a published risk score overestimates its incremental performance as compared to adding it to a multivari...

    journal_title:Statistics in medicine

    pub_type: 杂志文章

    doi:10.1002/sim.6165

    authors: Xanthakis V,Sullivan LM,Vasan RS,Benjamin EJ,Massaro JM,D'Agostino RB Sr,Pencina MJ

    更新日期:2014-07-10 00:00:00

  • Comparing onset of antidepressant action using a repeated measures approach and a traditional assessment schedule.

    abstract:BACKGROUND:It has been recommended that onset of antidepressant action be assessed using survival analyses with assessments taken at least twice per week. However, such an assessment schedule is problematic to implement. The present study assessed the feasibility of comparing onset of action between treatments using a ...

    journal_title:Statistics in medicine

    pub_type: 杂志文章

    doi:10.1002/sim.2309

    authors: Mallinckrodt CH,Detke MJ,Kaiser CJ,Watkin JG,Molenberghs G,Carroll RJ

    更新日期:2006-07-30 00:00:00

  • Interpretation of results from subset analyses within overviews of randomized clinical trials.

    abstract::Evaluating treatment effects within different subsets of patients is a common practice in the analysis of individual randomized clinical trials. Such analyses are limited, however, by the number of patients available. Overviews, by providing evidence based on large numbers of patients, can be useful for overcoming the...

    journal_title:Statistics in medicine

    pub_type: 杂志文章

    doi:10.1002/sim.4780060331

    authors: Gelber RD,Goldhirsch A

    更新日期:1987-04-01 00:00:00

  • Assessment of equivalence on multiple endpoints.

    abstract::Some clinical trials aim to demonstrate therapeutic equivalence on multiple primary endpoints. For example, therapeutic equivalence studies of agents for the treatment of osteoarthritis use several primary endpoints including investigator's global assessment of disease activity, patient's global assessment of response...

    journal_title:Statistics in medicine

    pub_type: 杂志文章

    doi:10.1002/sim.985

    authors: Quan H,Bolognese J,Yuan W

    更新日期:2001-11-15 00:00:00

  • Exact test size and power of a Gaussian error linear model for an internal pilot study.

    abstract::Wittes and Brittain recommended using an 'internal pilot study' to adjust sample size. The approach involves five steps in testing a general linear hypothesis for a general linear univariate model, with Gaussian errors. First, specify the design, hypothesis, desired test size, power, a smallest 'clinically meaningful'...

    journal_title:Statistics in medicine

    pub_type: 杂志文章

    doi:10.1002/(sici)1097-0258(19990530)18:10<1199::aid-s

    authors: Coffey CS,Muller KE

    更新日期:1999-05-30 00:00:00

  • Drug-drug interaction prediction: a Bayesian meta-analysis approach.

    abstract::In drug-drug interaction (DDI) research, a two drug interaction is usually predicted by individual drug pharmacokinetics (PK). Although subject-specific drug concentration data from clinical PK studies on inhibitor/inducer or substrate's PK are not usually published, sample mean plasma drug concentrations and their st...

    journal_title:Statistics in medicine

    pub_type: 杂志文章,meta分析

    doi:10.1002/sim.2837

    authors: Li L,Yu M,Chin R,Lucksiri A,Flockhart DA,Hall SD

    更新日期:2007-09-10 00:00:00

  • Two-sample rank tests for acceleration in cure models.

    abstract::I derive the locally most powerful rank tests for acceleration against semi-parametric alternatives when some patients are cured of the disease. I consider some particular classes of alternatives and present simulation results to verify the validity of the proposed tests. Real data from clinical trials for childhood l...

    journal_title:Statistics in medicine

    pub_type: 杂志文章

    doi:10.1002/sim.4780141905

    authors: Lee JW

    更新日期:1995-10-15 00:00:00

  • Emerging and recurrent issues in drug development.

    abstract::This paper reviews several emerging and recurrent issues relating to the drug development process. These emerging issues include changes to the FDA regulatory environment, internationalization of drug development, advances in computer technology and visualization tools, and efforts to incorporate meta-analysis methodo...

    journal_title:Statistics in medicine

    pub_type: 杂志文章,评审

    doi:10.1002/(sici)1097-0258(19990915/30)18:17/18<2301:

    authors: Anello C

    更新日期:1999-09-15 00:00:00

  • The partial testing design: a less costly way to test equivalence for sensitivity and specificity.

    abstract::We propose a new, less costly, design to test the equivalence of digital versus analogue mammography in terms of sensitivity and specificity. Because breast cancer is a rare event among asymptomatic women, the sample size for testing equivalence of sensitivity is larger than that for testing equivalence of specificity...

    journal_title:Statistics in medicine

    pub_type: 杂志文章

    doi:10.1002/(sici)1097-0258(19981015)17:19<2219::aid-s

    authors: Baker SG,Connor RJ,Kessler LG

    更新日期:1998-10-15 00:00:00

  • Bayesian sensitivity analysis of incomplete data: bridging pattern-mixture and selection models.

    abstract::Pattern-mixture models (PMM) and selection models (SM) are alternative approaches for statistical analysis when faced with incomplete data and a nonignorable missing-data mechanism. Both models make empirically unverifiable assumptions and need additional constraints to identify the parameters. Here, we first introduc...

    journal_title:Statistics in medicine

    pub_type: 杂志文章

    doi:10.1002/sim.6302

    authors: Kaciroti NA,Raghunathan T

    更新日期:2014-11-30 00:00:00

  • A scan statistic with a variable window.

    abstract::Given N points or events occurring according to some probability distribution in the unit interval (0, 1), the simple scan statistic is defined to be the maximum number of points in any sub-interval of length d. In many areas, as in epidemiology, it is used to test the null hypothesis that the events are random, again...

    journal_title:Statistics in medicine

    pub_type: 杂志文章

    doi:10.1002/(sici)1097-0258(19960415)15:7/9<845::aid-s

    authors: Nagarwalla N

    更新日期:1996-04-15 00:00:00

  • A model for cross-over trials evaluating therapeutic preferences.

    abstract::A preference trial is a special form of cross-over trial where clinical conditions determine when patients change treatment, in a prescribed order. This can be modelled using a geometric distribution. The model can be simply fitted using standard logistic regression methodology. The procedure is applied to a trial stu...

    journal_title:Statistics in medicine

    pub_type: 杂志文章

    doi:10.1002/(SICI)1097-0258(19960229)15:4<443::AID-SIM

    authors: Lindsey JK,Jones B

    更新日期:1996-02-28 00:00:00

  • Designs for phase I trials in ordered groups.

    abstract::We propose a new design for dose finding for cytotoxic agents in two ordered groups of patients. By ordered groups, we mean that prior to the study there is clinical information that would indicate that for a given dose one group would be more susceptible to toxicities than patients in the other group. The designs are...

    journal_title:Statistics in medicine

    pub_type: 杂志文章

    doi:10.1002/sim.7133

    authors: Conaway MR,Wages NA

    更新日期:2017-01-30 00:00:00

  • Precision of incidence predictions based on Poisson distributed observations.

    abstract::Disease incidence predictions are useful for a number of administrative and scientific purposes. The simplest ones are made using trend extrapolation, on either an arithmetic or a logarithmic scale. This paper shows how approximate confidence prediction intervals can be calculated for such predictions, both for the to...

    journal_title:Statistics in medicine

    pub_type: 杂志文章

    doi:10.1002/sim.4780131503

    authors: Hakulinen T,Dyba T

    更新日期:1994-08-15 00:00:00

  • Likelihood-based analysis of outcome-dependent sampling designs with longitudinal data.

    abstract::The use of outcome-dependent sampling with longitudinal data analysis has previously been shown to improve efficiency in the estimation of regression parameters. The motivating scenario is when outcome data exist for all cohort members but key exposure variables will be gathered only on a subset. Inference with outcom...

    journal_title:Statistics in medicine

    pub_type: 杂志文章

    doi:10.1002/sim.7633

    authors: Zelnick LR,Schildcrout JS,Heagerty PJ

    更新日期:2018-06-15 00:00:00

  • Permutation tests for joinpoint regression with applications to cancer rates.

    abstract::The identification of changes in the recent trend is an important issue in the analysis of cancer mortality and incidence data. We apply a joinpoint regression model to describe such continuous changes and use the grid-search method to fit the regression function with unknown joinpoints assuming constant variance and ...

    journal_title:Statistics in medicine

    pub_type: 杂志文章

    doi:10.1002/(sici)1097-0258(20000215)19:3<335::aid-sim

    authors: Kim HJ,Fay MP,Feuer EJ,Midthune DN

    更新日期:2000-02-15 00:00:00

  • Testing for central mixtures of compartment model parameters.

    abstract::I discuss alternatives to the one compartment model, delta Yt = alpha + beta exp(- gamma t). Instead of comparing the one and two compartment models, I derive statistics for testing mixtures of the parameters (beta, gamma) in the one compartment model. I apply the proposed methods to the problem of hydrogen clearance ...

    journal_title:Statistics in medicine

    pub_type: 杂志文章

    doi:10.1002/sim.4780080811

    authors: Zelterman D

    更新日期:1989-08-01 00:00:00

  • Compliance with quality of life data collection in the National Surgical Adjuvant Breast and Bowel Project (NSABP) Breast Cancer Prevention Trial.

    abstract::This paper describes compliance with the completion of a quality of life questionnaire in the Breast Cancer Prevention Trial, a large multi-centre randomized trial that is studying the efficacy of Tamoxifen in preventing breast cancer. In the first 4875 women enrolled in the control arm of the study, there was a very ...

    journal_title:Statistics in medicine

    pub_type: 杂志文章

    doi:10.1002/(sici)1097-0258(19980315/15)17:5/7<613::ai

    authors: Ganz PA,Day R,Costantino J

    更新日期:1998-03-15 00:00:00

  • Design evaluation and optimisation in crossover pharmacokinetic studies analysed by nonlinear mixed effects models.

    abstract::Bioequivalence or interaction trials are commonly studied in crossover design and can be analysed by nonlinear mixed effects models as an alternative to noncompartmental approach. We propose an extension of the population Fisher information matrix in nonlinear mixed effects models to design crossover pharmacokinetic t...

    journal_title:Statistics in medicine

    pub_type: 杂志文章

    doi:10.1002/sim.4390

    authors: Nguyen TT,Bazzoli C,Mentré F

    更新日期:2012-05-20 00:00:00

  • Missing data and sensitivity analysis for binary data with implications for sample size and power of randomized clinical trials.

    abstract::Despite our best efforts, missing outcomes are common in randomized controlled clinical trials. The National Research Council's Committee on National Statistics panel report titled The Prevention and Treatment of Missing Data in Clinical Trials noted that further research is required to assess the impact of missing da...

    journal_title:Statistics in medicine

    pub_type: 杂志文章

    doi:10.1002/sim.8428

    authors: Cook T,Zea R

    更新日期:2020-01-30 00:00:00

  • Spatially regularized estimation for the analysis of dynamic contrast-enhanced magnetic resonance imaging data.

    abstract::Competing compartment models of different complexities have been used for the quantitative analysis of dynamic contrast-enhanced magnetic resonance imaging data. We present a spatial elastic net approach that allows to estimate the number of compartments for each voxel such that the model complexity is not fixed a pri...

    journal_title:Statistics in medicine

    pub_type: 杂志文章

    doi:10.1002/sim.5997

    authors: Sommer JC,Gertheiss J,Schmid VJ

    更新日期:2014-03-15 00:00:00

  • Comparison of methods for imputing ordinal data using multivariate normal imputation: a case study of non-linear effects in a large cohort study.

    abstract:BACKGROUND:Multiple imputation is becoming increasingly popular for handling missing data, with Markov chain Monte Carlo assuming multivariate normality (MVN) a commonly used approach. Imputing categorical variables (which are clearly non-normal) using MVN imputation is challenging, and several approaches have been sug...

    journal_title:Statistics in medicine

    pub_type: 杂志文章

    doi:10.1002/sim.5445

    authors: Lee KJ,Galati JC,Simpson JA,Carlin JB

    更新日期:2012-12-30 00:00:00

  • Assessing heterogeneity and correlation of paired failure times with the bivariate frailty model.

    abstract::We consider bivariate survival times for heterogeneous populations, where heterogeneity induces deviations in an individual's risk of an event as well as associations between survival times. The heterogeneity is characterized by a bivariate frailty model. We measure the heterogeneity effects through deviations associa...

    journal_title:Statistics in medicine

    pub_type: 杂志文章

    doi:10.1002/(sici)1097-0258(19990430)18:8<907::aid-sim

    authors: Xue X,Ding Y

    更新日期:1999-04-30 00:00:00

  • Marker values at the time of an AIDS diagnosis.

    abstract::In this paper statistical methods are proposed to estimate the distribution of a CD4 T-cell number at the time of a clinical AIDS endpoint from serial measurements of CD4 T-cell values in a cohort study. The statistical formulation of the problem is that of survival analysis with interval censored data, but in which t...

    journal_title:Statistics in medicine

    pub_type: 杂志文章

    doi:10.1002/sim.4780131915

    authors: Taylor JM,Kim DK

    更新日期:1994-10-15 00:00:00

  • Surveillance of clustering near point sources.

    abstract::Health authorities are often alerted to suspected cancer clusters near the vicinity of potential point sources by members of the public. A surveillance system, where administrative regions around the potential point sources are regularly monitored for high disease rates, would allow for responses which are easier to o...

    journal_title:Statistics in medicine

    pub_type: 杂志文章

    doi:10.1002/(sici)1097-0258(19960415)15:7/9<727::aid-s

    authors: Le ND,Petkau AJ,Rosychuk R

    更新日期:1996-04-15 00:00:00

  • The social contagion hypothesis: comment on 'Social contagion theory: examining dynamic social networks and human behavior'.

    abstract::I reflect on the statistical methods of the Christakis-Fowler studies on network-based contagion of traits by checking the sensitivity of these kinds of results to various alternate specifications and generative mechanisms. Despite the honest efforts of all involved, I remain pessimistic about establishing whether bin...

    journal_title:Statistics in medicine

    pub_type: 评论,杂志文章

    doi:10.1002/sim.5551

    authors: Thomas AC

    更新日期:2013-02-20 00:00:00

  • Estimation of gene-environment interaction by pooling biospecimens.

    abstract::Case-control studies are prone to low power for testing gene-environment interactions (GXE) given the need for a sufficient number of individuals on each strata of disease, gene, and environment. We propose a new study design to increase power by strategically pooling biospecimens. Pooling biospecimens allows us to in...

    journal_title:Statistics in medicine

    pub_type: 杂志文章

    doi:10.1002/sim.5357

    authors: Danaher MR,Schisterman EF,Roy A,Albert PS

    更新日期:2012-11-20 00:00:00

  • On Bayesian methods of exploring qualitative interactions for targeted treatment.

    abstract::Providing personalized treatments designed to maximize benefits and minimizing harms is of tremendous current medical interest. One problem in this area is the evaluation of the interaction between the treatment and other predictor variables. Treatment effects in subgroups having the same direction but different magni...

    journal_title:Statistics in medicine

    pub_type: 杂志文章

    doi:10.1002/sim.5429

    authors: Chen W,Ghosh D,Raghunathan TE,Norkin M,Sargent DJ,Bepler G

    更新日期:2012-12-10 00:00:00

  • Design and analysis of non-inferiority mortality trials in oncology.

    abstract::The recent revision of the Declaration of Helsinki and the existence of many new therapies that affect survival or serious morbidity, and that therefore cannot be denied patients, have generated increased interest in active-control trials, particularly those intended to show equivalence or non-inferiority to the activ...

    journal_title:Statistics in medicine

    pub_type: 杂志文章

    doi:10.1002/sim.1400

    authors: Rothmann M,Li N,Chen G,Chi GY,Temple R,Tsou HH

    更新日期:2003-01-30 00:00:00