Abstract:
:We develop reinforcement learning trials for discovering individualized treatment regimens for life-threatening diseases such as cancer. A temporal-difference learning method called Q-learning is utilized that involves learning an optimal policy from a single training set of finite longitudinal patient trajectories. Approximating the Q-function with time-indexed parameters can be achieved by using support vector regression or extremely randomized trees. Within this framework, we demonstrate that the procedure can extract optimal strategies directly from clinical data without relying on the identification of any accurate mathematical models, unlike approaches based on adaptive design. We show that reinforcement learning has tremendous potential in clinical research because it can select actions that improve outcomes by taking into account delayed effects even when the relationship between actions and outcomes is not fully known. To support our claims, the methodology's practical utility is illustrated in a simulation analysis. In the immediate future, we will apply this general strategy to studying and identifying new treatments for advanced metastatic stage IIIB/IV non-small cell lung cancer, which usually includes multiple lines of chemotherapy treatment. Moreover, there is significant potential of the proposed methodology for developing personalized treatment strategies in other cancers, in cystic fibrosis, and in other life-threatening diseases.
journal_name
Stat Medjournal_title
Statistics in medicineauthors
Zhao Y,Kosorok MR,Zeng Ddoi
10.1002/sim.3720subject
Has Abstractpub_date
2009-11-20 00:00:00pages
3294-315issue
26eissn
0277-6715issn
1097-0258journal_volume
28pub_type
杂志文章abstract::Interim analyses are conducted to allow for early termination of the trial, for ethical as well as economical reasons. Here we consider interim analyses in repeated measurements studies where the measurements are binary. Two methods for analysing this kind of data are compared according to their operating characterist...
journal_title:Statistics in medicine
pub_type: 杂志文章
doi:10.1002/sim.1361
更新日期:2003-02-28 00:00:00
abstract::It is unclear to what extent the incremental predictive performance of a novel biomarker is impacted by the method used to control for standard predictors. We investigated whether adding a biomarker to a model with a published risk score overestimates its incremental performance as compared to adding it to a multivari...
journal_title:Statistics in medicine
pub_type: 杂志文章
doi:10.1002/sim.6165
更新日期:2014-07-10 00:00:00
abstract:BACKGROUND:It has been recommended that onset of antidepressant action be assessed using survival analyses with assessments taken at least twice per week. However, such an assessment schedule is problematic to implement. The present study assessed the feasibility of comparing onset of action between treatments using a ...
journal_title:Statistics in medicine
pub_type: 杂志文章
doi:10.1002/sim.2309
更新日期:2006-07-30 00:00:00
abstract::Evaluating treatment effects within different subsets of patients is a common practice in the analysis of individual randomized clinical trials. Such analyses are limited, however, by the number of patients available. Overviews, by providing evidence based on large numbers of patients, can be useful for overcoming the...
journal_title:Statistics in medicine
pub_type: 杂志文章
doi:10.1002/sim.4780060331
更新日期:1987-04-01 00:00:00
abstract::Some clinical trials aim to demonstrate therapeutic equivalence on multiple primary endpoints. For example, therapeutic equivalence studies of agents for the treatment of osteoarthritis use several primary endpoints including investigator's global assessment of disease activity, patient's global assessment of response...
journal_title:Statistics in medicine
pub_type: 杂志文章
doi:10.1002/sim.985
更新日期:2001-11-15 00:00:00
abstract::Wittes and Brittain recommended using an 'internal pilot study' to adjust sample size. The approach involves five steps in testing a general linear hypothesis for a general linear univariate model, with Gaussian errors. First, specify the design, hypothesis, desired test size, power, a smallest 'clinically meaningful'...
journal_title:Statistics in medicine
pub_type: 杂志文章
doi:10.1002/(sici)1097-0258(19990530)18:10<1199::aid-s
更新日期:1999-05-30 00:00:00
abstract::In drug-drug interaction (DDI) research, a two drug interaction is usually predicted by individual drug pharmacokinetics (PK). Although subject-specific drug concentration data from clinical PK studies on inhibitor/inducer or substrate's PK are not usually published, sample mean plasma drug concentrations and their st...
journal_title:Statistics in medicine
pub_type: 杂志文章,meta分析
doi:10.1002/sim.2837
更新日期:2007-09-10 00:00:00
abstract::I derive the locally most powerful rank tests for acceleration against semi-parametric alternatives when some patients are cured of the disease. I consider some particular classes of alternatives and present simulation results to verify the validity of the proposed tests. Real data from clinical trials for childhood l...
journal_title:Statistics in medicine
pub_type: 杂志文章
doi:10.1002/sim.4780141905
更新日期:1995-10-15 00:00:00
abstract::This paper reviews several emerging and recurrent issues relating to the drug development process. These emerging issues include changes to the FDA regulatory environment, internationalization of drug development, advances in computer technology and visualization tools, and efforts to incorporate meta-analysis methodo...
journal_title:Statistics in medicine
pub_type: 杂志文章,评审
doi:10.1002/(sici)1097-0258(19990915/30)18:17/18<2301:
更新日期:1999-09-15 00:00:00
abstract::We propose a new, less costly, design to test the equivalence of digital versus analogue mammography in terms of sensitivity and specificity. Because breast cancer is a rare event among asymptomatic women, the sample size for testing equivalence of sensitivity is larger than that for testing equivalence of specificity...
journal_title:Statistics in medicine
pub_type: 杂志文章
doi:10.1002/(sici)1097-0258(19981015)17:19<2219::aid-s
更新日期:1998-10-15 00:00:00
abstract::Pattern-mixture models (PMM) and selection models (SM) are alternative approaches for statistical analysis when faced with incomplete data and a nonignorable missing-data mechanism. Both models make empirically unverifiable assumptions and need additional constraints to identify the parameters. Here, we first introduc...
journal_title:Statistics in medicine
pub_type: 杂志文章
doi:10.1002/sim.6302
更新日期:2014-11-30 00:00:00
abstract::Given N points or events occurring according to some probability distribution in the unit interval (0, 1), the simple scan statistic is defined to be the maximum number of points in any sub-interval of length d. In many areas, as in epidemiology, it is used to test the null hypothesis that the events are random, again...
journal_title:Statistics in medicine
pub_type: 杂志文章
doi:10.1002/(sici)1097-0258(19960415)15:7/9<845::aid-s
更新日期:1996-04-15 00:00:00
abstract::A preference trial is a special form of cross-over trial where clinical conditions determine when patients change treatment, in a prescribed order. This can be modelled using a geometric distribution. The model can be simply fitted using standard logistic regression methodology. The procedure is applied to a trial stu...
journal_title:Statistics in medicine
pub_type: 杂志文章
doi:10.1002/(SICI)1097-0258(19960229)15:4<443::AID-SIM
更新日期:1996-02-28 00:00:00
abstract::We propose a new design for dose finding for cytotoxic agents in two ordered groups of patients. By ordered groups, we mean that prior to the study there is clinical information that would indicate that for a given dose one group would be more susceptible to toxicities than patients in the other group. The designs are...
journal_title:Statistics in medicine
pub_type: 杂志文章
doi:10.1002/sim.7133
更新日期:2017-01-30 00:00:00
abstract::Disease incidence predictions are useful for a number of administrative and scientific purposes. The simplest ones are made using trend extrapolation, on either an arithmetic or a logarithmic scale. This paper shows how approximate confidence prediction intervals can be calculated for such predictions, both for the to...
journal_title:Statistics in medicine
pub_type: 杂志文章
doi:10.1002/sim.4780131503
更新日期:1994-08-15 00:00:00
abstract::The use of outcome-dependent sampling with longitudinal data analysis has previously been shown to improve efficiency in the estimation of regression parameters. The motivating scenario is when outcome data exist for all cohort members but key exposure variables will be gathered only on a subset. Inference with outcom...
journal_title:Statistics in medicine
pub_type: 杂志文章
doi:10.1002/sim.7633
更新日期:2018-06-15 00:00:00
abstract::The identification of changes in the recent trend is an important issue in the analysis of cancer mortality and incidence data. We apply a joinpoint regression model to describe such continuous changes and use the grid-search method to fit the regression function with unknown joinpoints assuming constant variance and ...
journal_title:Statistics in medicine
pub_type: 杂志文章
doi:10.1002/(sici)1097-0258(20000215)19:3<335::aid-sim
更新日期:2000-02-15 00:00:00
abstract::I discuss alternatives to the one compartment model, delta Yt = alpha + beta exp(- gamma t). Instead of comparing the one and two compartment models, I derive statistics for testing mixtures of the parameters (beta, gamma) in the one compartment model. I apply the proposed methods to the problem of hydrogen clearance ...
journal_title:Statistics in medicine
pub_type: 杂志文章
doi:10.1002/sim.4780080811
更新日期:1989-08-01 00:00:00
abstract::This paper describes compliance with the completion of a quality of life questionnaire in the Breast Cancer Prevention Trial, a large multi-centre randomized trial that is studying the efficacy of Tamoxifen in preventing breast cancer. In the first 4875 women enrolled in the control arm of the study, there was a very ...
journal_title:Statistics in medicine
pub_type: 杂志文章
doi:10.1002/(sici)1097-0258(19980315/15)17:5/7<613::ai
更新日期:1998-03-15 00:00:00
abstract::Bioequivalence or interaction trials are commonly studied in crossover design and can be analysed by nonlinear mixed effects models as an alternative to noncompartmental approach. We propose an extension of the population Fisher information matrix in nonlinear mixed effects models to design crossover pharmacokinetic t...
journal_title:Statistics in medicine
pub_type: 杂志文章
doi:10.1002/sim.4390
更新日期:2012-05-20 00:00:00
abstract::Despite our best efforts, missing outcomes are common in randomized controlled clinical trials. The National Research Council's Committee on National Statistics panel report titled The Prevention and Treatment of Missing Data in Clinical Trials noted that further research is required to assess the impact of missing da...
journal_title:Statistics in medicine
pub_type: 杂志文章
doi:10.1002/sim.8428
更新日期:2020-01-30 00:00:00
abstract::Competing compartment models of different complexities have been used for the quantitative analysis of dynamic contrast-enhanced magnetic resonance imaging data. We present a spatial elastic net approach that allows to estimate the number of compartments for each voxel such that the model complexity is not fixed a pri...
journal_title:Statistics in medicine
pub_type: 杂志文章
doi:10.1002/sim.5997
更新日期:2014-03-15 00:00:00
abstract:BACKGROUND:Multiple imputation is becoming increasingly popular for handling missing data, with Markov chain Monte Carlo assuming multivariate normality (MVN) a commonly used approach. Imputing categorical variables (which are clearly non-normal) using MVN imputation is challenging, and several approaches have been sug...
journal_title:Statistics in medicine
pub_type: 杂志文章
doi:10.1002/sim.5445
更新日期:2012-12-30 00:00:00
abstract::We consider bivariate survival times for heterogeneous populations, where heterogeneity induces deviations in an individual's risk of an event as well as associations between survival times. The heterogeneity is characterized by a bivariate frailty model. We measure the heterogeneity effects through deviations associa...
journal_title:Statistics in medicine
pub_type: 杂志文章
doi:10.1002/(sici)1097-0258(19990430)18:8<907::aid-sim
更新日期:1999-04-30 00:00:00
abstract::In this paper statistical methods are proposed to estimate the distribution of a CD4 T-cell number at the time of a clinical AIDS endpoint from serial measurements of CD4 T-cell values in a cohort study. The statistical formulation of the problem is that of survival analysis with interval censored data, but in which t...
journal_title:Statistics in medicine
pub_type: 杂志文章
doi:10.1002/sim.4780131915
更新日期:1994-10-15 00:00:00
abstract::Health authorities are often alerted to suspected cancer clusters near the vicinity of potential point sources by members of the public. A surveillance system, where administrative regions around the potential point sources are regularly monitored for high disease rates, would allow for responses which are easier to o...
journal_title:Statistics in medicine
pub_type: 杂志文章
doi:10.1002/(sici)1097-0258(19960415)15:7/9<727::aid-s
更新日期:1996-04-15 00:00:00
abstract::I reflect on the statistical methods of the Christakis-Fowler studies on network-based contagion of traits by checking the sensitivity of these kinds of results to various alternate specifications and generative mechanisms. Despite the honest efforts of all involved, I remain pessimistic about establishing whether bin...
journal_title:Statistics in medicine
pub_type: 评论,杂志文章
doi:10.1002/sim.5551
更新日期:2013-02-20 00:00:00
abstract::Case-control studies are prone to low power for testing gene-environment interactions (GXE) given the need for a sufficient number of individuals on each strata of disease, gene, and environment. We propose a new study design to increase power by strategically pooling biospecimens. Pooling biospecimens allows us to in...
journal_title:Statistics in medicine
pub_type: 杂志文章
doi:10.1002/sim.5357
更新日期:2012-11-20 00:00:00
abstract::Providing personalized treatments designed to maximize benefits and minimizing harms is of tremendous current medical interest. One problem in this area is the evaluation of the interaction between the treatment and other predictor variables. Treatment effects in subgroups having the same direction but different magni...
journal_title:Statistics in medicine
pub_type: 杂志文章
doi:10.1002/sim.5429
更新日期:2012-12-10 00:00:00
abstract::The recent revision of the Declaration of Helsinki and the existence of many new therapies that affect survival or serious morbidity, and that therefore cannot be denied patients, have generated increased interest in active-control trials, particularly those intended to show equivalence or non-inferiority to the activ...
journal_title:Statistics in medicine
pub_type: 杂志文章
doi:10.1002/sim.1400
更新日期:2003-01-30 00:00:00