Evaluation of survival extrapolation in immuno-oncology using multiple pre-planned data cuts: learnings to aid in model selection.

Abstract:

BACKGROUND:Due to limited duration of follow up in clinical trials of cancer treatments, estimates of lifetime survival benefits are typically derived using statistical extrapolation methods. To justify the method used, a range of approaches have been proposed including statistical goodness-of-fit tests and comparing estimates against a previous data cut (i.e. interim data collected). In this study, we extend these approaches by presenting a range of extrapolations fitted to four pre-planned data cuts from the JAVELIN Merkel 200 (JM200) trial. By comparing different estimates of survival and goodness-of-fit as JM200 data mature, we undertook an iterative process of fitting and re-fitting survival models to retrospectively identify early indications of likely long-term survival. METHODS:Standard and spline-based parametric models were fitted to overall survival data from each JM200 data cut. Goodness-of-fit was determined using an assessment of the estimated hazard function, information theory-based methods and objective comparisons of estimation accuracy. Best-fitting extrapolations were compared to establish which one provided the most accurate estimation, and how statistical goodness-of-fit differed. RESULTS:Spline-based models provided the closest fit to the final JM200 data cut, though all extrapolation methods based on the earliest data cut underestimated the 'true' long-term survival (difference in restricted mean survival time [RMST] at 36 months: - 1.1 to - 0.5 months). Goodness-of-fit scores illustrated that an increasingly flexible model was favored as data matured. Given an early data cut, a more flexible model better aligned with clinical expectations could be reasonably justified using a range of metrics, including RMST and goodness-of-fit scores (which were typically within a 2-point range of the statistically 'best-fitting' model). CONCLUSIONS:Survival estimates from the spline-based models are more aligned with clinical expectation and provided a better fit to the JM200 data, despite not exhibiting the definitively 'best' statistical goodness-of-fit. Longer-term data are required to further validate extrapolations, though this study illustrates the importance of clinical plausibility when selecting the most appropriate model. In addition, hazard-based plots and goodness-of-fit tests from multiple data cuts present useful approaches to identify when a more flexible model may be advantageous. TRIAL REGISTRATION:JAVELIN Merkel 200 was registered with ClinicalTrials.gov as NCT02155647 on June 4, 2014.

journal_name

BMC Med Res Methodol

authors

Bullement A,Willis A,Amin A,Schlichting M,Hatswell AJ,Bharmal M

doi

10.1186/s12874-020-00997-x

subject

Has Abstract

pub_date

2020-05-06 00:00:00

pages

103

issue

1

issn

1471-2288

pii

10.1186/s12874-020-00997-x

journal_volume

20

pub_type

杂志文章
  • Development and preliminary validation of a brief nurses' perceived professional benefit questionnaire (NPPBQ).

    abstract:BACKGROUND:With the increased empirical interest in the positive significance of improving nurses' sense of professional benefits, there is a requirement for measures of nurses' perceived professional benefit (NPPB). Our objective was to develop and psychometrically test a brief Nurses' Perceived Professional Benefit Q...

    journal_title:BMC medical research methodology

    pub_type: 杂志文章,多中心研究

    doi:10.1186/s12874-020-0908-4

    authors: Hu Y,Hu J,Li L,Zhao B,Liu X,Li F

    更新日期:2020-01-30 00:00:00

  • Flexible parametric modelling of cause-specific hazards to estimate cumulative incidence functions.

    abstract:BACKGROUND:Competing risks are a common occurrence in survival analysis. They arise when a patient is at risk of more than one mutually exclusive event, such as death from different causes, and the occurrence of one of these may prevent any other event from ever happening. METHODS:There are two main approaches to mode...

    journal_title:BMC medical research methodology

    pub_type: 杂志文章

    doi:10.1186/1471-2288-13-13

    authors: Hinchliffe SR,Lambert PC

    更新日期:2013-02-06 00:00:00

  • Assessment of reproducibility of cancer survival risk predictions across medical centers.

    abstract:BACKGROUND:Two most important considerations in evaluation of survival prediction models are 1) predictability - ability to predict survival risks accurately and 2) reproducibility - ability to generalize to predict samples generated from different studies. We present approaches for assessment of reproducibility of sur...

    journal_title:BMC medical research methodology

    pub_type: 杂志文章,多中心研究

    doi:10.1186/1471-2288-13-25

    authors: Chen HC,Chen JJ

    更新日期:2013-02-20 00:00:00

  • A factorial cluster-randomised controlled trial combining home-environmental and early child development interventions to improve child health and development: rationale, trial design and baseline findings.

    abstract:BACKGROUND:Exposure to unhealthy environments and inadequate child stimulation are main risk factors that affect children's health and wellbeing in low- and middle-income countries. Interventions that simultaneously address several risk factors at the household level have great potential to reduce these negative effect...

    journal_title:BMC medical research methodology

    pub_type: 杂志文章

    doi:10.1186/s12874-020-00950-y

    authors: Hartinger SM,Nuño N,Hattendorf J,Verastegui H,Karlen W,Ortiz M,Mäusezahl D

    更新日期:2020-04-02 00:00:00

  • Structure formats of randomised controlled trial abstracts: a cross-sectional analysis of their current usage and association with methodology reporting.

    abstract:BACKGROUND:The reporting of randomised controlled trial (RCT) abstracts is of vital importance. The primary objective of this study was to investigate the association between structure format and RCT abstracts' quality of methodology reporting, informed by the current requirement and usage of structure formats by leadi...

    journal_title:BMC medical research methodology

    pub_type: 杂志文章

    doi:10.1186/s12874-017-0469-3

    authors: Hua F,Walsh T,Glenny AM,Worthington H

    更新日期:2018-01-10 00:00:00

  • Comparing denominator degrees of freedom approximations for the generalized linear mixed model in analyzing binary outcome in small sample cluster-randomized trials.

    abstract:BACKGROUND:Small number of clusters and large variation of cluster sizes commonly exist in cluster-randomized trials (CRTs) and are often the critical factors affecting the validity and efficiency of statistical analyses. F tests are commonly used in the generalized linear mixed model (GLMM) to test intervention effect...

    journal_title:BMC medical research methodology

    pub_type: 杂志文章

    doi:10.1186/s12874-015-0026-x

    authors: Li P,Redden DT

    更新日期:2015-04-23 00:00:00

  • Consensus workshops on the development of an ADHD medication management protocol using QbTest: developing a clinical trial protocol with multidisciplinary stakeholders.

    abstract:BACKGROUND:The study design and protocol that underpin a randomised controlled trial (RCT) are critical for the ultimate success of the trial. Although RCTs are considered the gold standard for research, there are multiple threats to their validity such as participant recruitment and retention, identifying a meaningful...

    journal_title:BMC medical research methodology

    pub_type: 杂志文章

    doi:10.1186/s12874-019-0772-2

    authors: Hall CL,Brown S,James M,Martin JL,Brown N,Selby K,Clarke J,Williams L,Sayal K,Hollis C,Groom MJ

    更新日期:2019-06-18 00:00:00

  • Awareness of wearing an accelerometer does not affect physical activity in youth.

    abstract:BACKGROUND:This study aimed to investigate whether awareness of being monitored by an accelerometer has an effect on physical activity in young people. METHODS:Eighty healthy participants aged 10-18 years were randomized between blinded and nonblinded groups. The blinded participants were informed that we were testing...

    journal_title:BMC medical research methodology

    pub_type: 杂志文章,随机对照试验

    doi:10.1186/s12874-017-0378-5

    authors: Vanhelst J,Béghin L,Drumez E,Coopman S,Gottrand F

    更新日期:2017-07-11 00:00:00

  • Barriers and facilitators to patient recruitment to a cluster randomized controlled trial in primary care: lessons for future trials.

    abstract:BACKGROUND:Primary-care based randomized controlled trials (RCTs) build an important evidence base for general practice but little evidence exists about barriers to recruitment which often hamper such trials. We investigated the issues that impeded and facilitated recruitment to a clinical trial in general practice. M...

    journal_title:BMC medical research methodology

    pub_type: 杂志文章

    doi:10.1186/s12874-015-0012-3

    authors: Foster JM,Sawyer SM,Smith L,Reddel HK,Usherwood T

    更新日期:2015-03-12 00:00:00

  • Validity of information on atopic disease and other illness in young children reported by parents in a prospective birth cohort study.

    abstract:BACKGROUND:The longitudinal birth cohort study is the preferred design for studies of childhood health, particularly atopic disease. Still, prospective data collection depends on recollection of the medical history since the previous visit representing a potential recall-bias. We aimed to ascertain the quality of infor...

    journal_title:BMC medical research methodology

    pub_type: 杂志文章

    doi:10.1186/1471-2288-12-160

    authors: Vissing NH,Jensen SM,Bisgaard H

    更新日期:2012-10-22 00:00:00

  • Self-reported measures in health research for people with intellectual disabilities: an inclusive pilot study on suitability and reliability.

    abstract:BACKGROUND:The lack of suitable and reliable scales to measure self-reported health and health behaviour among people with intellectual disabilities (ID) is an important methodological challenge in health research. This study, which was undertaken together with co-researchers with ID, explores possibilities for self-re...

    journal_title:BMC medical research methodology

    pub_type: 杂志文章

    doi:10.1186/s12874-018-0539-1

    authors: Vlot-van Anrooij K,Tobi H,Hilgenkamp TIM,Leusink GL,Naaldenberg J

    更新日期:2018-07-16 00:00:00

  • A randomised controlled trial to assess the effectiveness of offering study results as an incentive to increase response rates to postal questionnaires [ISRCTN26118436].

    abstract:BACKGROUND:Postal questionnaires are widely used to collect outcome data on participants. However, a poor response to questionnaires will reduce the statistical power of the study and may introduce bias. A meta analysis of ten trials offering study results, largely in the fields of education and marketing, was shown to...

    journal_title:BMC medical research methodology

    pub_type: 杂志文章,随机对照试验

    doi:10.1186/1471-2288-5-34

    authors: Cockayne S,Torgerson DJ

    更新日期:2005-10-26 00:00:00

  • The methods and baseline characteristics of a VA randomized controlled study evaluating supported employment provided in primary care patient aligned care teams.

    abstract:BACKGROUND:This article describes the design and baseline sample of a single-site trial comparing Individual Placement and Support (IPS) supported employment delivered within a Veterans Health Administration (VHA) primary care Patient Aligned Care Team (PACT) to treatment-as-usual vocational rehabilitation (TAU-VR) tha...

    journal_title:BMC medical research methodology

    pub_type: 杂志文章,随机对照试验

    doi:10.1186/s12874-020-0919-1

    authors: Davis LL,Blansett CM,Mumba MN,MacVicar D,Toscano R,Pilkinton P,Gay W,Bartolucci A

    更新日期:2020-02-17 00:00:00

  • Heckman-type selection models to obtain unbiased estimates with missing measures outcome: theoretical considerations and an application to missing birth weight data.

    abstract:BACKGROUND:In low-income settings, key outcomes such as biomarkers or clinical assessments are often missing for a substantial proportion of the study population. The aim of this study was to assess the extent to which Heckman-type selection models can create unbiased estimates in such settings. METHODS:We introduce t...

    journal_title:BMC medical research methodology

    pub_type: 杂志文章

    doi:10.1186/s12874-019-0840-7

    authors: Koné S,Bonfoh B,Dao D,Koné I,Fink G

    更新日期:2019-12-09 00:00:00

  • Reliability of routinely collected anthropometric measurements in primary care.

    abstract:BACKGROUND:Measuring body mass index (BMI) has been proposed as a method of screening for preventive primary care and population surveillance of childhood obesity. However, the accuracy of routinely collected measurements has been questioned. The purpose of this study was to assess the reliability of height, length and...

    journal_title:BMC medical research methodology

    pub_type: 杂志文章

    doi:10.1186/s12874-019-0726-8

    authors: Carsley S,Parkin PC,Tu K,Pullenayegum E,Persaud N,Maguire JL,Birken CS,TARGet Kids! Collaboration.

    更新日期:2019-04-24 00:00:00

  • Variable selection in social-environmental data: sparse regression and tree ensemble machine learning approaches.

    abstract:BACKGROUND:Social-environmental data obtained from the US Census is an important resource for understanding health disparities, but rarely is the full dataset utilized for analysis. A barrier to incorporating the full data is a lack of solid recommendations for variable selection, with researchers often hand-selecting ...

    journal_title:BMC medical research methodology

    pub_type: 杂志文章

    doi:10.1186/s12874-020-01183-9

    authors: Handorf E,Yin Y,Slifker M,Lynch S

    更新日期:2020-12-10 00:00:00

  • Relative performance of different exposure modeling approaches for sulfur dioxide concentrations in the air in rural western Canada.

    abstract:BACKGROUND:The main objective of this paper is to compare different methods for predicting the levels of SO2 air pollution in oil and gas producing area of rural western Canada. Month-long average air quality measurements were collected over a two-year period (2001-2002) at multiple locations, with some side-by-side me...

    journal_title:BMC medical research methodology

    pub_type: 杂志文章

    doi:10.1186/1471-2288-8-43

    authors: Burstyn I,Cherry NM,Yasui Y,Kim HM

    更新日期:2008-07-04 00:00:00

  • The development of QUADAS: a tool for the quality assessment of studies of diagnostic accuracy included in systematic reviews.

    abstract:BACKGROUND:In the era of evidence based medicine, with systematic reviews as its cornerstone, adequate quality assessment tools should be available. There is currently a lack of a systematically developed and evaluated tool for the assessment of diagnostic accuracy studies. The aim of this project was to combine empiri...

    journal_title:BMC medical research methodology

    pub_type: 杂志文章

    doi:10.1186/1471-2288-3-25

    authors: Whiting P,Rutjes AW,Reitsma JB,Bossuyt PM,Kleijnen J

    更新日期:2003-11-10 00:00:00

  • The use of relative incidence ratios in self-controlled case series studies: an overview.

    abstract:BACKGROUND:The self-controlled case series (SCCS) is a useful design for investigating associations between outcomes and transient exposures. The SCCS design controls for all fixed covariates, but effect modification can still occur. This can be evaluated by including interaction terms in the model which, when exponent...

    journal_title:BMC medical research methodology

    pub_type: 杂志文章

    doi:10.1186/s12874-016-0225-0

    authors: Hawken S,Potter BK,Little J,Benchimol EI,Mahmud S,Ducharme R,Wilson K

    更新日期:2016-09-23 00:00:00

  • The impact of varying cluster size in cross-sectional stepped-wedge cluster randomised trials.

    abstract:BACKGROUND:Cluster randomised trials with unequal sized clusters often have lower precision than with clusters of equal size. To allow for this, sample sizes are inflated by a modified version of the design effect for clustering. These inflation factors are valid under the assumption that randomisation is stratified by...

    journal_title:BMC medical research methodology

    pub_type: 杂志文章

    doi:10.1186/s12874-019-0760-6

    authors: Martin JT,Hemming K,Girling A

    更新日期:2019-06-14 00:00:00

  • Optimising the use of electronic health records to estimate the incidence of rheumatoid arthritis in primary care: what information is hidden in free text?

    abstract:BACKGROUND:Primary care databases are a major source of data for epidemiological and health services research. However, most studies are based on coded information, ignoring information stored in free text. Using the early presentation of rheumatoid arthritis (RA) as an exemplar, our objective was to estimate the exten...

    journal_title:BMC medical research methodology

    pub_type: 杂志文章

    doi:10.1186/1471-2288-13-105

    authors: Ford E,Nicholson A,Koeling R,Tate A,Carroll J,Axelrod L,Smith HE,Rait G,Davies KA,Petersen I,Williams T,Cassell JA

    更新日期:2013-08-21 00:00:00

  • Clustering of continuous and binary outcomes at the general practice level in individually randomised studies in primary care - a review of 10 years of primary care trials.

    abstract:BACKGROUND:In randomised controlled trials, the assumption of independence of individual observations is fundamental to the design, analysis and interpretation of studies. However, in individually randomised trials in primary care, this assumption may be violated because patients are naturally clustered within primary ...

    journal_title:BMC medical research methodology

    pub_type: 杂志文章

    doi:10.1186/s12874-020-00971-7

    authors: Stuart B,Becque T,Moore M,Little P

    更新日期:2020-04-15 00:00:00

  • Cross-cultural validation of the Functional Vision Questionnaire for Children and Young People (FVQ_CYP) with visual impairment in the Dutch population: challenges and opportunities.

    abstract:BACKGROUND:To assess cross-cultural validity between Dutch and English versions of the FVQ_CYP, a patient-reported outcome measure developed in the United Kingdom (UK) for children and adolescents with (severe) visual impairment or blindness (VI for brevity) to measure functional vision. METHODS:The 36-item FVQ_CYP wa...

    journal_title:BMC medical research methodology

    pub_type: 杂志文章

    doi:10.1186/s12874-019-0875-9

    authors: Elsman EBM,Tadić V,Peeters CFW,van Rens GHMB,Rahi JS,van Nispen RMA

    更新日期:2019-12-03 00:00:00

  • Maximising response from GPs to questionnaire surveys: do length or incentives make a difference?

    abstract:BACKGROUND:General Practitioners (GPs) respond poorly to postal surveys. Consequently there is potential for reduced data quality and bias in the findings. In general population surveys, response to postal questionnaires may be improved by reducing their length and offering incentives. The aim of this study was to inve...

    journal_title:BMC medical research methodology

    pub_type: 杂志文章

    doi:10.1186/1471-2288-15-3

    authors: Cottrell E,Roddy E,Rathod T,Thomas E,Porcheret M,Foster NE

    更新日期:2015-01-06 00:00:00

  • Evaluating treatments in health care: the instability of a one-legged stool.

    abstract:BACKGROUND:Both scientists and the public routinely refer to randomized controlled trials (RCTs) as being the 'gold standard' of scientific evidence. Although there is no question that placebo-controlled RCTs play a significant role in the evaluation of new pharmaceutical treatments, especially when it is important to ...

    journal_title:BMC medical research methodology

    pub_type: 杂志文章

    doi:10.1186/1471-2288-11-65

    authors: Kaplan BJ,Giesbrecht G,Shannon S,McLeod K

    更新日期:2011-05-11 00:00:00

  • Reported frequency of physical activity in a large epidemiological study: relationship to specific activities and repeatability over time.

    abstract:BACKGROUND:How overall physical activity relates to specific activities and how reported activity changes over time may influence interpretation of observed associations between physical activity and health. We examine the relationships between various physical activities self-reported at different times in a large coh...

    journal_title:BMC medical research methodology

    pub_type: 杂志文章

    doi:10.1186/1471-2288-11-97

    authors: Armstrong ME,Cairns BJ,Green J,Reeves GK,Beral V,Million Women Study Collaborators.

    更新日期:2011-06-22 00:00:00

  • Data enhancement for co-morbidity measurement among patients referred for sleep diagnostic testing: an observational study.

    abstract:BACKGROUND:Observational outcome studies of patients with obstructive sleep apnea (OSA) require adjustment for co-morbidity to produce valid results. The aim of this study was to evaluate whether the combination of administrative data and self-reported data provided a more complete estimate of co-morbidity among patien...

    journal_title:BMC medical research methodology

    pub_type: 杂志文章

    doi:10.1186/1471-2288-9-50

    authors: Ronksley PE,Tsai WH,Quan H,Faris P,Hemmelgarn BR

    更新日期:2009-07-15 00:00:00

  • Parental compliance--an emerging problem in Liverpool community child health surveys 1991-2006.

    abstract:BACKGROUND:Compliance is a critical issue for parental questionnaires in school based epidemiological surveys and high compliance is difficult to achieve. The objective of this study was to determine trends and factors associated with parental questionnaire compliance during respiratory health surveys of school childre...

    journal_title:BMC medical research methodology

    pub_type: 杂志文章

    doi:10.1186/1471-2288-12-53

    authors: Koshy G,Brabin BJ

    更新日期:2012-04-20 00:00:00

  • Blood spots as an alternative to whole blood collection and the effect of a small monetary incentive to increase participation in genetic association studies.

    abstract:BACKGROUND:Collection of buccal cells from saliva for DNA extraction offers a less invasive and convenient alternative to venipuncture blood collection that may increase participation in genetic epidemiologic studies. However, dried blood spot collection, which is also a convenient method, offers a means of collecting ...

    journal_title:BMC medical research methodology

    pub_type: 杂志文章

    doi:10.1186/1471-2288-9-76

    authors: Bhatti P,Kampa D,Alexander BH,McClure C,Ringer D,Doody MM,Sigurdson AJ

    更新日期:2009-11-13 00:00:00

  • Assembling and validating a heart failure-free cohort from the Reasons for Geographic and Racial Differences in Stroke (REGARDS) study.

    abstract:BACKGROUND:Studies examining incident heart failure (HF) have been limited to select populations. To examine incident HF with broader generalizability, there is need to assemble a HF-free cohort using a geographically-diverse sample. We aimed to develop and validate a simple medication-based strategy for assembling a H...

    journal_title:BMC medical research methodology

    pub_type: 杂志文章

    doi:10.1186/s12874-019-0890-x

    authors: Goyal P,Mefford MT,Chen L,Sterling MR,Durant RW,Safford MM,Levitan EB

    更新日期:2020-03-04 00:00:00