Generating evidence on a risk-based monitoring approach in the academic setting - lessons learned.

Abstract:

BACKGROUND:In spite of efforts to employ risk-based strategies to increase monitoring efficiency in the academic setting, empirical evidence on their effectiveness remains sparse. This mixed-methods study aimed to evaluate the risk-based on-site monitoring approach currently followed at our academic institution. METHODS:We selected all studies monitored by the Clinical Trial Unit (CTU) according to Risk ADApted MONitoring (ADAMON) at the University Hospital Basel, Switzerland, between 01.01.2012 and 31.12.2014. We extracted study characteristics and monitoring information from the CTU Enterprise Resource Management system and from monitoring reports of all selected studies. We summarized the data descriptively. Additionally, we conducted semi-structured interviews with the three current CTU monitors. RESULTS:During the observation period, a total of 214 monitoring visits were conducted in 43 studies resulting in 2961 documented monitoring findings. Our risk-based approach predominantly identified administrative (46.2%) and patient right findings (49.1%). We identified observational study design, high ADAMON risk category, industry sponsorship, the presence of an electronic database, experienced site staff, and inclusion of vulnerable study population to be factors associated with lower numbers of findings. The monitors understand the positive aspects of a risk-based approach but fear missing systematic errors due to the low frequency of visits. CONCLUSIONS:We show that the factors mostly increasing the risk for on-site monitoring findings are underrepresented in the current risk analysis scheme. Our risk-based on-site approach should further be complemented by centralized data checks, allowing monitors to transform their role towards partners for overall trial quality, and success.

journal_name

BMC Med Res Methodol

authors

von Niederhäusern B,Orleth A,Schädelin S,Rawi N,Velkopolszky M,Becherer C,Benkert P,Satalkar P,Briel M,Pauli-Magnus C

doi

10.1186/s12874-017-0308-6

subject

Has Abstract

pub_date

2017-02-14 00:00:00

pages

26

issue

1

issn

1471-2288

pii

10.1186/s12874-017-0308-6

journal_volume

17

pub_type

杂志文章
  • Validating and updating a risk model for pneumonia - a case study.

    abstract:BACKGROUND:The development of risk prediction models is of increasing importance in medical research - their use in practice, however, is rare. Among other reasons this might be due to the fact that thorough validation is often lacking. This study focuses on two Bayesian approaches of how to validate a prediction rule ...

    journal_title:BMC medical research methodology

    pub_type: 杂志文章

    doi:10.1186/1471-2288-12-99

    authors: Held U,Bové DS,Steurer J,Held L

    更新日期:2012-07-20 00:00:00

  • Adaptive propensity score procedure improves matching in prospective observational trials.

    abstract:BACKGROUND:Randomized controlled trials are the gold-standard for clinical trials. However, randomization is not always feasible. In this article we propose a prospective and adaptive matched case-control trial design assuming that a control group already exists. METHODS:We propose and discuss an interim analysis step...

    journal_title:BMC medical research methodology

    pub_type: 杂志文章

    doi:10.1186/s12874-019-0763-3

    authors: Weber D,Uhlmann L,Schönenberger S,Kieser M

    更新日期:2019-07-16 00:00:00

  • Application of a new dietary pattern analysis method in nutritional epidemiology.

    abstract:BACKGROUND:Diet plays an important role in chronic disease, and the use of dietary pattern analysis has grown rapidly as a way of deconstructing the complexity of nutritional intake and its relation to health. Pattern analysis methods, such as principal component analysis (PCA), have been used to investigate various di...

    journal_title:BMC medical research methodology

    pub_type: 杂志文章

    doi:10.1186/s12874-018-0585-8

    authors: Zhang F,Tapera TM,Gou J

    更新日期:2018-10-29 00:00:00

  • Outcome-sensitive multiple imputation: a simulation study.

    abstract:BACKGROUND:Multiple imputation is frequently used to deal with missing data in healthcare research. Although it is known that the outcome should be included in the imputation model when imputing missing covariate values, it is not known whether it should be imputed. Similarly no clear recommendations exist on: the util...

    journal_title:BMC medical research methodology

    pub_type: 杂志文章

    doi:10.1186/s12874-016-0281-5

    authors: Kontopantelis E,White IR,Sperrin M,Buchan I

    更新日期:2017-01-09 00:00:00

  • Evaluation of survival extrapolation in immuno-oncology using multiple pre-planned data cuts: learnings to aid in model selection.

    abstract:BACKGROUND:Due to limited duration of follow up in clinical trials of cancer treatments, estimates of lifetime survival benefits are typically derived using statistical extrapolation methods. To justify the method used, a range of approaches have been proposed including statistical goodness-of-fit tests and comparing e...

    journal_title:BMC medical research methodology

    pub_type: 杂志文章

    doi:10.1186/s12874-020-00997-x

    authors: Bullement A,Willis A,Amin A,Schlichting M,Hatswell AJ,Bharmal M

    更新日期:2020-05-06 00:00:00

  • Impact of preconception enrollment on birth enrollment and timing of exposure assessment in the initial vanguard cohort of the U.S. National Children's Study.

    abstract:BACKGROUND:The initial vanguard cohort of the U.S. National Children's Study was a pregnancy and birth cohort study that sought to enroll some women prior to pregnancy, and to assess exposures early in pregnancy. METHODS:During the recruitment phase (2009-2010), geographically based sampling was used to recruit women ...

    journal_title:BMC medical research methodology

    pub_type: 杂志文章

    doi:10.1186/s12874-015-0067-1

    authors: Stanford JB,Brenner R,Fetterer D,Palmer L,Schoendorf KC,U.S. National Children’s Study.

    更新日期:2015-09-24 00:00:00

  • The Platino project: methodology of a multicenter prevalence survey of chronic obstructive pulmonary disease in major Latin American cities.

    abstract:BACKGROUND:The prevalence of Chronic Obstructive Pulmonary Disease (COPD) in many developed countries appears to be increasing. There is some evidence from Latin America that COPD is a growing cause of death, but information on prevalence is scant. It is possible that, due to the high frequency of smoking in these coun...

    journal_title:BMC medical research methodology

    pub_type: 杂志文章

    doi:10.1186/1471-2288-4-15

    authors: Menezes AM,Victora CG,Perez-Padilla R,PLATINO Team.

    更新日期:2004-06-17 00:00:00

  • Understanding health management and safety decisions using signal processing and machine learning.

    abstract:BACKGROUND:Small group research in healthcare is important because it deals with interaction and decision-making processes that can help to identify and improve safer patient treatment and care. However, the number of studies is limited due to time- and resource-intensive data processing. The aim of this study was to e...

    journal_title:BMC medical research methodology

    pub_type: 杂志文章

    doi:10.1186/s12874-019-0756-2

    authors: Aufegger L,Bicknell C,Soane E,Ashrafian H,Darzi A

    更新日期:2019-06-13 00:00:00

  • Error in statistical tests of error in statistical tests.

    abstract:BACKGROUND:A recent paper found that terminal digits of statistical values in Nature deviated significantly from an equiprobable distribution, indicating errors or inconsistencies in rounding. This finding, as well as the discovery that a large percentage of p values were inconsistent with reported test statistics, led...

    journal_title:BMC medical research methodology

    pub_type: 评论,杂志文章

    doi:10.1186/1471-2288-6-45

    authors: Jeng M

    更新日期:2006-09-13 00:00:00

  • Heckman-type selection models to obtain unbiased estimates with missing measures outcome: theoretical considerations and an application to missing birth weight data.

    abstract:BACKGROUND:In low-income settings, key outcomes such as biomarkers or clinical assessments are often missing for a substantial proportion of the study population. The aim of this study was to assess the extent to which Heckman-type selection models can create unbiased estimates in such settings. METHODS:We introduce t...

    journal_title:BMC medical research methodology

    pub_type: 杂志文章

    doi:10.1186/s12874-019-0840-7

    authors: Koné S,Bonfoh B,Dao D,Koné I,Fink G

    更新日期:2019-12-09 00:00:00

  • The development of QUADAS: a tool for the quality assessment of studies of diagnostic accuracy included in systematic reviews.

    abstract:BACKGROUND:In the era of evidence based medicine, with systematic reviews as its cornerstone, adequate quality assessment tools should be available. There is currently a lack of a systematically developed and evaluated tool for the assessment of diagnostic accuracy studies. The aim of this project was to combine empiri...

    journal_title:BMC medical research methodology

    pub_type: 杂志文章

    doi:10.1186/1471-2288-3-25

    authors: Whiting P,Rutjes AW,Reitsma JB,Bossuyt PM,Kleijnen J

    更新日期:2003-11-10 00:00:00

  • The methods and baseline characteristics of a VA randomized controlled study evaluating supported employment provided in primary care patient aligned care teams.

    abstract:BACKGROUND:This article describes the design and baseline sample of a single-site trial comparing Individual Placement and Support (IPS) supported employment delivered within a Veterans Health Administration (VHA) primary care Patient Aligned Care Team (PACT) to treatment-as-usual vocational rehabilitation (TAU-VR) tha...

    journal_title:BMC medical research methodology

    pub_type: 杂志文章,随机对照试验

    doi:10.1186/s12874-020-0919-1

    authors: Davis LL,Blansett CM,Mumba MN,MacVicar D,Toscano R,Pilkinton P,Gay W,Bartolucci A

    更新日期:2020-02-17 00:00:00

  • Best practice for analysis of shared clinical trial data.

    abstract:BACKGROUND:Greater transparency, including sharing of patient-level data for further research, is an increasingly important topic for organisations who sponsor, fund and conduct clinical trials. This is a major paradigm shift with the aim of maximising the value of patient-level data from clinical trials for the benefi...

    journal_title:BMC medical research methodology

    pub_type: 信件

    doi:10.1186/s12874-016-0170-y

    authors: Hollis S,Fletcher C,Lynn F,Urban HJ,Branson J,Burger HU,Tudur Smith C,Sydes MR,Gerlinger C

    更新日期:2016-07-08 00:00:00

  • The fading of reported effectiveness. A meta-analysis of randomised controlled trials.

    abstract:BACKGROUND:The "real" effect size of a medical therapy is constant over time. In contrast, the effect size reported in randomised controlled trials (RCTs) may change over time because the sum of all kinds of bias influencing the reported effectiveness is not necessarily constant. As this would affect the validity of me...

    journal_title:BMC medical research methodology

    pub_type: 杂志文章,meta分析

    doi:10.1186/1471-2288-6-25

    authors: Gehr BT,Weiss C,Porzsolt F

    更新日期:2006-05-11 00:00:00

  • Does it matter whether the recipient of patient questionnaires in general practice is the general practitioner or an independent researcher? The REPLY randomised trial.

    abstract:BACKGROUND:Self-administered questionnaires are becoming increasingly common in general practice. Much research has explored methods to increase response rates but comparatively few studies have explored the effect of questionnaire administration on reported answers. METHODS:The aim of this study was to determine the ...

    journal_title:BMC medical research methodology

    pub_type: 杂志文章,随机对照试验

    doi:10.1186/1471-2288-8-42

    authors: Desborough JA,Butters P,Bhattacharya D,Holland RC,Wright DJ

    更新日期:2008-06-27 00:00:00

  • Eliciting parental support for the use of newborn blood spots for pediatric research.

    abstract:BACKGROUND:Biomarkers of exposures such as infection or environmental chemicals can be measured in small volumes of blood extracted from newborn dried blood spots (DBS) underscoring their potential utility for population-based research. However, few studies have evaluated the feasibility and utility of this resource; p...

    journal_title:BMC medical research methodology

    pub_type: 杂志文章

    doi:10.1186/s12874-016-0120-8

    authors: Yeung EH,Louis GB,Lawrence D,Kannan K,McLain AC,Caggana M,Druschel C,Bell E

    更新日期:2016-02-04 00:00:00

  • Predictor characteristics necessary for building a clinically useful risk prediction model: a simulation study.

    abstract:BACKGROUND:Compelled by the intuitive appeal of predicting each individual patient's risk of an outcome, there is a growing interest in risk prediction models. While the statistical methods used to build prediction models are increasingly well understood, the literature offers little insight to researchers seeking to g...

    journal_title:BMC medical research methodology

    pub_type: 杂志文章

    doi:10.1186/s12874-016-0223-2

    authors: Schummers L,Himes KP,Bodnar LM,Hutcheon JA

    更新日期:2016-09-21 00:00:00

  • Clinical trial simulation to evaluate power to compare the antiviral effectiveness of two hepatitis C protease inhibitors using nonlinear mixed effect models: a viral kinetic approach.

    abstract:BACKGROUND:Models of hepatitis C virus (HCV) kinetics are increasingly used to estimate and to compare in vivo drug's antiviral effectiveness of new potent anti-HCV agents. Viral kinetic parameters can be estimated using non-linear mixed effect models (NLMEM). Here we aimed to evaluate the performance of this approach ...

    journal_title:BMC medical research methodology

    pub_type: 杂志文章

    doi:10.1186/1471-2288-13-60

    authors: Laouénan C,Guedj J,Mentré F

    更新日期:2013-04-25 00:00:00

  • Novel study design to assess the utility of the copd assessment test in a primary care setting.

    abstract::The quality of a consultation provided by a physician can have a profound impact on the quality of care and patient engagement in treatment decisions. When the COPD Assessment Test (CAT) was developed, one of its aims was to aid the communication between physician and patient about the impact of COPD. We developed a n...

    journal_title:BMC medical research methodology

    pub_type: 信件

    doi:10.1186/1471-2288-13-63

    authors: Gruffydd-Jones K,Marsden H,Holmes S,Kardos P,Escamilla R,Dal Negro R,Roberts J,Nadeau G,Leather D,Jones P

    更新日期:2013-05-10 00:00:00

  • Reliability of the modified child and adolescent physical activity and nutrition survey, physical activity (CAPANS-PA) questionnaire among Chinese-Australian youth.

    abstract:BACKGROUND:Evidence suggests that differences exist in physical activity (PA) participation among Culturally and Linguistically Diverse (CALD) children and adolescents. It is possible that these differences could be influenced by variations in measurement technique and instrument reliability. However, culturally sensit...

    journal_title:BMC medical research methodology

    pub_type: 杂志文章

    doi:10.1186/1471-2288-11-122

    authors: Strugnell C,Renzaho A,Ridley K,Burns C

    更新日期:2011-08-25 00:00:00

  • Telephone and face to face methods of assessment of veteran's community reintegration yield equivalent results.

    abstract:BACKGROUND:The Community Reintegration of Service Members (CRIS) is a new measure of community reintegration developed to measure veteran's participation in life roles. It consists of three sub-scales: Extent of Participation (Extent), Perceived Limitations with Participation (Perceived), and Satisfaction with Particip...

    journal_title:BMC medical research methodology

    pub_type: 杂志文章,随机对照试验

    doi:10.1186/1471-2288-11-98

    authors: Resnik LJ,Clark MA,Borgia M

    更新日期:2011-06-25 00:00:00

  • A review of the reporting and handling of missing data in cohort studies with repeated assessment of exposure measures.

    abstract:BACKGROUND:Retaining participants in cohort studies with multiple follow-up waves is difficult. Commonly, researchers are faced with the problem of missing data, which may introduce biased results as well as a loss of statistical power and precision. The STROBE guidelines von Elm et al. (Lancet, 370:1453-1457, 2007); V...

    journal_title:BMC medical research methodology

    pub_type: 杂志文章,评审

    doi:10.1186/1471-2288-12-96

    authors: Karahalios A,Baglietto L,Carlin JB,English DR,Simpson JA

    更新日期:2012-07-11 00:00:00

  • Collecting household water usage data: telephone questionnaire or diary?

    abstract:BACKGROUND:Quantitative Microbial Risk Assessment (QMRA), a modelling approach, is used to assess health risks. Inputs into the QMRA process include data that characterise the intensity, frequency and duration of exposure to risk(s). Data gaps for water exposure assessment include the duration and frequency of urban no...

    journal_title:BMC medical research methodology

    pub_type: 杂志文章

    doi:10.1186/1471-2288-9-72

    authors: O'Toole JE,Sinclair MI,Leder K

    更新日期:2009-11-09 00:00:00

  • The new COSMIN guidelines confront traditional concepts of responsiveness.

    abstract::The recently published "COSMIN" guidelines aim to rate properties of outcome instruments and state two issues with regard to responsiveness which is the instrument's ability to detect change over time. These issues are comparison of score changes with change of an external criterion using correlations and the judgemen...

    journal_title:BMC medical research methodology

    pub_type: 评论,信件

    doi:10.1186/1471-2288-11-152

    authors: Angst F

    更新日期:2011-11-18 00:00:00

  • A random effects meta-analysis model with Box-Cox transformation.

    abstract:BACKGROUND:In a random effects meta-analysis model, true treatment effects for each study are routinely assumed to follow a normal distribution. However, normality is a restrictive assumption and the misspecification of the random effects distribution may result in a misleading estimate of overall mean for the treatmen...

    journal_title:BMC medical research methodology

    pub_type: 杂志文章

    doi:10.1186/s12874-017-0376-7

    authors: Yamaguchi Y,Maruo K,Partlett C,Riley RD

    更新日期:2017-07-19 00:00:00

  • Using bundle embeddings to predict daily cortisol levels in human subjects.

    abstract:BACKGROUND:Many biological variables sampled from human subjects show a diurnal pattern, which poses special demands on the techniques used to analyze such data. Furthermore, most biological variables belong to nonlinear dynamical systems, which may make linear statistical techniques less suitable to analyze their dyna...

    journal_title:BMC medical research methodology

    pub_type: 杂志文章

    doi:10.1186/s12874-018-0485-y

    authors: Toonen RB,Wardenaar KJ,Bos EH,van Ockenburg SL,de Jonge P

    更新日期:2018-03-21 00:00:00

  • Getting under the skin of the primary care consultation using video stimulated recall: a systematic review.

    abstract:BACKGROUND:Video stimulated recall (VSR) is a method of enhancing participants' accounts of the consultation using a video recording of the event to encourage and prompt recall in a post consultation interview. VSR is used in education and education research, and to a lesser extent in medical and nursing research. Litt...

    journal_title:BMC medical research methodology

    pub_type: 杂志文章,评审

    doi:10.1186/1471-2288-14-101

    authors: Paskins Z,McHugh G,Hassell AB

    更新日期:2014-08-30 00:00:00

  • Use of re-randomized data in meta-analysis.

    abstract:BACKGROUND:Outcomes collected in randomized clinical trials are observations of random variables that should be independent and identically distributed. However, in some trials, the patients are randomized more than once thus violating both of these assumptions. The probability of an event is not always the same when a...

    journal_title:BMC medical research methodology

    pub_type: 杂志文章

    doi:10.1186/1471-2288-5-17

    authors: Hozo I,Djulbegovic B,Clark O,Lyman GH

    更新日期:2005-05-10 00:00:00

  • Incongruence between test statistics and P values in medical papers.

    abstract:BACKGROUND:Given an observed test statistic and its degrees of freedom, one may compute the observed P value with most statistical packages. It is unknown to what extent test statistics and P values are congruent in published medical papers. METHODS:We checked the congruence of statistical results reported in all the ...

    journal_title:BMC medical research methodology

    pub_type: 杂志文章

    doi:10.1186/1471-2288-4-13

    authors: García-Berthou E,Alcaraz C

    更新日期:2004-05-28 00:00:00

  • Correction for retest effects across repeated measures of cognitive functioning: a longitudinal cohort study of postoperative delirium.

    abstract:BACKGROUND:Few studies have compared methods to correct for retest effects or practice effects in settings where an acute event could influence test performance, such as major surgery. Our goal in this study was to evaluate the use of different methods to correct for the effects of practice or retest on repeated test a...

    journal_title:BMC medical research methodology

    pub_type: 杂志文章

    doi:10.1186/s12874-018-0530-x

    authors: Racine AM,Gou Y,Fong TG,Marcantonio ER,Schmitt EM,Travison TG,Inouye SK,Jones RN

    更新日期:2018-07-03 00:00:00