Back to basics: Percentage agreement measures are adequate, but there are easier ways.

Abstract:

:Percentage agreement measures of interobserver agreement or "reliability" have traditionally been used to summarize observer agreement from studies using interval recording, time-sampling, and trial-scoring data collection procedures. Recent articles disagree on whether to continue using these percentage agreement measures, and on which ones to use, and what to do about chance agreements if their use is continued. Much of the disagreement derives from the need to be reasonably certain we do not accept as evidence of true interobserver agreement those agreement levels which are substantially probable as a result of chance observer agreement. The various percentage agreement measures are shown to be adequate to this task, but easier ways are discussed. Tables are given to permit checking to see if obtained disagreements are unlikely due to chance. Particularly important is the discovery of a simple rule that, when met, makes the tables unnecessary. If reliability checks using 50 or more observation occasions produce 10% or fewer disagreements, for behavior rates from 10% through 90%, the agreement achieved is quite improbably the result of chance agreement.

journal_name

J Appl Behav Anal

authors

Birkimer JC,Brown JH

doi

10.1901/jaba.1979.12-535

subject

Has Abstract

pub_date

1979-01-01 00:00:00

pages

535-43

issue

4

eissn

0021-8855

issn

1938-3703

journal_volume

12

pub_type

杂志文章
  • Reducing behavior problems through functional communication training.

    abstract::It is generally agreed that serious misbehavior in children should be replaced with socially appropriate behaviors, but few guidelines exist with respect to choosing replacement behaviors. We address this issue in two experiments. In Experiment 1, we developed an assessment method for identifying situations in which b...

    journal_title:Journal of applied behavior analysis

    pub_type: 杂志文章

    doi:10.1901/jaba.1985.18-111

    authors: Carr EG,Durand VM

    更新日期:1985-07-01 00:00:00

  • The modification of leisure behavior in a half-way house for retarded women.

    abstract::A multi-element baseline design combined with a multiple-baseline design, was used to investigate the effect of availability of materials, prizes for participation, and instruction on the leisure behavior of 14 mentally retarded women in a half-way house. A leisure program was conducted on weekday evenings, during whi...

    journal_title:Journal of applied behavior analysis

    pub_type: 杂志文章

    doi:10.1901/jaba.1977.10-273

    authors: Johnson MS,Bailey JS

    更新日期:1977-07-01 00:00:00

  • Creating tic suppression: comparing the effects of verbal instruction to differential reinforcement.

    abstract::The purpose of this study was to compare two methods designed to produce tic reduction in 4 children with Tourette's syndrome. Specifically, a verbal instruction not to engage in tics was compared to a verbal instruction plus differential reinforcement of zero-rate behavior (DRO). Results showed that the DRO-enhanced ...

    journal_title:Journal of applied behavior analysis

    pub_type: 杂志文章

    doi:10.1901/jaba.2004.37-417

    authors: Woods DW,Himle MB

    更新日期:2004-10-01 00:00:00

  • An evaluation of parents as behavior change agents in the Preschool Life Skills program.

    abstract::Parental involvement in intervention can support intervention efficacy, improve generalization, and increase accessibility. The Preschool Life Skills (PLS) program is designed to teach 13 preschool life skills and prevent problem behavior. The current study explores the utility of the PLS program as delivered by paren...

    journal_title:Journal of applied behavior analysis

    pub_type: 杂志文章

    doi:10.1002/jaba.660

    authors: Gunning C,Holloway J,Grealish L

    更新日期:2020-04-01 00:00:00

  • Prompted voiding to reduce incontinence in community-dwelling older adults.

    abstract::In-home caregivers were taught to implement a prompted voiding procedure with 2 older adults with cognitive impairments and urinary incontinence. Results suggested that the procedures can be implemented by family caregivers, and the intervention reduced incontinence for both participants. ...

    journal_title:Journal of applied behavior analysis

    pub_type: 杂志文章

    doi:10.1901/jaba.1997.30-153

    authors: Adkins VK,Mathews RM

    更新日期:1997-04-01 00:00:00

  • Classroom application of a trial-based functional analysis.

    abstract::We evaluated a trial-based approach to conducting functional analyses in classroom settings. Ten students referred for problem behavior were exposed to a series of assessment trials, which were interspersed among classroom activities throughout the day. Results of these trial-based functional analyses were compared to...

    journal_title:Journal of applied behavior analysis

    pub_type: 杂志文章

    doi:10.1901/jaba.2011.44-19

    authors: Bloom SE,Iwata BA,Fritz JN,Roscoe EM,Carreau AB

    更新日期:2011-04-01 00:00:00

  • Using video modeling to teach play comments to dyads with ASD.

    abstract::Individuals with autism spectrum disorder (ASD) often display deficits in social and conversational skills. One method used to improve social deficits includes video modeling. When targeting conversational skills, few studies have included individuals with ASD as conversational partners. We evaluated the effects of vi...

    journal_title:Journal of applied behavior analysis

    pub_type: 杂志文章

    doi:10.1002/jaba.621

    authors: Ezzeddine EW,DeBar RM,Reeve SA,Townsend DB

    更新日期:2020-04-01 00:00:00

  • An appointment-keeping improvement package for outpatient pediatrics: systematic replication and component analysis.

    abstract::Child health-care appointments that are not kept are an important pediatric problem. Previous research has shown that reducing effort (with a parking pass) and reminding patients (with mailed and telephone reminders) significantly improved appointment keeping for first-time and patient-scheduled appointments. This stu...

    journal_title:Journal of applied behavior analysis

    pub_type: 杂志文章

    doi:10.1901/jaba.1993.26-461

    authors: Ross LV,Friman PC,Christophersen ER

    更新日期:1993-01-01 00:00:00

  • Computerized assessment of preference for severely handicapped individuals.

    abstract::An investigation was conducted to demonstrate the application of a computerized assessment procedure for determining the preferences of persons with severe handicaps. A computer program was designed to interpret subjects' microswitch activations to produce three distinct types of events (visual, auditory, and tactile)...

    journal_title:Journal of applied behavior analysis

    pub_type: 杂志文章

    doi:10.1901/jaba.1986.19-445

    authors: Dattilo J

    更新日期:1986-01-01 00:00:00

  • Some determinants of changes in preference over time.

    abstract::Results of longitudinal studies suggest that the stability of preferences varies across individuals, although it is unclear what variables account for these differences. We extended this work by conducting periodic assessments of preference for leisure activities over 3 to 6 months with 10 adults with developmental di...

    journal_title:Journal of applied behavior analysis

    pub_type: 杂志文章

    doi:10.1901/jaba.2006.163-04

    authors: Hanley GP,Iwata BA,Roscoe EM

    更新日期:2006-07-01 00:00:00

  • Variant and invariant high-probability requests: increasing appropriate behaviors in children with emotional-behavioral disorders.

    abstract::This study examined the effects of variant versus invariant high-probability (high-p) request sequences on the performance of requests to initiate a social bid by young children with emotional-behavioral disorders. In the initial phases of the investigation, a multiple baseline design showed that the delivery of invar...

    journal_title:Journal of applied behavior analysis

    pub_type: 杂志文章

    doi:10.1901/jaba.1996.29-471

    authors: Davis CA,Reichle J

    更新日期:1996-01-01 00:00:00

  • A single-subject approach to evaluating vehicle safety belt reminders: Back to basics.

    abstract::A single-subject ABA reversal design was applied to evaluate the effectiveness of a limited 8-s safety belt reminder system and two modified reminder systems (a delayed and second reminder) to increase the safety belt use of 13 drivers. The research was conducted with a specially equipped research vehicle that permitt...

    journal_title:Journal of applied behavior analysis

    pub_type: 杂志文章

    doi:10.1901/jaba.1991.24-13

    authors: Berry TD,Geller ES

    更新日期:1991-04-01 00:00:00

  • Functional analysis of tardive dyskinesia: implications for assessment and treatment.

    abstract::We conducted an analogue functional analysis contrasting motor tasks with varying types of social consequences for movements associated with tardive dyskinesia (TD) in 2 men who had been diagnosed with developmental disabilities and TD. Our findings suggest that TD-related movements were not a function of social reinf...

    journal_title:Journal of applied behavior analysis

    pub_type: 杂志文章

    doi:10.1901/jaba.2005.53-04

    authors: Valdovinos MG,Roberts C,Kennedy CH

    更新日期:2005-07-01 00:00:00

  • Functional analysis and generalized treatment of disruptive behavior during dental exams.

    abstract::Patient disruption during dental visits can impede treatment and may result in invasive approaches to care. The current study evaluated the efficacy of graduated exposure with and without extinction to decrease disruption during dental treatment for 4 young men with autism spectrum disorder (ASD). Modified functional ...

    journal_title:Journal of applied behavior analysis

    pub_type: 杂志文章

    doi:10.1002/jaba.747

    authors: McConnell KL,Sassi JL,Carr L,Szalwinski J,Courtemanche A,Njie-Jallow F,Cheney WR

    更新日期:2020-09-01 00:00:00

  • A method for recording verbal behavior in free-play settings.

    abstract::The present study attempted to test the reliability of a new method of recording verbal behavior in a free-play preschool setting. Six children, three normal and three speech impaired, served as subjects. Videotaped records of verbal behavior were scored by two experimentally naive observers. The results suggest that ...

    journal_title:Journal of applied behavior analysis

    pub_type: 杂志文章

    doi:10.1901/jaba.1971.4-327

    authors: Nordquist VM

    更新日期:1971-01-01 00:00:00

  • An analysis of a contingency program on designated drivers at a college bar.

    abstract::The present study evaluated the effects of prompts and incentives on designated drivers in a bar. We defined the dependent variable as the percentage of customers either functioning as or riding with a designated driver. We used an ABCA design to evaluate the effectiveness of prompts and incentives on the dependent va...

    journal_title:Journal of applied behavior analysis

    pub_type: 杂志文章

    doi:10.1901/jaba.2010.43-273

    authors: Kazbour RR,Bailey JS

    更新日期:2010-07-01 00:00:00

  • Effects of bonuses for punctuality on the tardiness of industrial workers.

    abstract::This study evaluated the effectiveness of an incentive procedure designed to increase the punctuality of six workers who were chronically late to work in a manufacturing company. The six workers in the experiment received a 2.00 pesos ($0.16 U.S.) bonus for every day that they arrived on time. A reversal design was us...

    journal_title:Journal of applied behavior analysis

    pub_type: 杂志文章

    doi:10.1901/jaba.1973.6-563

    authors: Hermann JA,Montes AI,Domínguez B,Montes F,Hopkins BL

    更新日期:1973-01-01 00:00:00

  • Side effects of extinction: prevalence of bursting and aggression during the treatment of self-injurious behavior.

    abstract::Findings from basic and applied research suggest that treatment with operant extinction may produce adverse side effects; two of these commonly noted are an increase in the frequency of the target response (extinction burst) and an increase in aggression (extinction-induced aggression). Although extinction is often us...

    journal_title:Journal of applied behavior analysis

    pub_type: 杂志文章

    doi:10.1901/jaba.1999.32-1

    authors: Lerman DC,Iwata BA,Wallace MD

    更新日期:1999-04-01 00:00:00

  • Anti-litter procedures in an urban high-density area.

    abstract::In urban high-density areas, litter has become an increasingly obvious and pervasive problem. In the present study, repeated measures of the amount of litter on randomly selected yards in an urban low-income housing project were used to evaluate the effectiveness of a series of anti-litter procedures directed at the c...

    journal_title:Journal of applied behavior analysis

    pub_type: 杂志文章

    doi:10.1901/jaba.1974.7-377

    authors: Chapman C,Risley TR

    更新日期:1974-10-01 00:00:00

  • Evaluating progress in behavioral programs for children with autism spectrum disorders via continuous and discontinuous measurement.

    abstract::We evaluated the influence of two different frequencies of data collection on skill acquisition and maintenance within behavioral treatment programs for children with autism spectrum disorders. Six children were taught multiple skills in up to four different behavioral programs. Half of the skills were measured contin...

    journal_title:Journal of applied behavior analysis

    pub_type: 杂志文章

    doi:10.1901/jaba.2009.42-57

    authors: Cummings AR,Carr JE

    更新日期:2009-04-01 00:00:00

  • Effects of pay resets following drug use on attendance and hours worked in a therapeutic workplace.

    abstract::This secondary data analysis examined effects of an abstinence contingency on participation in a therapeutic workplace. Participants exposed to a pay reset after drug use did not differ in overall attendance from participants who were not exposed to a pay reset after drug use; however, they initially worked less after...

    journal_title:Journal of applied behavior analysis

    pub_type: 杂志文章

    doi:10.1002/jaba.298

    authors: Holtyn AF,Silverman K

    更新日期:2016-06-01 00:00:00

  • Effects of presession attention on the frequency of attention-maintained behavior.

    abstract::The effect of prior attention was systematically manipulated to study its influence on rates of yelling and head hitting, both maintained by positive reinforcement in the form of attention. Higher levels of head hitting occurred in analogue attention conditions when the person was deprived of attention (no social inte...

    journal_title:Journal of applied behavior analysis

    pub_type: 杂志文章

    doi:10.1901/jaba.1999.32-371

    authors: O'Reilly MF

    更新日期:1999-10-01 00:00:00

  • Effects of preference and reinforcer variation on within-session patterns of responding.

    abstract::We examined correspondence between preference assessment outcome and within-session patterns of responding in one subject with autism. Responding maintained by a single highly preferred item resulted in a greater total number of responses, a slower decline in within-session response rates, and a greater proportion of ...

    journal_title:Journal of applied behavior analysis

    pub_type: 杂志文章

    doi:10.1901/jaba.2012.45-637

    authors: Keyl-Austin AA,Samaha AL,Bloom SE,Boyle MA

    更新日期:2012-10-01 00:00:00

  • The elimination of autistic self-stimulatory behavior by overcorrection.

    abstract::No method is in general usage and of demonstrated effectiveness in eliminating the self-stimulatory behaviors of retardates and autistics. An Overcorrection rationale was used to develop such a method. The Overcorrection procedures consisted of a period of practice in the correct mode of the behavior contingent upon s...

    journal_title:Journal of applied behavior analysis

    pub_type: 杂志文章

    doi:10.1901/jaba.1973.6-1

    authors: Foxx RM,Azrin NH

    更新日期:1973-04-01 00:00:00

  • Further evaluation of response interruption and redirection as treatment for stereotypy.

    abstract::The effects of 2 forms of response interruption and redirection (RIRD)-motor RIRD and vocal RIRD-were examined with 4 boys with autism to evaluate further the effects of this intervention and its potential underlying mechanisms. In Experiment 1, the effects of motor RIRD and vocal RIRD on vocal stereotypy and appropri...

    journal_title:Journal of applied behavior analysis

    pub_type: 杂志文章

    doi:10.1901/jaba.2011.44-95

    authors: Ahrens EN,Lerman DC,Kodak T,Worsdell AS,Keegan C

    更新日期:2011-04-01 00:00:00

  • Use of escape and reward in the management of young children during dental treatment.

    abstract::A reinforced practice procedure was used to facilitate cooperative behavior in five children, aged 3 to 6 years, during dental treatment. In a multiple baseline design across subjects, the children were rewarded with escape, inexpensive stickers, and praise for cooperative behavior in the presence of the sights, sound...

    journal_title:Journal of applied behavior analysis

    pub_type: 杂志文章

    doi:10.1901/jaba.1987.20-381

    authors: Allen KD,Stokes TF

    更新日期:1987-01-01 00:00:00

  • The quantity and quality of marital interaction related to marital satisfaction: A behavioral analysis.

    abstract::An assessment instrument is presented for the evaluation of the quantity and quality of dyadic interaction, as well as for the daily recording of behaviors presented and omitted which influence marital satisfaction. Comparison of data from ten happy couples and from ten couples entering therapy indicated two distinct ...

    journal_title:Journal of applied behavior analysis

    pub_type: 杂志文章

    doi:10.1901/jaba.1979.12-665

    authors: Williams AM

    更新日期:1979-01-01 00:00:00

  • Sensory extinction and sensory reinforcement principles for programming multiple adaptive behavior change.

    abstract::The role of sensory reinforcement was examined in programming multiple treatment gains in self-stimulation and spontaneous play for developmentally disabled children. Two phases were planned. First, we attempted to identify reinforcers maintaining self-stimulation. Sensory Extinction procedures were implemented in whi...

    journal_title:Journal of applied behavior analysis

    pub_type: 杂志文章

    doi:10.1901/jaba.1979.12-221

    authors: Rincover A,Cook R,Peoples A,Packard D

    更新日期:1979-07-01 00:00:00

  • Effects of high-preference single-digit mathematics problem completion on multiple-digit mathematics problem performance.

    abstract::The purpose of this study was to examine the effects of a sequence of three single-digit (1 digit x 1 digit) multiplication problems on the latency to initiate multiple-digit (3 digit x 3 digit) multiplication problems for 2 students in an alternative education school. Data showed that (a) during the preference assess...

    journal_title:Journal of applied behavior analysis

    pub_type: 杂志文章

    doi:10.1901/jaba.1997.30-327

    authors: Belfiore PJ,Lee DL,Vargas AU,Skinner CH

    更新日期:1997-07-01 00:00:00

  • Does teaching an omnibus mand preclude the development of specifying mands?

    abstract::When problem behavior is controlled by a synthesized reinforcement contingency, a simple omnibus mand that yields access to all reinforcers simultaneously has been shown to effectively replace problem behavior. The question arises as to whether teaching an omnibus mand will preclude the acquisition of specifying mands...

    journal_title:Journal of applied behavior analysis

    pub_type: 杂志文章

    doi:10.1002/jaba.784

    authors: Ward SN,Hanley GP,Warner CA,Gage EE

    更新日期:2021-01-01 00:00:00