Influences of response rate and distribution on the calculation of interobserver reliability scores.

Abstract:

:We examined the effects of several variations in response rate on the calculation of total, interval, exact-agreement, and proportional reliability indices. Trained observers recorded computer-generated data that appeared on a computer screen. In Study 1, target responses occurred at low, moderate, and high rates during separate sessions so that reliability results based on the four calculations could be compared across a range of values. Total reliability was uniformly high, interval reliability was spuriously high for high-rate responding, proportional reliability was somewhat lower for high-rate responding, and exact-agreement reliability was the lowest of the measures, especially for high-rate responding. In Study 2, we examined the separate effects of response rate per se, bursting, and end-of-interval responding. Response rate and bursting had little effect on reliability scores; however, the distribution of some responses at the end of intervals decreased interval reliability somewhat, proportional reliability noticeably, and exact-agreement reliability markedly.

journal_name

J Appl Behav Anal

authors

Rolider NU,Iwata BA,Bullock CE

doi

10.1901/jaba.2012.45-753

subject

Has Abstract

pub_date

2012-01-01 00:00:00

pages

753-62

issue

4

eissn

0021-8855

issn

1938-3703

pii

190-12

journal_volume

45

pub_type

杂志文章
  • Rewarding psychiatric aides for the behavioral improvement of assigned patients.

    abstract::Different ways of modifying the aide-patient relationship to promote improvement in psychiatric patients were investigated. Psychiatric aides were given information about the behavior of assigned patients, cash awards based on the improvement of assigned patients, and different kinds of supervision by the psychology s...

    journal_title:Journal of applied behavior analysis

    pub_type: 杂志文章

    doi:10.1901/jaba.1973.6-383

    authors: Pomerleau OF,Bobrove PH,Smith RH

    更新日期:1973-10-01 00:00:00

  • Strategies to increase exercise-report correspondence by boys with moderate mental retardation: collateral changes in intention-exercise correspondence.

    abstract::Correspondence between verbal and nonverbal behavior in an exercise room was taught to 4 13-year-old boys diagnosed with moderate mental retardation. Participants were asked prior to each exercise session which exercise machine(s) they intended to use. No contingencies on stating intentions (promising) were applied. F...

    journal_title:Journal of applied behavior analysis

    pub_type: 杂志文章

    doi:10.1901/jaba.1992.25-681

    authors: Wilson PG,Rusch FR,Lee S

    更新日期:1992-10-01 00:00:00

  • Applying "group" contingencies to the classroom study behavior of preschool children.

    abstract::A group of 12 children were enrolled in a preschool class. During the first experimental stage they participated in special events contingent on token earning. Tokens were acquired by engaging in a variety of study behaviors. After a level of study behavior was established under this contingency, the special events we...

    journal_title:Journal of applied behavior analysis

    pub_type: 杂志文章

    doi:10.1901/jaba.1968.1-55

    authors: Bushell D,Wrobel PA,Michaelis ML

    更新日期:1968-04-01 00:00:00

  • Putative behavioral history effects and aggression maintained by escape from therapists.

    abstract::Differentially higher rates of aggression in treatment sessions occurred in the presence of two staff members who had previously worked with the participant at another facility. Adding an edible reinforcer for compliance and the absence of aggression in sessions conducted by these two staff members decreased aggressio...

    journal_title:Journal of applied behavior analysis

    pub_type: 杂志文章

    doi:10.1901/jaba.2001.34-69

    authors: Progar PR,North ST,Bruce SS,DiNovi BJ,Nau PA,Eberman EM,Bailey JR Jr,Nussbaum CN

    更新日期:2001-04-01 00:00:00

  • Instructive feedback embedded within group instruction for children diagnosed with autism spectrum disorder.

    abstract::The present study evaluated the effects of instructive feedback embedded within a group discrete trial teaching to teach tact relations to nine children diagnosed with autism spectrum disorder using a nonconcurrent multiple-baseline design. Dependent variables included correct responses for: primary targets (directly ...

    journal_title:Journal of applied behavior analysis

    pub_type: 杂志文章

    doi:10.1002/jaba.375

    authors: Leaf JB,Cihon JH,Alcalay A,Mitchell E,Townley-Cochran D,Miller K,Leaf R,Taubman M,McEachin J

    更新日期:2017-04-01 00:00:00

  • Generalization and maintenance of preschool children's social skills: a critical review and analysis.

    abstract::This paper summarizes the results of a retrospective review of generalization in the context of social skills research with preschool children. A review of studies from 22 journals (1976 to 1990) that assessed generalization as part of social interaction research provided information concerning the prevalence of studi...

    journal_title:Journal of applied behavior analysis

    pub_type: 杂志文章,评审

    doi:10.1901/jaba.1992.25-415

    authors: Chandler LK,Lubeck RC,Fowler SA

    更新日期:1992-07-01 00:00:00

  • Functional analysis and treatment of the delusional statements of a man with multiple disabilities: a four-year follow-up.

    abstract::Although delusional statements in people with intellectual disabilities and traumatic brain injury can be treated using behavioral interventions, none have demonstrated long-term treatment effects. In the current study, a functional analysis demonstrated that delusional statements were maintained by attention. Differe...

    journal_title:Journal of applied behavior analysis

    pub_type: 杂志文章

    doi:10.1901/jaba.2010.43-745

    authors: Travis R,Sturmey P

    更新日期:2010-01-01 00:00:00

  • Training elementary aged peer behavior managers to control small group programmed mathematics.

    abstract::The effects of a training procedure and two maintenance contingencies on consequence-dispensing behavior were investigated. Four peer behavior managers were trained to supervise small groups of subjects (four to six per group) working in programmed math materials and were compared with a teacher skilled in the use of ...

    journal_title:Journal of applied behavior analysis

    pub_type: 杂志文章

    doi:10.1901/jaba.1974.7-103

    authors: Greenwood CR,Sloane HN,Baskin A

    更新日期:1974-04-01 00:00:00

  • Effects of a multifaceted training procedure on the social behaviors of hearing-impaired children with severe language disabilities: a replication.

    abstract::The effectiveness of a training package on the social behaviors of 20 hearing-impaired children with severe language disabilities was assessed. The package consisted of initial instruction in role-play situations, reinforcement of appropriate instances of the behaviors, and a correction procedure following inappropria...

    journal_title:Journal of applied behavior analysis

    pub_type: 评论,杂志文章

    doi:10.1901/jaba.1993.26-405

    authors: Rasing EJ

    更新日期:1993-10-01 00:00:00

  • Longitudinal analysis of leisure-item preferences.

    abstract::Twenty-two individuals with developmental disabilities participated in two leisure-item preference assessments, spaced approximately 16 months apart. Results showed (a) an overall increase in item contact across assessments for 13 participants and (b) at least some overlap across assessments in the five most highly ra...

    journal_title:Journal of applied behavior analysis

    pub_type: 杂志文章

    doi:10.1901/jaba.2001.34-179

    authors: Zhou L,Iwata BA,Goff GA,Shore BA

    更新日期:2001-07-01 00:00:00

  • Effects of contextual competence on social initiations.

    abstract::The frequency of social initiations and satisfaction with interactions in three dyads, each consisting of 1 student with disabilities and 1 nondisabled peer, were assessed under two alternating conditions: Condition 1 assessed the interactions around a set of four trained computer games, and Condition 2 assessed inter...

    journal_title:Journal of applied behavior analysis

    pub_type: 杂志文章

    doi:10.1901/jaba.1991.24-337

    authors: Breen CG,Haring TG

    更新日期:1991-07-01 00:00:00

  • Side effects of extinction: prevalence of bursting and aggression during the treatment of self-injurious behavior.

    abstract::Findings from basic and applied research suggest that treatment with operant extinction may produce adverse side effects; two of these commonly noted are an increase in the frequency of the target response (extinction burst) and an increase in aggression (extinction-induced aggression). Although extinction is often us...

    journal_title:Journal of applied behavior analysis

    pub_type: 杂志文章

    doi:10.1901/jaba.1999.32-1

    authors: Lerman DC,Iwata BA,Wallace MD

    更新日期:1999-04-01 00:00:00

  • Teaching coin equivalence to the mentally retarded.

    abstract::A program was designed to teach coin equivalence to mentally retarded adolescents. Coin equivalence was defined as choosing several different combinations of coins to equal specified target values. A pretest-posttest matched-groups design was employed with an experimental group receiving the monetary training, and a n...

    journal_title:Journal of applied behavior analysis

    pub_type: 杂志文章

    doi:10.1901/jaba.1977.10-85

    authors: Trace MW,Cuvo AJ,Criswell JL

    更新日期:1977-04-01 00:00:00

  • An analysis-of-variance model for the intrasubject replication design.

    abstract::One- and two-way analysis-of-variance procedures are shown logically to be appropriate for testing hypotheses in successive treatment reversal designs for one-subject and N-subject experiments, respectively. The applicability of these designs is demonstrated through analyses of typical data. ...

    journal_title:Journal of applied behavior analysis

    pub_type: 杂志文章

    doi:10.1901/jaba.1972.5-193

    authors: Gentile JR,Roden AH,Klein RD

    更新日期:1972-07-01 00:00:00

  • Training parent implementation of discrete-trial teaching: effects on generalization of parent teaching and child correct responding.

    abstract::Behavioral skills training was used to teach 3 parents to implement discrete-trial teaching with their children with developmental disabilities. Parents learned to implement discrete-trial training, their skills generalized to novel programs, and the children's correct responding increased, suggesting that behavioral ...

    journal_title:Journal of applied behavior analysis

    pub_type: 杂志文章

    doi:10.1901/jaba.2007.685-689

    authors: Lafasakis M,Sturmey P

    更新日期:2007-01-01 00:00:00

  • Equivalence class formation: a method for teaching statistical interactions.

    abstract::Many students struggle with statistical concepts such as interaction. In an experimental group, participants took a paper-and-pencil test and then were given training to establish equivalent classes containing four different statistical interactions. All participants formed the equivalence classes and showed maintenan...

    journal_title:Journal of applied behavior analysis

    pub_type: 杂志文章

    doi:10.1901/jaba.2009.42-575

    authors: Fields L,Travis R,Roy D,Yadlovker E,de Aguiar-Rocha L,Sturmey P

    更新日期:2009-10-01 00:00:00

  • An experimental analysis of "spillover" effects on the social interaction of behaviorally handicapped preschool children.

    abstract::The effects of prompting and social reinforcement directed to target subjects on their social behavior and that of peers who never received prompting and reinforcement for positive social behavior, were examined. In a combined reversal and multiple-baseline design, three behaviorally handicapped preschool boys who exh...

    journal_title:Journal of applied behavior analysis

    pub_type: 杂志文章

    doi:10.1901/jaba.1976.9-31

    authors: Strain PS,Shores RE,Kerr MM

    更新日期:1976-04-01 00:00:00

  • Within-subject analysis of a prevention strategy for problem behavior.

    abstract::Although decades of research on functional analysis methodology have identified common contingencies that maintain problem behavior and effective interventions, relatively little research has been conducted on strategies to prevent the initial development of problem behavior. We conducted a 2-part case study, the purp...

    journal_title:Journal of applied behavior analysis

    pub_type: 杂志文章

    doi:10.1002/jaba.343

    authors: Fahmie TA,Iwata BA,Mead SC

    更新日期:2016-12-01 00:00:00

  • Teaching job independence and flexibility to mentally retarded students through the use of a self-control package.

    abstract::We examined mentally retarded individuals' use of picture cues and self-monitoring to initiate a series of tasks of varying type and order. Four severely to moderately retarded high school students participating in a vocational training program were trained to use a picture-cue system. The system consisted of photogra...

    journal_title:Journal of applied behavior analysis

    pub_type: 杂志文章

    doi:10.1901/jaba.1985.18-81

    authors: Sowers J,Verdi M,Bourbeau P,Sheehan M

    更新日期:1985-04-01 00:00:00

  • Internet-based contingency management increases walking in sedentary adults.

    abstract::Despite the link between inactivity and premature mortality, most adults exercise less than the Centers for Disease Control and Prevention (2008) recommends; thus, interventions to increase exercise are needed. The present study employed an Internet-based intervention to increase walking in 12 sedentary adults over 50...

    journal_title:Journal of applied behavior analysis

    pub_type: 杂志文章

    doi:10.1002/jaba.58

    authors: Kurti AN,Dallery J

    更新日期:2013-10-01 00:00:00

  • An evaluation of praise as a reinforcer for preschoolers' behavior.

    abstract::Behavior analysts and educators often recommend using praise, particularly descriptive praise, despite mixed empirical findings to support this recommendation. We evaluated the effectiveness of praise as a reinforcer during a reinforcer assessment using known tasks with preschoolers in Experiment 1. Praise functioned ...

    journal_title:Journal of applied behavior analysis

    pub_type: 杂志文章

    doi:10.1002/jaba.591

    authors: Senn LP,Bayles MW,Bruzek JL

    更新日期:2020-01-01 00:00:00

  • Effects of internet-based voucher reinforcement and a transdermal nicotine patch on cigarette smoking.

    abstract::Nicotine replacement products are commonly used to promote smoking cessation, but alternative and complementary methods may increase cessation rates. The current experiment compared the short-term effects of a transdermal nicotine patch to voucher-based reinforcement of smoking abstinence on cigarette smoking. Fourtee...

    journal_title:Journal of applied behavior analysis

    pub_type: 杂志文章,随机对照试验

    doi:10.1901/jaba.2007.40-1

    authors: Glenn IM,Dallery J

    更新日期:2007-04-01 00:00:00

  • The effect of incongruent instructions and consequences on imitation in retarded children.

    abstract::Three retarded boys served as subjects in a 13-phase experiment. In eight of these phases, the instructions administered by the experimenter before demonstrating a behavior and the consequences for imitative behavior were incongruent (the consequences were not those indicated by the instructions). Consequences rather ...

    journal_title:Journal of applied behavior analysis

    pub_type: 杂志文章

    doi:10.1901/jaba.1972.5-467

    authors: Martin JA

    更新日期:1972-01-01 00:00:00

  • Analysis of establishing operations for self-injury maintained by escape.

    abstract::Self-injurious behavior (SIB) can be maintained through negative reinforcement when, in the context of training or task requirements, it produces escape as a consequence. Several studies have demonstrated methods for identifying and treating SIB maintained by negative reinforcement; however, few analyses of the establ...

    journal_title:Journal of applied behavior analysis

    pub_type: 杂志文章

    doi:10.1901/jaba.1995.28-515

    authors: Smith RG

    更新日期:1995-01-01 00:00:00

  • Social validity assessments: is current practice state of the art?

    abstract::The use of evaluative feedback from consumers to guide program planning and evaluation is often referred to as the assessment of social validity. Differing views of its role and value in applied behavior analysis have emerged, and increasingly stereotyped assessments of social validity are becoming commonplace. This p...

    journal_title:Journal of applied behavior analysis

    pub_type: 杂志文章,评审

    doi:10.1901/jaba.1991.24-189

    authors: Schwartz IS,Baer DM

    更新日期:1991-07-01 00:00:00

  • Assessment of smoking behavior.

    abstract::The nature of smoking risk is first reviewed and a classification of procedures for assessing smoking behavior is presented. Areas requiring assessment include not only the traditionally measured smoking rate, but also the substance used and topography of consumption. Each of these areas may be assessed through a vari...

    journal_title:Journal of applied behavior analysis

    pub_type: 杂志文章

    doi:10.1901/jaba.1979.12-653

    authors: Frederiksen LW,Martin JE,Webster JS

    更新日期:1979-01-01 00:00:00

  • Evaluation of the accuracy, reliability, efficiency, and acceptability of fast forwarding to score problem behavior.

    abstract::Technological advances have allowed professionals to obtain extended recordings of caregiver-client interactions in natural settings, but scoring recorded video at normal speed to identify instances of low-rate problem behavior is impractical in terms of scoring time. Fast forwarding is a continuous measurement system...

    journal_title:Journal of applied behavior analysis

    pub_type: 杂志文章

    doi:10.1002/jaba.510

    authors: Machado MA,Luczynski KC,Hood SA

    更新日期:2019-02-01 00:00:00

  • Effects of active student response during error correction on the acquisition, maintenance, and generalization of sight words by students with developmental disabilities.

    abstract::We used an alternating treatments design to compare the effects of active student response error correction and no-response error correction during sight word instruction. Six students with developmental disabilities were provided one-to-one daily sight word instruction on eight sets of 20 unknown words. Each set of 2...

    journal_title:Journal of applied behavior analysis

    pub_type: 临床试验,杂志文章,随机对照试验

    doi:10.1901/jaba.1993.26-111

    authors: Barbetta PM,Heron TE,Heward WL

    更新日期:1993-04-01 00:00:00

  • Generalization of negatively reinforced mands in children with autism.

    abstract::Each day, people encounter stimuli they find unpleasant. Some children with autism may require systematic instruction to acquire the communication skills necessary to request the termination of such aversive stimuli. We taught 2 school-aged boys with autism a mand (e.g., signing "stop") that could be used to escape a ...

    journal_title:Journal of applied behavior analysis

    pub_type: 杂志文章

    doi:10.1002/jaba.151

    authors: Groskreutz NC,Groskreutz MP,Bloom SE,Slocum TA

    更新日期:2014-10-01 00:00:00

  • Sequential evaluation of behavioral treatments and methylphenidate dosage for children with attention deficit hyperactivity disorder.

    abstract::We used a sequential approach to evaluate the relative and combined effects of different types of behavioral treatments, as well as dosage of methylphenidate (MPH), on the disruptive behavior of 3 students who had been diagnosed with attention deficit hyperactivity disorder. Results showed that individualized behavior...

    journal_title:Journal of applied behavior analysis

    pub_type: 临床试验,杂志文章,随机对照试验

    doi:10.1901/jaba.2003.36-375

    authors: Gulley V,Northup J,Hupp S,Spera S,LeVelle J,Ridgway A

    更新日期:2003-10-01 00:00:00