Signal probability, reinforcement and signal detection.

Abstract:

:Five pigeons were trained to detect differences in light intensity. Two stimuli, S1 and S2, differing in intensity, were arranged on the center key of a three-key chamber according to set probabilities. A peck on the center key turned on the two side keys. When S1 was presented on the center key, a peck on the left key was "correct" and when S2 was presented, a peck on the right key was "correct." Correct responses produced reinforcement and incorrect responses produced 3-second blackout. Detection performance was measured under three procedures. The first was a standard signal-detection design in which the probability of S1 was varied and the number of reinforcements obtained for correct responses to S1 was allowed to covary. In the second procedure, the probability of S1 was again varied but the distribution of reinforcements between the two choices was kept equal. In the third procedure, probability of S1 was held constant while the distribution of reinforcements was varied between the two choices. Changes in response bias were a function of variations in the relative reinforcement ratio for the choice responses and not a function of variations in the probability of stimulus presentation. Discriminability remained constant across the three procedures.

journal_name

J Exp Anal Behav

authors

McCarthy D,Davison M

doi

10.1901/jeab.1979.32-373

subject

Has Abstract

pub_date

1979-11-01 00:00:00

pages

373-86

issue

3

eissn

0022-5002

issn

1938-3711

journal_volume

32

pub_type

杂志文章
  • Reinforcement of variability facilitates learning in humans.

    abstract::Studies with rats and pigeons showed that reinforcement of response variability improved learning of difficult response sequences. The results suggested that concurrent reinforcement of variability might be a helpful tool when educators or therapists attempt to teach individuals with learning difficulties. However, si...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1002/jeab.475

    authors: Hansson J,Neuringer A

    更新日期:2018-11-01 00:00:00

  • Signal detection methods for measurement of utility in animals.

    abstract::Analytic methods of signal detection theory were employed to assess the utility of reinforcers. Four pigeons were trained to detect the presence or absence of a stimulus by pecking one of two side keys in a trial-by-trial choice paradigm. The relative rate of positive reinforcement for correct choices was varied to of...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.1974.21-373

    authors: Wright AA,Nevin JA

    更新日期:1974-03-01 00:00:00

  • Stimulus control of skin resistance responses on an escape-avoidance schedule.

    abstract::The effects of discrimination and avoidance training on the skin resistance response were studied in eight humans. Responses occurring during one stimulus delayed the interruption of music for 30 sec; responses during a second stimulus either had no effect or interrupted the music for 15 sec. The results showed stimul...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.1971.16-269

    authors: Greene WA,Sutor LT

    更新日期:1971-09-01 00:00:00

  • The role of the response-reinforcer contingency in negative automaintenance.

    abstract::When a response key is briefly illuminated before a grain reinforcer is presented, key pecking is reliably developed and maintained in pigeons, even if pecking prevents reinforcement (negative automaintenance). This experiment demonstrated that pigeons are sensitive to a negative response-reinforcer contingency, even ...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.1972.17-351

    authors: Schwartz B,Williams DR

    更新日期:1972-05-01 00:00:00

  • Accuracy of discrimination, rate of responding, and resistance to change.

    abstract::Pigeons were trained on multiple schedules in which responding on a center key produced matching-to-sample trials according to the same variable-interval 30-s schedules in both components. Matching trials consisted of a vertical or tilted line sample on the center key followed by vertical and tilted comparisons on the...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.2003.79-307

    authors: Nevin JA,Milo J,Odum AL,Shahan TA

    更新日期:2003-05-01 00:00:00

  • A comparison of variable-ratio and variable-interval schedules of reinforcement.

    abstract::Four pigeons responded under a two-component multiple schedule of reinforcement. Responses were reinforced in one component under a variable-ratio schedule and in the other component under a variable-interval schedule. It was found that when rates of reinforcement were equal in the two components, the rate of response...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.1970.13-369

    authors: Zuriff GE

    更新日期:1970-05-01 00:00:00

  • Some conditions affecting the choice to cooperate or compete.

    abstract::Three experiments investigated conditions affecting the choice to cooperate or compete. Experiment I compared the effects first of an individual activity, then of a competitive task as an alternative to cooperation. For both comparisons, subjects could earn more by cooperating. Choice of competition, but not individua...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.1976.25-165

    authors: Schmitt DR

    更新日期:1976-03-01 00:00:00

  • Prisoner's dilemma and the pigeon: Control by immediate consequences.

    abstract::In three experiments pigeons played (i.e., chose between two colored keys) iterated prisoner's dilemma and other 2 x 2 games (2 participants and 2 options) against response strategies programmed on a computer. Under the prisoner's dilemma pay-off matrix, the birds generally defected (i.e., pecked the color associated ...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.1995.64-1

    authors: Green L,Price PC,Hamburger ME

    更新日期:1995-07-01 00:00:00

  • Unit price and choice in a token-reinforcement context.

    abstract::Pigeons were exposed to multiple and concurrent second-order schedules of token reinforcement, with stimulus lights serving as token reinforcers. Tokens were produced and exchanged for food according to various fixed-ratio schedules, yielding equal and unequal unit prices (responses per unit food delivery). On one sch...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.2004.81-5

    authors: Foster TA,Hackenberg TD

    更新日期:2004-01-01 00:00:00

  • Roger T. Kelleher, behavior analyst.

    abstract::Roger T. Kelleher, rightly known as one of the foremost contributors to behavioral pharmacology, also made many important contributions to the experimental analysis of behavior. He participated significantly in the development of the discipline, through both his research and his editorial contributions to thisjournal....

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 传,历史文章,杂志文章

    doi:10.1901/jeab.2006.25-06

    authors: Branch MN

    更新日期:2006-11-01 00:00:00

  • Effects on spelling of training children to read.

    abstract::Experiment 1 investigated whether training subjects to read words aloud would induce correct written spelling of the words even though spelling had no experimental consequences. Training in reading was followed by a weak increment in correct spelling. Experiment 2 investigated whether overtraining in reading would imp...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.1982.37-311

    authors: Lee VL,Pegler AM

    更新日期:1982-03-01 00:00:00

  • Contingency discriminability and peak shift in concurrent schedules.

    abstract::We investigated the effects of discriminative stimuli on choice in a highly variable environment using a procedure in which multiple two-key concurrent VI VI components changed every 10 reinforcers and were signaled by differential flashes of red and yellow keylights. Across conditions, five pigeons were exposed to a ...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.2006.11-05

    authors: Krägeloh CU,Elliffe DM,Davison M

    更新日期:2006-07-01 00:00:00

  • Early extinction effects following intermittent reinforcement: Little evidence of extinction bursts.

    abstract::The occurrence of extinction bursts-transient increases in response rate in excess of those observed in baseline during the period immediately following discontinuation of reinforcement of a response-was examined. In Experiment 1, key pecking of pigeons was reinforced according to a multiple schedule in which a variab...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1002/jeab.616

    authors: Lattal KA,Kuroda T,Cook JE

    更新日期:2020-07-01 00:00:00

  • Auto-maintenance in the pigeon: sustained pecking despite contingent non-reinforcement.

    abstract::If a response key is regularly illuminated for several seconds before food is presented, pigeons will peck it after a moderate number of pairings; this "auto-shaping" procedure of Brown and Jenkins (1968) was explored further in the present series of four experiments. The first showed that pecking was maintained even ...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.1969.12-511

    authors: Williams DR,Williams H

    更新日期:1969-07-01 00:00:00

  • Stochastic choice models: A comparison between Bush-Mosteller and a source-independent reward-following model.

    abstract::Horner and Staddon (1987) argued that a class of reward-following processes defined by a property they termed ratio invariance is a better model for the probabilistic choice performance of pigeons than competing molecular accounts such as momentary maximizing, melioration, and the Bush-Mosteller model. The critical da...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.1989.52-57

    authors: Staddon JE,Horner JM

    更新日期:1989-07-01 00:00:00

  • Human coffee drinking: manipulation of concentration and caffeine dose.

    abstract::In a residential research ward coffee drinking was studied in 9 volunteer human subjects with histories of heavy coffee drinking. A series of five experiments was undertaken to characterize adlibitum coffee consumption and to investigate the effects of manipulating coffee concentration, caffeine dose per cup, and caff...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 临床试验,杂志文章,随机对照试验

    doi:10.1901/jeab.1986.45-133

    authors: Griffiths RR,Bigelow GE,Liebson IA,O'Keeffe M,O'Leary D,Russ N

    更新日期:1986-03-01 00:00:00

  • The influence of ultraviolet radiation on the pigeon's color discrimination.

    abstract::Two experiments demonstrated the pigeon's sensitivity to ultraviolet light. In Experiment I, pigeons' responses were reinforced on a multiple schedule with a variable-interval reinforcement schedule in one component and extinction in the other component. Response rates were quite different in the two components where ...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.1972.17-325

    authors: Wright AA

    更新日期:1972-05-01 00:00:00

  • Social learning by following: an analysis.

    abstract::Learning by "following", probably a common means by which behaviors are socially transmitted from adults to young in many species, was analyzed. Pigeons first learned to eat from a human hand. When the hand then approached an operant key and pecked it, the pigeons followed and quickly learned to do the same, thereby d...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.1977.27-127

    authors: Bullock D,Neuringer A

    更新日期:1977-01-01 00:00:00

  • Do adjusting-amount and adjusting-delay procedures produce equivalent estimates of subjective value in pigeons?

    abstract::The current experiment examined whether adjusting-amount and adjusting-delay procedures provide equivalent measures of discounting. Pigeons' discounting on the two procedures was compared using a within-subject yoking technique in which the indifference point (number of pellets or time until reinforcement) obtained wi...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.2007.37-06

    authors: Green L,Myerson J,Shah AK,Estle SJ,Holt DD

    更新日期:2007-05-01 00:00:00

  • The Wyckoff observing response-a reappraisal.

    abstract::Pigeons were trained on a Wyckoff observing response procedure in which key responses were reinforced on a mixed schedule consisting of fixed-interval and extinction components. In Experiment 1, stepping on a pedal (a) converted the mixed schedule to a multiple schedule, (b) replaced the mixed-schedule stimulus with a...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.1972.18-263

    authors: Hirota TT

    更新日期:1972-09-01 00:00:00

  • Combinations of response-reinforcer relations in periodic and aperiodic schedules.

    abstract::Key pecking of 4 pigeons was studied under a two-component multiple schedule in which food deliveries were arranged according to a fixed and a variable interfood interval. The percentage of response-dependent food in each component was varied, first in ascending (0, 10, 30, 70 and 100%) and then in descending orders, ...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1002/jeab.13

    authors: Kuroda T,Cançado CR,Lattal KA,Elcoro M,Dickson CA,Cook JE

    更新日期:2013-03-01 00:00:00

  • Schedules of electric shock presentation in the behavioral control of imprinted ducklings.

    abstract::The behavioral effects of various schedules of electric shock presentation were investigated during and after the imprinting of Peking ducklings to moving stimuli. The behavior of following a moving imprinted stimulus was differentially controlled by a multiple schedule of punishment and avoidance that respectively su...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.1972.18-305

    authors: Barrett JE

    更新日期:1972-09-01 00:00:00

  • Controls for and constraints on auto-shaping.

    abstract::Auto-shaping the pigeon's key-peck response was examined as a respondent conditioning procedure with the use of Rescorla's truly-random control procedure. In the first experiment, pigeons received presentations of brief light on the response key and brief presentations of food where the light and the food were indepen...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.1973.20-323

    authors: Bilbrey J,Winokur S

    更新日期:1973-11-01 00:00:00

  • Delayed stimulus control: recall for single and relational stimuli.

    abstract::In a discrete-trial symbolic matching-to-sample procedure, pigeons' left-key responses were reinforced following presentation of one center-key sample, and right-key responses were reinforced following presentation of another. Recallability was measured by the difference between log ratios of left to right responses f...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.1982.38-305

    authors: White KG,McKenzie J

    更新日期:1982-11-01 00:00:00

  • The stay/switch model of concurrent choice.

    abstract::This experiment compared descriptions of concurrent choice by the stay/switch model, which says choice is a function of the reinforcers obtained for staying at and for switching from each alternative, and the generalized matching law, which says choice is a function of the total reinforcers obtained at each alternativ...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.2009.91-21

    authors: MacDonall JS

    更新日期:2009-01-01 00:00:00

  • Effects of reinforcer magnitude on responding under differential-reinforcement-of-low-rate schedules of rats and pigeons.

    abstract::Experiment I investigated the effects of reinforcer magnitude on differential-reinforcement-of-low-rate (DRL) schedule performance in three phases. In Phase 1, two groups of rats (n = 6 and 5) responded under a DRI. 72-s schedule with reinforcer magnitudes of either 30 or 300 microl of water. After acquisition, the wa...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.2002.78-17

    authors: Doughty AH,Richards JB

    更新日期:2002-07-01 00:00:00

  • Choice, changeover, and travel: A quantitative model.

    abstract::Six pigeons were trained on concurrent variable-interval schedules in which responding on fixed-interval schedules was required to give access to the alternate schedule. Responding on the concurrent schedules was not allowed, after changing over had commenced, until the changeover schedule had been completed. In Parts...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.1991.55-47

    authors: Davison M

    更新日期:1991-01-01 00:00:00

  • Preference for free or forced choice in Sumatran orangutans (Pongo abelii).

    abstract::Empirical investigations of humans, pigeons, rats, and monkeys have indicated that these species will select free over forced choice, even when faced with identical outcomes. However, the same has yet to be quantitatively confirmed in nonhuman great apes. This experiment is the first systematic investigation of prefer...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1002/jeab.584

    authors: Ritvo SE,MacDonald SE

    更新日期:2020-03-01 00:00:00

  • Classical avoidance without a warning stimulus.

    abstract::White rats were scheduled to be shocked every 15 sec; but they were given a limited time interval between shocks when they could prevent the next scheduled shock from occurring if they pressed a lever. The duration of this limited avoidance period was varied, as was its location within the interval between scheduled s...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.1962.5-97

    authors: SIDMAN M

    更新日期:1962-01-01 00:00:00

  • Temporal framing and the hidden-zero effect: rate-dependent outcomes on delay discounting.

    abstract::Recent research suggests that presenting time intervals as units (e.g., days) or as specific dates, can modulate the degree to which humans discount delayed outcomes. Another framing effect involves explicitly stating that choosing a smaller-sooner reward is mutually exclusive to receiving a larger-later reward, thus ...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1002/jeab.328

    authors: Naudé GP,Kaplan BA,Reed DD,Henley AJ,DiGennaro Reed FD

    更新日期:2018-05-01 00:00:00