Operant Conditioning PDF

Learning part 2 { Operant Conditioning: Learning { What Does What to What? Or Increasing & Decreasing Behaviour  Develops radical behaviourism:  Free will is an illusion  Studied public, observable events (as opposed to private, internal events)  Psychology could underst...

Learning part 2 { Operant Conditioning: Learning { What Does What to What? Or Increasing & Decreasing Behaviour  Develops radical behaviourism:  Free will is an illusion  Studied public, observable events (as opposed to private, internal events)  Psychology could understand and predict behaviour without resorting to internal or physiological explanations Behaviourism: B.F. Skinner   Sometimes, the things we do lead to certain consequences  Theses consequences may impact the chances that we will perform that behaviour again Consequences of behaviour  https://www.yout ube.com/watch? v=PQtDTdDr8vs https://www.yout ube.com/watch? v=xt-ycTMISwg https://www.yout ube.com/watch? v=vGazyH6fQQ4 Rat in a Skinner Box 5   All behaviour has consequences.  We learn from the consequences of our actions.  Some consequences increase the likelihood of the behaviour that caused them.  Some consequences decrease the likelihood of the behaviour that caused them.  https://www.youtube.com/watch?v=5XUvm_smWHY Operant Conditioning  Some consequences increase the likelihood of the behaviour that caused them.  Organisms tend to repeat behaviour that leads to desirable outcomes Reinforcement E.g. , You are 4. You scream for candy in line at the supermarket. Your mother buys you candy. You stop screaming. Next time you are in line at the supermarket, you scream for candy again.  Behaviour: screaming  Consequence: kid gets candy  Since kid likes candy, this reinforces* screaming behaviour *reinforces = increases the likelihood of Reinforcement (Examples)  Another way to look at this… Reinforcement (Examples) E.g. , You are a mom. Your 4 yr old kid screams for candy and causes a scene everytime you’re in line at the supermarket. You buy kid candy. Kid stops screaming. Next time kid starts screaming, you give kid candy again.  Behaviour: give kid candy  Consequence: kid stops screaming  You really hate the screaming. Since kid stops screaming, this reinforces* candy giving behaviour *reinforces = increases the likelihood of Reinforcement (Examples) The above examples nicely illustrate the two types of reinforcement:  Positive reinforcement  Something added increases the likelihood of behaviour (e.g. candy)  Negative reinforcement  Something removed increases the likelihood of behaviour (e.g. screaming stopped) Reinforcement  Reinforcer is any stimulus that increases the probability that responses preceding it will be repeated  Positive reinforcer  Increase probability that behaviour will occur when it is added  Negative reinforcer  Increase probability that behaviour will occur when it is removed Types of Reinforcements 12 13  Positive always means something added Negative always means something removed or taken away In operant conditioning… Reinforcement always increases the likelihood of the behaviour E.g., increases candy giving behaviour (+) E.g., increases chances kid will stop screaming (-) Punishment always decreases the likelihood of the behaviour… In operant conditioning…  Some consequences decrease the likelihood of the behaviour that caused them.  Organisms tend not to repeat behaviour that leads to negative or neutral outcomes (punishment) Punishment E.g. , You are 4. You like sneaking into your sister’s room and drawing in her diary with your crayons. Next time she catches you, she soaks you with a watergun. You stop drawing in her diary.  Behaviour: drawing in her diary  Consequence: get sprayed with supersoaker  Since you don’t like being soaked, this punishes* diary drawing behaviour behaviour *punishess = decreases the likelihood of Punishment (Examples)   Positive punishment? Something added decreases the likelihood of the behaviour OR  Negative punishment?  Something taken away decreases the likelihood of the behaviour Is this an example of…  Or consider the following scenario… Punishment (Examples) E.g. , You are 4. You like sneaking into your sister’s room and drawing in her diary with your crayons. Every time she catches you, she goes into your room and takes one of your beloved stuff toys and locks them in her closet. You stop drawing in her diary.  Behaviour: drawing in her diary  Consequence: Fluffy gets taken away.  Since you don’t like losing your stuffies, this punishes* diary drawing behaviour behaviour *punishess = decreases the likelihood of Punishment (Examples)   Positive punishment? Something added decreases the likelihood of the behaviour OR  Negative punishment?  Something taken away decreases the likelihood of the behaviour Is this an example of… ‘Dude, what dog??’ More operant conditioning concepts… { Immediate & Delayed Primary & Secondary   For convenience, we’ll talk about these in terms of reinforcers  These principles apply to punishments too Immediate & Delayed Primary & Secondary Immediate versus Delayed  Immediate – consequences follow behaviour in very short space of time  Delayed – Longer time interval between behaviour and consequence  Immediate reinforcers are more effective than delayed  Short-term consequences are more of incentive than long-term 26 Primary and Secondary Primary reinforcers  Instinctual and unlearned  are inherent to the organism’s biological makeup that fulfills basic survival needs  E.g., food, water, shelter, relieving pain 27 Primary and Secondary Secondary reinforcers  Learned  We learn to associate neutral stimulus with reinforcement  Stimuli acquire value through association with established reinforcers  Conditioned reinforcers  Money – learn it may be exchanged for primary reinforcer 28 Extinction and Spontaneous Recovery in Operant Conditioning  Extinction  Learned responses are extinguished after repeated performance without reinforcement  Spontaneous Recovery  Occurs as a function of time 29 Let’s return to our Skinner box  Rat has learned that pressing lever (behaviour) will lead to delivery of food pellet (reinforcement) Schedules of Reinforcement  Consequences can be continuous or partial Continuous reinforcement  Happens every time behaviour is displayed  Most rapid acquisition  Most easily extinguished Partial reinforcement  Happens, but not every time  4 kinds of partial reinforcement Schedules of Reinforcement 31  Four types:  Fixed ratio schedule  Variable ratio schedule  Fixed interval schedule  Variable interval schedule Let’s start with some definitions… Schedules of Reinforcement Interval always refers to time e.g., the number of seconds/minutes/hours between behaviour and reinforcement Ratio always refers to number of responses e.g., the number of responses that must take place before reinforcement will occur Schedules of Reinforcement Fixed means the same number every occasion  E.g., reinforcement occurs  After every 5 seconds (fixed interval)  After every 5 responses (fixed ratio) Variable means a changing or different number on each occasion  E.g., reinforcement occurs  After 4 seconds, next after 6, next after 5 (variable interval)  After 4 responses, next after 6, next after 5 (variable ratio) Schedules of Reinforcement  Schedules of Reinforcement Fixed-interval schedule  The reinforcer is given following the first correct response after a fixed amount of time  Response rate falls off after each reinforcement and then picks up as reinforcer approaches Variable-interval schedule  Unpredictable time elapses  The reinforcer is given following the first correct response on the basis of an average amount of time  (3 seconds this time, 7 seconds next time, 5 seconds the time after)  Steadier but lower response rate (than fixed-interval) 35 Schedules of Reinforcement Fixed-ratio schedule  The reinforcer is given after a fixed number of correct responses  High response rate; higher immediately after reinforcement Variable-ratio schedule  The reinforcer is given after an unpredictable number of correct responses (based on an average ratio)  Highest response rate (VLTs) 36 Shaping OR teaching your pigeon to play piano  Reinforce progressive steps toward the behavioural goal  As training proceeds, reinforce successive approximations of the goal 37 Applications of Operant Conditioning  Check out Mod 5D: Behaviour Modification 38 Review video for classical & operant conditioing { https://www.youtube.com/watch?v=H6LEcM0E0i o Cognitive Factors in Learning { Cognitive Learning Latent Learning and Cognitive Maps Observational Learning  Rote learning:  Takes place mechanically, through repetition and memorization, or by learning a set of rules Discovery learning  Based on insight and understanding Question: Does it make a difference? Cognitive Learning Copyright © 2016 by Nelson Education Ltd. Latent Learning and Cognitive Maps  Edward Tolman  Rats formed a cognitive map  Learning was hidden, or latent, until food motivated them 42  Cognitive maps  Internal representation of an area Latent learning  Occurs without obvious reinforcement and is not demonstrated until reinforcement is provided The maze used by Tolman and Honzik to demonstrate latent learning by rats. Associative Learning  Results of the experiment:  Notice the rapid improvement in performance that occurred when food was made available to the previously unreinforced animals.  This indicates that learning had occurred but that it remained hidden or unexpressed. Latent learning and cognitive maps   Acquire skills by observing others (Bandura)  Can occur without overt responses  Paying attention to the behaviour is sufficient  Learning may be latent  Model – person who engages in response that is imitated  Vicarious reinforcement Observational Learning 45  Bandura and colleagues classic study of media violence – Bobo and preschool children  Children who saw aggressive model showed significantly more aggressive behaviour toward the doll themselves  http://www.youtube.com/watch?v=xfG55uY2NS U&feature=related Learning Violence and Aggression: The Bobo Doll 46 Experiments https://www.youtube.com /watch?v=XHIhkM1cAv4 A youtube clip on the Bobo doll experiment