The Whys and Hows of Behavior Modification
The following article was written by Dr. Melissa Bain, DMV, DACVM
University of California School of Veterinary Medicine, Clinical Animal Behavior Program
“My dog is stupid. When I say ‘no’ she looks guilty, but I still come home to destruction in the house.”
“Doc, I read about this tap-method of using shock collars, and they say it is positive reinforcement. Can you explain it to me?”
“My dog is scared of people. I take him every morning to the coffee shop and, even after lots of people pet him, he’s still fearful!”
When you must answer these questions, you will need to know learning theory- the scientific knowledge developed from the learning principles of habituation, classical conditioning and operant conditioning.
Classical Conditioning.
We can countercondition new desirable responses or extinguish existing undesirable responses. New aversive or positive emotional responses are created by pairing the relevant stimulus with an aversive stimulus (loud noise), or a positive appetitive stimulus (food). Undesirable classically conditioned responses are extinguished by presenting the conditioned stimulus repeatedly without the unconditioned stimulus.
Operant Conditioning.
You can establish new responses by reinforcing (e.g., food) desirable behaviors, or extinguish undesirable behaviors (such as attention-seeking behavior) by allowing no more reinforcement.
Reinforcement vs. Punishment
Reinforcement INCREASES the chance that a behavior reoccurs in the future.
Punishment DECREASES the chance that a behavior reoccurs in the future.
“Positive” and “negative” have to do with “adding” or “removing” something.
- Positive reinforcement: Increasing the probability of a behavior reoccurring by ADDING SOMETHING PLEASURABLE. Example: food treats to reward a “sit” command.
- Negative reinforcement: Increasing the probability of a behavior reoccurring by REMOVING SOMETHING AVERSIVE. Example: removal of pressure of a bit in horse’s mouth when horse stops.
- Positive punishment: Decreases the probability of a behavior reoccurring by ADDING SOMETHING AVERSIVE. Examples: yelling, hitting, water gun, can of pennies.
- Negative punishment: Decreases the probability of a behavior reoccurring by REMOVING SOMETHING PLEASURABLE. Examples: social punishment, time-outs, leaving dog park.
Reinforcement
It is MUCH easier to reward an animal for a behavior that has he has performed correctly. For example, if you are teaching a dog to “sit,” it is more effective, and makes more sense, to give a reward when the animal “sits” rather than punishing the dog when it doesn’t “sit.” Different animals work for different reinforcers. The key is finding the motivation for the animal.
Clicker training is a way to incorporate positive reinforcement methods into your repertoire, by being able to use a bridging stimulus. However, it is not a magical tool and dogs can easily be trained without using clickers.
Punishment
Rules of punishment (that most people do not adequately follow):
- Provide opportunities for the animal to perform correct behavior!
- Reduce the motivation for the behavior
- Stage misbehavior if possible (i.e., set up the steak on top of the counter)
- The punishment should be intense enough to stop behavior, but not too severe to cause anxiety/fear
- Needs to be short delay between behavior and punishment, 1-3 seconds
- Don’t gradually increase punishment, as the animal can habituate to it
- The punishment should be dependent on the behavior, not the punisher
- The behavior needs to be punished every time
Types of Punishment
- Interactive or direct punishment
Examples include: hitting, slapping, grabbing by scruff of neck, yelling, and correction with choke chain. Interactive punishment can produce an aversion to the person delivering the punishment and can make a fear-motivated problem worse. In many cases, it can also lead to an escalation of aggression.
Examples are use of: shock collars, invisible fences, water sprayers, air horns, and electronic sirens. Remote punishment is delivered so the person delivering the punishment is not associated with the punishment. It can be used with common misbehaviors that are directed to only one or two locations, and avoids the problem of producing aversion to the person who is responsible for delivering punishment, but should still not be used on fearful or aggressive animals.
This involves temporarily abandoning or socially isolating the animal. Companion animals, especially dogs, do not like people to abandon them or be forced to leave a fun place. Thus one can punish dogs by terminating pleasant social situations. Examples: walking away, leaving the house, going home from the park when misbehavior occurs.
Habituation
This is used to help eliminate fears or anxieties by presentation of a stimulus without aversive consequences. It may be accomplished by presenting the stimulus repeatedly or continuously at full strength, called flooding, or by presenting stimuli in gradually increasing steps, called desensitization.
Flooding
This unintentionally occurs frequently in animals in nature and in our homes, and happens when animals are habituated to situations causing anxiety and fear, where the full-strength stimulus is presented repeatedly, and does not produce aversive consequences. Flooding can be a risky procedure. If not done properly, it can worsen the fear response. We RARELY recommend this procedure for behavior modification.
Systematic desensitization
In adult animals, this technique is useful in treating the aversive emotional reaction associated with innate and acquired anxieties or fears. The procedure is commonly used in treating separation anxiety and fears of loud noises. The technique involves habituation of an innate fear or extinction of classically conditioned responses.
In adult animals, the full stimulus often evokes a full-blown aversive emotional reaction (with visceral consequences) which makes it almost impossible to stop because the stimulus is, in fact, followed by aversive consequences. Desensitization involves presentation of a gradient of increasing intensity of the stimulus. The stimulus eventually loses its ability to produce an adverse emotional reaction. The gradient is distance or intensity. To accomplish desensitization it is necessary to identify the emotion-evoking stimulus (stimuli), determine the starting intensity which evokes no response or a weak response, and conduct trials at increasing steps of intensity. Desensitization may also be used to reduce excitatory reactions such as exuberant barking to door bell ringing.
Counterconditioning
This is used to supplement desensitization to replace an aversive emotional response (fear or anxiety) with a pleasant emotional response that is incompatible with the aversive state. Counterconditioning resolves problems better than just a neutral reaction from desensitization alone.
For treating fears (aversive emotional reactions), pair a very mild form of the fear-evoking stimulus with food and/or affection to condition a positive emotional response that is incompatible with the internal aversive reaction. The positive internal state overcomes the aversive internal state if the aversive state is only mildly aroused. As the animal becomes progressively desensitized to the low-level stimulus, the counterconditioning is carried out with the stimulus at progressively higher levels.
This article may also be accessed directly from it’s source, The California Veterinary Medical Association (CVMA) at this address http://www.cvma.net/doc.asp?id=3245
The following is an excerpt written by Dr. Ian Dunbar, veterinarian and animal behaviorist, which was originally published in After you Get Your Puppy.