BEHAVIOR THEORY IN PRACTICE

[Music] much can be learned by studying a single operant but we are frequently interested in describing sequences of behavior under multiple stimulus control probably the simplest sequence or chain of behavior is one in which the successive responses have the same topography one way to establish such a homogeneous chain is to start with the response nearest reinforcement and work backwards this Quail has had a brief history of pecking in this apparatus when the response of pecking the white key is well established the blue key is lighted pecking blue is reinforced by the white light and pecking white is reinforced with food then the red key is added and finally the green each SD light functions as a conditioned reinforcer for the preceding response in the chain this Quail is believed to be the first bird recorded in history it is the quail of the Bible and is pictured on Egyptian reliefs in this homogeneous chain the reinforcer at the end of the chain is a token which can be traded in for candy or a toy at the end of the experimental session so although the chain we are measuring is the sequence of responses on Telegraph Keys the reinforcer that maintains the behavior comes much later and follows a different set of responses including Gathering up the tokens and bringing them over to the table it is relatively easy to equate the responses within homogeneous chains and that is the main reason for studying them in the laboratory but most sequences of behavior outside the laboratory include a variety of responses they comprise heterogeneous chains of behavior this pigeon is really performing a heterogeneous chain as we have seen such a chain starts with magazine training when the light and the sound of the feeder become SDS for the bird to approach the food magazine and eat we then use the stimula connected with the feeder to condition the pecking response we can say that the feeder stimuli are conditioned reinforcers for pecking because they shape pecking and we can say they are SDS for head lowering because the bird does not lower his head until they are presented we can add another response to this kind of a heterogeneous chain using the SD for pecking as a conditioned reinforcer to shape the new response the red disc will be the SD for pecking and we will use it to shape the response of turning a circle a black disc in the window will be the SD for turning we will shape the Turning response reinforcing successive approximations of a full turn since the first approximation was in a clockwise direction that is the direction we will condition his head has turned farther than before but his feet haven't moved keep watching his feet for last time his head turned more than halfway now we hope he'll turn his body once a bird turns more than halfway you can usually bring him the rest of the way when you present the SD for for now he's turning 3/4 of the way by himself now he makes most of the turn before the SD is presented this will be the first complete turn this pigeon is working under a three component heterogeneous chain he pecs the Bell turns a circle and pecs the triangle on a variable ratio schedule averaging 10 responses he was first condition to Peck the black triangle the last response in the chain then turning was shaped by using the triangle as a condition reinforcer so turning was added to the front of the chain after this response was well established the bird was trained to pack a bell a blank window was the SD for packing the bell and a circle was the SD for turning then a fourth response was added added the bird was trained to climb on a perch to reach the Bell first the Bell is raised and the chain breaks down since the bird does not peck it the response of reaching in the direction of the Bell is reinforced raising the Bell even this small amount has generalized effects the clockwise turn is completely disrupted eventually he turns in the correct direction and receives the SD for packing the components of a chain closest to reinforcement are the most stable pecking the triangle is not affected after going through the chain six times with a bell in this position the performance is fairly stable and the bell is moved to the end of the box where the perch will be placed the pecking response is disrupted and so is turning unfortunately he's turning the wrong direction for the next approximation the perch was placed in the box under the bell and again the bird's Behavior was disrupted in 5 minutes there were no approximations of pecking the Bell so it was lowered to the height you see here after another 1 and 1/2 minutes he makes a pecking Motion in the direction of the bell and this response is reinforced with the SD for turning he pecs this pattern and the first turn is in the wrong direction the final pecking response is not disrupted by the introduction of the perch during the next 5 minutes pecking the Bell was reestablished then the Bell was raised to this height here is the next major approximation again turning is disrupted and the Criterion of a full clockwise turn is relaxed in favor of presenting the primary reinforcer as soon as possible the next three times the bird placed his foot on the perch this is the next approximation turning is still disrupted and again we accept a turn in the wrong direction but climbing the perch is now established in the chain some two hours of training later the chain looks like this probably most operant chains are established with a discriminative stimulus for each successive response but here there is no separate SD for climbing the perch the situation was structured so that the easiest way to reach the Bell was by climbing the perch in other cases SDs that are present when a chain is learned may be gradually dropped out when this dog obedience exercise is performed in competition the Handler may give only four commands stay get it out and heal get it out heel good boy good boy Nick good boy the command get it serves as the SD for several responses that had separate SDS during training getting up taking the hurdle finding the dumbbell picking it up returning over the jump approaching the Handler and sitting out heel that's a good boy good boy when the chain was learned there was an SD for each response in the final performance the completion of one response seems to serve as the SD for the next response in the chain in this exercise the chain contains alternative responses the dog is sent out between two jumps the next SD depends on the judge who Waits until the dog is seated before telling the Handler which jump he wants the dog to take Nick the Handler then says over pointing to the jump designated by the judge the dog takes the jump and with no further commands approaches the Handler and sits in front of her the SD and the response of heel follow good boy good boy Nick good boy a paradim for this chain might look like this of course the Handler's behavior is also a chain controlled partly by SDS from a judge she gives no command to her dog until the judge gives her the appropriate SD the interactions between a blind man his guide dog and the environment illustrate the control of behavior by several stimuli that at any given moment may be SD's for incompatible Behavior as they approach the corner the verbal behavior of the man is an SD for the dog to go forward but the curb is an SD for the dog to stop and sit the dog's stopping is an SD for the man to feel about with his foot and when he finds the curb he again tells the dog to go forward now the dog obeys the command and moves out and now the man walks ahead responding to tactual SDS from the dog in harness the training of a seeing eye dog includes punishment as well as reinforcement but the punishment always comes from things in the environment that the dog must learn to avoid not from the trainer forward here the trainer walks right up to the car and hits it making as much noise as possible this is an aversive stimulus for the dog and on future occasions the dog avoids coming that close to a car here she blocks the trainer and doesn't let him move from the curb now when the traffic stops she moves right out traffic training is relatively easy because the dog has a reliable Instinct for self-preservation but how would you train a dog to avoid something like an awning that isn't an obstacle to the dog itself how would you make a conditioned aversive stimulus out of something that wasn't even a stimulus the trainer walks right into the awning and makes a lot of noise then he backs off and tries again that's a good in just one trial the dog avoids the awning and leads her trainer wide around it in training a seeing eye dog it is imperative that the trainer behave as though he were blind if he anticipates the danger he will be signaling the dog rather than the other way around forward good dog good dog good dog here the dog will be trained to avoid pitfalls such as a hole in the street the trainer walks right into the hole and stumbles creating confusion to make the hole an aversive stimulus follow it on the next trial she forces him away from the hole and is praised for this avoidance behavior good we have examined the behavior of a number of species both inside and outside of the laboratory and we have become increasingly aware of those basic principles of behavior which obtain between organisms and their environment at various levels of sophistication yet with remarkably consistent results while operant conditioning is sometimes called trial and error learning a better name might be trial and success learning