Cabbages and Kings

[From Rick Marken (950708.1200)]

Samuel Saunders (950707:1415 EDT) --

It would be nice if there were a "critical experiment" [to distinguish
PCT and EAB] ...but realistically it is likely to take a long, sustained,
and systematic effort.

I agree. There is no experiment that can distinguish PCT from any
theory that predicts that whatever happens in any experiment is
what is expected. Until we can determine what reinforcement theory
IS, distinguishing PCT from EAB is likely to take not just a long time
but an infinitely long time.

In the interim, setting a PCT view of the EAB interpretation of
previous results, then attacking the inadequacy of that presumed
EAB view, is more likely to provoke hostility, and a negative
impression of PCT, than to further the dialog and debate.

Why is it an "attack" to show that the EAB view is wrong? It's rather
difficult to show that PCT is right and not, at the same time, at least
implicitly show that EAB is wrong. In his analysis of Vehave's shock
avoidance experiment I don't believe Bill Powers ever said that EAB is
wrong; but it would be hard to understand Bill's analysis and not realize
that this is precisely what was being shown.

Bill's PCT analysis of the shock avoidance experiment was published in
1971. Not only was there no hostile reaction; there was no reaction at
all. So another 24 years has passed with EAB types learning nothing
about the nature of organisms. Instead, they continue to use organisms
as analog computers to measure the (inverse of) environmental conditions
into which they have been placed.

I think it would be a lot better to get a hostile reaction from EAB types
than to get what we have been getting for the last 20+ years -- ignored. I
think EAB types realize, albeit unconsciously, that it is a lot safer to
ignore questions that are impossible to answer than to dissemble and risk
exposure. If EAB types were openly hostile to PCT they would have to say
what's wrong with PCT -- and then we could call their bluff.

I wonder if both Bruce Abbott and Rick Marken are not setting
themselves too difficult a task by trying to develop general
"reinforcement models". There are really a number of models
advanced by various reinforcement theorists.

There are also a number of models that are advanced by various PCT
theorists. But all PCT models are based on one organizing principle:
control OF consequences. I believe that all reinforcement models are
also based on one organizing principle: control BY consequences.

Control OF consequences and control BY consequences are two
fundamentally different concepts of behavioral organization. It is this
fundamental difference that I want to test -- not any particular PCT or
EAB model. PCT says that organisms control the consequences of their
actions; reinforcement theory (unless all my professors lied to me) says
that organsisms are controlled by the consequences of their actions.
I am apparently not the only person laboring under the assumption that
this is the difference between PCT and EAB. Just this morning, Bill
Powers (950607.0530 MDT) said the following:

they [reinforcement models] all sort of merge together after a while:
people trying to understand a control phenomenon while also trying
to hang onto the idea that the reinforcer [consequence] is controlling
behavior.

I have the same impression of EAB models. There are big differneces
between these models but they all have one thing in common; all are
built on the assumption that consequences control behavior. This is
where all EAB models differ from all PCT models. The latter are built
on the assumption that behavior is the control of consequences.

Best

Rick

<[Bill Leach 950709.23:29 U.S. Eastern Time Zone]

[From Rick Marken (950708.1200)]

The issue here is not "Can EAB explain xyz?" Such is pretty much a
foregone conclusion. The problem is can EAB explain "xyz" in a manner
that is consistent with the theory?

An impossible to deal with problem is that the invokation of "behaviour
is caused by present AND PAST reinforcers" one is faced with a totally
untestable assertion.

I believe that PCTers also recognize that past experience "influences"
future behaviour though definately not in the fashion that seems to be
the belief of EABers.

I fear that the only "arguement" that is ultimately convincing with
regard to PCT is the one that deals with the fact that only closed loop
negative feedback control systems achieve and maintain goals, wants, or
desires against disturbance.

The problem is that until one understands that closed loop negative
feedback control is the only thing that controls and that living systems
do control, all arguements are futile.

I suppose that some might think of me as being philosophic and stretching
the limits of credibility I will even maintain that the the model
proposed by Han's is STILL ULTIMATELY a closed loop negative feedback
model when viewed as an overall system (at least to the extent that it
actually works -- and in some environments such systems really do work).

An important part of the negative feedback is largely ignored and that is
the work of the design engineer. The engineer's work in designing a
"world model" and engineering a means for "self-modification to that
model is a substantial input to the system.

All "open loop" control systems that work are only possible because of
much more than "trivial" negative feedback control system efforts to
create both the environment and system that works.

I just don't see anyway to convince anyone that does not already
understand what the phenomenon of control is all about that living
systems must be control systems. One can get so wrapped up in chaos
theory, systems theory, game theory and the like that the obvious becomes
something that is totally incomprehensible.

-bill

[From Bruce Abbott (950710.1225 EST)]

Bill Leach 950709.23:29 U.S. Eastern Time Zone --

The issue here is not "Can EAB explain xyz?" Such is pretty much a
foregone conclusion. The problem is can EAB explain "xyz" in a manner
that is consistent with the theory?

Yes, and WHICH theory? The attempt to deal with the anomalies presented by
some data for reinforcement has spawned a number of alternative models.
Some attempt to preserve traditional reinforcement theory and some suggest
certain modifications. Then there's this alternative conception nobody's
seriously considering yet (although they've danced all around it with models
such as "behavioral regulation" and "response deprivaiton"). This
alternative conception states that behavior is the control of perception, if
I've got it right. (;->

An impossible to deal with problem is that the invokation of "behaviour
is caused by present AND PAST reinforcers" one is faced with a totally
untestable assertion.

In its broadest sense, this says only the obvious, which is that behavior
depends not only on the current circumstances (feedback functions,
disturbances, etc.) but on past learning. This assertion is no different
than what PCT would hold. It is testable in the laboratory where one has
the ability to observe what has been learned and under what circumstances.

I believe that PCTers also recognize that past experience "influences"
future behaviour though definately not in the fashion that seems to be
the belief of EABers.

So reinforcement theory is untestable because it appeals to previous
learning as a determinant of behavior but PCT escapes from this conundrum
because it appeals to the "influence" of past experience through some other
mechanims not stated? I don't follow...

I just don't see anyway to convince anyone that does not already
understand what the phenomenon of control is all about that living
systems must be control systems. One can get so wrapped up in chaos
theory, systems theory, game theory and the like that the obvious becomes
something that is totally incomprehensible.

I don't feel so hopeless about it. What I think can do it (at least in EAB)
is a series of studies in which models based on PCT consistently outperform
models based on reinforcement or other principles (matching, melioration,
etc.) and do to in a simpler and more natural way that is consistent with
common experience and the organism's anatomy and physiology.

Regards,

Bruce

[From Rick Marken (950710.1300)]

Bill Leach (950709.23:29 U.S. Eastern Time Zone) --

I just don't see anyway to convince anyone that does not already
understand what the phenomenon of control is all about that living
systems must be control systems.

Bruce Abbott (950710.1225 EST)--

I don't feel so hopeless about it. What I think can do it (at least in EAB)
is a series of studies in which models based on PCT consistently outperform
models based on reinforcement or other principles (matching, melioration,
etc.) and do to in a simpler and more natural way that is consistent with
common experience and the organism's anatomy and physiology.

I hope you are right, Bruce. But I think Bill Leach called it: if EABers
don't understand the phenomenon of control then they are not going to be
convinced that what they have been studying for the last 50+ years are just
the side- effects of perceptual control.

I think the only way a model based on PCT will consistently outperform a
model based on reinforcement (or other, non-control principles) will be in
terms of its ability to account for the controlling done by organisms. Models
based on reinforcement are not designed to account for control; the data
these models purport to explain were not collected in a way that was designed
to reveal the controlling done by the organism. We have been able to see the
controlling that is done in operant conditioning task by reploting data
obtained in many differnet studies with many differnet schedules in terms of
reinforcement rate and behavior rate. We find that when the schedule is not
too demanding the organism does what is necessary to keep reinforcement rate
nearly constant state despite changes in the effect of responding on
reinforcement. Reinforcement-based models can't explain this data (at least,
I have still not seen that it can) because reinforcement theories can't
explain control.

I think it's more important to approach EABers with data rather than with
models; show that what is happening in an operant chamber is that the
organism is controlling (against disturbance, if necessary) an input
variable; show that the organism is not regulating but varying its output, as
necessary to protect a perception from disturbance. Show that the same
consequence can increase or decrease responding depending on the state of the
perception that it disturbs.

We must try to convince psychologists that the subjects in their experiments
are, and have always been, controlling perceptions. We must keep trying to
demonstrate the ubiquitous reality of the phenomenon of control.

Best

Rick

[From Bruce Abbott (950710.1530 EST)]

From Rick Marken (950710.1325) --

I think it's more important to approach EABers with data rather than with
models; show that what is happening in an operant chamber is that the
organism is controlling (against disturbance, if necessary) an input
variable; show that the organism is not regulating but varying its output, as
necessary to protect a perception from disturbance. Show that the same
consequence can increase or decrease responding depending on the state of the
perception that it disturbs.

We must try to convince psychologists that the subjects in their experiments
are, and have always been, controlling perceptions. We must keep trying to
demonstrate the ubiquitous reality of the phenomenon of control.

I don't disagree with this in the least. In fact, it's what I'm advocating.
Building models that explain extant data and doing original research
designed explicitly to demonstrate control by introducing disturbances and
showing how they are countered are not mutually exclusive activities. It's
just that at the moment I happen to have extant data to play with and am
using these to guide my thinking about control-system models. I'm sorry
I've been so slow at getting the project started in which the new data will
be collected, but I can assure you that I view this phase as an essential
part of the program.

Regards,

Bruce

<[Bill Leach 950710.18:37 U.S. Eastern Time Zone]

[From Bruce Abbott (950710.1225 EST)]

An impossible to deal with problem is that the invokation of "behaviour
is caused by present AND PAST reinforcers" one is faced with a totally
untestable assertion.

In its broadest sense, this says only the obvious, which is that
behavior depends not only on the current circumstances (feedback
functions, disturbances, etc.) but on past learning. This assertion is
no different than what PCT would hold. It is testable in the laboratory
where one has the ability to observe what has been learned and under
what circumstances.

I believe that PCTers also recognize that past experience "influences"
future behaviour though definately not in the fashion that seems to be
the belief of EABers.

So reinforcement theory is untestable because it appeals to previous
learning as a determinant of behavior but PCT escapes from this
conundrum because it appeals to the "influence" of past experience
through some other mechanims not stated? I don't follow...

No, no, NO, NOOOOO!!! And this just might be one of the most crucial
differences between the PCT and the EAB views.

PCT tests for and studies control of perception. When the researcher
has perceived a potential CCEV, the researcher will attempt to apply
disturbances and observe how the subject controls.

The disturbances should range in magnitude and "phase" (if possible).
Ideally, for studies in the realm that we are presently capable of
modeling, disturbances should not be such as to cause a loss of control
by the subject.

The PCTer is NOT particularly interested in HOW the specific control loop
set came into being. That such came about through "learning",
"experience" and doubtlessly contains random components in the process is
just plain accepted in PCT (for now).

The issue in PCT then, is to find examples of control, isolate "what" is
being controlled, study "how" the control is accomplished (as perceived
by the observer), postulate a control model that can emulate this
observed control and then TEST the model.

I presume that as experience is gained in the process some attempts will
be made to identify control processes that are "different" and are used
by either different subjects or even the same subject under different
conditions to control essentially similar CCEVs.

PCT accepts that there is little more that we can do currently to explain
why "goal" type references change except to assert that such changes are
due to past experience. Such neither "explains them" nor offers any
useful insight. While you may well be right that it is testable in the
laboratory, I doubt that sufficient knowledge of control exists to date
to allow meaningful testing.

Thus, PCT does not "escape" from the conundrum but rather studies _what_
and _how_ a subject controls and takes as a given that trying to
determine _why_ or change _what_ is either futile or will provide
misleading results.

Some comments on a message from Martin are included here because I think
that they are somewhat relevent to this discussion and Martin may not see
them anyway. I will be interested in Bill P.'s thoughts on this as well.

[Martin Taylor 950710 13:15]

... the organization of the control hierarchy. This may be all well and
good for one's own experience, but where does that leave you when
someone else claims to have a different experience that suggests a
different kind of organization?

I would suggest here that there really isn't any solid evidence to claim
that the organization of every individual of a species IS the same. It
just might very well be that there are different structures for the
hiearachy in different individuals.

Just the fact that an at least somewhat random process must exist in the
creation of the organization of the neural processes suggests that it is
quite probable that significant differences could exist.

Experience with control theory already tells us that many control systems
of vastly different organization can achieve exactly the same control
performance. If one then allows for some variance besides...

Even when all our perceptions are our own, including our perceptions of
what other people say, nevertheless if we believe in "science" we have
to have some kind of observations that "ought" to correspond to
observations other people will agree that they have made. We need to
work with perceptions of the environment, rather than with perceptions
of perceptions of the environment.

If we _need_ to do this then we are in serious trouble! Though I might
perceive something about the environment, when I am thinking about that
perception, the _thinking_ is indeed an entirely different perception and
related only by inference.

If I try to "experience" a controlled perception, what I am conscious of
may well be quite a different perception than the one that is actually a
perceptual input signal for some control loop (it may not be also, but I
doubt that at this point we really know one way or the other).

For "attending to" controlled perceptions I think that it is actually
even a lot worse than what I just stated above...

We probably NEVER control any perceptions in "isolation". That is, there
are always perceptions with references above any controlled perception
that we might be "attending to" and there are likely always other, not
necessarily related, controlled perceptions with "pre-emptive" priority
should their value deviate from acceptable limits.

Bill P.

What we're trying to model is the part behind the eyes, but the
phenomena we're trying to account for is in the part right here before
us.

Martin

And it is those phenomena that we have to try to select in such a way
that various people can agree to their existence.

In modeling terms this is presently not much of a problem as long as all
parties are in agreement that the phenomenon of interest is a control
phenomenon and that the application of the Test is the proper way to
study what is to be modeled.

When we do get to the point where different _Control_ phenomenon are
reported by different researchers we will have to deal with such
differences as any science should: investigate; attempt to understand
both what is different and how is that significant; what might explain
what is observed; and what are the implications to the theory?

In a very real sense, we have already encountered some of this. The
"performance" of different people in the oft run tracking experiments are
not only not the same between different people but differ some with
successive run with the same person in the observed and recorded results
much less those "actions" that are neither observed or recorded. As I
see it, the theory is NOT currently trying to explain this observed
variation in performance phenomenon (much less that which is not
explicitely observed and recorded) as long as the model can be made to
duplicate the "end point" performance to within an acceptable margin of
error.

At the moment the same model, differing only in slight parameter changes
and not in any fundamental way is used for all such modeling. At some
time in the future, it might well prove that it will be necessary to have
models that are structurally different for different people and/or
circumstances.

I think that we are currently severely restricted in that the PIF for all
of our models is significantly and substantially different from that of
our subjects. Some day...

-bill

<[Bill Leach 950710.21:12 U.S. Eastern Time Zone]

[From Rick Marken (950710.1300)]

I think it's more important to approach EABers with data rather than
with models; show that what is happening in an operant chamber is that
the organism is controlling (against disturbance, if necessary) an input
variable; show that the organism is not regulating but varying its
output, as necessary to protect a perception from disturbance. Show that
the same consequence can increase or decrease responding depending on
the state of the perception that it disturbs.

The meaning of terms is "clobbered" at will in the field of psychology
(and common discourse). A "regulator" IS a closed loop negative feedback
controller. The process of "regulating" is the process of varying an
_output_ to maintain a "parameter" (perception) at a relatively constant
value against disturbance (ie: Pressure Regulator, Voltage Regulator,
etc).

-bill