PCT Research

[from Jeff Vancouver 960606.1345 EST]

[From Rick Marken (960604.0800)]

Jeff Vancouver (960603.1430 EST) --
>We define goals as internally represented desired states

Desired states of what? Perceptual variables, I hope;-)

Yes, the role of the input function is very much in the paper. We call it
the perception of the current or anticipated state. Although it strikes
me as inconsistent to use the term perception to mean, generally, the
output of an input function but, specifically to refer to the output of
input functions in the non-intrinsic hierarchy (i.e., perceptual
hierarchy). We try to be clear that a perception need not refer to the
system's translation of the environment into a mental representation, it
could also refer to translations of a state of the system into a metric
that can be used to compared the current state with the desired state.

>we were both surprised by the reception that the paper got from the
>reviewers.

Maybe the psychological _zeitgeist_ is now right for PCT.

This is what I am thinking, but one must be very careful in making the
argument. Remember Anthony began by condemning Caesar. (not that I
condemn PCT).

>When I talk to colleagues in these areas they also agree that the control
>process is an accepted concept.

Control theory (the control _process_) has always had some acceptance in
psychology. What has been missing from psychology is 1) an understanbding of
the nature of control as a phenomenon and 2) an understanding of the fact
that behavior IS control -- in fact, not in theory.

I would not question that control is a fact, but I would question the
premise that is it the fact that explains all of behavior. It may, I am
just questioning it. Can you allow us that?

Psychologists (other than PCTers) who accept or use control theory as a model
of behavior do so in the context of a cause-effect model of behavior; they
accept the theory, but not the fact, of control. This means that they don't
really understand the appropriate application of control theory to behavior.

That is perhaps true of some, even many psychologists. But I have met
others, particular in the cognitive areas that have grave doubts about
the simple cause effects model.

I find that the best way to determine whether a psycholgist understands
control is to watch what he or she does, not what he or she says. The
psychologist who says "control theory is the greatest thing since sliced
bread" while manipulating independent variables to determine their effect on
behavioral responses, does not understand control.

This is where we begin to part company and where those who might have
been interested turn away because it is so antithetical to previous beliefs.
But we part company because I think you are wrong. The TEST does it
(actually would be a little cleaner if it did). To quote RUnkel (1990):

"3. apply various amounts and directions of disturbance directly to the
variable
4. Measure the actual effects of the disturbance" (p. 14)

This is a maniputate the independent variable, measure the dependent
variable experiment. Only, rather than measuring disturbances, one might
measure behavior (actions) instead or as well (it would be cleaner as the
disturbances might be coming from more than the focal system).

Avery Andrews (960604) gives some great hints about where to look for
articles that have contributed to the idea that control theory is not up to
the task of explaining behavior. Surely the "best" article on this topic --
the one that tried to reject PCT in one swell foop -- is one by Fowler and
Turvey (1978) called "Skill acquisition"; it's in G. Stelmach (Ed.)
Information processing in motor control and learning. New Yory; Academic
Press.

Thanks, this will be helpful. I have found the general criticism to be
of the nature Avery mentions. That is over-simplifying the model. THis
is a major aspect of my current arguments. More examples will be good.

BTW, Bill P. notes that the motivation (e.g., hunger) psychologists have
been looking a control systems for some time. THis is true. Cannon at
the beginning of the century coined the term homeostasis. Homeostasis was
also supposedly trashed long ago. But, my reading of Mook is that the
counter-argument was something like this: Cannon proposed that rats
control x (x _means_ hunger). Studies of input functions (experimental,
cause-effect studies) reveal that x is not being controlled. In fact
(a little while later) y and z are proposed as the inputs that are
controlled. More studies and y and z (well almost z) are supported.
THerefore, Cannon was wrong. Follow the argument? I don't.

Finally, of the issue of the term goal. First, let me say that I am
simpathetic to using the term reference signal. Second, we were clear
that goal need not be an achievement but may very well be, if not most
often is a maintenance goal. Third, the reason we went with goal boils
down to the Anthony argument above. It would be very hard to sell a
paper titled "The reference signal in psychology...". THe goal construct
in psychology is much more likely to hook psychologists in. I am trying
to convince these people that they have really already largely adopted a
PCT approach to looking at psychology. We try to show them the advantage
of pushing a little bit more forward in that direction. Of course, one
reason for this is that my coauthor has no particular enthusasiam for
PCT. It is not that he does not like it, but he is very aware that
others do not.

Bill's (969694.0800 MDT) problem with the goal term is one of degree, not
kind. It is not that we cannot hold desired _future_ states, it is just
that they might play a lesser role than psychologist give credit.
Whatever, I think the difference (if that is the correct word) is the lag
in the system. Goals with long lags look like what Rick and Bill think
of when they think of goals. Goals with short lags are the kind where
much of your research focuses. It kind of makes one think about how the
practicalities of doing research influence the nature of the theories
used the think about the phenomenon.

One more thing, Bill P. I realized that I might have sounded a little
testy in my response to your test of my understanding of PCT. After
reading another of your posts to me I understand your position better and
in fact am amazed at your restraint. A reasonable interpretation of my
June 3 post is that another yahoo has bastardized PCT to the psychological
community. I respectively hope that after reading it, Rick will attest to
it (I'll send you a copy if you would like). I am not saying he or you
(particularly he) will like it, but he might find (by using words like
goal) that I have not misrepresented PCT. I have my own ideas about this
stuff, many others have ideas about this stuff, and they are reflected in
that paper.

Later

Jeff

Rick,

Would it be possible for Bill to help someone study why a voter selects
on presidential candidate over another? If yet, I would love to get
involved with that kind of PCT application into another field of inquiry.

Ciao, Ken Hacker

[From Rick Marken (950730.1715)]

Bruce Abbott (950730.1300 EST) --

Bill's control model seems to do an excellent job of fitting these data
under the assumption that reinforcement rate IS under control. So
perhaps things are not so strange as they seem.

The only things that seem strange to me are your arguments. You started
things off with a (flawed) analysis of reinforcement rate that led you to
proclaim that reinforcement rate was NOT the controlled variable in
the "cyclic ratio" task; you suggested response rate or collection interval
as alternatives. Now you're acting as though it's clear that reinforcement
rate is the controlled variable.

What's your point?

But Rick, as I never tire of repeating to you, this is just preparation, to
gain some insight into the variables at work and their relationships.

I'm not interested in the "variables at work" in control tasks; I leave
the study of those variables to animists (all conventional psychologists).
The variables that interest me are not "at work"; rather, they are controlled
by organisms that are at work controlling them.

Moreover, Staddon's cyclic ratio study was conducted to do exactly
what you ask for: to evaluate a control model.

If that was really Staddon's goal (I seriously doubt it) then he really
needs to spend a bit more time learning how to study control.

Staddon assumed that rate of food intake was being controlled.

OK. Next step would be to test that assumption.

So I really don't understand the criticism.

Staddon used a "disturbance" (changes in ratio) that changes the gain of
the control loop; this makes it very difficult to tell whether the
hypothesized controlled variable is actualy under control. A control
theorist like Staddon should know that it is best to test for controlled
variables when control is good (as your own analysis of reinforcement
rate shows). Moreover, Staddon apparently never tested any other hypothesis
about the controlled variable besides reinforcement rate. And worst of
all, Staddon never compared his results to a control model. Staddon is
NOT a "model" control researcher.

The fact that we were able to make any sense of Staddon's research is a
tribute to the carrectness of the control model (and the skill of one control
modeller -- William T. Powers). It is also an indication of how
important it is to start doing research on control the right way -- which
is most emphaticallty NOT Staddon's way.

We're having to think about some important issues that haven't
really been dealt with as yet within PCT, such as the allocation of
behavior.

I haven't felt the slightest inclination to think about "allocation of
behavior". I'm not sure I even know what it is. If, by "behavior" you
mean "controlled results of action", then we already know how this
behavior is "allocated" -- by the reference signal. If, by "behavior", you
mean "the actions that keep a controlled result in its reference state",
then we already know how this behavior is allocated -- by the reference
signal, disturbance variables and feedback connection to the controlled
variable: that is o = r-1/g(d)

What do you think is important about "allocation of behavior"?

This isn't an either-or thing. We can do basic control studies and we
can anlayze extant data to learn what we can from them which will
help up to develop more adequate control models that apply more
generally to real-world situations.

In practice it is an either-or thing because the more time we waste
trying to make sense of extant data the less time we spend doing studies
of control. It's time to admit that operant studies have been done by
people who were clueless about the fact that organisms control. So the
extant data is usually of little value to those of us who are interested in
understanding control. All that the extant data tells us is that it COULD
have been collected from living control systems; the data is not inconsistent
with the notion that organisms are perceptual control systems. But the data
don't tell us much about what variables these organisms are controlling
and/or how they are controlling them.

We now have a model that is at least not inconsistent with the operant
data that we can make some sense of. Now let's start doing the research
that tests the model. That is, let's start studying control the right way,
right now.

Best

Rick

[From Rick Marken (950730.2200)]

Bruce Abbott (950730.2115 EST)--

Rick, _I'm_ interested in these things [variables at work, allocation of
behavior], and I don't see them as a waste of time.

You and the rest of conventional psychology. I'm not surprised that you
find these things interesting but then I do find your interest in PCT
puzzling. Do you think PCT will help you find the variables at work in
behavior? the algorithms for allocating behavior? the consequences that
select behavior? Do you really WANT to understand PCT?

I don't see that my pursuing these interests is stopping anyone else from
getting a PCT research project started. Go ahead, name one person I'm
keeping from dong PCT research.

Bruce Abbott.

You're welcome to join in, but if you really don't want to, the least
you can do is get out of the way.

I don't mean to be in the way. But there is not much to get in the way
of. The more time we spend doing these analyses of extant data, the more
we learn about why such data tell us almost nothing about control.
In a recent post, Tom Bourbon (950730.2245) describes my feelings about
what you are doing far better than I can:

Fine. Absolutely no problem with the idea that we can do basic control
studies _and_ analyze extant data. But I have some reservations about the
idea that extant data will help us develop "more adequate control models."
They might, but I don't think so. For one thing, the data were collected
with procedures designed to support the notions that animals control their
behaviors, and that the behaviors they select or allocate can be in
competition, or in conflict.

On the other hand, I believe good research that tests for variables
controlled by animals will provide material for PCT modeling _and_ that the
results of the modeling will reveal the illusory nature of earlier ideas
that animals allocate, select, and control "behaviors."

Just an opinion.

And, as usual, the right one.

Best

Rick

[From:Â Richard Pfau (2017.06.01Â 20:25 EDT)]
Ref: [From Rick Marken (2017.06.01.1415)]

RP: The term and the idea behind “psychorobotics” is great. I’m just concerned that the term by itself, with no obvious linkage to perceptual control when it is used by others, will just become a popular word in the literature with the PCT implications being lost along the way.  Fred’s suggestion of “PCRobotics, standing for Perceptual Control Robotics” (PCR) might keep that linkage in a way that helps keep perceptual control in the forefront.

Richard Pfau (2017.06.01 9:40 EDT)–

RP: To keep PCT at the forefront, I suggest using the term “PCT-psychorobotics” rather than simply “psychorobotics”.

[From Rick Marken (2017.06.01.1415)]

RM: Actually, I was trying to keep methodology in the forefront. The idea was that psychorobotics was about how to evaluate the psychology behind the behavior of robots (and, by inference, that of the behavior of living control systems, like people). I’d be interested to hear what you think of that idea.Â

Best

Rick

···

---------- Forwarded message ----------
From: richardpfau4153@aol.com
Date: Thu, Jun 1, 2017 at 8:27 PM
Subject: Re: PCT Research
To: csgnet@lists.illinois.edu

-----Original Message-----
From: Richard Marken rsmarken@gmail.com
To: csgnet csgnet@lists.illinois.edu
Sent: Wed, May 31, 2017 10:00 pm
Subject: Re: PCT Research

[From Rick Marken (2017.05.31.1900)

RM: Well, there doesn’t seem to be a great deal of interest in PCT research here on CSGNet but it’s what I am interested in so I’ll follow up on myself. The argument of my first post is summed up in this statement:

RM: What I claim is that the main focus of research based on PCT has to be testing to determine what variables are controlled when we see organisms carrying out various behaviors.

RM: I think there are a couple of reasons why this kind of research has not been pursued by conventional behavioral scientists. One is that these scientists don’t know why this research should be done and the other is that they don’t know how to do this kind of research anyway.Â

RM: I think both of these problems can be solved by leveraging Rupert Young’s robotics work into the new field that I have just christened psychorobotics. Psychorobotics is the field aimed at understanding the psychology of robots, specifically robots that are known to be perceptual control systems. Understanding the behavior of such robots is, then, largely a matter of figuring out what perceptions they are controlling.Â

RM: Psychorobotics is really a process of reverse engineering, which is what we are doing when we are trying to understand the behavior of humans and other living control systems. I am imagining psychorobotics as the study of how best to do this reverse engineering in order to accurately determine the perceptual variables that the robot is controlling. The first step would be to build a robot like the one that Rupert describes in his recently published paper. The next step would be to have people (who are completely unfamiliar with how the robot works, of course) try to figure out what the robot is controlling. To do this, these people will have to be familiar with (or be made familiar with) the principles of perceptual control (PCT) and the methods used to determine what variables the robot is controlling. Then what would be studied is how well these people are able to come up with correct descriptions of the perceptual variables that robots are controlling.Â

RM: Obviously, the new field of psychorobotics needs some more careful thought. But I think the basic idea of showing what’s involved in figuring out what perceptual variables are being controlled by a robot would be a good way to illustrate what PCT researchers are trying to figure out about the behavior of living systems. And, of course, the benefit of doing this reverse engineering process on robots is that we know what perceptions they re actually control because we built them. So we can evaluate how well various approaches to determining the perceptual variables that the robots are controlling actually work.Â

Best regards

Rick


Richard S. MarkenÂ

"Perfection is achieved not when you have nothing more to add, but when you
have nothing left to take away.�
                --Antoine de Saint-Exupery


Richard S. MarkenÂ

"Perfection is achieved not when you have nothing more to add, but when you
have nothing left to take away.�
                --Antoine de Saint-Exupery

Paul George 940810 15:00

[From Rick Marken (940810.0915)]

Me

Nope, but after being knocked around for a number of years you tend to
'control for rejection'.

This implies that we would treat acceptance of PCT as a disturbance. Why not
try "The Test" and see if it is.

Nailed by sloppy phrasing again. I intended 'minimization of rejection'. More
accurately tending to reduce the pain or discomfort brought about by rejection
as people tend to desire approval and recognition. You tend to expect rejection
in certain quarters. Eventually you stop banging your head against the wall.
Consider the image of an adult lion being tied up with a string that restrained
him in cub-hood.

Unfortunately, this is not the case. Engineers reject PCT as vigorously as do
psychologists. Does it really seem to you that the notion of "control of
perception" is taken for granted in control (or any other kind of)
engineering?

Well, to me it _is_ (on the other hand I am not renowned for conventional
thought processes). Your universe is what you can perceive as compared to what
you would like it to be (dodging for the moment whether these are intrinsic
values or remembered perceptions). Any control you attempt can only be detected
through perception. People control for illusion all the time ('image', the
Vedic concept of 'maya'). An engineer or scientist relys upon measurements and
assumptions (or associations) about how various measurements relate. In
software engineering we are dealing almost entirely with intellectual artifacts
using symbolic techniques.We are dealing with perceptions and assumptions about
the world (a model) or another set of symbols. The rules are what ever we agree
(or appear to agree) they are. It seems obvious to me that you try to control
results, not actions.
PCT did reveal to me a number of twists I hadn't previously considered and an
amazingly elegant and powerful mechanism to describe the behavior. Your
experiments demonstrated that a lot can be done by simple feedback and that a
lot of 'computation' can be eliminated. To that extent PCT _is_ truly a
breakthrough.

Nevertheless, we still get questions about how PCT explains "such
and such" or other non-control phenomenon. And, indeed, when we answer these
questions, we are "dismissed out of hand" -- because, of course, it was the
favorite phenomenon of the person who asked. Any suggestions about how to
deal with this problem?

A tough one. In some cases you may be able to rephrase the phenomenon as a
control problem as Bill P (?) did with the operant conditioning data for the
rats. In other case you can wave your hands ( cries arise: Heretic! Heretic!
:slight_smile: and indicate that it would be handled in the higher levels or
reorganization in a mechanism not yet studied. You could even be real sneaky
and suggest that their model might be incorporated within PCT and encourage
them to try to formulate the model. The approach of 'we haven't addressed it
yet, but show me how your theory/concept can be justified in fact or
experiment'(a.k.a. 'we're no worse than you') can also work, albeit not winning
friends.
(of course you have never tried anything like this ;-})

In reality however, it is almost a no-win situation. The person in question
(particularly a department head or other professor emeritus) would reject _any_
theory not his own, as his identity or reputation is based upon it. But, if you
can get them to acknowledge that PCT as a possible interpretation, though
inferior to theirs, you may be able to convince the next generation.

There is a theory that ideas in science don't change, the proponents of the
old ones just die off eventually and no longer sit on review boards, thesis
committees or chair departments.
"When a respected senior scientist says something can be done, he is almost
certainly right. When he says it cannot, he is almost always wrong"- R.A.
Heinlien

Back to the bushes,
Paul

[From Rick Marken (941010.2100)]

Bruce Abbott (941010.1600 EST) --

Bruce, I think it would be easier to read your posts if you'd mark off
quoted sections in some way. The convention seems to be to use the
greater than, >, sign before each quoted line.

I said:

I submit that there is only one reason why there has been so little PCT
research and publication: it is because there is a reluctance to turn
away from pre-PCT research.

Bruce replies:

My own recent posting (941007.1240 EST) argued for a different set of
reasons... there may be little incentive to switch research programs,
especially if one has already invested considerable efforts in the
current one. Second, asserting that everyone else's program of
research is misguided and trivial is almost guaranteed to generate
resistance to PCT.

I agree with both of these points; both are clearly reasons why
psychologists have not switched to PCT. I think I didn't make my
point very clearly. What I said in the quote above was not an attempt to
explain why people who are already happily engaged in their own non-
PCT research are not doing PCT resarch. It was an attempt to explain
why people who ostensibly _embrace_ PCT don't do PCT research. Remember,
B:CP was published in 1974. Since that time, there have been hundreds
of people (like yourself) who got turned on by the ideas in that book.
Many of those people were experimental psychologists. But _very_ few
of them have gone on to do research based on PCT. Why? I think the reason
for this is, unquestionably, a reluctance to turn away from one's pre-
PCT research methods and goals and take off in a new direction -- the
direction of PCT. PCT research has new goals (determining what variables
organisms control, how they control them and why) and new methods
(variants of The Test for the controlled variable). Some experimental
psychologists (like Tom B.) have been able to turn away from the past
and start doing great PCT research; most others haven't. I think I know
why this happens but I don't know how to get it to happen more often. In fact
I'm pretty sure that I can't make it happen; the magic has to be within
you as it was (and is) in Tom.

What we ARE asserting is that past (and some present) research on
the behaving organism has disclosed important facts which (a) may
supply important pieces of the puzzle and (b) may reveal important
phenomena of behavior that must be explained by ANY adequate
model of the behaving organism.

How about presenting an example of an important fact from that old
time psychology?

Tycho Brahe collected some of the most exacting astronomical data on
the motions of the planets available in his time.

The differences between Tycho and the Psychos are as follows: 1) as
Tom pointed out, all group data is irrelevant to understanding individual
purposeful behavior; so 90% of conventional psychological data is out the
window, PCT or no PCT 2) the remaining individual data (like operant
conditioning data) is often too noisy to be of much use (mainly because
the data is collected from organisms who are in egregious states of
deprivation) and 3) even when the data is reasonably good, it is
collected under conditions that make it difficult to observe the details
of control (for example, food powder is slapped into a dog's mouth and
measures of salivation are obtained but there is no continous measure
of possible controlled variables, such as the viscosity of the material in
the mouth).

All in all, Newton had a lot more to go on with Tycho's data than
Powers has to go on with the Psycho's data. Nevertheless, Bill has
shown how PCT can be used to explain some conventional data when
possible controlled variables are pretty obviously maintained against
disturbance or changing feedback functions (see "Analysis of a rat
experiment" in LCS I; it's also described in B:CP). Analyses like this
should have been the start of systematic research (preferably using
continuous variables rather than "shock vs no shock") on the variables
rats control, the gain of the control systems, etc. But, noooo. Not one
operant PCT study after Bill published that beautiful analysis -- in
1971! Maybe you could finally take up where Bill left off, Bruce. That
would be great!

The fact that most current behavioral science researchers still hold to
the Ptolemaic view does not automatically invalidate their findings
or render them trivial

No. But some experimental tests and modelling results do invalidate
their findings or render them trivial. And when this happens (as it did
when I published my "Selection of consequences" paper, showing that
consequences are selected, they don't select) there is MASSIVE
resistance. My little E. coli experiment proves that people can produce
systematic results even when the consequences of their actions are
random. The experiment shows that the _appearance_ of selection by
consequences is (as predicted by the control theory equations -- see the
"Blind men" paper) an illusion; an expected side-effect of keeping
perceptions in reference states despite changing disturbances and feedback
functions.

Maybe you could provide a detailed description of some important
"fact" that has been "revealed" by non-PCT behavioral science research.
Then maybe we could all get a more tangible idea of where we are
coming from (or trying to get to). OK?

Best

Rick