Illusion

[From Rick Marken (970903.1000)]

Me:

Bruce [ A.] cannot seem to bring himself to the point of admitting
one of the most obvious implications of PCT: there is no such
thing as reinforcment; there is nothing to explain; reinforcement
is just an illusion, like the movement of the sun around the earth.

Bruce Gregory (970903.1115 EDT) --

It is not an illusion that the sun circles the Earth, it is
simply a description from our point of view.

It is an illusion if we think that the observation is something
other than just a description from our point of view. It is an
illusion if we think that the sun _really_ moves around the earth.
Before Copernicus, everybody thought the sun really did move around
the earth. We now know (from tons of observations and models that
fit those observations) that it doesn't. Reinforcement is an
illusion in the same sense. There are many people who believe
that certain consequences of behavior (reinforers) _really_
strengthen (increase the strength of) behavior. We now know (from
tons of observations and models that fit those observations) that
they don't. Consequences are controlled; they don't reinforce.

Best

Rick

···

--
Richard S. Marken Phone or Fax: 310 474-0313
Life Learning Associates e-mail: rmarken@earthlink.net
http://home.earthlink.net/~rmarken

[From Bruce Abbott (970903.1220 EST)]

Rick Marken (970903.1000) to Bruce Gregory:

Me:

Bruce [ A.] cannot seem to bring himself to the point of admitting
one of the most obvious implications of PCT: there is no such
thing as reinforcment; there is nothing to explain; reinforcement
is just an illusion, like the movement of the sun around the earth.

Bruce Gregory (970903.1115 EDT) --

It is not an illusion that the sun circles the Earth, it is
simply a description from our point of view.

It is an illusion if we think that the observation is something
other than just a description from our point of view. It is an
illusion if we think that the sun _really_ moves around the earth.
Before Copernicus, everybody thought the sun really did move around
the earth. We now know (from tons of observations and models that
fit those observations) that it doesn't. Reinforcement is an
illusion in the same sense. There are many people who believe
that certain consequences of behavior (reinforers) _really_
strengthen (increase the strength of) behavior. We now know (from
tons of observations and models that fit those observations) that
they don't. Consequences are controlled; they don't reinforce.

Yes, but it doesn't help the discussion when you respond as if one is
talking about the illusory explanation when one is actually talking about
the observation itself and how it may be explained correctly.

Regards,

The "bad" Bruce

[From Rick Marken (970903. 1200)]

Me:

We don't need a model to see that there is no such thing as
reinforcement; and we don't need a model to see that there
is such a thing as control.

Bruce Gregory (970903.1300 EDT)--

If this is true, why doesn't everyone recognise the existence
and importance of control?

Because they don't know what to look for. The model certainly
helps point them in the right direction but people (William
James, for example) have seen (and understood how to demonstrate)
that there is such a thing as control, with no model to point
them at it.

Yes, but as an economist whose name escapes me said, "Without a
theory, the facts are silent."

One would expect that from an economist. Actually, for economists
the facts are silent no matter what;-)

Bruce Abbott (970903.1220 EST):

Yes, but it doesn't help the discussion when you respond as if
one is talking about the illusory explanation when one is
actually talking about the observation itself and how it may
be explained correctly.

See Francisco Arocha's [970903/13.05 EDT] excellent post on illusion:
An illusion is "an impression of sight ... that is different
from what actually is; a mistaken perception". It's not the
explanation that is illusory (an explanation can be wrong but it
can't be illusory); it's observations that are illusory. It
_looks like_ consequences strengthen behavior (an impression of
sight) but they don't; they are controlled (what actually -- as
best as we can tell -- is).

Best

Rick

···

--
Richard S. Marken Phone or Fax: 310 474-0313
Life Learning Associates e-mail: rmarken@earthlink.net
http://home.earthlink.net/~rmarken

[From Rick Marken (970903.1050]

Me:

We don't need a model to see that there is no such thing as
reinforcement; and we don't need a model to see that there
is such a thing as control.

Bruce Gregory (970903.1300 EDT)--

If this is true, why doesn't everyone recognise the existence
and importance of control?

Because they don't know what to look for. The model certainly
helps point them in the right direction but people (William
James, for example) have seen (and understood how to demonstrate)
that there is such a thing as control, with no model to point
them at it.

Yes, but as an economist whose name escapes me said, "Without a
theory, the facts are silent."

One would expect that from an economist. Actually, for economists
the facts are silent no matter what;-)

Bruce Abbott (970903.1220 EST):

Yes, but it doesn't help the discussion when you respond as if
one is talking about the illusory explanation when one is
actually talking about the observation itself and how it may
be explained correctly.

See Francisco Arocha's [970903/13.05 EDT] excellent post on illusion:
An illusion is "an impression of sight ... that is different
from what actually is; a mistaken perception". It's not the
explanation that is illusory (an explanation can be wrong but it
can't be illusory); it's observations that are illusory. It
_looks like_ consequences strengthen behavior (an impression of
sight) but they don't; they are controlled (what actually -- as
best as we can tell -- is).

Best

Rick

···

--
Richard S. Marken Phone or Fax: 310 474-0313
Life Learning Associates e-mail: rmarken@earthlink.net
http://home.earthlink.net/~rmarken

[From Bruce Gregory (970903.1425 EDT)]

Rick Marken (970903.1000)

Me:

> Bruce [ A.] cannot seem to bring himself to the point of admitting
> one of the most obvious implications of PCT: there is no such
> thing as reinforcment; there is nothing to explain; reinforcement
> is just an illusion, like the movement of the sun around the earth.

Bruce Gregory (970903.1115 EDT) --

> It is not an illusion that the sun circles the Earth, it is
> simply a description from our point of view.

It is an illusion if we think that the observation is something
other than just a description from our point of view. It is an
illusion if we think that the sun _really_ moves around the earth.
Before Copernicus, everybody thought the sun really did move around
the earth. We now know (from tons of observations and models that
fit those observations) that it doesn't. Reinforcement is an
illusion in the same sense. There are many people who believe
that certain consequences of behavior (reinforers) _really_
strengthen (increase the strength of) behavior. We now know (from
tons of observations and models that fit those observations) that
they don't. Consequences are controlled; they don't reinforce.

I would be happier if we never worried about what _really_
happens, because we can never know. All we ever know, as far as
I can tell, is how well our models allow us to predict the
outcome of future observations or experiments. The Copernican
model is consistent with all the data we have. The geocentric
model is consistent with a subset of the data. Yet navigators
quite happily use the geocentric model and arrive exactly where
they plan to.

This discussion is about how we _talk about_ the models we use
to explain what we observe, not about what we observe. If we
insist on reifying our models, I am afraid we will continue to
fight theological battles.

Bruce

[From Bruce Gregory (970903.1430 EDT)]

Bruce Abbott (970903.1220 EST)]

Regards,

The "bad" Bruce

Not "bad," "evil" :wink:

Bruce

[From Rick Marken (970903.1400)]

Bruce Gregory (970903.1425 EDT)

I would be happier if we never worried about what _really_
happens, because we can never know.

But we can (I think) get better and better approximations to
reality. I do science because I am interested in what is
_really_ out there. I don't expect that I (we) will ever know
what is really, really out there. But I think science provides
the best approach to honing in on it.

I happen to like worrying about what is _really_ going on out
there. If I didn't worry about it then science would just seem
like a game to me; a game aimed at finding the best formalism
to describe observations. Maybe that's what science is. But I
don't like thinking of it that way. As Dylan said "There
are many here among us who feel that life is but a joke".
Well, you and I have been through that and this is not our
fate. So let us not talk falsely now, the hour is getting late
(can't you just hear the Hendrix guitar riff):wink:

The Copernican model is consistent with all the data we have.
The geocentric model is consistent with a subset of the data.

So I consider the Copernican model a better model of reality;
and in that reality the sun doesn't move. We have (and will
continue to produce) better models than the Copernican model
but the sun still won't move in those models either. Whatever
is going on out there, it's not a sun going around the earth
kind of thing;-)

If we insist on reifying our models, I am afraid we will
continue to fight theological battles.

I don't think I am reifying the model; perhaps I am doing a
_tentative_ reification. I know that the model is _not_ reality,
but I think of it (tentatively) as reality when it is the best
approximation thereunto. Is that so wrong? :wink:

Bruce Gregory (970903.1515 EDT)--

Just when I think you are hopeless, you say something brilliant.

I'm kind of like the proverbial 10,000 monkeys with typewriters;
something good had to come out eventually;-)

Best

Rick

···

--
Richard S. Marken Phone or Fax: 310 474-0313
Life Learning Associates e-mail: rmarken@earthlink.net
http://home.earthlink.net/~rmarken

[From Bruce Gregory (970903.1720 EDT)]

Rick Marken (970903.1400)

But we can (I think) get better and better approximations to
reality. I do science because I am interested in what is
_really_ out there. I don't expect that I (we) will ever know
what is really, really out there. But I think science provides
the best approach to honing in on it.

Need I say that I agree?

I happen to like worrying about what is _really_ going on out
there. If I didn't worry about it then science would just seem
like a game to me; a game aimed at finding the best formalism
to describe observations. Maybe that's what science is. But I
don't like thinking of it that way.

Few scientists do!

> The Copernican model is consistent with all the data we have.
> The geocentric model is consistent with a subset of the data.

So I consider the Copernican model a better model of reality;
and in that reality the sun doesn't move. We have (and will
continue to produce) better models than the Copernican model
but the sun still won't move in those models either. Whatever
is going on out there, it's not a sun going around the earth
kind of thing;-)

True. I'm just trying to keep you out of arguments about whether
or not reinforcement is _real_. Reinforcement is a feature of a
model. (It is also truly that reinforcement is a feature of a
model that at first seems elegant, but that breaks down under
any critical scrutiny.)

> If we insist on reifying our models, I am afraid we will
> continue to fight theological battles.

I don't think I am reifying the model; perhaps I am doing a
_tentative_ reification. I know that the model is _not_ reality,
but I think of it (tentatively) as reality when it is the best
approximation thereunto. Is that so wrong? :wink:

No. (It can't be wrong, because I do the same ;-).

Bruce Gregory (970903.1515 EDT)--

>Just when I think you are hopeless, you say something brilliant.

I'm kind of like the proverbial 10,000 monkeys with typewriters;
something good had to come out eventually;-)

False modesty will get you nowhere. We agree on all of the
important issues. I'm probably suffering from an excess of
ideological purity. I'll take two aspirins and lie down....

Bruce

[From francisco arocha, 970903;16.25 EDT]

[Bruce Gregory (970903.1425 EDT)]

This discussion is about how we _talk about_ the models we use
to explain what we observe, not about what we observe. If we
insist on reifying our models, I am afraid we will continue to
fight theological battles.

I dont think is a problem of reifying models, but of making the
distinction between a model (which is basically a made-up conceptual
object with no real existence) and what the models refer to (the reality
out there). Those theological battles are for philosophers, who insist,
by playing with words, on making things more complicated that what they
really are (no quotes needed).

salut,

francisco arocha

[From Bruce Abbott (970903.1925 EST)]

Bruce Gregory (970903.1430 EDT)]

Bruce Abbott (970903.1220 EST)]

Regards,

The "bad" Bruce

Not "bad," "evil" :wink:

Ah, yes. I stand corrected. But wouldn't "demonic" be closer? I'd much
rather be demonic than merely "evil."

Regards,

The "evil" if not demonic (not bad) Bruce

[From Bruce Gregory (970904.0930 EDT)]

francisco arocha, 970903;16.25 EDT]

[Bruce Gregory (970903.1425 EDT)]

>This discussion is about how we _talk about_ the models we use
>to explain what we observe, not about what we observe. If we
>insist on reifying our models, I am afraid we will continue to
>fight theological battles.

I dont think is a problem of reifying models, but of making the
distinction between a model (which is basically a made-up conceptual
object with no real existence) and what the models refer to (the reality
out there). Those theological battles are for philosophers, who insist,
by playing with words, on making things more complicated that what they
really are (no quotes needed).

Fair enough. But we must keep in mind that _only_ things we can
_say_ about "the reality out there" is said in terms of a model.

Bruce

[From Rick Marken (970904.0830)]

I wrote this this morning, before I got the news of Joe's death.
I couldn't finish it until now.

Bruce Gregory (970903.1720 EDT) --

I'm just trying to keep you out of arguments about whether
or not reinforcement is _real_. Reinforcement is a feature of a
model.

I suppose that's true. But Bruce A. has been claiming that
reinforcement is an _empirical_ phenomenon; he even gave a formula
for calculating reinforcement (change in response rate/unit change
in reinforcer). Reinforcement applies to the situation where
an _increase_ in response rate is associated with an _increase_
in reinforcer; we are measuring reinforcement if the ratio
(change in response rate/unit change in reinforcer) is _positive_.

One of my points has been that the empirical phenomenon of is not
real in the sense that it is not seen in all situations where
psychologists have said that it is seen; in particular, it is not
seen when an animal is feeding itself in an operant chamber. In
that case, the relationship between response rate and reinforcer
is _not_ positive (the reinforcement phenomenon); rather it is
negative. So I am saying that reinforcement is not actually
(really?) observed in operant experiments, except in the
special case where the animal first discovers the means to feed
itself.

My other point is based on a model. The control model shows that
when a rat is feeding itself in an operant experiment, it will
_appear_ as though contingencies ("schedules of reinforcement")
control behavior when you ignore the fact that an input variable
("reinforcement" rate) is under control. This appearance is an
illusion in the same sense that a straight stick appears to bend
in water and that disturbances appear to cause the responses of a
control system.

The control model doesn't really say that the phenomenon of
reinforcement (as described by Bruce A.) is an illusion because
there is no such phenomenon (at least, not when the animal in the
operant cage is feeding itself). So I still think it's OK to
say that reinforcement doesn't exist; it doesn't exist in the
same sense that Zeus doesn't exist; it's a phenomenon that
cannot be observed.

Best

Rick

···

--
Richard S. Marken Phone or Fax: 310 474-0313
Life Learning Associates e-mail: rmarken@earthlink.net
http://home.earthlink.net/~rmarken

[From Bruce Gregory (970905.0950 EDT)]

Rick Marken (970904.0830)]

The control model doesn't really say that the phenomenon of
reinforcement (as described by Bruce A.) is an illusion because
there is no such phenomenon (at least, not when the animal in the
operant cage is feeding itself). So I still think it's OK to
say that reinforcement doesn't exist; it doesn't exist in the
same sense that Zeus doesn't exist; it's a phenomenon that
cannot be observed.

I'm feeling better now. Those aspirins really helped. Or
perhaps it was the lying down... How about this compromise:
Since reinforcement cannot be observed, it doesn't require
explanation.

Bruce

[From Richard Kennaway (970905.1400)]

Rick Marken (970903.1400):

So I consider the Copernican model a better model of reality;
and in that reality the sun doesn't move. We have (and will
continue to produce) better models than the Copernican model
but the sun still won't move in those models either.

So the Milky Way revolves round the Sun?

According to current models, "not moving" is not an observable property of
anything. For computational convenience in particular situations, you can
choose coordinate systems that place any object you like on the x=y=z=0
axis. Being at rest is a fiction which in certain limited situations
(limited by the standard of scientific explanation, i.e. less than all)
appears to be measurable, but on closer inspection turns out to be an
artifact of the theory.

Hmm, sounds a familiar story.

I happen to like worrying about what is _really_ going on out
there. If I didn't worry about it then science would just seem
like a game to me; a game aimed at finding the best formalism
to describe observations.

So do I. But whenever I say anything about what is out there, I seem to be
expressing a model that is in here. Would it satisfy you to see science as
a game aimed at finding the best formalism to explain observations?

-- Richard Kennaway, jrk@sys.uea.ac.uk, http://www.sys.uea.ac.uk/~jrk/
   School of Information Systems, Univ. of East Anglia, Norwich, U.K.

[From Rick Marken (970905.0900)]

Bruce Abbott (970905.0845 EST)--

So instead of apologizing to me for your mistake, you blame me
for it. How kind of you.

I apologize. I'm such a beast;-)

Me:

So it's all over then. Reinforcers are controlled variables;

Bruce:

It is the role they play in the higher-level system that I am
focusing on here

I know. But who cares? Whatever role they play in higher level
systems doesn't change the fact that they are a controlled variable
for some system. This is what I mean by "changing the subject".
It seems like you are diverting attention from the main point,
which is this: in an operant conditioning situation, once the
animal has learned how to produce food pellets for itself, then
those food pellets (actually their rate of occurance) come under
control; the organism resists disturbances (like changes in the
pellet delivery schedule and the addition of non-contingent
pellets) to keep the pellets coming at a reference rate. So the
pellets are a controlled variable, not a "reinforcer". This is
a significantly different way of looking at what the organism
is doing in an operant conditioning situation; the pellets are
not strengthening the organism's behavior; rather the organism is
_controlling_ the rate of occurrance of the pellets.

Now you want to talk about the role of the controlled pellets
in another, presumed control loop -- one that controls something
like nutrient level. That's fine. Just draw the diagram of how
you think the controlled pellet occurance variable fits into the
nutrient control process. It's got to be either an input variable,
a disturbance variable, an output variable or an input quantity.
It can't be a reference variable because references are inside
the nervous system and food pellets not.

The thing behaviorists call a reinforcer _can_ be found in a
control loop. Its defining property is _not_ that it serves as
a CV in some other loop. Its defining property is that its
delivery serves to reduce the error between the CV and its
reference in _this_ loop.

So you don't want see that reinforcers are actually CVs?
Which way do you want it, Bruce?

I am hopeful that my analysis of the relationships between
certain EAB phenomena and control theory will make for a
convincing argument in favor of the control interpretation
when it is presented to my "EAB pals."

But we've shown you the control interpretation. It's very
simple. The variable that EABers have always identified as
a reinforcer is actually a controlled variable. Very clear.
Very simple. Very neat. What's the poroblem?

You ought to be in favor of this, but for some reason you
wish to fight my project tooth and nail.

I'm not fighting your project; I'm trying to set it on the
right track. Your project should be to convince EABers (and
the rest of the psychology establishment) that what they have
been calling a "reinforcer" is a controlled variable. Do the
experiments to show beyond a doubt that food pellet rate (or
whatever variable it actually is) is controlled. What could be
a more powerful message than "The enviromental variable that
you took to be a strenthener of behavior is actually controlled
by that behavior. If you can convince the EABers of that simple
fact then you will be the Galileo of psychology (and I will
be one of your admiring acolytes).

Bruce Gregory (970905.0950 EDT) --

How about this compromise:Since reinforcement cannot be
observed, it doesn't require explanation.

I wish I had been able to say that in the first place. Compromise
enthusiastically accepted.

···

--
Richard S. Marken Phone or Fax: 310 474-0313
Life Learning Associates e-mail: rmarken@earthlink.net
http://home.earthlink.net/~rmarken

[From Rick Marken (970905.1530)]

Richard Kennaway (970905.1400)

Would it satisfy you to see science as a game aimed at finding
the best formalism to explain observations?

No. I still like to think of it as honing in on the best model
of what's _really_ out there (the observations being all we
actually experience of that reality).

I like this because it makes science a hell of a lot more
fun. And science was a hell of a lot of fun in the old days,
when deeply held religious beliefs were at stake. That's
why Galileo had such a great ride; neither he nor the church
thought that the argument was about the best formalism to
explain observations. The argument was about whether God
would stick man on an insignificant spinning satellite of
the sun. It was about whether the earth _really did_ rotate
while moving in an orbit around the sun. Our verbalisms
may not capture the details of the Galilean (and eventually
Newtonian) model, but people sure got the gist of it; and
some people got pissed, big time. That's what I call fun
science.

Most of us aren't fighting religious battles anymore. But
I think we are in a similar position with PCT as Galileo
was with the Copernican model. While Galileo's foil was
the church, ours is "conventional wisdom" about
"what makes people tick". When we say that people control,
and that they are not controlled by the environment we
are not saying "control is the best formalism to account
for the observations". We are saying that people _really
do control_ and that they are _really not_ controlled
by environmental circumstances. If it were just a matter
of formalisms PCT would have become the tacit model in
the life sciences years ago. No, I think the resistance to
PCT comes from the fact that many people (especially
"scientific psychologists") can't believe that people
are _really_ controllers. Rather, they (like the church
of old) have a serious, vested interest in the idea that
people are _really_ controlled by what happens to them.

I believe, based on my observations and modeling, that
people _really are_ controllers; that they control what happens
to themselves. They may not be exactly the kind of controllers
described by the current version of the PCT model; the model
will, I expect, be improved over time. But I am sure that
people are not controlled by events in their environment
(reinforcers, stimuli, etc). That possible reality -- the
one that psychologists currently believe -- can unquestionably
be rejected.

Best

Rick

···

--
Richard S. Marken Phone or Fax: 310 474-0313
Life Learning Associates e-mail: rmarken@earthlink.net
http://home.earthlink.net/~rmarken