World Model (was Re: What I'm controlling for...)

[Martin Taylor 2015.04.21.17.13]

[From Rick Marken (2015.04.21.1320)]

Why thank you, Rick!

Bill did say he had been resisting this idea for a long time.

Indeed, I had argued with him about it at CSG93, proposing precisely
what he describes in his 2010 post to CSGnet (Boris quoted it at
more length, so I won’t repost the whole thing), because I had used
it, in my big Paris tutorial on PCT for interface design in 1992
(though not in as explicit a form, embedded in my Layered Protocols)
and again more explicitly at a Symposium in Washington in 1993
before the CSG meeting.

I didn't say then, and wouldn't say now as Bill did in 2010, that we

don’t initially experience the external world, but otherwise Bill is
more or less paraphrasing what I had suggested to him 17 years
earlier. It is exactly how I have presumed the world model to work.
What Bill hadn’t yet got, so far as I can tell from his message, is
that the relationship of the model with the external world is
created implicitly in the reorganization of the control structure.
And I had indeed not made that explicit in 1993, though it is
implicit in the text quoted below.

p4.Planning1.ECU.jpg

···

(Quoted by HB)

Bill P :

                Something is coming together that is making sense

of some ideas I have resisted for a long time. It
has to do with the brain’s models of the external
world. From the way I have seen those models
proposed by others such as Ashby and Modern Control
Theory adherents, I have thought they were simply
impractical, calling for far too much knowledge,
computing power, and precision of action – as
indeed they are and they do, as they have been
presented.

But those ideas may nevertheless be right.

          RM: This is a wonderful quote from Bill .... Bill's

quote is an extremely clever way of making the predictive
or model-based approach to control taken by Ashby and
Modern Control Theorists sensible in terms of PCT. He does
this by realizing that what we experience as the
environment
is actually a model of the environment.

[Martin Taylor 2015.04.21.17.13]

[From Rick Marken (2015.04.21.1320)]

(Quoted by HB)

Bill P :

Something is coming together that is making sense of some ideas I have resisted for a long time. It has to do with the brain’s models of the external world. From the way I have seen those models proposed by others such as Ashby and Modern Control Theory adherents, I have thought they were simply impractical, calling for far too much knowledge, computing power, and precision of action – as indeed they are and they do, as they have been presented.

But those ideas may nevertheless be right.

RM: This is a wonderful quote from Bill … Bill’s quote is an extremely clever way of making the predictive or model-based approach to control taken by Ashby and Modern Control Theorists sensible in terms of PCT. He does this by realizing that what we experience as the environment is actually a model of the environment.

Why thank you, Rick!

Bill did say he had been resisting this idea for a long time. Indeed, I had argued with him about it at CSG93, proposing precisely what he describes in his 2010 post to CSGnet (Boris quoted it at more length, so I won’t repost the whole thing), because I had used it, in my big Paris tutorial on PCT for interface design in 1992 (though not in as explicit a form, embedded in my Layered Protocols) and again more explicitly at a Symposium in Washington in 1993 before the CSG meeting.

I didn’t say then, and wouldn’t say now as Bill did in 2010, that we don’t initially experience the external world, but otherwise Bill is more or less paraphrasing what I had suggested to him 17 years earlier. It is exactly how I have presumed the world model to work. What Bill hadn’t yet got, so far as I can tell from his message, is that the relationship of the model with the external world is created implicitly in the reorganization of the control structure. And I had indeed not made that explicit in 1993, though it is implicit in the text quoted below.

---------quote from 1993 presentation------

p4.Planning1.ECU.jpg

The imagination is not necessarily a direct connection between the output and the perceptual input function, as shown in the previous slide. It is likely to go through some kind of a world model, particularly at the higher control levels where the perceptual input function may be logical rather than analogue in form. The world model may well be implemented in parts of the complicated control network that are not currently being used for active control (and which might be specialized for the imagination function). It allows the output signal to have effects that are distributed over time, rather than being concentrated at the time the output signal is issued. The world model is built up through experience with the world, as well as by training. Testing out the likely effects of output by imagining through the world model is “planning.”

--------end quote--------

I’m glad Bill came to the same opinion late in his life, and I’m glad you now think it is “wonderful”.

HB : What a nice presentation, Martin. And I’m also glad, that we all agree about something. This is sure one thing that I’m controlling for.

Boris

Martin

···

From: Martin Taylor (mmt-csg@mmtaylor.net via csgnet Mailing List) [mailto:csgnet@lists.illinois.edu]
Sent: Tuesday, April 21, 2015 11:59 PM
To: csgnet@lists.illinois.edu
Subject: World Model (was Re: What I’m controlling for…)

[From Rick Marken (2015.04.22.0920)]

p4.Planning1.ECU.jpg

···
MT... Bill is

more or less paraphrasing what I had suggested to him 17 years
earlier…

MT: I'm glad Bill came to the same opinion late in his life, and I'm

glad you now think it is “wonderful”.

RM: If the diagram above represents your view of what Bill was saying in the paragraph Boris quoted then we have a very different idea (as usual) of what Bill was saying. I don’t think Bill was adding a “World Model” into the system side of PCT, as you show in the diagram above. In fact, Bill never made a functional diagram that included such a component.

RM: I’ve attached a slight modification of your diagram to show what I think Bill was talking about in the quote. The modification involves simply the removal of the “World Model” from the diagram so that what we have is the basic PCT control diagram. What I did do is circle the components of the control diagram – the input and output functions – that I believe are what Bill was talking about as the “model” in his quoted segment.

RM: My justification for circling the Input Function as part of the world model Bill was talking about is based on the following portions of the quoted segment:

BP: Briefly, then: what I call the hierarchy of perceptions is the model. When you open your eyes and look around, what you see – and feel, smell, hear, and taste – is the model. In fact we never experience ANYTHING BUT the model. The model is composed of perceptions of all kinds from intensities on up.

BP: So that is the model that Ashby and the Modern Control Theorists are talking about. It’s the world we experience.

RM: Since the perceptions in the hierarchy are created by the perceptual input functions it is clear to me that the “model” Bill is talking about here is just the perceptual input function side of the control loop. This “model” is, of course, already part of PCT; what Bill is saying is that he is now able to see that our perceptual experience – the hierarchy of outputs of our perceptual functions, per PCT – is a model of whatever is out there in the external world. And, as he say, this is the model that Ashby and the Modern Control Theorists are talking about. He’s trying to explain that there is no need for Ashby and the MCTs to posit a model to deal with the external world; the external world they are talking about already is a model; it’s the model that is their own perceptual experience that they are calling the “external world”. All the things they talk about as being the external world – rocks, papers, scissors, etc – are our perceptual models of the external world.

RM: My justification for circling the Output Function as part of the world model Bill was talking about is based on the following portion of the quoted segment:

BP: Why we have to act one way instead of another to get a particular effect is unknown, but we learn the rules. When we don’t get the effect we want, we alter what we are doing until we do get it.

RM: In order to get our perceptual model – what we think of as the external world – to behave as we want (to get a particular effect like opening a door) we have to learn the “rules” – which I see as properties of the output function-- that make it possible for us to get the model to behave as desired (to get the desired effects). These rules are not consciously learned; they are built into the output function through E. coli reorganization. What those rules (functions) are depend on constraints imposed by the external world – physical laws. And once we learned those rules – that is, once we have build an output function that turns the door knob correctly so that the result is a perception of a door opening – that output function is like a model of the constraints in the external world that require that the perception be produced one way rather than another.

RM: Bottom line for me is that Bill’s quote indicates no change in the PCT model of behavior. It does reflect a change in how Bill conceptualized the PCT model. He was able to see that PCT could be seen as “model based” control by realizing that the input and output functions of the model could be viewed as a model of an external world to which we will never have direct access. Everything we know and do (control) is always done inside a model of the external world in which the model (us) presumably exists.

Best

Rick


Richard S. Marken

www.mindreadings.com
Author of Doing Research on Purpose.
Now available from Amazon or Barnes & Noble

[Martin Taylor 2015.04.22.12.47]

No, I agree, he didn't. And nor did he need to. As I said in the bit

I quoted from 1993 that you refrained from quoting, I did not expect
the “World Model” to be implemented as a separate component, but as
the rest of the hierarchy below the control unit in question, at
least that part of the hierarchy not currently involved in active
control. Judging from your diagram, that’s what you think, too,
except that you ignore the imagination connections entirely.
What I read Bill as saying was that the imagination loop would not
simply return a perceptual value to the perceptual input as shown in
Figure 15.3 of B:CP, but would take advantage of the reorganized
structure of the hierarchy below to return the likely effect of a
particular pattern of reference values at the higher level. [Comment: It would have to be a pattern, not a single value, because
many higher-level outputs contribute to any one reference value, so
returning just that one perceptual value as an input to the many
higher-level perceptual functions would give results that were
highly context-dependent. Of course, there would be situations in
which this would happen, but they would be just an usual example of
a pattern.]
If you add multiple levels of imagination-loop connections, you
would have what I believe Bill and I were both talking about.
Both you and I are trying to draw a highly interconnected
multi-level structure as though it were a single loop. However you
do that, it’s bound to miss things that one assumes will be taken
for granted by the viewer. I subsumed all the lower-level structure
into one “world model” of “the way the world works”. You omitted all
the imagination connections. Both the lower-level systems and the
imagination connections should be there in a full diagram.
And good for him for finally having reinvented that wheel. You
understand wheels much better if you reinvent them than you do if
you are just given a functioning wheel. That’s why the demos you and
he have written are so useful.
What else could the reorganized hierarchy BE but a model of the
external world to which we never have direct access, but which
allows us to control perceptions if we get the model right? What I
read Bill as having newly realized was not the tautology, but that
one could, and probably does, use the world model inherent in the
reorganized structure when imagining the likely effects of different
ways to control some perception. Here’s what he said in 2010:
--------Bill P quote -------
When we examine that external plant [“world�, MT] in order to model
it, we are already looking at the brain’s model. It lacks detail,
but as we probe and push and peer and twiddle and otherwise act on
these rudimentary perceptions, new perceptions form that begin to
add features and properties — like mass — to the model.el. … Why we
have to act one way instead of another to get a particular effect is
unknown, but we learn the rules. When we don’t get the effect we
want, we alter what we are doing until we do get it.

p4.Planning1.ECU.jpg

···

I wonder if you perhaps read Bill’s
writing as carefully as you do mine? I realize you prefer to
substitute your imagination for what I write when you respond to
me, so I just wonder???

[From Rick Marken (2015.04.22.0920)]

          Martin Taylor

(2015.04.21.17.13)–

                MT... Bill is more or less paraphrasing what I had

suggested to him 17 years earlier…

                MT: I'm glad Bill came to the same opinion late in

his life, and I’m glad you now think it is
“wonderful”.

              RM: If the diagram above represents your view of

what Bill was saying in the paragraph Boris quoted
then we have a very different idea (as usual) of what
Bill was saying. Â I don’t think Bill was adding a
“World Model” into the system side of PCT, as you show
in the diagram above. In fact, Bill never made a
functional diagram that included such a component.

              RM: I've attached a slight modification of your

diagram to show what I think Bill was talking about in
the quote. The modification involves simply the
removal of the “World Model” from the diagram so that
what we have is the basic PCT control diagram. What I
did do is circle the components of the control diagram
– the input and output functions – that I believe
are what Bill was talking about as the “model” in his
quoted segment.Â

            RM: Bottom line for me is that Bill's quote indicates

no change in the PCT model of behavior. It does reflect
a change in how Bill conceptualized the PCT model. He
was able to see that PCT could be seen as “model based”
control by realizing that the input and output functions
of the model could be viewed as a model of an external
world to which we will never have direct access.
Everything we know and do (control) is always done
inside a model of the external world in which the model
 (us) presumably exists.

[From Rick Marken (2015.04.22.2330)]

p4.Planning1.ECU.jpg

···

Martin Taylor (2015.04.22.12.47)–

MT: No, I agree, he didn't. And nor did he need to. As I said in the bit

I quoted from 1993 that you refrained from quoting, I did not expect
the “World Model” to be implemented as a separate component, but as
the rest of the hierarchy below the control unit in question, at
least that part of the hierarchy not currently involved in active
control. Judging from your diagram, that’s what you think, too,
except that you ignore the imagination connections entirely.

RM: I don’t think the imagination connection has anything to do with it. There is certainly no mention of it in Bill’s quote. The “model’” Bill was talking about (as he said) IS the hierarchy of perception so it starts at the lowest level.

MT: What I read Bill as saying was that the imagination loop would not

simply return a perceptual value to the perceptual input as shown in
Figure 15.3 of B:CP, but would take advantage of the reorganized
structure of the hierarchy below to return the likely effect of a
particular pattern of reference values at the higher level.

RM: It seems like you’re reading a lot into what Bill said. There was no mention of imagination connections. All Bill said is that the model is the hierarchy of perception.Â

MT: If you add multiple levels of imagination-loop connections, you

would have what I believe Bill and I were both talking about.

RM: This may be what you and Bill talked about sometime (or your impression of what you talked about). But it was certainly not what Bill was talking about in the quote Boris posted.Â

MT: Both you and I are trying to draw a highly interconnected

multi-level structure as though it were a single loop. However you
do that, it’s bound to miss things that one assumes will be taken
for granted by the viewer. I subsumed all the lower-level structure
into one “world model” of “the way the world works”. You omitted all
the imagination connections. Both the lower-level systems and the
imagination connections should be there in a full diagram.

RM: Again, imagination has nothing to do with it. All Bill was saying was that perception – our experience of the world – can be considered a model of whatever is Out There in the external environment. When you open your eyes and look at the world you are are seeing a model of external reality, not external reality itself. Perception is the model; our experience is the model; the world we live in is the model.Â

MT: And good for him for finally having reinvented that wheel. You

understand wheels much better if you reinvent them than you do if
you are just given a functioning wheel. That’s why the demos you and
he have written are so useful.

MT: What else could the reorganized hierarchy BE but a model of the

external world to which we never have direct access, but which
allows us to control perceptions if we get the model right?

RM:I’m with you up to “get the model right”. I don’t think we can say whether the model – our perception – is right or wrong in the sense of being a correct or incorrect representation of external reality. There is no way to tell whether or not what we experience is “right” or not in that sense. The only way I think we can evaluate the rightness or wrongness of our perceptions is in terms of controllability, which is basically what Bill said in the quote. If we are able to develop the ability to have the desired effect on our model – we are able to control the perception – then the perception is “right”. But there may be many ways to perceive (model) external reality that are “right” in this sense. I think this is what Bill was demonstrating in his demo (which I can’t find at the moment) where he had a very large number of control systems controlling different aspects of the same environment (made up of as many variables as there were control systems) and E. coli reorganization would always come up with each system successfully controlling a different function (perception) of all the environmental variables. And the perception that was successfully controlled by each of the control systems was different on each reorganization/learning run.Â

Â

MT: What I

read Bill as having newly realized was not the tautology, but that
one could, and probably does, use the world model inherent in the
reorganized structure when imagining the likely effects of different
ways to control some perception.

RM: I don’t read it that way at all but it’s really more of a philosophical point so it probably not practically important. What it says to me is that when I put environmental variables into my models – like the height and width of the rectangles in my “size” control demo-- those are actually lower level perceptions standing in for variables in the presumed external environment.Â

MT: Here’s what he said in 2010:

--------Bill P quote -------

When we examine that external plant [“world�, MT] in order to model

it, we are already looking at the brain’s model.

RM: Exactly. The external plant we are looking at is perception – a model itself. When I am looking at the different aspects of the display in my “Control of Perception” demo in order to model  them (in that case to calculate their value over time) it seems to me like I am examining  the external plant to see  how to measure it but I am actually examining and measuring my model of that plant, not the plant itself. When I calculate area as X*Y I am using perception of length and width (X and Y) to “stand in” for the external plant variable, but they are just my model (perception) of aspects of that plant. But apparently it works out OK because combining those perceptions that way results in a measure that behaves the way the plant would be expected to behave when controlled or not controlled. So, as Bill says:

BP: It lacks detail,

but as we probe and push and peer and twiddle and otherwise act on
these rudimentary perceptions, new perceptions form that begin to
add features and properties — like mass — to the model.el.

RM: And in the "Control of Perception"demo (twiddle) Â I add the feature called “controlled variable” to my model (perception) of external reality – my model of the plant.

Â

BP… Why we

have to act one way instead of another to get a particular effect is
unknown, but we learn the rules. When we don’t get the effect we
want, we alter what we are doing until we do get it.

RM: And thus we learn to control the world and, by doing research, we learn how we control the world – the world, of course, being our perceptual model of what we presume is a reality Out There.Â


MT: Â I read "learn the rules" as "reorganize", and say that it is just

as I proposed over two decades ago.

RM: I agree. We “learn the rules” (the output function that process the effect we want) by reorganization. If you proposed it two decades ago then congratulations, great insight. But Bill proposed it over 50 years ago so he takes precedence. Still, good show. Wallace was no slouch relative to  Darwin, even though he came up with natural selection 20 years (or whatever it was) after Darwin did.Â

Best

Rick


Richard S. MarkenÂ

www.mindreadings.com
Author of  Doing Research on Purpose
Now available from Amazon or Barnes & Noble

.

                MT: I'm glad Bill came to the same opinion late in

his life, and I’m glad you now think it is
“wonderful”.

              RM: If the diagram above represents your view of

what Bill was saying in the paragraph Boris quoted
then we have a very different idea (as usual) of what
Bill was saying. Â I don’t think Bill was adding a
“World Model” into the system side of PCT, as you show
in the diagram above. In fact, Bill never made a
functional diagram that included such a component.Â

            RM: Bottom line for me is that Bill's quote indicates

no change in the PCT model of behavior. It does reflect
a change in how Bill conceptualized the PCT model. He
was able to see that PCT could be seen as “model based”
control by realizing that the input and output functions
of the model could be viewed as a model of an external
world to which we will never have direct access.
Everything we know and do (control) is always done
inside a model of the external world in which the model
 (us) presumably exists.

[Martin Taylor 2015.04.24.14.23]

[From Rick Marken (2015.04.22.2330)]

No, I disagree. Read it again -- the whole thing, if you want. Bill

was talking about a model of “The way the world works”. You are
talking about a model of “the the world is now”. Bill was talking
about using the model of “the way the world works”, which is
manifest in the reorganized structure of the whole control
hierarchy, to determine how different actions would influence the
“now” perception if they were to be executed through the outer
environment. If reorganization has worked well, the two will not be
too far different, apart from the effect of future disturbances. It
might well help identify areas of conflict, and help with MOL. (Bill
didn’t say this last; that’s my corollary).

No. Of perceptual CONTROL.

Martin

p4.Planning1.ECU.jpg

···
            Martin Taylor

(2015.04.22.12.47)–

            MT: No, I agree, he didn't. And nor did he need

to. As I said in the bit I quoted from 1993 that you
refrained from quoting, I did not expect the “World
Model” to be implemented as a separate component, but as
the rest of the hierarchy below the control unit in
question, at least that part of the hierarchy not
currently involved in active control. Judging from your
diagram, that’s what you think, too, except that you
ignore the imagination connections entirely.

          RM: I don't think the imagination connection has

anything to do with it. There is certainly no mention of
it in Bill’s quote. The “model’” Bill was talking about
(as he said) IS the hierarchy of perception so it starts
at the lowest level.

.

                              MT: I'm glad Bill came to the same

opinion late in his life, and I’m glad
you now think it is “wonderful”.

                            RM: If the diagram above represents

your view of what Bill was saying in the
paragraph Boris quoted then we have a
very different idea (as usual) of what
Bill was saying. I don’t think Bill
was adding a “World Model” into the
system side of PCT, as you show in the
diagram above. In fact, Bill never made
a functional diagram that included such
a component.

            MT: What I read Bill

as saying was that the imagination loop would not simply
return a perceptual value to the perceptual input as
shown in Figure 15.3 of B:CP, but would take advantage
of the reorganized structure of the hierarchy below to
return the likely effect of a particular pattern of
reference values at the higher level.

          RM: It seems like you're reading a lot into what Bill

said. There was no mention of imagination connections. All
Bill said is that the model is the hierarchy of
perception.

[From Rupert Young (2015.04.24 21.30)]

  ([Martin

Taylor 2015.04.21.17.13]
RM: This is a wonderful quote from Bill … Bill’s quote is
an extremely clever way of making the predictive or model-based
approach to control taken by Ashby and Modern Control Theorists
sensible in terms of PCT. He does this by realizing that what we
experience as the environment is actually a model of the
environment.

  Why thank you, Rick!



  I didn't say then, and wouldn't say now as Bill did in 2010, that

we don’t initially experience the external world, but otherwise
Bill is more or less paraphrasing what I had suggested to him 17
years earlier. It is exactly how I have presumed the world model
to work. What Bill hadn’t yet got, so far as I can tell from his
message, is that the relationship of the model with the external
world is created implicitly in the reorganization of the control
structure.

  ---------quote from 1993 presentation------

p4.Planning1.ECU.jpg

How would you have a "world model" related to perceptions such as

beauty, arrogance, fear or hunger?

Regards,

Rupert

[From Rick Marken (2015.04.24.1330)]

Martin Taylor (2015.04.24.14.23)--

RM: I don't think the imagination connection has anything to do with it. There is certainly no mention of it in Bill's quote. The "model'" Bill was talking about (as he said) IS the hierarchy of perception so it starts at the lowest level.

MT: No, I disagree. Read it again -- the whole thing, if you want. Bill was talking about a model of "The way the world works".

RM: I quote again:

BP: Briefly, then: what I call the hierarchy of perceptions is the model. When you open your eyes and look around, what you see -- and feel, smell, hear, and taste -- is the model. In fact we never experience ANYTHING BUT the model. The model is composed of perceptions of all kinds from intensities on up.

RM: It seems like you're reading a lot into what Bill said. There was no mention of imagination connections. All Bill said is that the model is the hierarchy of perception.

MT: No. Of perceptual CONTROL.

RM: Yes, that's what I take it to mean as well; the model is the hierarchy of perceptual control. So the model that Bill is talking about (as per my substitute figure) is the input and output functions that make up the the PCT model. The idea that what Bill said had anything to do with imagination exists only in your imagination.
Best
Rick

···

--
Richard S. Marken
<http://www.mindreadings.com>www.mindreadings.com
Author of <http://www.amazon.com/Doing-Research-Purpose-Experimental-Psychology/dp/0944337554/ref=sr_1_1?ie=UTF8&qid=1407342866&sr=8-1&keywords=doing+research+on+purpose&gt;Doing Research on Purpose.
Now available from Amazon or Barnes & Noble

[Martin Taylor 2015.04.24.17.10]

[From Rupert Young (2015.04.24 21.30)]

    ([Martin

Taylor 2015.04.21.17.13]
RM: This is a wonderful quote from Bill … Bill’s quote
is an extremely clever way of making the predictive or
model-based approach to control taken by Ashby and Modern
Control Theorists sensible in terms of PCT. He does this by
realizing that what we experience as the environment is
actually a model of the environment.

    Why thank you, Rick!



    I didn't say then, and wouldn't say now as Bill did in 2010,

that we don’t initially experience the external world, but
otherwise Bill is more or less paraphrasing what I had suggested
to him 17 years earlier. It is exactly how I have presumed the
world model to work. What Bill hadn’t yet got, so far as I can
tell from his message, is that the relationship of the model
with the external world is created implicitly in the
reorganization of the control structure.

    ---------quote from 1993 presentation------

p4.Planning1.ECU.jpg

  How would you have a "world model" related to perceptions such as

beauty, arrogance, fear or hunger?

If you have reorganized so that you could control such perceptions

through the real world, you can imagine acting so that they take on
values that would match their references if you acted in the real
world. Mozart could apparently imagine a whole symphony movement
before he write it down, and the writing is in part the
manifestation of his world model for controlling for beauty because
he wouldn’t hear his symphony until much later, if at all (some
composers, such as Schubert, never heard some of their symphonies
that we now think are very beautiful). If you are able to control
for yourself or someone else’s level of arrogance, how you do it
would be in the World Model. If you feel hungry, you can imagine
going to the fridge and making a sandwich, but if you had never seen
a fridge or a sandwich, you wouldn’t be able to do that. You can
even, as I did just then, imagine yourself being hungry with a
refernce not to be hungry, and use your World Model to see how to
fix the situation.

Any perception you can control and the outputs through which you

control it in the real world is a candidate for inclusion in the
World Model. That doesn’t necessarily mean that they are all
included. They might be, but they might not.

Martin

[Martin Taylor 2015.04.24.17.22]

I don't like duelling quotes from a guru as a means of advancing

science, but I’ll see you and raise you one in the spirit of your
Game:

···

[From Rick Marken (2015.04.24.1330)]

            Martin Taylor

(2015.04.24.14.23)–

            MT: No, I disagree. Read it again -- the whole

thing, if you want. Bill was talking about a model of
“The way the world works”.

RM: I quote again:

            BP:

Briefly, then: ** what I call the hierarchy of
perceptions is the model**. ** When you open your
eyes and look around, what you see – and feel, smell,
hear, and taste – is the model** . In fact we never
experience ANYTHING BUT the model. The model is composed
of perceptions of all kinds from intensities on up.

MT: No. Of perceptual CONTROL.

            RM:

Yes, that’s what I take it to mean as well; the model is
the hierarchy of perceptual control. So the model that
Bill is talking about (as per my substitute figure) is
the input and output functions that make up the the PCT
model. The idea that what Bill said had anything to do
with imagination exists only in your imagination.Â

                        RM: I don't think the imagination

connection has anything to do with it. There
is certainly no mention of it in Bill’s
quote. The “model’” Bill was talking about
(as he said) IS the hierarchy of perception
so it starts at the lowest level.

                        RM: It seems like you're reading a lot

into what Bill said. There was no mention of
imagination connections. All Bill said is
that the model is the hierarchy of
perception.Â

[From Rick Marken (2015.04.24.2120)]

···

Martin Taylor (2015.04.24.17.22)–

MT: I don't like duelling quotes from a guru as a means of advancing

science, but I’ll see you and raise you one in the spirit of your
Game:

RM: This isn’t about dueling quotes. Boris posted a discussion from Bill, I think to show that he “changed his mind” about fundamental aspects of the PCT model, specifically with regard to the role of  “world models” in PCT, where these are the “world models” of Ashby and Modern Control  Theory (MCT); inverse kinematic or other predictive models that select actions based on predictions of the effect of those actions what we call controlled variables. I think Boris took Bill’s discussion as indicating Bill’s willingness to put such  “world models” into PCT. My take was that Bill’s discussion reflected no change in anything about the PCT model. It just reflected Bill’s realization that the perceptual control hierarchy could be considered a “world model” in itself. Your quotes from Bill’s discussion further support my take on it:

Â


BP:Â  So by experimenting with output forces, we can build up a set

of control systems for controlling the immediate consequences of
applying forces. We can get to know how much consequence a given
amount of force produces. …

When we examine that external plant [“world�, MT] in order to model

it, we are already looking at the brain’s model. It lacks detail,
but as we probe and push and peer and twiddle and otherwise act on
these rudimentary perceptions, new perceptions form that begin to
add features and properties — like mass — to the model.el. … Why we
have to act one way instead of another to get a particular effect is
unknown, but we learn the rules. When we don’t get the effect we
want, we alter what we are doing until we do get it.

--------



MT: To me it reads as though Bill is talking about reorganizing so

that we know how much a particular force will move what we perceive
as a particular mass. It reads as though Bill is “pushing, peering,
and twiddling” by real actions through the environment so that “we
learn the rules”.

RM: Bill is clearly talking about reorganization. I doubt that when he said “We can get to know how much consequence a given amount of force produces” he meant “consciously know exactly the consequence of a given amount of force” Â because the consequence of a given amount of force depends on what other forces are acting on the variable at the same time. Reorganization does work by “pushing, peering and twiddling” but what is reorganized by this process(which is an informal description of the E. coli reorganization process) are the characteristics of the perceptual and output functions. When the reorganization process is complete, the perceptual and output functions can be considered to be an implicit “world model” that allows the control system to vary the outputs (forces, for example) Â it produces in just the right way so that the aspect of the world that the control system perceives can be kept under control.Â

MT: Anyway, if you are removing the imagination loop from Bill's model

for the purposes of your Game, that seems to me like changing the
rules, which are (I think) to work within what Bill wrote.

RM: No, the imagination loop is still there. It’s just not the “world model” that Bill was talking about. Imagination is still what we use to plan what we will do in the future. But that’s not how we control – we don’t control by planning (predicting) actions because you know what happens to the best laid plans.Â

MT: On the other hand, if you are removing the imagination loop because

you are, as a scientist, sceptical that imagination exists, that’s
completely fine. I would disagree with you, but I would presume you
have some backup theory to explain why people act as though they
believe they can imagine things. Do you have a different internal
structure to replace Bill’s “imagination connection”? Or are you
taking John Watson’s radical behaviourist stance that there’s no
such thing as imagination, just learned responses to stimuli that
are questions relating to imagination?

RM: No, I like the imagination loop just fine. But it’s an imagination loop, not the control loop. And when Bill was talking about the control hierarchy being the equivalent of the Ashby and MCT world model he was talking about the world model as a basis of control, not of imagination. Basically what Bill was saying was that you don’t need the Ashby and MCT world model to control; indeed, such “predictive” world models won’t even work in a disturbance prone world. The PCT model works without a “world model” of this sort because control is understood to take place in the context of what is implicitly a model of the external world – a model in the form of our perceptions of that world and the constraints that world places on the kinds of output functions that will have the desired effect on those perceptions, the effect of bringing those perceptions to their reference states and keeping them there, protected from disturbances,Â

BestÂ

Rick

            MT: No, I disagree. Read it again -- the whole

thing, if you want. Bill was talking about a model of
“The way the world works”.

RM: I quote again:

            BP:

Briefly, then: ** what I call the hierarchy of
perceptions is the model**. ** When you open your
eyes and look around, what you see – and feel, smell,
hear, and taste – is the model** . In fact we never
experience ANYTHING BUT the model. The model is composed
of perceptions of all kinds from intensities on up.Â

                        RM: I don't think the imagination

connection has anything to do with it. There
is certainly no mention of it in Bill’s
quote. The “model’” Bill was talking about
(as he said) IS the hierarchy of perception
so it starts at the lowest level.

Richard S. MarkenÂ

www.mindreadings.com
Author of  Doing Research on Purpose
Now available from Amazon or Barnes & Noble

[Martin Taylor 2015.04.25.10.41]

So far, you are with me (and my 1993 concept) 100%.

I agree.
Yep. Still with me.
Exactly! Still together, but only 90%. We don’t control by planning, but we do decide on how to control,
such as by choosing to take a bike or walk to work rather than using
the car, because we perceive it to be a nice day. We don’t
necessarily do that when outside looking at the bike and car. We
imagine it and then change into the appropriate clothes (if the
World Model indicates that different clothes might be needed for the
different modes). Control happens by varying the output as
perceptions change. If we planned on biking, but go out to start and
find that there’s a big black cloud and the wind has come up with
some rain, we might go back inside, change clothes, and get into the
car. That’s control.
Yep.
I won’t presume to judge what Bill intended when he wrote what he
did. I read it as referring to both control and imagination, because
otherwise what would have been the point of him seeing it as a new
insight? Everything in it that refers to on-line control is not new
at all. It’s just the way control and reorganization had been
understood for decades.
That’s all true, but it was old news in 2010, and it would have been
old news 30 or 40 years earlier. Why, then, was Bill proclaiming
that he had an insight that those guys might not have been wrong at
all about building a world model? I think it was because the World
Model created by reorganization was sitting there available for use
through the imagination loop for planning.
Here’s some more of Bill’s post [From Bill Powers (2010.12.22.2300
MDT)]: --------
BP: It seems very risky to be operating entirely on an internal
model without any ability to know what is really going on that we
can’t see, but really, it’s not. Before you step into the bathtub
you feel the water, so if you’ve made a mistake you’re not going to
scald your whole body."

···

On 2015/04/25 12:23 AM, Richard Marken
( via csgnet Mailing List) wrote:

rsmarken@gmail.com

[From Rick Marken (2015.04.24.2120)]

            Martin Taylor

(2015.04.24.17.22)–

                                        RM: I don't think the

imagination connection has
anything to do with it.
There is certainly no
mention of it in Bill’s
quote. The “model’” Bill was
talking about (as he said)
IS the hierarchy of
perception so it starts at
the lowest level.

                            MT: No, I disagree. Read it again

– the whole thing, if you want. Bill
was talking about a model of “The way
the world works”.

RM: I quote again:

                            BP:

Briefly, then: ** what I call the
hierarchy of perceptions is the model** .
** When you open your eyes and look
around, what you see – and feel,
smell, hear, and taste – is the model** .
In fact we never experience ANYTHING BUT
the model. The model is composed of
perceptions of all kinds from
intensities on up.Â

            MT: I don't like duelling quotes from a guru as a means

of advancing science, but I’ll see you and raise you one
in the spirit of your Game:

          RM: This isn't about dueling quotes. Boris posted a

discussion from Bill, I think to show that he “changed his
mind” about fundamental aspects of the PCT model,
specifically with regard to the role of  “world models” in
PCT, where these are the “world models” of Ashby and
Modern Control  Theory (MCT); inverse kinematic or other
predictive models that select actions based on predictions
of the effect of those actions what we call controlled
variables. I think Boris took Bill’s discussion as
indicating Bill’s willingness to put such  “world models”
into PCT. My take was that Bill’s discussion reflected no
change in anything about the PCT model. It just reflected
Bill’s realization that the perceptual control hierarchy
could be considered a “world model” in itself.

          Your quotes from Bill's discussion further support my

take on it:

Â


            BP:Â  So by experimenting with output forces, we can

build up a set of control systems for controlling the
immediate consequences of applying forces. We can get to
know how much consequence a given amount of force
produces. …

            When we examine that external plant [“world�, MT] in

order to model it, we are already looking at the brain’s
model. It lacks detail, but as we probe and push and
peer and twiddle and otherwise act on these rudimentary
perceptions, new perceptions form that begin to add
features and properties — like mass — to th the model. …
Why we have to act one way instead of another to get a
particular effect is unknown, but we learn the rules.
When we don’t get the effect we want, we alter what we
are doing until we do get it.

            --------



            MT: To me it reads as though Bill is talking about

reorganizing so that we know how much a particular force
will move what we perceive as a particular mass. It
reads as though Bill is “pushing, peering, and
twiddling” by real actions through the environment so
that “we learn the rules”.

          RM: Bill is clearly talking about reorganization. I

doubt that when he said “We can get to know how much
consequence a given amount of force produces” he meant
“consciously know exactly the consequence of a given
amount of force” Â because the consequence of a given
amount of force depends on what other forces are acting on
the variable at the same time.

          Reorganization does work by "pushing, peering and

twiddling" but what is reorganized by this process(which
is an informal description of the E. coli reorganization
process) are the characteristics of the perceptual and
output functions. When the reorganization process is
complete, the perceptual and output functions can be
considered to be an implicit “world model” that allows the
control system to vary the outputs (forces, for example)
 it produces in just the right way so that the aspect of
the world that the control system perceives can be kept
under control.

            MT: Anyway, if you

are removing the imagination loop from Bill’s model for
the purposes of your Game, that seems to me like
changing the rules, which are (I think) to work within
what Bill wrote.

          RM: No, the imagination loop is still there. It's just

not the “world model” that Bill was talking about.
Imagination is still what we use to plan what we will do
in the future.

          But that's not how we control -- we don't control by

planning (predicting) actions because you know what
happens to the best laid plans.

            MT: On the other

hand, if you are removing the imagination loop because
you are, as a scientist, sceptical that imagination
exists, that’s completely fine. I would disagree with
you, but I would presume you have some backup theory to
explain why people act as though they believe they can
imagine things. Do you have a different internal
structure to replace Bill’s “imagination connection”? Or
are you taking John Watson’s radical behaviourist stance
that there’s no such thing as imagination, just learned
responses to stimuli that are questions relating to
imagination?

          RM: No, I like the imagination loop just fine. But it's

an imagination loop, not the control loop.

          And when Bill was talking about the control hierarchy

being the equivalent of the Ashby and MCT world model he
was talking about the world model as a basis of control,
not of imagination.

          Basically what Bill was saying was that you don't need

the Ashby and MCT world model to control; indeed, such
“predictive” world models won’t even work in a disturbance
prone world. The PCT model works without a “world model”
of this sort because control is understood to take place
in the context of what is implicitly a model of the
external world – a model in the form of our perceptions
of that world and the constraints that world places on the
kinds of output functions that will have the desired
effect on those perceptions, the effect of bringing those
perceptions to their reference states and keeping them
there, protected from disturbances,

[From Rupert Young (2015.04.27 21.00)]

[Martin Taylor 2015.04.24.17.10]

[From Rupert Young (2015.04.24 21.30)]

    How would you have a "world model" related to perceptions such

as beauty, arrogance, fear or hunger?

  If you have reorganized so that you could control such perceptions

through the real world, you can imagine acting so that they take
on values that would match their references if you acted in the
real world. Mozart could apparently imagine a whole symphony
movement before he write it down, and the writing is in part the
manifestation of his world model for controlling for beauty
because he wouldn’t hear his symphony until much later, if at all
(some composers, such as Schubert, never heard some of their
symphonies that we now think are very beautiful). If you are able
to control for yourself or someone else’s level of arrogance, how
you do it would be in the World Model. If you feel hungry, you can
imagine going to the fridge and making a sandwich, but if you had
never seen a fridge or a sandwich, you wouldn’t be able to do
that. You can even, as I did just then, imagine yourself being
hungry with a refernce not to be hungry, and use your World Model
to see how to fix the situation.

What would comprise this World Model that is not already covered by

imagination, memory or perception?

  Any perception you can control and the outputs through which you

control it in the real world is a candidate for inclusion in the
World Model. That doesn’t necessarily mean that they are all
included. They might be, but they might not.

How would outputs be in this model rather than just (imagined)

perceptions of the effects of outputs, e.g. imagine the perception
of opening fridge door?

Regards,

Rupert

[Martin Taylor 2015.04.27.15.14]

[From Rupert Young (2015.04.27 21.00)]

[Martin Taylor 2015.04.24.17.10]

[From Rupert Young (2015.04.24 21.30)]

      How would you have a "world model" related to perceptions such

as beauty, arrogance, fear or hunger?

    If you have reorganized so that you could control such

perceptions through the real world, you can imagine acting so
that they take on values that would match their references if
you acted in the real world. Mozart could apparently imagine a
whole symphony movement before he write it down, and the writing
is in part the manifestation of his world model for controlling
for beauty because he wouldn’t hear his symphony until much
later, if at all (some composers, such as Schubert, never heard
some of their symphonies that we now think are very beautiful).
If you are able to control for yourself or someone else’s level
of arrogance, how you do it would be in the World Model. If you
feel hungry, you can imagine going to the fridge and making a
sandwich, but if you had never seen a fridge or a sandwich, you
wouldn’t be able to do that. You can even, as I did just then,
imagine yourself being hungry with a refernce not to be hungry,
and use your World Model to see how to fix the situation.

  What would comprise this World Model that is not already covered

by imagination, memory or perception?

I'm not at all clear what you want from this question. Imagination

is just the use of the WM. Memory exists in many forms, but in the
WM they are the connection structures of the input and output parts
of the hierarchy that support control of a perception that uses the
WM. Perception is the way the world is as seen by a combination of
ongoing sensory input and imagination. I don’t know what you mean by
“already covered”.

    Any perception you can control and the outputs through which you

control it in the real world is a candidate for inclusion in the
World Model. That doesn’t necessarily mean that they are all
included. They might be, but they might not.

  How would outputs be in this model rather than just (imagined)

perceptions of the effects of outputs, e.g. imagine the perception
of opening fridge door?

The intent of the model is that the imagined perception of opening

the fridge door occurs because the imagined actions (downgoing
reference values) to open the door occurred along with the imagined
sensory inputs associated with control of those perceptions. The
model doesn’t have any outputs except the perceptions that you
imagine would occur if you did thus and so – pull on the fridge
door handle, or kick the fridge hard. The world model provides the
perception of an opening door in the first case, not in the second
(unless the fridge is old and a bit quirky, which is in the
perceptual input to the perceptual control that started this whole
thing off.

In other words, I don't know what you are asking, so I just describe

the way I imagine it all to work together.

I don't think the World Model is anything new, except for giving a

name to a working collection of components of the hierarchy. There’s
no need for an isolated component that would be a world model, but
the effect of the hierarchy working without real output to the world
is as though there is such a component (and there might be one,
though I have no evidence for it and I don’t believe it), just as
(to use Bill’s example) there is no set of physical variables or
sensory inputs called “the taste of lemonade”, but you surely
perceive it if the pattern of sensory inputs now and recently is
appropriate.

What you perceive is that the environment contains a liquid that has

the property of tasting like lemonade. It takes a lot of research to
allow a food company to synthesize such a liquid without using
lemons, but your taste and odour sensors do it very easily. And
someone else tasting the same liquid would be likely to agree with
you that it is out there in the environment, in the liquid. It’s the
same with the World Model. Someone else may have a different World
Model (almost certainly has), just as the exact taste of lemonade
can never be known to be the same for any two people. It’s just a
name for a complex that gives you some kind of perception.

Since I really didn't understand where you were going with your

questions, I don’t know whether I have answered properly.

Martin

[From Rupert Young (2015.04.27 22.15)]
Well, to me a model means a replica of something, such as you may
have a model of the Flying Scotsman in your train set. So a “World
Model” would be a replica of the world, that is, stuff outside of
the perceiver; the objective world. But, in PCT, it’s all
perception, inside. And there are no perceptions outside. So what
you are calling a “world” model is not really a model of the world;
e.g. if it contains arrogance or hunger they are not aspects of the
external world. I suppose you could say it’s a Perception Model but
that would just be perceptions (memory or imagined) so not really a
model either.
Sounds like you are using the term “model” to mean a set of
perceptions, or view of the world, rather than a replica. Trouble is
“model” has a lot of connotations in AI which are unrelated to
perception. Regards,
Rupert

···

On 27/04/2015 21:35, Martin Taylor
( via csgnet Mailing List) wrote:

[Martin Taylor 2015.04.27.15.14]

[From Rupert Young (2015.04.27 21.00)]

[Martin Taylor 2015.04.24.17.10]

[From Rupert Young (2015.04.24 21.30)]

        How would you have a "world model" related to perceptions

such as beauty, arrogance, fear or hunger?

      If you have reorganized so that you could control such

perceptions through the real world, you can imagine acting so
that they take on values that would match their references if
you acted in the real world. Mozart could apparently imagine a
whole symphony movement before he write it down, and the
writing is in part the manifestation of his world model for
controlling for beauty because he wouldn’t hear his symphony
until much later, if at all (some composers, such as Schubert,
never heard some of their symphonies that we now think are
very beautiful). If you are able to control for yourself or
someone else’s level of arrogance, how you do it would be in
the World Model. If you feel hungry, you can imagine going to
the fridge and making a sandwich, but if you had never seen a
fridge or a sandwich, you wouldn’t be able to do that. You can
even, as I did just then, imagine yourself being hungry with a
refernce not to be hungry, and use your World Model to see how
to fix the situation.

    What would comprise this World Model that is not already covered

by imagination, memory or perception?

  I'm not at all clear what you want from this question. Imagination

is just the use of the WM. Memory exists in many forms, but in the
WM they are the connection structures of the input and output
parts of the hierarchy that support control of a perception that
uses the WM. Perception is the way the world is as seen by a
combination of ongoing sensory input and imagination. I don’t know
what you mean by “already covered”.

  I

don’t think the World Model is anything new, except for giving a
name to a working collection of components of the hierarchy.
There’s no need for an isolated component that would be a world
model, but the effect of the hierarchy working without real output
to the world is as though there is such a component (and there
might be one, though I have no evidence for it and I don’t believe
it), just as (to use Bill’s example) there is no set of physical
variables or sensory inputs called “the taste of lemonade”, but
you surely perceive it if the pattern of sensory inputs now and
recently is appropriate.

  What you perceive is that the environment contains a liquid that

has the property of tasting like lemonade. It takes a lot of
research to allow a food company to synthesize such a liquid
without using lemons, but your taste and odour sensors do it very
easily. And someone else tasting the same liquid would be likely
to agree with you that it is out there in the environment, in the
liquid. It’s the same with the World Model. Someone else may have
a different World Model (almost certainly has), just as the exact
taste of lemonade can never be known to be the same for any two
people. It’s just a name for a complex that gives you some kind of
perception.

mmt-csg@mmtaylor.net

[Martin Taylor 2015.04.27.16.47]

  [From Rupert Young (2015.04.27 22.15)]

Well, to me a model means a replica of something,

Oh. I assumed you were using the sense that Bill P used: in

discussions of PCT, a model is usually a structure that seems to do
what the thing modelled does, but not necessarily using the same
underlying support structure as the thing modelled. The World model
is a structure that makes imagination work the way the external
world has been found to work by the process of structural
reorganization. A tracking model uses Von Neumann computing hardware
and complex software to work the way human tracking does, by
modelling perceptual control using a certain set of defined dynamic
parameters.

  such as you may have a model of the Flying Scotsman in

your train set. So a “World Model” would be a replica of the
world, that is, stuff outside of the perceiver; the objective
world.

There's no replica in the sense that the neural structures that

implement perceptual control of perceptions of the outer world most
certainly don’t work the same way as the outer world seems to do.
Neural impulses are not the same as masses accelerated by forces.
But there is a replica in the sense that the imagined actions on the
outer world result in the perceptions that those actions would
produce if executed in the outer world (though usually on a much
shorter time-scale).

  But, in PCT, it's all perception, inside. And there

are no perceptions outside. So what you are calling a “world”
model is not really a model of the world; e.g. if it contains
arrogance or hunger they are not aspects of the external world. I
suppose you could say it’s a Perception Model but that would just
be perceptions (memory or imagined) so not really a model either.

It's not a model of perception. It's a model of what might happen to

a perception if you were to do thus-and-so.

I suspect you are thinking of a model as an object, like your Flying

Scotsman, rather than a dynamic functioning system that produces
results like those of the thing modelled. PCT tracking models, for
example, assume a particular form of control loop and populate its
parameters such as gain rate, leak rate, and transport lag with
values that produce tracking data similar to the tracks produced by
humans in the same tasks. The World Model you have built up by long
experience controlling perceptions in the real world does much the
same. Neither is a model of perception. Both are models of the
dynamics. Neither works the way the thing modelled works. Both, if
they work well, have some functional correspondence with the thing
modelled.

    I don't think the World Model is anything new, except for giving

a name to a working collection of components of the hierarchy.
There’s no need for an isolated component that would be a world
model, but the effect of the hierarchy working without real
output to the world is as though there is such a component (and
there might be one, though I have no evidence for it and I don’t
believe it), just as (to use Bill’s example) there is no set of
physical variables or sensory inputs called “the taste of
lemonade”, but you surely perceive it if the pattern of sensory
inputs now and recently is appropriate.

    What you perceive is that the environment contains a liquid that

has the property of tasting like lemonade. It takes a lot of
research to allow a food company to synthesize such a liquid
without using lemons, but your taste and odour sensors do it
very easily. And someone else tasting the same liquid would be
likely to agree with you that it is out there in the
environment, in the liquid. It’s the same with the World Model.
Someone else may have a different World Model (almost certainly
has), just as the exact taste of lemonade can never be known to
be the same for any two people. It’s just a name for a complex
that gives you some kind of perception.

  Sounds like you are using the term "model" to mean a set of

perceptions, or view of the world, rather than a replica.

Not at all. The World Model isn't "what". It's a "How".
  Trouble is "model" has a lot of connotations in AI

which are unrelated to perception.

Indeed. I don't know those connotations, but if they are unrelated

to the way modelled things work, I’m not interested. I’m just
working within the frame of PCT, and Bill Powers’s particular HPCT,
at that. In that context, a model is something that performs like
the thing modelled when given the same data as the the thing
modelled would be given.

Martin
···

On 27/04/2015 21:35, Martin Taylor (
via csgnet Mailing List) wrote:

mmt-csg@mmtaylor.net

[Martin Taylor 2015.04.27.15.14]

[From Rupert Young (2015.04.27 21.00)]

[Martin Taylor 2015.04.24.17.10]

[From Rupert Young (2015.04.24 21.30)]

          How would you have a "world model" related to perceptions

such as beauty, arrogance, fear or hunger?

        If you have reorganized so that you could control such

perceptions through the real world, you can imagine acting
so that they take on values that would match their
references if you acted in the real world. Mozart could
apparently imagine a whole symphony movement before he write
it down, and the writing is in part the manifestation of his
world model for controlling for beauty because he wouldn’t
hear his symphony until much later, if at all (some
composers, such as Schubert, never heard some of their
symphonies that we now think are very beautiful). If you are
able to control for yourself or someone else’s level of
arrogance, how you do it would be in the World Model. If you
feel hungry, you can imagine going to the fridge and making
a sandwich, but if you had never seen a fridge or a
sandwich, you wouldn’t be able to do that. You can even, as
I did just then, imagine yourself being hungry with a
refernce not to be hungry, and use your World Model to see
how to fix the situation.

      What would comprise this World Model that is not already

covered by imagination, memory or perception?

    I'm not at all clear what you want from this question.

Imagination is just the use of the WM. Memory exists in many
forms, but in the WM they are the connection structures of the
input and output parts of the hierarchy that support control of
a perception that uses the WM. Perception is the way the world
is as seen by a combination of ongoing sensory input and
imagination. I don’t know what you mean by “already covered”.

You now seem to be talking about a different kind of model; external
models. Models that we build to simulate tracking control, for
example, are external models built to simulate processes internal to
humans (perceptual control). And, I would say, the purpose of them
is precisely to replicate those processes, though they will be
restricted to some level of approximation due to the inadequacies of
the medium (Von Neumann computers).
What we were talking about (well I was) was that living (perceptual
control) systems have inside them something that models the external
world, that is, an internal world model (your position).
I’d agree there, but this would indicate that there isn’t a “model”.
This, it seems to me, could be called a replica of perceptual
control but not of the outer world. I could imagine myself closing a
door and imagine actions that would result in a closed door. But
these “imagined actions” themselves are perceptions (perceptions of
actions). There is no need to invoke “World Models” to explain this.
If you are saying that imagined perceptions are models of the world
then, it would follow, ordinary perceptions are too. If so, I’d
refer back to my original list of perceptions and again ask how
would you have “World Models” of things that don’t exist in the
outer world?
In what way is this a model of the outer world rather than just a
model of the control of perceptions?
No, I am thinking of dynamic processes as in PCT. Again you appear
to be talking about two different types of models here. External
models where the purpose is to replicate internal dynamic processes.
And internal models of external processes. I do not see the case for
the latter.
I think what we can say is that through experience we build up a
structure whereby we successfully control our perceptual goals. We
can do this in real time or in imagination. To say that a “World
Model” is involved is going an, unnecessary, step too far.
The property of “tasting like lemonade” is a property of the
perceiving system not of the external world. It can’t be said to
model the world if there is nothing in the external world to model.
Attached is a typical example (from )
of what is meant by internal models, whereby they explicitly
encapsulate properties and process of the external world, for the
generation of output. this would fit your criterion of “something
that performs like the thing modelled when given the same data as
the the thing modelled would be given”. But, I would hope you agree,
living systems do not contain this type of World Model.
Maybe there is a difference in terminology (as usual), but, in
essence, I think it is misleading and unnecessary to talk about
internal world models in the context of PCT.
Regards,
Rupert

···

[From Rupert Young (2015.05.03 15.50)]
(Martin Taylor 2015.04.27.16.47)

    [From Rupert Young (2015.04.27 22.15)]

Well, to me a model means a replica of something,

  Oh. I assumed you were using the sense that Bill P used: in

discussions of PCT, a model is usually a structure that seems to
do what the thing modelled does, but not necessarily using the
same underlying support structure as the thing modelled. The World
model is a structure that makes imagination work the way the
external world has been found to work by the process of structural
reorganization. A tracking model uses Von Neumann computing
hardware and complex software to work the way human tracking does,
by modelling perceptual control using a certain set of defined
dynamic parameters.

    such as you may have a model of the Flying Scotsman

in your train set. So a “World Model” would be a replica of the
world, that is, stuff outside of the perceiver; the objective
world.

  There's no replica in the sense that the neural structures that

implement perceptual control of perceptions of the outer world
most certainly don’t work the same way as the outer world seems to
do. Neural impulses are not the same as masses accelerated by
forces.

  But

there is a replica in the sense that the imagined actions on the
outer world result in the perceptions that those actions would
produce if executed in the outer world (though usually on a much
shorter time-scale).

    But, in PCT, it's all perception, inside. And there

are no perceptions outside. So what you are calling a “world”
model is not really a model of the world; e.g. if it contains
arrogance or hunger they are not aspects of the external world.
I suppose you could say it’s a Perception Model but that would
just be perceptions (memory or imagined) so not really a model
either.

  It's not a model of perception. It's a model of what might happen

to a perception if you were to do thus-and-so.

  I

suspect you are thinking of a model as an object, like your Flying
Scotsman, rather than a dynamic functioning system that produces
results like those of the thing modelled. PCT tracking models, for
example, assume a particular form of control loop and populate its
parameters such as gain rate, leak rate, and transport lag with
values that produce tracking data similar to the tracks produced
by humans in the same tasks. The World Model you have built up by
long experience controlling perceptions in the real world does
much the same. Neither is a model of perception. Both are models
of the dynamics. Neither works the way the thing modelled works.
Both, if they work well, have some functional correspondence with
the thing modelled.

      What you perceive is that the environment contains a liquid

that has the property of tasting like lemonade. It takes a lot
of research to allow a food company to synthesize such a
liquid without using lemons, but your taste and odour sensors
do it very easily. And someone else tasting the same liquid
would be likely to agree with you that it is out there in the
environment, in the liquid. It’s the same with the World
Model. Someone else may have a different World Model (almost
certainly has), just as the exact taste of lemonade can never
be known to be the same for any two people. It’s just a name
for a complex that gives you some kind of perception.

    Trouble is "model" has a lot of connotations in AI

which are unrelated to perception.

  Indeed. I don't know those connotations, but if they are unrelated

to the way modelled things work, I’m not interested. I’m just
working within the frame of PCT, and Bill Powers’s particular
HPCT, at that. In that context, a model is something that performs
like the thing modelled when given the same data as the the thing
modelled would be given.

http://www.perceptualrobots.com/2014/09/18/taros-2014-iet-public-lecture/

      On 27/04/2015 21:35, Martin Taylor

(
via csgnet Mailing List) wrote:

mmt-csg@mmtaylor.net

[Martin Taylor 2015.04.27.15.14]

[From Rupert Young (2015.04.27 21.00)]

[Martin Taylor 2015.04.24.17.10]

[From Rupert Young (2015.04.24 21.30)]

            How would you have a "world model" related to

perceptions such as beauty, arrogance, fear or hunger?

          If you have reorganized so that you could control such

perceptions through the real world, you can imagine acting
so that they take on values that would match their
references if you acted in the real world. Mozart could
apparently imagine a whole symphony movement before he
write it down, and the writing is in part the
manifestation of his world model for controlling for
beauty because he wouldn’t hear his symphony until much
later, if at all (some composers, such as Schubert, never
heard some of their symphonies that we now think are very
beautiful). If you are able to control for yourself or
someone else’s level of arrogance, how you do it would be
in the World Model. If you feel hungry, you can imagine
going to the fridge and making a sandwich, but if you had
never seen a fridge or a sandwich, you wouldn’t be able to
do that. You can even, as I did just then, imagine
yourself being hungry with a refernce not to be hungry,
and use your World Model to see how to fix the situation.

        What would comprise this World Model that is not already

covered by imagination, memory or perception?

      I'm not at all clear what you want from this question.

Imagination is just the use of the WM. Memory exists in many
forms, but in the WM they are the connection structures of the
input and output parts of the hierarchy that support control
of a perception that uses the WM. Perception is the way the
world is as seen by a combination of ongoing sensory input and
imagination. I don’t know what you mean by “already covered”.

[From Rupert Young (2015.05.06 20.30)]

As you say there's no replica, and neural structures implement of the outer world. Though perhaps you mean perceptions are models

of the outer world?
So does an associative memory system (already part of the theory) so
why need a “World Model”. Sure, your system has reorganised to select the appropriate goals
(perceptions), but I don’t see any support for the case that this
constitutes a “World Model” in that it is replicating actual
dynamic processes of the world.
How about if all animals were suddenly to die, or if we went back a
few billion years before animals existed would you still say that
there were still a property that exists which corresponds to
“perception X” (or any other perception)?
That sounds like just a program-level perception in operation. What
does a “world model” give you that the perceptual hierarchy does
not?
Another thought; if a model is a model of the world then it could
only produce things that the world could produce, so a
perception-producing “world model” would need to account for
perceptions that do not and could not exist in the real world, such
as imaginary concepts and events, especially during dream time.
Whatever is producing these perceptions is not a model of the world,
but an associative memory system is quite consistent with this, I
would say. Regards,
Rupert

···

I’m replying to the list as I assume you
meant to send it the all.

(Martin Taylor 2015.05.04.13.38

        such as you may have a model of the Flying

Scotsman in your train set. So a “World Model” would be a
replica of the world, that is, stuff outside of the
perceiver; the objective world.

      There's no replica in the sense that the neural structures

that implement perceptual control of perceptions of the outer
world most certainly don’t work the same way as the outer
world seems to do. Neural impulses are not the same as masses
accelerated by forces.

    I'd agree there, but this would indicate that there isn't a

“model”.

  Why?

perceptions

      But

there is a replica in the sense that the imagined actions on
the outer world result in the perceptions that those actions
would produce if executed in the outer world (though usually
on a much shorter time-scale).

    This, it seems to me, could be called a replica of perceptual

control but not of the outer world. I could imagine myself
closing a door and imagine actions that would result in a closed
door. But these “imagined actions” themselves are perceptions
(perceptions of actions). There is no need to invoke “World
Models” to explain this.

  So how do you imagine a door closing so as to produce the same

perception as a closing door would have, if you don’t have a model
(which I claim to be in the form of all the connections you have
reorganized as you have learned to control such things as a
perception of a door closing)? What kind of magic produces this
perception? A “World Model” produces perceptions.

    No, I am thinking of dynamic processes as in PCT.

Again you appear to be talking about two different types of
models here. External models where the purpose is to replicate
internal dynamic processes. And internal models of external
processes. I do not see the case for the latter.

  They aren't different. When you actually control in a tracking

experiment showing the task on a screen and using a mouse to move
a cursor on screen, you don’t act randomly, flailing at the air,
yelling and rolling your eyes before happening on the mouse and
discovering that it influences the cursor and helps you control.
You don’t reorganize to control every perception. You have done
that already. You have a model inside you of what it taked to move
that cursor on screen, and that model includes finding a mouse,
holding it, and moving it. You don’t even have to imagine it,
though you may. You are using a model you have already built.

    The property of "tasting like lemonade" is a

property of the perceiving system not of the external world. It
can’t be said to model the world if there is nothing in the
external world to model.

  Can you get the taste of lemonade from what's in a glass from

which you are drinking, if what is in the glass is gasoline? Can
you really say there’s nothing in the properties of the glass
contents that our perceptual functions convert from sensory input
into the taste of lemonade? I think that’s a ridiculous
proposition, or one that if you are to be consistent about it must
apply to every one of our perceptions. There is nothing in the
sensory input that corresponds to, say, colour, or even light
intensity. To say that there is nothing on the external world
corresponding to “perception X” is a solipsistic copout. And I say
this knowing that Bill Powers made that claim.

  I

ask you to think about what you do when you are confronted with a
problem – to make it specific, imagine you are on a mountain road
with a river far below, and you are confronted by a recent
rockslide that blocks the road. Do you not then model things like
“If I move that rock, more will come tumbling down” “If I try to
turn round, I may fall off into the river down there” “Could I
maybe use some of the rocks to shore up the cliff above while
leaving enough room for the car to get around” “What happens if I
try to walk, leaving the car here” and so forth. Is this a
violation of PCT, or does one simply not do anything of that kind,
ever?

[Martin Taylor 2015.05.06.15.18]

[From Rupert Young (2015.05.06 20.30)]

You assume correctly, and thank you.
  As you say there's no replica, and neural structures implement of the outer world.
Some presumably do, some have other functions of many different

types.

  Though perhaps you mean perceptions are models of the

outer world?

Not necessarily. I have said that I consider the complete set of

perceptions at any moment to be a model of the current state of the
world, but the question you raised in the previous iteration of this
exchange has led me to restrict this, because some perceptions are
clearly not of the outer world. You provide examples later in the
message to which I am now responding.

A "World Model" in the sense I have been using it is a process

model, which, given the state of the world and some imagined action
on it, produces the flow of perceptions that would (as imagined)
occur in that world. My problem now is that I had previously
presumed the “world” in question to be the one to which the organism
had reorganized, but you made me realized that the modelled world
could have any imagined properties, and if those properties don’t
correspond to the ones for which we reorganized, then using the
existing structure of the hierarchy won’t work, and we would need to
entertain the possibility that an explicit world model can be built
and retained and used somewhere in the brain. Maybe you would think
of such a model as a “replica”; I wouldn’t, because I think
“replica” has connotations that wouldn’t be appropriate.

        But

there is a replica in the sense that the imagined actions on
the outer world result in the perceptions that those actions
would produce if executed in the outer world (though usually
on a much shorter time-scale).

      This, it seems to me, could be called a replica of perceptual

control but not of the outer world. I could imagine myself
closing a door and imagine actions that would result in a
closed door. But these “imagined actions” themselves are
perceptions (perceptions of actions). There is no need to
invoke “World Models” to explain this.

    So how do you imagine a door closing so as to produce the same

perception as a closing door would have, if you don’t have a
model (which I claim to be in the form of all the connections
you have reorganized as you have learned to control such things
as a perception of a door closing)? What kind of magic produces
this perception? A “World Model” produces perceptions.

  So does an associative memory system (already part of the theory)

so why need a “World Model”.

Don't confuse implementation with function. Associative memory has

been very much in my underlying thinking of how a World Model might
be implemented.

Anyway, as I have said many times, I previously thought of the

“World Model” as a consequence of the existing theory, not as an
addendum requiring a new construct. To me, it was just the way the
imagination connection would have to work. The only new thing was
that Bill in 1993 hadn’t seen it that way, but in 2010 he seemed to
be coming around to this way of looking at it (though Rick
disagrees).

      No, I am thinking of dynamic processes as in PCT.

Again you appear to be talking about two different types of
models here. External models where the purpose is to replicate
internal dynamic processes. And internal models of external
processes. I do not see the case for the latter.

    They aren't different. When you actually control in a tracking

experiment showing the task on a screen and using a mouse to
move a cursor on screen, you don’t act randomly, flailing at the
air, yelling and rolling your eyes before happening on the mouse
and discovering that it influences the cursor and helps you
control. You don’t reorganize to control every perception. You
have done that already. You have a model inside you of what it
taked to move that cursor on screen, and that model includes
finding a mouse, holding it, and moving it. You don’t even have
to imagine it, though you may. You are using a model you have
already built.

  Sure, your system has reorganised to select the appropriate goals

(perceptions), but I don’t see any support for the case that this
constitutes a “World Model” in that it is replicating actual
dynamic processes of the world.

I'm not clear what you are getting at in this comment. The "World

Model" you use in going straight to the appropriate control action
at the many levels needed to select “mouse”, get your hand on it,
and move it usefully don’t replicate the dynamic processes of the
world. They produce the perceptions that you need in order to be
using the mouse, and those perceptions do depend on the dynamics of
the world.

      The property of "tasting like lemonade" is a

property of the perceiving system not of the external world.
It can’t be said to model the world if there is nothing in
the external world to model.

    Can you get the taste of lemonade from what's in a glass from

which you are drinking, if what is in the glass is gasoline? Can
you really say there’s nothing in the properties of the glass
contents that our perceptual functions convert from sensory
input into the taste of lemonade? I think that’s a ridiculous
proposition, or one that if you are to be consistent about it
must apply to every one of our perceptions. There is nothing in
the sensory input that corresponds to, say, colour, or even
light intensity. To say that there is nothing on the external
world corresponding to “perception X” is a solipsistic copout.
And I say this knowing that Bill Powers made that claim.

  How about if all animals were suddenly to die, or if we went back

a few billion years before animals existed would you still say
that there were still a property that exists which corresponds to
“perception X” (or any other perception)?

Does a tree make a noise if it falls in an empty forest? The answer

is the same. It depends on whether you are talking about imagined
sound waves (or whatever environmental properties are involved) or
on the existence of perceptual functions that create specific
perceptions from those sound waves or property sets. Do you have the
same “taste of lemonade” as I do? There’s no way I could tell. But I
could do a Test fot the Controlled Variable along the lines of the
coin game, and try different chemical structures and/or material
processing procedures, and see whether you said “Lemonade” for the
same liquid as I would say had the taste of lemonade. I couldn’t do
that with a fossillized animal, or even a dog.

    I ask you to think about what you do when you are confronted

with a problem – to make it specific, imagine you are on a
mountain road with a river far below, and you are confronted by
a recent rockslide that blocks the road. Do you not then model
things like “If I move that rock, more will come tumbling down”
“If I try to turn round, I may fall off into the river down
there” “Could I maybe use some of the rocks to shore up the
cliff above while leaving enough room for the car to get around”
“What happens if I try to walk, leaving the car here” and so
forth. Is this a violation of PCT, or does one simply not do
anything of that kind, ever?

  That sounds like just a program-level perception in operation.

What does a “world model” give you that the perceptual hierarchy
does not?

Again I ask you to think about this situation. Where does the

program-level perceptual function get its structure and its data
from? It get’s its structure from reorganization and experience with
piles of things that may fall down if you move an item from the
bottom of the pile. That’s a component of the kind of “World Model”
I was thinking of until a couple of days ago. Where does the data
“I’m moving that rock in my imagination” come from that enters
this program-level perception, and how does it then get the data
“No, I’ll move this rock” or “I’ll try to edge the car around the
rockfall” or “I’ll walk”, all of which may be nearly simultaneously
tested in what I call the “World Model”.

To belabour the obvious, my new problem is that I can imagine the

rocks being as light as a feather and loose enough for me to blow
them away, or that my car had a gear that made it float up and over
the fall, or that rocks are repelled by cars, which would allow me
to drive through the fall, as the rocks flow over and around the
car. Those possibilities do not come from my experience with cars or
piles of rocks.

  Another thought; if a model is a model of the world then it could

only produce things that the world could produce, so a
perception-producing “world model” would need to account for
perceptions that do not and could not exist in the real world,
such as imaginary concepts and events, especially during dream
time.

Yes, that is exactly the problem I was posing in my last message, to

which I have hearkened back a few times in this message.

  Whatever is producing these perceptions is not a

model of the world,

Really???
  but an associative memory system is quite consistent

with this, I would say.

Why the word "but"?

Couldn't you say: "Whatever is producing these perceptions is a

model of a non-existent world, in the construction of which the
actions of associative memories play a significant part"?

Martin
···

I’m replying to the list as I assume
you meant to send it the all.

(Martin Taylor 2015.05.04.13.38

          such as you may have a model of the Flying

Scotsman in your train set. So a “World Model” would be a
replica of the world, that is, stuff outside of the
perceiver; the objective world.

        There's no replica in the sense that the neural structures

that implement perceptual control of perceptions of the
outer world most certainly don’t work the same way as the
outer world seems to do. Neural impulses are not the same as
masses accelerated by forces.

      I'd agree there, but this would indicate that there isn't a

“model”.

    Why?

perceptions

[From Rick Marken (2015.05.08.1830)]

···

Martin Taylor (2015.05.06.15.18)–

MT: Anyway, as I have said many times, I previously thought of the

“World Model” as a consequence of the existing theory, not as an
addendum requiring a new construct. To me, it was just the way the
imagination connection would have to work. The only new thing was
that Bill in 1993 hadn’t seen it that way, but in 2010 he seemed to
be coming around to this way of looking at it (though Rick
disagrees).

RM: What I disagreed with was the idea that the quote from Bill that Boris posted had anything to do with imagination. I don’t know what you mean when you say that you thought the “World Model” was “just the way the imagination connection would have to work”. The only thing I know about the way the imagination connection works is as it’s described in B:CP (Figure 15.3). The imagination connection is the state of a two switches which, when thrown, connects the descending reference (from memory) to the ascending perceptual signal. But Bill never came up with any proposals regarding the mechanisms involved in “throwing the switches” – why they are thrown (and un-thrown). This seems like the kind of mechanism that is needed to explain Rupert’s observation – that we can imagine things that we have never perceived before. A unicorn isn’t the best example of this, perhaps, because most people have perceived them in drawings and cartoons; but the first person to come up with the idea of a unicorn certainly had to construct it using existing perceptual function via imagination. There is nothing currently in PCT that explains how we do this – how we imagine things that we construct imagined perceptions that we have never perceived before. This must involve combining imagined versions of perceptions that we have had – like horses and rhinoceroses – but there is nothing in PCT that says how this is done. Your concept of a World Model may be this mechanism, if, as you say, the World Model is the way the imagination connection works. If you do propose a mechanism to add to the PCT model that explains the workings of the imagination connection it would be great if you could also propose a way of testing that proposal. That would make it more interesting to me given my interest in research.

Best

Rick


Richard S. Marken

www.mindreadings.com
Author of Doing Research on Purpose.
Now available from Amazon or Barnes & Noble