[From Bill Powers (960927.0645 MDT)]
Bruce Abbott (960926.2040 EST)--
I think we're getting into a language problem here. If the participant has
adopted the experimenter's reference (or if the experimenter has adopted the
participant's reference), and the experimenter is reporting the deviation of
the CV from reference, and the participant takes corrective action on the
basis of that deviation, isn't that the same as if the participant observed
the CV, compared it to the reference, and took corrective action on the
basis of that deviation?
A long time ago, and for reasons that are partly neurological and partly
arbitrary, I set the rule for myself that perception is associated ONLY with
afferent pathways in the brain. By that I mean the pathways that begin with
sensory neurons and build higher and higher levels of representation on the
signals from those neurons. A strict interpretation of that rule says that
we do NOT experience reference signals or error signals, or the signals
emitted by any level to lower levels (efferent signals).
It was the strict application of this rule (which dates back close to the
beginning in the period with Bob Clark, 1953 - 1960) that led to proposing
the imagination connection. If only afferent or upgoing signals can be
experienced as perceptions, how do we know the values of reference signals
before we put them into effect? We obviously do: I can tell you what my aim
is before I carry it out. But that means we are perceiving reference
signals, and the rule says that we do not perceive reference signals, which
are efferent signals.
It took a while before the answer popped up. In order not to violate the
basic rule, somehow we have to get the reference signal information into the
afferent channels so it can be perceived. The simple-minded way to do this
(my normal way) was to route a copy of the reference signal through a
short-circuit into the perceptual input function of the system that is
providing the reference signal. Then the input function of the higher system
receives a signal just like the one it would receive if the lower system had
actually made its own perceptual signal match the reference signal it is
receiving from above. Normally the higher-level input function receives
copies of lower-level perceptual signals; substituting the reference signals
sent to each contributing lower-level system would create the same situation
that would hold if the lower systems were all controlling perfectly.
This immediately suggested "imagination," because imagination has the same
sort of properties that this connection would have. First, the
short-circuited reference signal would enter the same input function that
the lower-level perception would normally enter, so the signal would receive
the same interpretation it receives in the normal mode of operation. Second,
the conversion of the reference signal into a perception would be immediate
and effortless -- control of the perceptions would be perfect. Third, it
would be possible to imagine perceptions in this way which the lower-level
systems could not actually provide, either because doing so would be
physically impossible (imagine lifting your car over you head) or because
you don't happen to be in the required environment (while you're driving to
work, imagine having a conversation with your boss). Fourth, the terms in
which we imagine are exactly the same terms in which we perceive. Such
properties certainly fit what we call imagination. Incidentally, brain
research has recently shown that animals which are anticipating the
appearance of a stimulus show activity in the same perceptual channels that
are involved when the stimulus actually appears, which is strong support for
this picture.
It was only a short step to get memory into this. If efferent signals from
one level of systems are translated by a memory function into the actual
signals received as references by lower systems (a feature which would take
care of translating from the terms of a higher system into the terms of a
lower one), then the same connection could explain remembering as well as
imagining. The memory aspect of reference signals comes in when you "do the
same thing again." If the "thing" is turning left at the third traffic
light, what you are repeating is obviously the perception of turning left,
not the actions that lead to this result in the traffic of today, and with
the timing of today's arrival at the traffic light which could be either
green or red (or broken) when you get there. What you're repeating is the
_perception_ of turning left, not the _actions_, which means that the
perceptions must be remembered somehow and used as reference signals. But if
you can do that, you can also simply remember without acting, because the
source of the reference signals is memory and the imagination connection can
route the output of memory into the perceptual input functions that will
give that output the correct interpretation.
So we get imagination, remembering, and "doing the same thing again" all
from the basic postulate that all perception is of afferent signals. Quite a
harvest from planting a single seed. And of course we also get planning and
dreaming -- model-based control is the "modern" term.
OK, I wanted you to see the structure of the model that explains why I want
to keep the postulate that all perception is associated with afferent
channels only.
And who says we can't perceive error? Are you asserting that when I wish to
be at A, and perceive myself to be at B, that I can't perceive the error in
my position? And act on it?
This is how levels of perception get into the act. I'm on the left side of
the street (A) and I wish to be on the right side of the street (B). How do
I perceive being on the right side of the street when I am not there? By the
above reasoning, I must imagine being there. Imagining provides a signal
(actually a lot of signals, because we're really talking about multiple
systems operating in parallel) that is like what I would experience if I
were in position B, on the other side of the street. Normal-mode perception
provides similiar signals representing being in position A, the position
where I am. I can now _perceive the difference in positions_ at a higher
level of perception. One of the positions is real, the other imagined. And I
can perceive the relationship between them.
The relationship is a certain distance between A and B. And what is the
_reference_ relationship? ZERO distance between A and B. So the higher
control system turns this error (which I do not perceive) into an action
that moves me from A to B and corrects the relationship error.
If the control-system error signals were the errors we perceive, then we
would always have to reduce all errors to zero. It's very easy to see the
target in a pursuit tracking task as setting the reference position and the
cursor position as being the controlled variable. Obviously, good tracking
requires minimizing the "error" in cursor position. If you've become
satisfied with this interpretation, it comes as a great shock to see the
controller suddenly start keeping the cursor two inches to the right of the
moving target. I always try to administer this shock when demonstrating
control, as with the rubber band experiment. The point is that the
controlled variable is a spatial _relationship_, and cursor-on-target is
just one of a possible range of relationships that could be maintained. It's
not an error in the control-system sense, it's just a distance. If you
always pick the reference condition of zero distance you have a degenerate
case, because zero error does happen to coincide with zero distance between
target and cursor. But if you pick a different distance like two inches to
the right for the cursor, zero error corresponds to a NON-ZERO distance
between cursor and target. And then you can see that while the spatial
relationship is perceivable, the error signal is not.
Best,
Bill P.
···
---------------------------------------------------------------------------