assorted replies, and some more

[Hans Blom, 930621]

(Bill Powers (930620.1600 MDT))

The slogan "it's all perception" is much too static. It has a
connotation of having to act in an a priori circumprescribed
way given a set of perceptions and a set of top-level (very
slowly changing; innate?) reference levels.

I agree. Perceptions are learned, too. There is a reason for the
slogan, however. It's to remind us that each of us sits inside
one of these gadgets, and that ALL we know either of the world or
of our own actions and inner being consists of perceptions.

Agreed. This is the important point that CSG makes and that I fully
agree with. In places, I disagree with some of the details of your
models, however (you notice how each time I stress the 'optimal' usage
of what is perceived), but that does not detract from the importance
of this basic point.

We can tune our responses finer and finer, and reach ever
higher qualities of response and perception.

I'm not sure how you mean this, but it sounds like one of the
concepts we're trying to destroy. "Response" is the conceptual
opposite of "control." It implies a blind reaction to an input,
and carries overtones of jab-and-jump psychology.

I am talking in terms of the response of a control system to, say, a
step change of a reference level or of a disturbance. As you know, the
response might be overly damped or oscillatory. By a high quality
response I mean one that is approximately critically damped. Maybe you
show a great deal of self-control when your response is critically
damped :slight_smile:

Control over control is self-control, perceiving your own
perceptions is self-perception, consciousness.

That sounds nice, but I don't believe it. If you diagram a system
that senses the stability of a control system and adjusts
parameters to control stability, you do not have a system
controlling itself: you have a system controlling something about
a different system. If you perceive your own perceptions, one
subsystem is perceiving the perceptions originating in another
subsystem, and most likely interpreting them in a different way.
The moment you say "I am thinking," you have denied the
statement: the system that is aware of the thinking is not
thinking, it is making a statement about a system that is
thinking. The "I" of which you speak is never the "I" that
speaks.

I do not believe in a monolithic "I", and neither do your models. Just
look at that "society of mind". There is a lot of parallel processing
going on in that brain of ours, and it is quite possible that one part
talks about what another part is thinking. In a mentally healthy
person, I assume that the parts are more or less in mutual contact; in
multiple personality disorder they are not.

The only way to make sense of self-reflexive ideas is to treat a
person as if that person were solid, like a potato: only the
whole person perceives and acts.

Demonstrably false. In split brain patients, one hand of the patient
may caress his wife while the other hand hits her. In my experience,
many people (all?) show such (psychological?) splits to some extent.
Inconsistencies, due to 'conflict'.

Loop gain, in PCT, is not "internal to the device."

In a hifi amp, it is. That was my example.

                                               I suspect that
you haven't yet understood just how the PCT diagram differs from
the standard engineering one.

Yes, I think I do. But sometimes I need to make a principle clear
using the simplest example that I can think of, and I think that this
kind of reductionism is the basis of science. If you cannot clarify a
principle using a simple example, you will certainly be unclear when
things get complex. Anyhow, thanks for the repeat. One comment to this
section:

This separation is always important in detailed control-system
design, but especially so when the effector is coupled to the
controlled quantity loosely or through complex intervening
processes. Then we clearly would expect the effector output to be
changing far more than the controlled quantity is changing.

That would be bad in any control system, especially if the load can
vary. An optimal control system needs to know as exactly as possible
what the effects of its OUTPUTS are. This can be done by SENSING THE
ACTIONS OF THE EFFECTORS (by sensors in or near the effectors) and OB-
SERVING THE REACTION OF THE OUTSIDE WORLD to the actions of the effec-
tors (in any sensory modality). I therefore hypothesize that human
effectors have must have built-in sensors. These should sense what the
effectors do, not through a (changing) environment as your model
shows, but as intimately and directly as possible.

Note that this directly solves the adaptation (learning) problem as
well: correlating the effector's action with the world's reaction
'identifies' ('systems identification') the world. This is how
adaptive control systems work, and this is how I suppose a human
works. This is also where control theory meets information theory.

Our effectors do in fact have built-in and/or built-on sensors, as you
know. In my opinion, they have this additional function above the one
that you describe, the comparator function.

When we see the controlled variable separated from the effector
output, we can much more easily understand that the visible
behavior of an organism is really just its actuator output

Not when the actuator is loosely coupled to its environment (through
some layers of skin tissue, for example). An analogy is a battery with
a large internal resistance. Its 'visible' voltage greatly depends on
its load.

(Martin Taylor 930621 11:10)

It seems to me that just as a power gain is an essential element of
the outflow side of a control system, so a corresponding power loss
is an essential element of the inflow (perceptual) side. The
perceiving of the state of a CEV should not contribute as a disturb-
ance any more than it must (Heisenberg showed that it must, to some
extent).

How true. Very familiar, too. In my blood pressure controller, the
arterial pressure must be measured. Imagine what a thick needle in a
thin blood vessel can do to disturb the circulatory system and thence
the pressure measured!

             On the other hand, the output power of the control
system wants to have maximum effect on the CEV, or as tight coupling
and as high power gain as is feasible, given the information limita-
tions on the perceptual side.

Feel that micromanipulator carefully tear a single cell away from its
surrounding tissue as your hand squeezes on the macroscopic counter-
part of the micro-pincer. Power GAIN? No! Very carefully scale the
power down! Almost Virtual Reality...

(Rick Marken (930621.1000))

could you just tell us -- does the sensory input to a control
system contain information regarding how "plant" outputs should
vary in order to control the sensed variable?

Hans Blom (930620) replies --

Sorry, but I decline to be arbiter. As a teacher (my other role) I
have to say that having this discussion is by far more fruitful than
knowing who is right.

But just out of curiosity, who is right? I'm sure we'll go on
discussing it anyway, even after we find out. Or is your point that
neither side is right? Or that both are right?

My experience says that servomechanism theory and information theory
are orthogonal. Neither has any use for the other. In the field that
is called 'optimal control theory', however, where you deal with noisy
sensors, noisy actuators and a noisy and/or a changing environment, it
becomes critically important to try to identify the characteristics of
the environment's reactions to your actions as accurately as possible.
Optimal control theory is very much an extension of the combination of
servomechanism theory and information theory. And therefore not very
attractive for people who refuse to think in terms of stochastic
differential equations and their ilk, I might say :slight_smile:

It shows, once again, that PCT is trying to just make a simple point;
that is, behavior is the process if controlling INPUT perceptual
variables. That is a simple point, but it is basic.

Yes, but not only. See above.

(Tom Bourbon (930621.1301))

Identifying our flockness turned it into a controlled variable [CSG-
L], for each of us. From something that had never been a controlled
variable, we created one.

Nicely put! Yet, no single individual can 'control for' CSG-L. But
where two or three are gathered in the name of CSG-L...

(Tom Bourbon (930621.1323))

                                              Take one example of
control, as it is recreated or predicted by PCT models, and show me,
in the results of simulations, how making more "information"
available "within the control system" improves the recreations and
predictions from the model.

Let me give you a practical example from my blood pressure controller.
The arterial blood pressure decrease delta_p due to an infusion flow
rate i can be modelled as

      delta_p = sensitivity * i

where sensitivity is a constant that describes an individual's sensi-
tivity for the drug used. It can vary by a factor of 80. That is just
the static response, that is obtained as soon as a stable pressure is
established. The dynamics of the process can be modelled by a delay
time of about one minute and a dominant time constant of about one
minute as well, in case you're interested. I will leave out other
gruesome details, such as an often (but not always!) very pronounced
non-linearity of the response and frequent sensor malfunction due to
drawing blood through the same line that the pressure is measured
with.

In this controller it was crucial to estimate the the individual's
sensitivity (not necessarily very accurately; within a factor of two
was good enough) to obtain a step-response that did not oscillate yet
was fast enough to satisfy the anesthesiologist. Note that the sens-
itivity was not known and could not be established beforehand and had
to be established while controlling. I dare you to design a servo-
mechanism that can control under these circumstances. I tried but
failed miserably.

Then show me that those results generalize, with no further tinkering
with the model, to new conditions, with unpredictably different
disturbances and targets. That is not much to ask. Just improve on
the performance of a single-level, single-loop PCT model.

We did. With slight modifications (different choices for sensitivity
range, delay time, time constant), we got the system going with
another drug. That was also the control of blood pressure. Now we are
working on a very similar 'robust' control system for muscle relaxa-
tion, with excellent prospects.

(Tom Bourbon (930621.1348))

In a reply, Bill addressed your idea that loop gain is internal to
the device. (It is not.)

In a hifi power amp, it is. See above.

                                   But analogue is what living
systems are all about. Neural currents and hormonal fluxes are
analogue, through and through.

No, they are not. They are MODELLED as such. Neural currents come in
units called action potentials, and hormones come in units called
molecules. Using 'fluxes' in a MODEL is fine, as long as you do not
forget that a model necessarily is a simplification of reality.

Greetings,

Hans

Tom Bourbon (930621.1748)

Only time for a brief reply to part of Hans' post:

[Hans Blom, 930621]

..

(Tom Bourbon (930621.1348))

                                   But analogue is what living
systems are all about. Neural currents and hormonal fluxes are
analogue, through and through.

No, they are not. They are MODELLED as such. Neural currents come in
units called action potentials, and hormones come in units called
molecules. Using 'fluxes' in a MODEL is fine, as long as you do not
forget that a model necessarily is a simplification of reality.

Yes, the are. Don't forget, action potentials neither originate at nor
travel to synapses. At the synapse, slow potentials, correlated highly
with fluxes in the synaptic space, are the order of the day. I don't use
fluxes in a model just to be using them; rather, I use them because the
concepts of flux and current come a lot closer to describing the synaptic
business of nervous systems than do the "impulses" moving along single
axons. Even using the action potential as a measure, it is action
potentials across axons across time that comprise the affairs of the nervous
system -- back to currents and fluxes, again. The nervous system seems not
to be very discreet -- oops, discrete -- in its affairs.

Until later,
   Tom Bourbon

From Tom Bourbon (930622.1725)

From all indications, my posts to and from csg-l stopped going through,

early this morning. The traffic just resumed. If the following message did
go through earlier, I apologize for the duplication; if not, here it is.

From Tom Bourbon (930622.1157)

[Hans Blom, 930621]

..

(Tom Bourbon (930621.1323))

                                              Take one example of
control, as it is recreated or predicted by PCT models, and show me,
in the results of simulations, how making more "information"
available "within the control system" improves the recreations and
predictions from the model.

That remark was in as post directed to Martin Taylor. It was a reiteration
(the third or fourth) of an offer I first made a couple of years ago.
Rather than assert that Martin's claims that information theory can
contribute to PCT (no, that PCT derives necessarily from information
theory), I suggested that Martin and anyone who cares to join him take one
published example of prediction by a PCT model and show that procedures or
measures from information theory improve the predictions. When that
demonstration is achieved, there will be no need to debate whether
information theory can contribute to PCT; it will already have done so.

The offer remains in effect. The additions, which must be information
theoretic, must improve the correlations between predicted and human
performance beyond the present .996 or .997. Stated another way, the
additions must "explain" or "account for" more than the .991-plus of the
variance accounted for by the present PCT model.

Let me give you a practical example from my blood pressure controller.
The arterial blood pressure decrease delta_p due to an infusion flow
rate i can be modelled as

     delta_p = sensitivity * i

where sensitivity is a constant that describes an individual's sensi-
tivity for the drug used. It can vary by a factor of 80. That is just
the static response, that is obtained as soon as a stable pressure is
established. The dynamics of the process can be modelled by a delay
time of about one minute and a dominant time constant of about one
minute as well, in case you're interested. I will leave out other
gruesome details, such as an often (but not always!) very pronounced
non-linearity of the response and frequent sensor malfunction due to
drawing blood through the same line that the pressure is measured
with.

In this controller it was crucial to estimate the the individual's
sensitivity (not necessarily very accurately; within a factor of two
was good enough) to obtain a step-response that did not oscillate yet
was fast enough to satisfy the anesthesiologist. Note that the sens-
itivity was not known and could not be established beforehand and had
to be established while controlling. I dare you to design a servo-
mechanism that can control under these circumstances. I tried but
failed miserably.

Nice, but not an example of the results from an application of the simplest
PCT model to human performance. We are not attempting to be control
engineers. Horrors, that would mean we might make a living out of our work!

Then show me that those results generalize, with no further tinkering
with the model, to new conditions, with unpredictably different
disturbances and targets. That is not much to ask. Just improve on
the performance of a single-level, single-loop PCT model.

We did.

Did you? Where are the results of using the PCT model to recreate or
predict an instance of human performance?

With slight modifications (different choices for sensitivity
range, delay time, time constant), we got the system going with
another drug. That was also the control of blood pressure. Now we are
working on a very similar 'robust' control system for muscle relaxa-
tion, with excellent prospects.

Again, that is nice to know. It reaffirms my genuine belief that control
engineering is a thriving enterprise and that it can lead to useful, many
times important, products. I know that many aspects of our lives have been
influenced by devices crafted by control engineers. But I am a reformed
psychologist who recently renounced that professional title. I am trying to
understand control by living things. Even with my severely limited skills,
I have been able to apply the PCT model to instances of control by
individuals, pairs, and groups of four. The results amaze me, coming as I do
from an academic and research background in which statistical trash passes
as the currency of the realm. I am eager to see the PCT model added to and
improved in any way possible -- so long as the addition or improvement works
-- and my criterion for "working" is improvement in prediction, either
by producing closer fits for previously studied phenomena, or by predicting
phenomena not previously modeled. When I ask for demonstrations, that is
what I mean, nothing more.

Until later,
   Tom Bourbon

Rick Marken,

I am sorry to take so long to respond to your
response (930614.1400) to my questions about modeling the
phenomenon of understanding (930614). I have been off the
net for two weeks due to a family crisis, APS convention, etc.

I appreciate your post. As a way of helping you see where I
am coming from, I thought it might be best to send you parts
of a poster presentation I did at APS (American Psychological
Society). I am intending to submit something along this line
for publication.

I hope you would take the time to go through it and help me
out with your PCT input. I am aware that its not reporting
The Test with higher level functioning, but to me its a step
in that direction.

My questions about understanding are rooted in this paper
but are also an attempt to go beyond this present work.

Title--Computer-based Drill Performance Predicted by Feedback
Processing: Explained by Perceptual Control Theory

Abstract
        The theoretical concern is explanations of higher level
        human functioning which are rooted in Perceptual Control
        Theory (Powers, 1973) The applied concern is the
        identification of the source of differing performance levels.
        Data are reported from over 150 hours of computer-based drills.
        Fifty-four subjects were tasked to learn name labels for 27
        combinations of simultaneous displays of graphic, aural, and
        iconic information. After each response subjects were asked
        to judge the certainty of their response correctness (a form
        of metacognitive estimate). Then response sensitive feedback
        information was displayed. The highest performing subjects
        showed an inverse relationship between certainty and feedback
        frame latency. This could indicate that subjects had a goal (or
        reference level) for understanding the associations between
        stimuli and the correct label. They also displayed a significant
        increase in feedback time when responses were incorrect,
        indicating an additional goal of responding correctly to the
        stimuli. The middle performing subjects did not demonstrate a
        goal of understanding but tended to exhibit only a goal for
        responding correctly (and that with lower magnitude). The lowest
        performing subjects exhibited little consistent relationship
        between feedback time and correctness, nor between feedback time
        and certitude. We interpret their poor performance to be due to
        a lack of goals (reference levels) for correctness or
        understanding. This work demonstrates an empirically based and
        theoretically driven explanation of an enduring practical problem
        in training and education.

Introduction
        Our proposed solution to the enduring problem of understanding
        instructional feedback (e.g. Kulhavy & Stock, 1989; McKendree,
        1990) for adaptive instruction, is to view humans as hierarchical
        perceptual control systems. Three aspects of PCT or Perceptual
        Control Theory (see Bourbon, 1990; Cziko, 1992; Marken, 1986;
        Powers, 1973, 1978, 1990) are pivotal to our understanding of
        how humans use instructional feedback: 1. a human always seeks to
        maintain or control perceptual input so that it matches internal
        perceptual references or goals, in order that error signals or
        discrepancy will be minimized; 2. a humanUs behavior is driven by
        discrepancyQoutput, and as such behavior is simply the means of
        controlling perceptual input; 3. a human is composed of a hierarchy
        of levels of control, such that the output of higher level control
        systems control the internally driven goal state of the lower level
        control systems (For the most detailed explanation of PCT, see
        Powers, 1973.)

        Thus when a student in a class or a subject in an experiment
        perceives a feedback message, that personUs use of the feedback
        is to be explained in terms of the following: 1. the subject
        views the message, compares perceptions stimulated by the message
        to the internal goals that are operative at that moment, and then
        2. continues to spend time with the message (probably executing
        RprocessingS programs) as long as the message continues to appear
        helpful in reducing the magnitude of discrepancy. And the crucial
        point in this paper is that 3. the references that will be
        operative as the subject spends time with the feedback message are
        determined by the output of higher level control systems related
        to the task at hand.

        The basic concern here is that subjects should have various
        references or goals which drive the lower level programs and
        the use of the feedback message and thereby affect the performance.
        That is, subjects could have the following higher level goals:
        a) Rgetting done with this boring taskSQperceiving the task as
        finished; b) Rgetting responses correctSQperceiving correct
        feedback messages; c) Runderstanding why a response is correctS
        Qperceiving distinct connections between category labels (correct
        responses) and the output of programs for perceiving the associates
        of the categories. These types of concerns are not only
        theoretically noteworthy but are also important to a trainer who
        has goals that the students would be correct and/or understand.
        We propose that a means of testing a subjectUs higher level control
        is by observing his/her use of the feedback message. By looking at
        the variance of feedback frame latencies across levels of
        metacognitive judgments of response certainty (e.g. Hancock,
        Stock, Kulhavy, 1992), and between response correctness
        (right or wrong), we hope to determine whether each subjectUs
        higher level control systems are efficiently related to learning
        to respond correctly. Thus, we are attempting an empirically
        based and theoretically driven understanding of an enduring
        practical problem in training and education.

        We assume that a subject who rates his/her certainty of
        responding correctly is thereby providing evidence of the
        amount of discrepancy that persists in control systems
        related to responding correctly. For example, a subject who
        rates 100% certainty of being correct is presumably sensing no
        discrepancy related to responding correctly, while a subject
        who rates 25% is experiencing substantial discrepancy. And
        secondly, we assume that a subject who spends more time with
        a feedback frame is using the information in the frame to
        reduce discrepancy, and thereby the performance should be
        improved as well. Based on these assumptions, we would hypothesize
        the following: 1. Those subjects who have stronger goals for
        understanding, will have feedback frame times that increase as
        certainty decreases. 2. Those subjects that have stronger goals
        for responding correctly, will have feedback frame times that
        are longer for incorrects than for corrects. 3. Those subjects
        who have stronger goals for something other than understanding
        or responding correctly (such as getting finished), will have
        feedback frame times which bear little consistent relationship
        to either correct/incorrect differences or to certainty. In this
        context, we hypothesize that the objective correct performance
        will be ordered according to hypothesized higher level references:
        understanding > correct responding > something else.

Method
        The basic experimental design was a completely within subjects
        factorial design--5 levels of certitude estimate, and 2 levels
        of response correctness. The predicted value was the feedback
        time. For the group analyses the subjects were ordered by mean
        correct response--high, middle, low. The ultimate concern was
        not just grouped data, but the trends within individuals.
        Fifty-four university undergraduates participated. The subjects
        were randomly assigned to the experimental conditions.
        The stimuli consisted of 27 separate items each presented as a
        screen of information. Each item consisted of three separate
        but simultaneous displays of graphic, aural and iconic information.
        In addition, the graphic, aural and iconic information could be
        presented at one of three levels, yielding a total of 27
        combinations. The right side of the screen also displayed 27
        names. Each display item was associated with one and only one
        of these names. The subjectUs task was to identify the display
        item by clicking on the appropriate name with the computerUs mouse.
        The certainty rating screens included a certainty rating scale:
        RHow certain are you that your response is correct?S 100% certain,
        75% certain, 50% certain, 25% certain, 0% certain. There was a
        radio button to the left of each level of certainty.

    Each feedback screen displayed response sensitive feedback information.

        The procedure during each of the five approximately 40 minute sessions
        was as follows:
        -1. view stimulus item and Rclick onS a name button;
        -2. view a certainty rating scale and select a rating;
        -3. view the feedback screen, and press a RcontinueS button;
        -4. view the next stimulus item, etc.

Results
        First, in casting a net (Runkel, 1990), performance (ability/
        achievement) groups were determined by dividing the subjects into
        thirds according to mean number of correct responses. All group and
        individual analyses of variance were performed on log2 feedback
        frame times. Inspection of the graphic plots of the data indicated
        that the trends were as hypothesized.

        The partial R squared was calculated for the relation between
        correctness and feedback time, adjusting for certitudeQtop group,
        .570; middle group, .185; low group, .058. And the R squared was
        calculated for the relation between certainty following corrects
        and feedback timeQtop group, .305; middle group, .173; and low
        group, .070.

        With the same analyses conducted separately on each subject there
        were the following trends: high groupQevery subject yielded a
        significant effect (alpha = .01) for correctness and 10 of the
        16 had significant effects for certainty; middle groupQ11 of 16
        significant effects for correctness and 6 of 16 for certainty;
        low groupQ3 of 16 significant effects for correctness and 3 of
        16 for certainty.