Conrol of (and with) rate of firing

[Clem McGowan (981123.1850)]

Take a look at the general interest article located at:

   http://www.salonmagazine.com/21st/feature/

It describes some exciting experimental brain surgery. This surgery implants
a device that -- after growth establishes a connection -- uses neuronal rate
of firing and feedback to the implanted person (a stroke victim) for him to
achieve a new control capability -- control of a cursor's position by brain
activity.

From a PCT perspective this result seems more natural than surprising. Indeed

the surgeon who developed this procedure Dr. Phillip Kennedy noted:
"People say it's amazing that your brain can operate this cursor. I think
it's more amazing that your brain can operate your arms, your legs, your
mouth."

[From Bill Powers (981124.0615 MST)]

Clem McGowan (981123.1850)--

Take a look at the general interest article located at:

  http://www.salonmagazine.com/21st/feature/

Most interesting. Also interesting is the proprietary nature of the growth
factor and the capsule. Someone remarked recently that the motivation for
many scientists, these days, is no longer the pursuit of knowledge, but the
hope of getting rich.

Best,

Bill P.

[From Chris Cherpas (981124.1111 PT)]

Clem McGowan (981123.1850)--

Take a look at the general interest article located at:

  http://www.salonmagazine.com/21st/feature/

The emphasis on variations in rates of firing sounded like
an exact fit with one of PCT's modeling assumptions. Is
there another interpretation?

Bill Powers (981124.0615 MST)--

Someone remarked recently that the motivation for
many scientists, these days, is no longer the pursuit
of knowledge, but the hope of getting rich.

I guess if it really gets us more knowledge, I'll buy it.

Best regards,
cc

[From Bill Powers (981224.1343 MST)]

Chris Cherpas (981124.1111 PT)]

Bill Powers (981124.0615 MST)--

Someone remarked recently that the motivation for
many scientists, these days, is no longer the pursuit
of knowledge, but the hope of getting rich.

I guess if it really gets us more knowledge, I'll buy it.

I rather suspect that it slows us down. Science depends on the free and
open exchange of information. If information is held back to obtain a
commercial advantage, science loses.

Best,

Bill P.

Date: Tue, 24 Nov 1998 11:11:12 -0800
From: Chris Cherpas <computeruser@HOME.COM>
Subject: Re: Conrol of (and with) rate of firing

[From Chris Cherpas (981124.1111 PT)]

Clem McGowan (981123.1850)--
>Take a look at the general interest article located at:
>
> http://www.salonmagazine.com/21st/feature/

The emphasis on variations in rates of firing sounded like
an exact fit with one of PCT's modeling assumptions. Is
there another interpretation?

[From Peter Cariani (981125)]

Hi everyone!

One should never try to extrapolate what neuroscientists are
really thinking from a popular science article -- the writers
almost invariably mangle whatever the scientists tell them in
order to get something concise that is semi-intelligible
to the general public.

But of course this is very interesting work indeed. Grey Walter
in the 1950's had such feedback experiments going where EEG's
were displayed and stimuli were triggered on particular phases
of EEG's. (see The Living Brain, c. 1959). There are some
very striking effects that occur when external stimuli are
coupled to endogenous rhythms. (There is a cottage industry
of stimulus-induced brain manipulation, see Hutchinson,
MegaBrain, c. 1991 for a pop-intro).

One needs to be careful here. From the article, there is an
audio feedback of the firings of the neuron(s) and there is
also feedback from cursor movements. First, firing rate may
be under adaptive control, but it may be one of any number
of spike train parameters that could be controlled. Other
potential variables might be the latency of spikes relative
to some reference auditory event or the synchrony between
spikes produced within some neural population. Many of the
putative codes in the CNS also have some component that
varies with firing rate, so that the controlled variable
(I hope I have this terminology right) is not necessarily
exactly the variable that is being used by the system to
encode the percept and/or to actuate a muscle response.
For example, an audio signal with more spikes is louder than
one with fewer ones, and rhythmic firings or bursts may be more
perceptually salient than other patterns.

Usually neuroscientists see some variation of a stimulus
parameter and firing rate, and then, since they can now tell
a story that everyone understands, they stop looking for
alternative codes or conditions that would falsify their
simple story. For example, the bit about the whiskers is
much more complicated than is related in the news story --
much of that kind of work was done under heavy anesthesia where
there is much less activity than in the waking animal, where
there is considerable spontaneous activity. In awake animals
when whiskers are briskly stroked, my understanding is that
many regions in somatosensory cortex are activated (way
beyond restricted classical receptive fields comprising
one whisker). I would point to Nicolelis' work (he uses
50-100 chronically implanted electrodes in an awake animal),
but very similar kinds of things are seen in all other
sensory systems -- the areas that are activated can be
quite broad when the stimuli are well above perceptual
thresholds. These effects cast doubt on simple rate
codes, though not more complicated ones.

It's important not to overestimate our present knowledge
of neural codes in the cerebral cortex -- we are really
in a state that is comparable to molecular biology before
the nature of the genetic code was understood
(e.g. that genetic information resides in DNA rather than protein).

Peter Cariani

P.S. This article set off some other bells.....
What is also interesting about this feedback
experiment is that the time patterns of spikes
that are transmitted over the audio channel in effect
recreate similar time patterns in the auditory system
which then may reinforce the original pattern of
produced spikes (it would be quite interesting if
particular patterns emerged over time, having been
reinforced by the feedback loop). The clicks that
are produced when listening to spike activity we
know robustly create similar time patterns over
large parts of auditory cortex and indeed over the
rest of the cortex (acoustic transients and patterns
of transients are particularly well-represented in
the cortex).

(I think of this because I have been working on
recurrent timing models for auditory expectation,
e.g. how a rhythm builds up an expectation of
its continuation. Movements similarly contain
perceptual expectations of what is to happen as
their consequence).

Let's think about the full percept-action loop
(or action-percept loop, if you prefer) for a minute.
Whenever there are motor commands to activate
muscles, there must be a volley of well-timed
signals to the various muscle groups to initiate,
modulate and terminate movements (to an agonist
at time t, to an antagonist after some delay, etc).
There are efferent copies of the time structure
of this command-volley that are generated, then
there is a similar temporal pattern that is
generated by the stretch receptors when the
muscles move, then there is yet another similar
temporal pattern that is generated in the
environmental disturbances that are produced
(e.g. acoustic disturbances created by
articulatory muscles), then there is a
sensory signal (e.g. an auditory signal of
the utterance) that once again carries many
of the gross aspects of the time structure
of the command, efferent-copy, stretch-feedback,
articulator movement, and acoustic production
(albeit with different characteristic delays).
It may be the case that the whole mechanism by
which we learn to coordinate our bodies has
to do with the conguence/incongruence of these
various time patterns -- that the basic adaptive
mechanisms are set up to put all of these patterns
into congruence, and that the audio feedback is
then a particularly efficient way of closing
the sensorimotor (motorsensory) loop. There is
older work by Morrell, John, and others that
time patterns are assimilated during conditioning,
and that memory traces encode the respective
times of events in addition to their simple
conjunctions, so the general idea is perhaps
not so far-fetched.

Perhaps a test of this would be if the spike rate
were converted into a continouous pure tone whose
frequency varied with spike rate --
would the feedback be as effective?

[From Rick Marken (981125.1040)]

Clem McGowan (981123.1850)--

Take a look at the general interest article located at:

   http://www.salonmagazine.com/21st/feature/

It describes some exciting experimental brain surgery. This
surgery implants a device that -- after growth establishes a
connection -- uses neuronal rate of firing and feedback to the
implanted person (a stroke victim) for him to achieve a new
control capability -- control of a cursor's position by brain
activity.

I don't understand what the big deal is here. It looks like
Kennedy (the developer of the proprietary procedure) has found
a very expensive and intrusive way of doing what I did with
David Goldstein's cheap biofeedback equipment years ago; I
controlled a variable aspect of a computer display (the size
of a rectangle, but it could just as easily have been the lateral
position of a cursor) by "thinking". In the biobeedback case
the "thinking" affects GSR which affects the computer display
variable; in Kennedy's case "thinking" affects neural firing rate
which affects the computer display variable.

Kennedy's approach is more direct than biofeedback in the sense
that the feedback connection from output (neural activity) to
input (computer display variable) has fewer links; in the
biofeedback case the feedback connection is

neural activity-->GSR-->computer display variable

whereas in the Kennedy demo the connection is

neural activity-->computer display variable

Kennedy's more direct method (which requires _brain surgery_
and drugs -- the proprietary tissue growth chemical) seems
justified only if it significantly imporves the _quality_
of control that can be exerted by the patient. The Salon
report says nothing at all about how tight cursor control is
using Kennedy's method. This seems like the most important thing
to know about Kennedy's method since the biofeedback approach to
control of visual variables is such a well known and inexpensive
alternative.

I know from my own experience that the quality of control in
the biofeedback case is pretty poor; but it's definitely better
than nothing and it would surely do for a paraplegic what
Kennedy's method does -- it would give a paraplegic a means
of controlling the cursor using an output system (GSR) that is
still intact.

For comparative purposes, quality of control using biofeedback
vs the Kennedy system could be measured in terms of easily
understood PCT type variables like the stability factor.

Best

Rick

···

--
Richard S. Marken Phone or Fax: 310 474-0313
Life Learning Associates e-mail: rmarken@earthlink.net
http://home.earthlink.net/~rmarken

[From Chris Cherpas (981125.1040 PT)]

Peter Cariani (981125.1300 ET)--

These effects cast doubt on simple rate
codes, though not more complicated ones.

I'm not surprised that a simple rate would not be
the end of the story, but your informative post has
opened a range of possibilities that I had not considered,
and look forward to investigating.

It's important not to overestimate our present knowledge
of neural codes in the cerebral cortex -- we are really
in a state that is comparable to molecular biology before
the nature of the genetic code was understood
(e.g. that genetic information resides in DNA rather than protein).

Perhaps the "decade of the brain" to be revised
to the "century of the brain" to put the problem
in better perspective.

It may be the case that the whole mechanism by
which we learn to coordinate our bodies has
to do with the conguence/incongruence of these
various time patterns -- that the basic adaptive
mechanisms are set up to put all of these patterns
into congruence, and that the audio feedback is
then a particularly efficient way of closing
the sensorimotor (motorsensory) loop.

If I understand you correctly, this approach
expands beyond, but is consistent with, Gerald
Edelman's view of coordination/integration.

Best regards,
cc

Rick Marken (981125.1040)--

I don't understand what the big deal is here. It looks like
Kennedy (the developer of the proprietary procedure) has found
a very expensive and intrusive way of doing what I did with
David Goldstein's cheap biofeedback equipment years ago; I
controlled a variable aspect of a computer display (the size
of a rectangle, but it could just as easily have been the lateral
position of a cursor) by "thinking".

Is this written up somewhere? Sounds like a good read.

This is an excerpt from The Salon (Kennedy quote):

"I think it should be kept purely medical. It's an
  invasive procedure. You have to do a craneotomy.
  It's possible that they will use EEG waves -- if
  they can figure those well enough -- to control
  computers. But they're usually on and off signals."

Did the study with David Goldstein use EEG?

The Salon report says nothing at all about how tight cursor control
is using Kennedy's method. This seems like the most important thing
to know about Kennedy's method since the biofeedback approach to
control of visual variables is such a well known and inexpensive
alternative.

Agreed. Anything called "The Salon" already seems a bit tainted.

I know from my own experience that the quality of control in
the biofeedback case is pretty poor;

Any data on variability with experience or training or across
subjects?

For comparative purposes, quality of control using biofeedback
vs the Kennedy system could be measured in terms of easily
understood PCT type variables like the stability factor.

Unfortunately, Consumer's Guide has not done this study yet.

What did you think of changes in rate of firing being
"the key information" (see Kennedy quote below)?

"The information in one neuron and its electrical
output is not just the fact that it's connected to
something else, but the fact that the rate of firing
can change. And it's the rate of firing, that rate of
change, that's the key information ... "

Best regards,
cc

[From Rick Marken (981125.1630)]

Me:

I controlled a variable aspect of a computer display (the size
of a rectangle, but it could just as easily have been the lateral
position of a cursor) by "thinking".

Chris Cherpas (981125) --

Is this written up somewhere?

This was just an informal thing that happened in the early 80s.
David showed my some biofeedback equipment he had that ran on
a PC. It was really very simply; a GSR electrode was hooked to
my finger tip; the output of the electrode went into the serial
port of the PC; the software took this continuously changing
measure of GSR and converted it into an animated square whose area
(I believe) was proportional to the GSR measure. So by "thinking"
about stuff that influenced the GSR (thinking about sex seemed to
work well for me; when I thought about naked ladies the rectangle
got bigger -- just as you might expect;-) -- and when I mentally
dressed them the rectangle shrank. So I could control a display
variable by thinking; but the control was lagged and very low gain.
I couldn't keep the retangle steady at an exact target size.

Did the study with David Goldstein use EEG?

I think it could; but we used GSR.

Any data on variability with experience or training or across
subjects?

Sorry. No. This was done informally. David might know of some
data on biofeedback control, though. Is there any good data on
the quality of biofeedback-based control, David?

What did you think of changes in rate of firing being
"the key information" (see Kennedy quote below)?

I think it reflects the influence of the idea that behavior is
the control of _output_. Control of the auditory representation of
the neural firing rate seems unnecessary to me; the cursor position
is presumably as dependent on neural firing rate as is the tone
intensity; why not just control the cursor directly? The person
in the Kennedy set-up is probably doing something like what I
was doing in David's biofeedback set-up; thinking about something
that, for whatever reason, influences the output (GSR or beural
firing rate) that influences the controlled variable (area of
rectangle or position of cursor).

I think it is possible that Kennedy's complex "neural growth"
technique may actually allow a person to control a variable
(like cursor position) better than does the simple biofeedback
technique. But I would really like to see the data on it. Right
now it strikes me as a terribly expensive and unpleasant way to
accomplish the same thing that could be accomplished with a nice,
safe, cheap GSR system. And all because Kennedy thinks that
behavior is the control of _output_ rather than the control
of _input_.

Best

Rick

···

--
Richard S. Marken Phone or Fax: 310 474-0313
Life Learning Associates e-mail: rmarken@earthlink.net
http://home.earthlink.net/~rmarken

[From Chris Cherpas (981125.2323 PT)]

Rick Marken (981125.1630) --

The person in the Kennedy set-up is probably doing
something like what I was doing in David's biofeedback
set-up; thinking about something that, for whatever
reason, influences the output (GSR or neural firing
rate) that influences the controlled variable (area of
rectangle or position of cursor).

Thanks for the info.

Chris Cherpas (981125) --

What did you think of changes in rate of firing being
"the key information" (see Kennedy quote...)?

Rick Marken (981125.1630) --

I think it reflects the influence of the idea that behavior is
the control of _output_.

This didn't occur to me. I think I need remedial reading,
or possibly some kind of implant.

Best regards,
cc

[From Rupert Young (981125.1000 UT)]

Chris Cherpas Wed, 25 Nov 1998 13:39:31 -0800

Is this written up somewhere? Sounds like a good read.

You can find something similar to the fingertip control system as described by Rick from MindDrive at
http://www.other90.com/new/home.html
A product you can buy and try out yourself. It sounds interesting though I've no idea how good it is.

Regards,
Rupert

[From Dick Robertson,981125.0657CST]

Bill Powers wrote:

[From Bill Powers (981124.0615 MST)]

Clem McGowan (981123.1850)--

>Take a look at the general interest article located at:
>
> http://www.salonmagazine.com/21st/feature/

Most interesting. Also interesting is the proprietary nature of the growth
factor and the capsule. Someone remarked recently that the motivation for
many scientists, these days, is no longer the pursuit of knowledge, but the
hope of getting rich.

Best,

Bill P.

Something to think about for sure. Thanks for calling attention.

Best, Dick R.

[From Rick Marken (981126.0920)]

Me:

I think it [Kennedy's neural control technique] reflects the
influence of the idea that behavior is the control of _output_.

Chris Cherpas (981125.2323 PT)

This didn't occur to me. I think I need remedial reading,
or possibly some kind of implant.

I think I'm just hypersensative to this stuff. It was the part
of the Salon article about controlling the amplitude of a tone
in order to control neural firing rate that was the real give-
away. Clearly, Kennedy is thinking that that brain controls
outputs (efferent neural signals) in order to produce an intended
result of these outputs (cursor movements). In fact, as we know
from PCT, the brain must _not_ control outputs if it is to be
able to control a consequence of these outputs. So a person
can't move a cursor to a particular position by producing a
paricular neural signal; the neural signal that moves the cursor
to the intended position depends on prevailing disturbances and
the nature of the feedback connection from neural signal to cursor
movement.

Behavior is the control of input; the system must be able to
vary its output _as necessary_ in order to produce the inputs
it intends. The system can't do this if it intends to produce
a particular output (if it is controlling its output).

Rupert Young (981125.1000 UT) --

You can find something similar to the fingertip control system
as described by Rick from MindDrive at
http://www.other90.com/new/home.html

Yes. This looks like the Pentium II version of what I did with
David's equipment.

Best

Rick

···

---
Richard S. Marken Phone or Fax: 310 474-0313
Life Learning Associates e-mail: rmarken@earthlink.net
http://home.earthlink.net/~rmarken/

[From Mike Acree (981130.0851 PST)]

Peter Cariani (981125)--

But of course this is very interesting work indeed. Grey Walter
in the 1950's had such feedback experiments going where EEG's
were displayed and stimuli were triggered on particular phases
of EEG's. (see The Living Brain, c. 1959). There are some
very striking effects that occur when external stimuli are
coupled to endogenous rhythms.

Indeed. When Grey Walter connected a slide projector to the cortical
readiness wave, so that mere anticipation of the next slide triggered
the mechanism, some subjects became so excited at being able to produce
the next slide simply by "willing" it to appear that they wet their
pants.