Springs and Muscles

[From Bruce Abbott (2015.03.02.1230 EST)]

If you’ve been following my “Springs and Muscles” series of posts, by now you may be wondering what happened to the next installment, comparing Bill Powers’ PCT-based model of the bottom-level control system to one based on Feldman’s equilibrium-point hypothesis. Well, several issues cropped up that I have had to deal with and it’s been taking me much longer than expected to resolve them. In fact I’m still working on it.

Although I have a nice description of Bill’s model in his 1999 paper describing the “Little Man 2” demo and have the computer code that Bill wrote to implement that model, it wasn’t clear to me how the code represents the model. The paper describes a system with an inner loop that implements control of muscle tension and an outer loop that implements control over muscle length, just as shown in the block diagram presented at Figure 7.4 in B:CP (Powers, 1973). Muscles can only pull, so to control joint angle, nature provides opposing muscles that change joint angle in opposite directions: flexors to close the angle and extensors to open it. However, in his implementation for Little Man 2, Bill chose to replace the flexor-extensor pair with a single “muscle” that can both pull and push. (The “push” represents the pull of the opposing muscle.) According to Bill, this simplified the model by automatically taking account of the reciprocal actions of opposing muscle and the cross-inhibitory neural connections that make this happen, so long as it is assumed that neither muscle becomes completely slack. If that assumption holds, then the two muscles can be represented as a single spring, with a particular length, that can be either stretched or compressed. In the model, the resting position is given a value of zero, so that deviations from this point represent the degree of elongation or compression of the spring.

Bill asserts that real muscles act like strongly nonlinear springs, but by representing opposing muscles with a single spring, the nonlinearities tend to cancel out. Consequently the composite push-pull spring can be represented in the model as a linear spring. In the model, therefore, Hooke’s Law will give a reasonably good approximation to the force generated by muscle contraction or stretch from the neutral position. Thus, multiplying this deviation by the muscle spring constant, ks, gives the force generated by the muscle.

Using this single push-pull muscle may have simplified the implementation of the model, but it also had two unfortunate consequences. First, I found the model as implemented in code much more difficult to understand, and second, the push-pull model does not provide a direct means to produce specified levels of co-contraction, as could be done if the two opposing muscles were represented independently. In the paper Bill states that co-contraction is “absorbed into the effective spring constant,” but the model as implemented provides no means for varying the effective spring constant. The Feldman model to which I intend to compare Bill’s model provides independent reference inputs for reciprocal contraction and co-contraction, and it would be nice to have that same ability in Bill’s model for the purpose of comparison.

Although Bill’ s model works by producing changes in muscle contraction (or stretch) as output, those changes are represented in the model as changes in joint angle, as if joint angle were a linear function of muscle length. This is another simplification, which Bill acknowledges would need to be corrected in a more realistic model. The model also directly computes Torque (force inducing rotation about the joint) rather than the muscle tension or compression that produces the torque.

The environment side represents the limb (whose angle is being changed through joint rotation) in terms of length, mass, and its moment of inertia. These are used to compute the angular acceleration of the limb, which is integrated to give its angular velocity, which is integrated to give its angular position, during each iteration of the simulation loop.

Bill’s original presentation includes two references, one to the alpha motor neuron and the other to the muscle spindles. In Merton’s servo model, varying the spindle reference determined the degree of muscle contraction through feedback to the alpha motor neuron. However, data showed that the alpha and gamma motor neurons tend to be co-activated. In Bill’s model as implemented in Little Man 2, both the alpha and gamma neurons receive the same reference value (and thus are co-activated). There is no provision for manipulating them separately. By separating them I have found that manipulating the alpha reference level produces rather limited changes in joint angle, given the gain factors that Bill found to produce good control. Most of the variation in joint angle can be achieved by varying the spindle reference value by itself. Whether that is realistic or not I do not currently know.

Finally, those gain factors do not seem to match up with what is known about the physiology of the system. Perhaps this is due to the use of linear approximations in the model rather than the various nonlinear relationships known to exist in the real system.

Perhaps this has all led me too far afield – I certainly can compare the PCT and EP models at the diagrammatic level without getting into issues concerning how to implement comparable simulations. But I sure would like to have those two simulations to compare, if only to assure myself that my analyses of the two models and their behaviors are valid.

Bruce

Hi Bruce, it is a shame to say it, but my hunch is that you will have to compare a new PCT model with the Feldman model. It sounds like Bill got a lot right but also these anatomical and physiological simplifications should like they need to be unsimplified to make a direct comparison, don’t you? Then it would be the Abbott PCT muscle model…

Warren

···

Dr Warren Mansell
Reader in Clinical Psychology
School of Psychological Sciences
2nd Floor Zochonis Building
University of Manchester
Oxford Road
Manchester M13 9PL
Email: warren.mansell@manchester.ac.uk

Tel: +44 (0) 161 275 8589

Website: http://www.psych-sci.manchester.ac.uk/staff/131406

The highly acclaimed therapy manual on A Transdiagnostic Approach to CBT using Method of Levels is available now.

Check www.pctweb.org for further information on Perceptual Control Theory

[From Bruce Abbott (2015.03.03.0945)]

···

From: Warren Mansell (wmansell@gmail.com via csgnet Mailing List) [mailto:csgnet@lists.illinois.edu]
Sent: Monday, March 02, 2015 1:14 PM
To: Bruce Abbott
Cc: CSGnet
Subject: Re: Springs and Muscles

Hi Bruce, it is a shame to say it, but my hunch is that you will have to compare a new PCT model with the Feldman model. It sounds like Bill got a lot right but also these anatomical and physiological simplifications should like they need to be unsimplified to make a direct comparison, don’t you? Then it would be the Abbott PCT muscle model…

Warren

BA: Thanks, but no, it would still be the Powers PCT model. All I would have done is substitute more realistic functions to go into the system diagram boxes and represent each muscle separately. The control system Bill developed for force and length control of the muscle would remain the same.

Bruce

[From Bruce Abbott (2015.03.03.0945)]

···

From: Warren Mansell (wmansell@gmail.com via csgnet Mailing List) [mailto:csgnet@lists.illinois.edu]
Sent: Monday, March 02, 2015 1:14 PM
To: Bruce Abbott
Cc: CSGnet
Subject: Re: Springs and Muscles

Hi Bruce, it is a shame to say it, but my hunch is that you will have to compare a new PCT model with the Feldman model. It sounds like Bill got a lot right but also these anatomical and physiological simplifications should like they need to be unsimplified to make a direct comparison, don’t you? Then it would be the Abbott PCT muscle model…

Warren

BA: Thanks, but no, it would still be the Powers PCT model. All I would have done is substitute more realistic functions to go into the system diagram boxes and represent each muscle separately. The control system Bill developed for force and
length control of the muscle would remain the same.

Bruce

[From Rick Marken (2015.03.04.1050)]

···

Bruce Abbott (2015.03.02.1230 EST)–

Â

BA: If you’ve been following my “Springs and Musclesâ€? series of posts, by now you may be wondering what happened to the next installment, comparing Bill Powers’ PCT-based model of the bottom-level control system to one based on Feldman’s equilibrium-point hypothesis. Well, several issues cropped up that I have had to deal with and it’s been taking me much longer than expected to resolve them. In fact I’m still working on it.

RM: This seems like a very odd way to compare models. You seem to be comparing the models in terms their correspondence to “known” anatomical/physiological properties of an organism (the properties of the muscles, tendons and neural systems involved in limb position control) rather than comparing them in term of their ability to account for observable behavior. Of course, when you do the latter type of comparison you want the model to be at least not inconsistent with what is known about the anatomical/physiological characteristics of the system being modeled. But I would be inclined to look at the detailed correspondence of the model to anatomical/physiological characteristics of the system once we’ve established which model does a better job of accounting for the behavioral data. Â

RM: But, of course, you gotta do what you gotta do. So I look forward to seeing your comparison once you get things straightened out to your satisfaction.Â

BestÂ

Rick

Â

Â

Although I have a nice description of Bill’s model in his 1999 paper describing the “Little Man 2â€? demo and have the computer code that Bill wrote to implement that model, it wasn’t clear to me how the code represents the model. The paper describes a system with an inner loop that implements control of muscle tension and an outer loop that implements control over muscle length, just as shown in the block diagram presented at Figure 7.4 in B:CP (Powers, 1973). Muscles can only pull, so to control joint angle, nature provides opposing muscles that change joint angle in opposite directions: flexors to close the angle and extensors to open it. However, in his implementation for Little Man 2, Bill chose to replace the flexor-extensor pair with a single “muscleâ€? that can both pull and push. (The “pushâ€? represents the pull of the opposing muscle.) According to Bill, this simplified the model by automatically taking account of the reciprocal actions of opposing muscle and the cross-inhibitory neural connections that make this happen, so long as it is assumed that neither muscle becomes completely slack. If that assumption holds, then the two muscles can be represented as a single spring, with a particular length, that can be either stretched or compressed. In the model, the resting position is given a value of zero, so that deviations from this point represent the degree of elongation or compression of the spring.

Â

Bill asserts that real muscles act like strongly nonlinear springs, but by representing opposing muscles with a single spring, the nonlinearities tend to cancel out. Consequently the composite push-pull spring can be represented in the model as a linear spring. In the model, therefore, Hooke’s Law will give a reasonably good approximation to the force generated by muscle contraction or stretch from the neutral position. Thus, multiplying this deviation by the muscle spring constant, ks, gives the force generated by the muscle.

Â

Using this single push-pull muscle may have simplified the implementation of the model, but it also had two unfortunate consequences. First, I found the model as implemented in code much more difficult to understand, and second, the push-pull model does not provide a direct means to produce specified levels of co-contraction, as could be done if the two opposing muscles were represented independently. In the paper Bill states that co-contraction is “absorbed into the effective spring constant,â€? but the model as implemented provides no means for varying the effective spring constant. The Feldman model to which I intend to compare Bill’s model provides independent reference inputs for reciprocal contraction and co-contraction, and it would be nice to have that same ability in Bill’s model for the purpose of comparison.

Â

Although Bill’ s model works by producing changes in muscle contraction (or stretch) as output, those changes are represented in the model as changes in joint angle, as if joint angle were a linear function of muscle length. This is another simplification, which Bill acknowledges would need to be corrected in a more realistic model. The model also directly computes Torque (force inducing rotation about the joint) rather than the muscle tension or compression that produces the torque.

Â

The environment side represents the limb (whose angle is being changed through joint rotation) in terms of length, mass, and its moment of inertia. These are used to compute the angular acceleration of the limb, which is integrated to give its angular velocity, which is integrated to give its angular position, during each iteration of the simulation loop.

Â

Bill’s original presentation includes two references, one to the alpha motor neuron and the other to the muscle spindles. In Merton’s servo model, varying the spindle reference determined the degree of muscle contraction through feedback to the alpha motor neuron. However, data showed that the alpha and gamma motor neurons tend to be co-activated. In Bill’s model as implemented in Little Man 2, both the alpha and gamma neurons receive the same reference value (and thus are co-activated). There is no provision for manipulating them separately. By separating them I have found that manipulating the alpha reference level produces rather limited changes in joint angle, given the gain factors that Bill found to produce good control. Most of the variation in joint angle can be achieved by varying the spindle reference value by itself. Whether that is realistic or not I do not currently know.

Â

Finally, those gain factors do not seem to match up with what is known about the physiology of the system. Perhaps this is due to the use of linear approximations in the model rather than the various nonlinear relationships known to exist in the real system.

Â

Perhaps this has all led me too far afield – I ceertainly can compare the PCT and EP models at the diagrammatic level without getting into issues concerning how to implement comparable simulations. But I sure would like to have those two simulations to compare, if only to assure myself that my analyses of the two models and their behaviors are valid.

Â

Bruce

Â

Â

Â

Â

Â

Richard S. Marken, Ph.D.
Author of  Doing Research on Purpose
Now available from Amazon or Barnes & Noble

[From Bruce Abbott (2015.03.13.1200 EST)]

image00410.jpg

Reza Shadmehr and Stephen P. Wise (2005) published a book, Computational Neurobiology of Reaching and Pointing: A Foundation for Motor Learning. Shadmehr’s laboratory website provides several supplements for use with this book that detail the derivation of the many formulas used to simulate the kinematics and dynamics of movement as well as the properties of muscles and spindles. One of these (musclemodel.pdf) ends by presenting what the authors describe as “A model of the spinal controller,” or “schematic of the spindle and Golgi tendon organ feedback system,” shown at right. Note the force control signal entering the “interneurons” and summing with the force feedback signal coming from the tendon organs. The output of these interneurons goes to the alpha motor neurons, which contract the muscle, thus generating force on the tendon organs and on the load. (External forces also act on the load and together these determine changes in muscle length.)

At the bottom left of the diagram is the length control signal, which enters the gamma motor neuron to produce a “gamma bias” that acts on the muscle spindles. The spindles sense the length of the muscle as well as the rate of change in length; the output signal feeds back onto the same alpha motor neurons that receive feedback from the tendon organs via the interneurons.

image00610.jpgFor comparison, at right is the equivalent diagram from Powers (1973). Bill simplified his diagram a bit by omitting the interneurons, which invert the sign of the force signal coming from the Golgi tendon organs; thus the “force control signal” and ‘driving signal” of Shadmehr and Wise’s diagram are combined as the alpha reference signal in Bill’s diagram. Thus the diagram Shadmehr and Wise presented in 2005 is essentially identical to the diagram Bill provided for this same system in 1973.

I don’t want to leave the impression, however, that Shadmehr and Wise interpret the system’s operation in the same way as Bill does. According to them, gamma motor activity (i.e., their “length control signal”) is “set based on the expected length change in the muscle” (emphasis mine). If I understand them correctly, Shadmehr and Wise are here referring to the coactivation of the alpha and gamma motor neurons so as to produce equal contraction of the main muscle and the muscle spindle, thus preventing the muscle spindle from generating a non-zero error signal as a result of main-muscle contraction. Instead, an error in perceived muscle length will occur only if the contraction of the spindle actually matches the contraction of the muscle. In this scheme, an “unexpected” load will cause the muscle to contract more (if the load is lighter than expected) or less (if the load is heavier than expected) than the muscle spindle, resulting in an non-zero error signal from the spindle. Because this signal feeds back negatively, the error signal will tend to change muscle output in a direction that will reduce this error between expected and actual load. Shadmehr and Wise give the example of picking up a milk carton you believe is empty but which turns out to be full. The result is that you don’t exert enough force on the carton at first. (The more interesting example, in my opinion, is where you believe the carton to be full when it is empty, with the result that your arm flies up because you initially exert too much force.) The resulting discrepancy between spindle contraction and actual muscle contraction produces an error signal that readjusts muscle contraction to the actual load, after an initial under- or over-reaction.

In Bill’s interpretation, input to the gamma motor neurons changes the spindle’s reference level for muscle length, while input to the alpha motor neuron changes the alpha reference signal. Because the alpha motor neuron acts as a comparator that receives perceptions of both tendon force and the error in muscle length (from the spindles), the reference signal entering it cannot be interpreted simply as a force reference signal but instead represents a force reference modified by length error. The Shadmehr and Wise diagram separates the force reference signal from the alpha motor neuron input so that its role as a force reference is clearer.

In Powers (1999) Little Man 2 demo, the alpha reference signal also goes to the gamma motor neuron to become the gamma reference signal, thus producing coactivation of the two signals. In tests I’ve conducted, the gamma input to the spindles was found to be doing most of the work in changing joint angle, given the parameter values Bill found to work well.

My understanding of the system in question is hampered by my uncertainty as to the actual effects of muscle spindle output. Type 1a (or “primary”) afferents are primarily sensitive to rate of change in muscle length and length error. Spindles also produce type 2 (or “secondary”) afferents that are sensitive to muscle length. Bill suggested that rate sensitivity might be used to help stabilize the system. The muscle model implemented in Little Man 2 produces a error signal that is proportional to the difference in length between muscle and spindle, without the velocity component. There is also a line of code that seems intended to add rate sensitivity, but I’ve made some tests of this and it just doesn’t seem to do much.

Reading Shadmehr and Wise’s supplements has shown me just how out of my depth I am in terms of the mathematics involved in these models. Often they provide formulas in the form of differential equations, whereas what I need are the difference equations in order to implement them iteratively in a simulation. Unfortunately for me, my mathematical training ended with algebra and trig.

Bruce

image00178.jpg

image00332.jpg