perspective on the healthcare bill

[From Bill Powers (2009.09.05.0856 MDT)]

Rick Marken (2009.09.04.2145) --

RM: Yes, the standard error of the sampling distribution of r goes down with increasing N but I don't see how that would "artificially" inflate significance (you can't really inflate significance because it's an all or none thing).

BP: Try "inflate the level of significance" (make p < 0.1 look like p < 0.05). If you get what looks like more significance just by using the same data twice, something is wrong, isn't it?

RM: I guess I still don't understand the problem. But the significance tests are not important to my argument anyway.

BP: In one sense they are: the data you present show that there is no relationship between variables that are commonly assumed to be related. Martin L. was actually arguing on your side by pointing out that the correlations may be even lower than they appear to be.

Martin L. is saying some things about data that raise my eyebrows. If a theory doesn't predict what actually happens, how can it be considered right? That is starting to sound theological.

RM: And I am not presenting these correlations in order to predict or recommend what individuals should do in their daily lives. I am simply presenting them as measures of an observed relationship between variables (aggregate variables at that), a relationship that seems pertinent to the question of whether, as economists believe, increased taxation (an aggregate variable) is associated with a decrease in growth (another aggregate variable) or an increase in unemployment (another aggregate variable).

BP: Right, the statistics are being used correctly in Runkel's "casting nets" mode. However, if a policy that economic theory predicts will improve the economy in the aggregate has a 33% chance of making it worse, should we put that policy into practice?

RM: The way we know what's going on with the cursor-action relationship is through modeling. If that's how economists know that something like circular causality is involved in the tax-growth relationship then I would just like to see the modeling that reveals it. It would not disturb me at all to find out that there is clear evidence, based on modeling, that taxes really do impede growth. I just want to know how economists know this is true. Because just looking at the data it looks like taxes either have nothing to do with growth (if the correlations are really not significant) or they are positively related to growth.

BP: The reason that arguments about economics get so passionate is that the arguments on all sides are so ineffective. That's good control theory. After the reasoning fails, the yelling starts, and then the guns come out. As far as I'm concerned, I won't know the truth about economics until I see a working model that correctly represents what has already happened and correctly predicts what will happen if various policies are put into effect. So far I haven't seen or been able to devise such a model, so all the confident pronouncements about economic truths that I hear and read appear hollow to me. And so do the criticisms of economic theories, because the people arguing on your side don't have a working model, either. Nobody has a verified working model; that's why it's a waste of time to argue. If anyone wants to know how the economy works, work on the model. Otherwise the arguments pro and con are built on sand.

Best,

Bill P.

[From Rick Marken (2009.09.05.0950)]

Bill Powers (2009.09.05.0856 MDT)–

BP: Try “inflate the level of significance” (make p < 0.1 look like p < 0.05). If you get what looks like more significance just by using the same data twice, something is wrong, isn’t it?

I make sure to teach my students that saying a result is “more significant” is a version of lying with statistics. Significance is the probability that you are making an error when you reject the null hypothesis. You are supposed to decide on what you consider to be an acceptable probability of error (significance level) before you collect the data. Then you collect the data and see if the observed statistic (say, r) allows you to reject the null with your preselected probability of being wrong.

You don’t have to do anything fancy to improve your chances of observing a statistic (r) that will allow you to reject the null; just increase the sample size. Assuming that the null is false (it probably always is), increasing sample size makes it more likely that you will observe an r value that is above the “critical r” for you pre-selected significance level (traditionally .05 or .01). That means that, by increasing sample size, you can make post hoc decisions to reject the null with a significance level on the order of .0000001 or less.

When people report these extremely small post hoc significance probabilities, they are wrongly implying that a result that is significant at, say, the .0000021 level is more important than a result that is significant at the .01 level. This is lying with statistics because these probabilities depend on df as well as the actual deviation of the population statistic from the null value. But this kind of thing is done all the time in reports of the results of psychological research. I was up in arms about this canard even before I was involved in PCT and apparently the journals have finally come around. Nowadays, people have to report not only significance levels but true measures of something like strength of association, in the form of r2. So an r of .2 might be reported as significant at the .00001 level in one report and only at the .05 level in another but now it would also have to be reported that this correlation means that one variable accounts for only 4% of the variance in the other in both cases!

BP: In one sense they are: the data you present show that there is no relationship between variables that are commonly assumed to be related. Martin L. was actually arguing on your side by pointing out that the correlations may be even lower than they appear to be.

I know. And I was trying to concur.

Martin L. is saying some things about data that raise my eyebrows. If a theory doesn’t predict what actually happens, how can it be considered right? That is starting to sound theological.

My point as well!

BP: Right, the statistics are being used correctly in Runkel’s “casting nets” mode. However, if a policy that economic theory predicts will improve the economy in the aggregate has a 33% chance of making it worse, should we put that policy into practice?

Wait, you switched from data to theory. I presume you meant to say: if a policy that economic data predicts will improve the economy in the aggregate. Whatever, I’m not using my data to recommend policy. I’m using my data to show that there is no basis for economists to recommend against a policy of raising taxes as recession.

Since no one has a good model of how the economy works, all policy makers are shooting in the dark. But there seems to be a consensus among economists, based apparently on nothing but theology, that one of the possible shots we might take – increasing taxes, especially on the upper brackets – is recessionary. All I’m trying to say is that these people are full of some serious bull. Raising taxes may not help. But there is absolutely no empirical basis for saying that raising taxes will hurt.

BP: The reason that arguments about economics get so passionate is that the arguments on all sides are so ineffective. That’s good control theory.

Sounds like a tautology rather than control theory. I suspect that even a perfect model will not keep some people from ignoring the results. If the model shows, for example, as I think it will, that increases in wealth discrepancy lead to decreases in economic performance, the people who are against any form of wealth redistribution because it’s “socialist” will be out in the street with their guns drawn just as fast as they are now. That’s good control theory; people will protect their perceptions from disturbance. If people want to perceive “capitalism red in tooth and claw” as the ideal economic system then that’s what they are going to see, facts and models be damned. I think it’s great to build an economic model that predicts the data perfectly. But I predict, based on control theory, that when we have that model, it will be to the “free marketers” of the world like water off a ducks back. Actually, I should say the same about committed “collectivists” as well. If it turns out that the model shows that the economy works best when it’s every man for himself, then the socialists will be out there (with pamphlets in stead of guns, perhaps, but it will be the same) foolishly fighting for economic fairness, the fools;-)

After the reasoning fails, the yelling starts, and then the guns come out.

My experience dealing with ideologues is that the reasoning (and certainly the consideration of the data) never really starts.

As far as I’m concerned, I won’t know the truth about economics until I see a working model that correctly represents what has already happened and correctly predicts what will happen if various policies are put into effect.

Me too!

So far I haven’t seen or been able to devise such a model, so all the confident pronouncements about economic truths that I hear and read appear hollow to me.

I agree. But we are living in the real world here and we have to try to act in ways that make things better. Since we have no model, I recommend (for the time being) the e. coli approach that I described earlier; if a policy seems not to be working (and it’s clear that virtually all the policies implemented over the last 8 years are not working) then change it and see how things go. If the change seems to make things better then stay with it; if not, change again. I presented the data on taxes and recession to show that there is no empirical basis for eliminating tax increases on the wealthy as a policy option, even during a recession.

And so do the criticisms of economic theories, because the people arguing on your side don’t have a working model, either.

I don’t have a side. Again, I’ve been trying to be up front about the fact that I have no better idea of how the economy works than anyone else. All I am doing is presenting data that shows that there is NO EVIDENCE that a policy of increasing the upper marginal tax rate is recessionary; so there is no reason to avoid trying this policy at this time, especially since we apparently could use some revenue to balance the budget.

Nobody has a verified working model; that’s why it’s a waste of time to argue. If anyone wants to know how the economy works, work on the model. Otherwise the arguments pro and con are built on sand.

But I’m not arguing about how the economy works. I’m arguing about one little thing: that the data does not seem to support the idea that we should not raise taxes during a recession. I have no idea whether raising taxes will make things better or worse. I’m just saying that I see NO EVIDENCE that this policy has ever been recessionary. I’m waiting to hear from those who believe that taxes are recessionary, why they think so. So far, I’ve heard only that this belief is based on theory. Which, of course, is like saying “it’s because I say so”.

Best

Rick

···


Richard S. Marken PhD
rsmarken@gmail.com
www.mindreadings.com

[From Bill Powers (2009.09.05.1230 MDT)]

Rick Marken (2009.09.05.0950)–

RM: You don’t have to do
anything fancy to improve your chances of observing a statistic (r) that
will allow you to reject the null; just increase the sample
size.

BP: But if your second sample is simply an exact copy of the first sample
(i.e., not new observations independent of the first set, but just the
first set written down again) does that count as increasing the sample
size? That’s what I think Martin L. is talking about – though I’m
exaggerating his point here by saying that the two sample sets are
identical rather than just correlated by being partly determined by some
common extraneous influences like seasonal variations.

RM: So an r of .2 might be
reported as significant at the .00001 level in one report and only at the
.05 level in another but now it would also have to be reported that this
correlation means that one variable accounts for only 4% of the variance
in the other in both cases!

BP: I like that. Good example. But I already know the difference between
significance and importance.

BP: Martin L. is saying some things about data that raise my
eyebrows. If a theory doesn’t predict what actually happens, how can it
be considered right? That is starting to sound theological.

My point as well!

BP: Right, the statistics are being used correctly in Runkel’s
“casting nets” mode. However, if a policy that economic theory
predicts will improve the economy in the aggregate has a 33% chance of
making it worse, should we put that policy into practice?

Wait, you switched from data to theory. I presume you meant to say: if a
policy that economic data predicts will improve the economy in the
aggregate.

I don’t think data predict anything. They just describe observations. A
occurs, then B occurs. If your theory is that A causes B, you predict
that making A occur again will cause B to occur. But if your theory is
that some unknown C is causing both A and B, you will not make that
prediction, using the same data. The behavioral illusion,
remember?

Whatever, I’m not using my data
to recommend policy. I’m using my data to show that there is no basis for
economists to recommend against a policy of raising taxes as recession.

BP: Yes, and you can use the same data to show there is no basis for
supporting a policy for raising taxes. There is no basis for drawing any
conclusion. If you want to raise taxes, or lower taxes, it can’t be
because of what the data tell you.

RM: Since no one has a good
model of how the economy works, all policy makers are shooting in the
dark. But there seems to be a consensus among economists, based
apparently on nothing but theology, that one of the possible shots we
might take – increasing taxes, especially on the upper brackets – is
recessionary. All I’m trying to say is that these people are full of some
serious bull. Raising taxes may not help. But there is absolutely no
empirical basis for saying that raising taxes will hurt.

BP: Nor that it will help, as you said. I agree that economists base
their recommendations on inadequate evidence. How does that show their
recommendations are manure? Or that yours aren’t?

BP: The reason that arguments about economics get so passionate is
that the arguments on all sides are so ineffective. That’s good control
theory.

Sounds like a tautology rather than control theory.

Not at all. If your action is only weakly connected to the variable
you’re trying to control, you will have to produce a lot of output to
have the effect you want – and if that doesn’t work, you will raise the
output gain some more.

An increase in the vehemence of an argument shows that the outputs are
being increased because they are not having the desired effect. You then
have to make them even more vehement, or give up the argument. Excessive
heat in an argument shows that the arguments are failing.

Rm: I suspect that even a
perfect model will not keep some people from ignoring the results. If the
model shows, for example, as I think it will, that increases in wealth
discrepancy lead to decreases in economic performance, the people who are
against any form of wealth redistribution because it’s
“socialist” will be out in the street with their guns drawn
just as fast as they are now.

BP: I don’t believe that increases in wealth discrepancy lead to
decreases in economic performance. I don’t believe the opposite, either.
What data led you to your conclusion? How do you know what the model will
show? And if you have already make up your mind about that, shouldn’t you
recuse yourself from the model-building effort? What if you begin to
suspect that the model is going to show something else?

That’s good control
theory; people will protect their perceptions from disturbance. If people
want to perceive “capitalism red in tooth and claw” as the
ideal economic system then that’s what they are going to see, facts and
models be damned. I think it’s great to build an economic model that
predicts the data perfectly. But I predict, based on control theory, that
when we have that model, it will be to the “free marketers” of
the world like water off a ducks back.

So all the people who believe in free markets are prejudiced and
impervious to reason? You anticipate universal stupidity from
free-marketers. I predict that you will stick to that expectation no
matter what happens, which makes you just like them, just another control
system controlling for predetermined truths. You’ve declared your
position – doesn’t that mean you have to defend it now?

BP earlier: After the reasoning fails, the yelling starts, and then
the guns come out.

RM: My experience dealing with ideologues is that the reasoning (and
certainly the consideration of the data) never really starts.

BP: What makes you different from them, except for the particular
ideology you’re expressing?

BP earlier: As far as I’m concerned, I won’t know the truth about
economics until I see a working model that correctly represents what has
already happened and correctly predicts what will happen if various
policies are put into effect.

Me too!

BP: Wait a minute, “Me too” what? You’re speaking as if you
know what the model will show us, but what if it shows that you’re wrong
and the other side is right about some things? If you take a position
now, isn’t that going to make it hard to evaluate the model correctly? I
was saying I don’t know the truth, and that I am committing myself to the
model-based approach which I’m trying to do without hoping or wishing for
it to turn out any particular way. You say “Me, too” but it
doesn’t sound as if you’re doing that.

BP earlier: So far I haven’t seen or been able to devise such a
model, so all the confident pronouncements about economic truths that I
hear and read appear hollow to me.

RM: I agree. But we are living in the real world here and we have to try
to act in ways that make things better. Since we have no model, I
recommend (for the time being) the e. coli approach that I described
earlier; if a policy seems not to be working (and it’s clear that
virtually all the policies implemented over the last 8 years are not
working)

BP: It’s not clear to me. I can think of lots of things I didn’t like
about the last 8 years, but those are just my own reactions and have
nothing to do with Truth. There were lots of other people who were quite
happy with what was going on, with equally little reason except for their
own personal preferences. Whose preferences count the most? You see
errors and want to reorganize. What about others who don’t see errors,
and don’t want to reorganize?

RM: then change it and see how
things go. If the change seems to make things better then stay with it;
if not, change again. I presented the data on taxes and recession to show
that there is no empirical basis for eliminating tax increases on the
wealthy as a policy option, even during a recession.

BP: But you haven’t shown the opposite, that we should maintain taxes on
the wealthy. Just showing that an argument is baseless doesn’t
automatically mean that its opposite must be true. Reorganization is
based on error, so before you reorganize you have to determine that there
is an error. If you just reorganize because you don’t know what to do
next, you could be throwing perfectly good control systems away. You
still might get somewhere, because there’s always the chance that you’re
right. But reorganization is slow and inefficient, and it’s always better
to have a systematic way of solving problems; in fact, finding those ways
is supposed to be one of the outcomes of reorganization.

BP earlier: And so do the criticisms of economic theories, because
the people arguing on your side don’t have a working model, either.

RM: I don’t have a side. Again, I’ve been trying to be up front about the
fact that I have no better idea of how the economy works than anyone
else. All I am doing is presenting data that shows that there is NO
EVIDENCE that a policy of increasing the upper marginal tax rate is
recessionary; so there is no reason to avoid trying this policy at this
time, especially since we apparently could use some revenue to balance
the budget.

BP: But haven’t you just stated which side you’re on? You say there’s no
reason not to try it, but is that a reason to try it? There are a lot of
people saying that they can think of reasons not to try it. Do we just
brush them away? It doesn’t sound to me as if you don’t have a
side.

BP earlier: Nobody has a
verified working model; that’s why it’s a waste of time to argue. If
anyone wants to know how the economy works, work on the model. Otherwise
the arguments pro and con are built on sand.

RM: But I’m not arguing about how the economy works. I’m arguing about
one little thing: that the data does not seem to support the idea that we
should not raise taxes during a recession.

BP: Nor does it support the idea that we should raise taxes during a
recession. You’re trying to make knowledge out of ignorance. If you can’t
prove something is wrong, it must be right?

RM: I have no idea whether
raising taxes will make things better or worse. I’m just saying that I
see NO EVIDENCE that this policy has ever been recessionary. I’m waiting
to hear from those who believe that taxes are recessionary, why they
think so. So far, I’ve heard only that this belief is based on
theory. Which, of course, is like saying “it’s because I say
so”.

BP: And there you are saying we should try raising taxes, or keep them
raised, because you say so. Your willingness to proceed as if raising
taxes is not recessionary is no more justified by the data than the other
side’s reluctance to raise taxes because doing so would be
recessionary.

All my objections here have to do with clinging to previous arguments and
positions instead of abandoning them and trying to develop a model which
will give us some basis for drawing conclusions. Wouldn’t it be enough
just to know that we are working our way toward a real basis for making
decisions, and a solid understanding of how economies work? If a project
like that were under way, couldn’t we simply drop whatever half-baked
ideas we had been having and look forward to finding out the
truth?

I don’t know if you remember the days before the first moon landing.
There were furious debates about what the astronauts would encounter.
There was one camp which argued that the first step into the surface of
another world would end up with the man (or the landing module)
disappearing into a fine dust layer several kilometers deep, never to be
seen again. There were arguments about finding lava or volcanos,
arguments about just about everything anyone had imagined about the moon.
And all this only about a day or two before the astronauts would actually
get there and find out what the conditions actually were. I simply
couldn’t imagine why anyone was arguing at all, when all they had to do
was wait a few days to see the answers.

If I thought a model was really going to be developed, and this isn’t
quite an empty dream yet, it wouldn’t matter to me what opinions about
the economy anyone had, including my own. I’m a little discouraged, as I
was the last time, when arguments start to develop before the model is
even started. This pretty much tells me that the people doing the arguing
are not really going to try to help develop the model, or that if they
did, they would be so prejudiced that they wouldn’t contribute much
anyway.

I wish we could just start working on the model, not worrying about where
it will lead but just trying to get it right. That’s all we really need
to do.

Best,

Bill P.

[From Rick Marken (2009.09.06.1050)]

Bill Powers (2009.09.05.1230 MDT)-

Rick Marken (2009.09.05.0950)–

RM: You don’t have to do
anything fancy to improve your chances of observing a statistic (r) that
will allow you to reject the null; just increase the sample
size.

BP: But if your second sample is simply an exact copy of the first sample
(i.e., not new observations independent of the first set, but just the
first set written down again) does that count as increasing the sample
size? That’s what I think Martin L. is talking about –

Well, I still don’t think I understand but maybe Martin L. can clear it up.

BP: Yes, and you can use the same data to show there is no basis for
supporting a policy for raising taxes. There is no basis for drawing any
conclusion.

I disagree. The data show that growth has been higher and unemployment lower when the top marginal tax rate was higher. These are the observed relationships, and they are statistically significant on top of it. But even if they weren’t I think the observations must count for something.

BP: Nor that it will help, as you said. I agree that economists base
their recommendations on inadequate evidence. How does that show their
recommendations are manure? Or that yours aren’t?

I didn’t say their recommendations were manure. I said they had no evidentiary basis for recommending against raising taxes, which is what they do recommend.

BP: I don’t believe that increases in wealth discrepancy lead to
decreases in economic performance. I don’t believe the opposite, either.
What data led you to your conclusion?

I don’t believe it; I suspect it. And this suspicion is based both on the historical data and some data on the relationship between Gini and GDP per capita accross differnet countries. But if it turn out that there is actually no relationship between wealth discrepancy and, say, growth or unemployment, then that would be surprising but no more discouraging than finding that mass has nothing to do with water displacement.

How do you know what the model will
show? And if you have already make up your mind about that, shouldn’t you
recuse yourself from the model-building effort?

I am not committed to a model doing anything but fitting the data. How are you planning to evaluate whatever model you produce if you think all the data is useless?

So all the people who believe in free markets are prejudiced and
impervious to reason?

No. As you see from what I said later I meant all ideologues. The only ones I’ve been talking with lately are free market types. But I know that the “collectivists” can be a pretty prejudiced/impervious bunch too.

You’ve declared your
position – doesn’t that mean you have to defend it now?

No, I haven’t declared my position. My work on taxes and recession has nothing to do with free market versus socialism. It has to do with evidence regarding the relationship between taxation and recession. Economists of all stripes have said that raising taxes is recessionary (I think I mentioned that I recently heard this from Paul Krugman, no free marketer he). I presented data to show that the evidence suggests just the opposite.

BP: What makes you different from them, except for the particular
ideology you’re expressing?

The difference is that I am not expressing an ideology. All I’m saying is that there is no evidence that taxes are recessionary. If anything, the evidence suggests the opposite.

BP: Wait a minute, “Me too” what? You’re speaking as if you
know what the model will show us, but what if it shows that you’re wrong
and the other side is right about some things?

I am not interested in building a model to test ideologies. I’m interested in building a model that fits the data.

If you take a position
now, isn’t that going to make it hard to evaluate the model correctly?

The only position I am taking is that a model of the macro economy should produce behavior like that which is observed. So if top marginal tax rate is included as an independent variable in the model and growth rate and unemployment are dependent variables, I would expect variations in the tax rate to produce variations in growth and unemployment like those that are observed when income tax rate has varied in the real world.

BP: It’s not clear to me. I can think of lots of things I didn’t like
about the last 8 years, but those are just my own reactions and have
nothing to do with Truth.

I’ll ignore all this policy stuff because I think your main interest is in modeling.

I wish we could just start working on the model, not worrying about where
it will lead but just trying to get it right. That’s all we really need
to do.

My problem with your approach to economic modeling is that you have not described how you are going to test any model that is developed. It’s as though you want me to join in developing a model of the solar system before you have any data on planetary movement against which to test the model. How will we know whether or not we are getting the model right if we ignore all the data because you think it’s junk? Maybe the data is junk but then I think it behooves you to say what data you will use to test the model. If you don’t know in advance what data your model will explain than I don’t see how you can even consider starting the modeling project. Although there were serious flaws in your Dad’s modeling efforts, at least he was ostensibly working to develop a model that would account for some fundamental macro-economic data. In that sense, I’m afraid I prefer your Dad’s approach to economic modeling to yours.

Best

Rick

···


Richard S. Marken PhD
rsmarken@gmail.com
www.mindreadings.com