[From Bill Powers (2001.20.1115 MDT)]
Now that we seem to be reaching a consensus about the control model for the Arielly data, I think we might start re-evaluating the subject of priming. The explanation for the apparent effect of the social security numbers on the bid prices was simply that raising the SS# considered as an asking price resulted in an increase of the bid, as if increasing the SS# made the subjects want to pay more for the item. We may well be seeing an instance of population data being mistaken for individual characteristics, and leading to getting the relationship exactly backward.
This depends on the model, of course. The priming model is a simple stimulus-response model as I understand it. The magnitude of the independent variable is the size of the social security number, and the magnitude of the dependent variable is the bid offered for the item. The control-system model, on the other hand, proposes that raising the SS# acts as a disturbance of the price the subject feels called upon to pay, and the actual response of the subject (which we are calling O, the output) is to act in the opposite direction, attempting to bring the price to a lower reference level. So raising the SS# higher than the subject's reference level makes the subject want to pay less, not more. The bid price increases anyway because the action is based on the error, but without the action the payment offered (if the deal was not abandoned) would be much higher when the SS# increases. This is exactly analogous to the demonstration in my paper for the American Behavioral Scientist on this same subject.
This does not say we should prefer the control-system model over the S-R model; it merely shows that the two models are incompatible, since the actions they predict are exactly opposite. So now the problem becomes that of finding an experiment that would satisfy the premises of both models and also would involve an output that we could observe. That would allow us to reject the model that was incorrect, or both models if they were both incorrect.
We can do this with a computer. What we need is for the subject's alterations of the bid price to be made observable, which can be done just by having the subject move a mouse (which measures O) to adjust a bid price displayed on the screen. The proposed effect of the asked price on the bid price is harder, conceptually, to explain, but by actually giving the asked price an effect on the bid price we can satisfy the premises of the S-R model without having to explain the effect.
We almost have that worked out right now. The environmental part of the control-system model already says that B = A + O, so if A increases, B will increase. We can display numbers representing these three variables on the screen, with the subject's mouse altering O and thus causing a change in B adding to the change caused by A.
If the subject's output doesn't change when A changes, B will simply change proportionally to A. We could insert constant multipliers to vary the inherent amount of the effects of A and O, but let's keep it simple for now.
Now we can do the Arielly experiment on the computer screen instead of on paper. Each subject is asked his SS# and the experimenter enters it as A on the screen. The subject then moves the mouse to change the displayed bid price until it is whatever value the subject wants to see.
If a change in the SS# directly influences the price the subject wants to bid (still ignoring the use of population measures in place of testing specimens), we should observe that O and B both change in the same direction as the SS#. If the bid price is a controlled variable, we should see B change in the same direction as the SS# (by a smaller amount), while the output changes in the opposite direction. I predict that the latter is what we will observe.
We could also say that the effect of A on B occurs inside the subject, and remove the effect seen on the screen by presenting A but not adding its value to B on the screen. If there is an internal effect of the perception of A on the perception of B, inside the subject, we should see a change of O in the same direction as the change in SS# if the S-R model is right. If the control model is right, the subject will move the mouse to bring B to the subject's reference level for it, and the changes in SS# will have no effect.
It would be better, of course, to use a single subject and a series of different values of A. While this might alter the magnitudes of some effects, it is unlikely to reverse the relationship between A and O. Of course if someone wants to invent a model that would have that result without being a negative feedback control system, we could test it and see if it works. Telling the right background story as part of the instructions would, in my opinion, probably prevent any serious effects of repeated trials by the same subject, but again nobody has to take my word for that. We can just set up the experiment to satisfy the conditions of the model and test it. If it makes a difference, it makes a difference. If it doesn't, it doesn't.
Noticed that in both cases we assume a real effect of A on B as the subject perceives these variable. However, the "priming" theory predicts an action by the subject opposite to the direction of action predicted by the control-system model. If the control system model is favored, the term "priming" and all of its associated implications becomes inappropriate.
"Priming" is simply a term applied to an observed effect, an apparently direct effect. The word evokes images of certain possible mechanisms (I imagined a leakage between perceptual pathways). But those images are nonspecific and far from quantitative, and just saying the word priming doesn't prove that the images have anything to do with what is observed. Only testing models can allow us to distinguish one explanation from another or choose between them. I don't know if this is likely to be done. I have no facilities with which to do them. If anyone takes this challenge to the concept of priming seriously maybe the experiments will happen. Of course the best way to defend against the challenge is to ignore it, so I suspect that is what will happen.
Best,
Bill P.