No regress: Digit ratios and risky decisions
February 7, 2011 § Leave a comment
Suppose you wanted to know the relationship between risk-taking and digit ratio (index finger length divided by ringer finger length). Suppose you had the pretty good idea of giving 152 Caucasian experimental subjects a choice of six lotteries, ordered by riskiness.
One approach would be to give every one the same choice of lotteries. You could then draw two dot or scatter plots of lottery choice against digit ratio–one for women, one for men. If you really wanted a P-value, you could test, for each gender, whether the relationship between lottery choice and digit ratio was significantly different from random assignment.
Another approach would be to use three different sets of lotteries (called 50-50, 75-25, and 25-75). Furthermore, devise three different “frames” (wordings) for the lotteries; for each subject, randomly assign one wording. Throw the result into a regression, with indicators for the set of lotteries and for the frame. You get something like this:
make it very hard to believe that the difference between the lotteries is well-represented by a constant; the graphs aren’t even the same shape. (No, an ordered probit doesn’t solve this problem.) There isn’t any good reason to think frame and gender effects are constant, either.
The difference between the first approach and the second is the difference between “hey, this is cool” and “hey, this might be cool but I don’t trust any of the numbers”. (Also, the first approach is easier.) As it stands, there may well be something real going on, but it’s hard to say more than that.