No regress: Digit ratios and risky decisions

February 7, 2011 § Leave a comment

Suppose you wanted to know the relationship between risk-taking and digit ratio (index finger length divided by ringer finger length). Suppose you had the pretty good idea of giving 152 Caucasian experimental subjects a choice of six lotteries, ordered by riskiness.

One approach would be to give every one the same choice of lotteries. You could then draw two dot or scatter plots of lottery choice against digit ratio–one for women, one for men. If you really wanted a P-value, you could test, for each gender, whether the relationship between lottery choice and digit ratio was significantly different from random assignment.

Another approach would be to use three different sets of lotteries (called 50-50, 75-25, and 25-75). Furthermore, devise three different “frames” (wordings) for the lotteries; for each subject, randomly assign one wording. Throw the result into a regression, with indicators for the set of lotteries and for the frame. You get something like this:

The problem with this second approach is that the regression model is wrong. This is because all models is wrong. In particular, these graphs:

make it very hard to believe that the difference between the lotteries is well-represented by a constant; the graphs aren’t even the same shape. (No, an ordered probit doesn’t solve this problem.) There isn’t any good reason to think frame and gender effects are constant, either.

The difference between the first approach and the second is the difference between “hey, this is cool” and “hey, this might be cool but I don’t trust any of the numbers”. (Also, the first approach is easier.) As it stands, there may well be something real going on, but it’s hard to say more than that.

Advertisements

Leave a Reply

Fill in your details below or click an icon to log in:

WordPress.com Logo

You are commenting using your WordPress.com account. Log Out / Change )

Twitter picture

You are commenting using your Twitter account. Log Out / Change )

Facebook photo

You are commenting using your Facebook account. Log Out / Change )

Google+ photo

You are commenting using your Google+ account. Log Out / Change )

Connecting to %s

What’s this?

You are currently reading No regress: Digit ratios and risky decisions at "But it's under .05!".

meta

%d bloggers like this: