Tuesday, November 23, 2010

Most arrogant paragraph, this week edition

Source: http://econlog.econlib.org/archives/2010/11/not_who_you_thi.html
Here in the United States, one thing that strikes me about my most liberal friends is how conservative their thinking is at a personal level. For their own children, and in talking about specific other people, they passionately stress individual responsibility. It is only when discussing public policy that they favor collectivism. The tension between their personal views and their political opinions is fascinating to observe. I would not be surprised to find that my friends' attachment to liberal politics is tenuous, and that some major event could cause a rapid, widespread shift toward a more conservative position.

My only response:
Here in the United States, one thing that strikes me about my most conservative friends is how liberal their thinking is at a personal level. For their own children, and in talking about specific other people, they passionately stress generosity. It is only when discussing public policy that they favor individualism. The tension between their personal views and their political opinions is fascinating to observe. I would not be surprised to find that my friends' attachment to conservative politics is tenuous, and that some major event could cause a rapid, widespread shift toward a more liberal position.

Sunday, September 26, 2010

Measures of unemployment closely track U3

This is pretty cool.

Everybody knows that the "official" unemployment rate isn't really an accurate measure of unemployment. Why? Well, it only counts people who have been looking for jobs in the last 15 weeks and haven't found them. That's such a restrictive measure of unemployment that one can't help but wonder whether the BLS is using "Lie with Statistics 101," which tells us (inter alia) to never cite a statistic that measures what you claim it's measuring.

The problem here is that "unemployment" is not a simple concept. Are people who aren't looking for jobs "unemployed"? What about people who look for jobs sometimes, but not always? People who are taking whatever they can get, instead of picking the best job for them? People who are between jobs? And so forth.

The BLS number represents essentially an arbitrary measure. It captures some, but not all, of what we mean when we say "unemployed" --- it's the best we can do with a single number. But in addition to the "unemployment rate", the BLS also tracks five other numbers of varying restrictiveness: U1, U2, U4, U5, and U6. The unemployment rate you hear in the news is called U3.

The BLS has been following U1 and U3 since 1948, U2 since 1967, and U4-6 since 1994. U6 is the most expansive measure of unemployment --- it measures not only who are unemployed individuals, but those who have taken part-time jobs for lack of anything better and those who aren't looking for jobs at all, but would start if the economy improved (the so-called 'marginally unattached').

Is it possible to figure out U4-6 for past recessions, so we can get a better picture of how past labor markets compare to today's labor markets?

Turns out, yes. Very definitely. I ran some regressions this afternoon on the BLS employment numbers and the five unemployment measures U1, U2, U4, U5, and U6 are very, very tightly correlated in the short-run with U3:

$U_1 = (0.76 \pm 0.01)U_3 − (2.31 \pm 0.07)$
$U_2 = (0.78 \pm 0.01)U_3 − (1.47 \pm 0.05)$
$U_4 = (1.066 \pm 0.003)U_3 − (0.09 \pm 0.01)$
$U_5 = (1.099 \pm 0.005)U_3 − (0.43 \pm 0.03)$
$U_6 = (1.70 \pm 0.07)U_3 − (0.3 \pm 0.1)$

Isn't that beautiful? This is from the 1994-2010 panel data. Look at how tight those spreads are! Apparently, over short (one-two decade) periods, U3 is able to predict upwards of 95% of the variation of U1-6.

This breaks down over the longer run, as you might expect. The linear correlation actually migrates slowly over time. I believe this reflects changing population demographics, such as the aging of the baby boomers, and technological change. So you can't take these numbers and extrapolate backwards with them too carelessly. However, it does mean that you can get a good idea of how past labor markets compare to this labor market just by comparing U3, and bearing in mind that the relationship between U3 and U1-6 across many decades isn't as tight as you might want it to be.

Friday, March 5, 2010

Simple versus Complicated

When you're modeling a phenomenon, you face a tradeoff between complexity and ease of use. If you build a model with extremely accurate predictions, it's probably very complex and difficult to use. Conversely, if you build a simple model that's easy to use, you won't be able to capture as much of the behavior of the phenomenon you're modeling.

Here are two examples: long-run growth models and orbital dynamics.

Long-run growth models. Your typical long-run growth model deals in three variables: A, Y, K, and N - technology, GDP, capital, and employment, respectively. You can crudely model long-term growth trends by knocking these two variables together. However, it's very difficult to capture any details; for example, not all forms of capital are the same - some is used for long-term projects, some for short-term projects, a highway here might be more efficient than a highway there, etc. To make the predictions correct, you have to generally use A as a "fudge factor"; the model still predicts a particular pattern in the data, but it's not good enough to get the pattern from more basic principles.

Similarly, a more complicated growth model would require knowledge of the time-distribution and geographic distribution of capital, population and inclination distributions of workers, various forms of technology, and so forth. It would be significantly more difficult to use.

Orbital dynamics. Let's think about the Sun and the Earth. Newton's laws can explicitly be solved for a two-body problem, giving the motion of each body about the center of mass of the system. However, the solution is rather complicated. Since the Sun is much, much, much bigger than the Earth, we may as well assume the Sun is stationary. The problem, instead of dealing with the motion of two bodies, only has to describe the motion of the Earth in a central force field -- much easier.

Thursday, March 4, 2010

How not to do science

Check out this (warning: .pdf) study. It claims that African inequality is dropping rapidly. You don't have to go too far for big red WARNING signs to pop up:
The World Bank concurs: “In 1990, 28.3 percent of the people in low and middle‐income countries lived on less than \$1 a day. By 1999 the share had fallen to 21.6 percent, driven mainly by strong growth in China and India (…) In Sub‐Saharan, where the GDP per capita fell by 5 percent, the extreme poverty rate rose from 47.4 percent in 1990 to 49 percent in 1999. The numbers are believed to be still rising” (World Bank (2004).) The U.N. Millenium Campaign Deputy Director for Africa says: “Poverty continues to intensify due to the exclusion of groups of people on the basis of class, caste, gender, disability, age, race, religion and other status,” (UN Millenium Campaign (2009).) This conventional wisdom is further documented and critically reviewed in Easterly (2009).
...
In this paper, we use the methodology of Pinkovskiy and Sala‐i‐Martin (2009) to estimate income distributions for African countries, and compute their poverty rates, and inequality and welfare indices for the period 1970‐2006. Our results show that the conventional wisdom that Africa is not reducing poverty is wrong. In fact, since 1995, African poverty has been falling steadily.

This should be setting off low-level bullshit detectors. But it gets better. The method the authors used is very simple: curve-fitting a lognormal distribution to PPP GDP and gini coefficients. The lognormal is entirely characterized by two numbers, the mean and the variance. Any curve-fitting to data is going to result in errors in mean and variance -- errors which, in the name of honesty, should be quoted. They don't show up anywhere.

So what are the authors doing in this paper? They are applying a model of income distributions to one set of data, refusing to specify uncertainties in the model's predictions, and using the results of the model to contradict existing data. To say the least, this is completely backwards: disagreement between the model's predictions and World Bank data should be evidence against the use of lognormal distributions and the fitting methods used in the paper, not evidence against the World Bank data.

This, kids, is how not to do science.

Wednesday, March 3, 2010

"What is truth?"

Have you ever seen a baby crawling around learning things? The next time you're around a baby who's old enough to move (i.e., >4 months or so), sit down and have some playtime. It's quite a joy to watch: checking out new things, going back to old ones - shaking, pounding, tasting, smelling, touching, feeling, listening, using every sense to try to figure out how it works.

What's going on in their heads? We can't really know for sure, but we can guess. They're trying to figure out how the world works. There's a world around them, and they don't know what's going on -- so, characteristically, they launch into figuring it out. You might characterize this as building expectations for how things should behave. In other words, they're developing models for how the world works. Their expectations are based on predictions the model makes.

Babies are natural scientists. It's informal, sure, but the informal scientific method is there: poke at it, watch its response, and take it into account in your mental model of how it works.

It's a shame we adults have to relearn this -- a lot of us never actually do. Some lucky people never lose it, but after a couple of decades, the old mental shortcuts kick in, and we forget what it's like to actively learn. We forget how to engage life, how to approach new ideas skeptically, how to be unsure, and in fact be sure of just how unsure you are. (To be fair, the "adult" version of the scientific method is a lot more rigorous - just the other day, I measured G to be (5.3 +/- 1.2) x 10^-11 Nm^2kg^-2*; that sort of quantification is far, far beyond my daughter. But the basic idea of the scientific method is the same, and when you apply it to life in general, you can't always specifically quantify your uncertainty; you just have to get a feel of how off your best guess might be and go with it.)

Part of the reason for this forgetfulness is the mental shortcuts we figure out as we go ahead in life. When you're figuring out something new, like the fact that things fall when you drop them (wow!), you're very tentative. As you experience it more, your uncertainty decreases. And after a while, your uncertainty gets so low that it's not worth your time to think about it anymore: you just assume that when you drop something, it will automatically fall - end of story.

But that black-and-white thinking, while convenient, is harmful. As adults, we face a world full of uncertainty -- and if we've gotten sloppy by not engaging life, we have simply forgotten what it's like to be uncertain! Thus breed black-and-white thinking and other symptoms of intellectual sloth.

So, moral of the day? To be skeptical, be more like babies -- get a sense of your uncertainty, and realize that the things you "know", you really just have very high confidence in because you have a lot of (experiential) evidence** for them.

* Which is cool in and of itself; how many people can say they've measured Newton's gravitational constant to within 20%?

** Mind, it's often good to go back and requestion these things too once you have the adult version of the scientific method, but all too many people don't even have the baby version. Once you get the adult version, you'll sort of automatically question them anyway.