The importance of appreciating complexity

Here is another new essay of mine, called The Simplicity Assumption.

The opposite of the Simplicity Assumption would be a complexity diagram. Imagine a diagram with a social problem, such as the obesity epidemic or the financial crisis of 2008, at the center. Then list all of the plausible factors that could have contributed to this problem, and put those on the diagram, with arrows pointing to the central problem. Next, draw arrows that reflect likely feedback loops among these various causal factors. Finally, draw arrows that reflect likely feedback loops from the central problem to some of these causal factors. For a complex problem, this diagram will look rather messy, like a badly tangled ball of kite string; you cannot be sure that tugging on one part of the knotted mess will make things better or worse.

Economists do not work with complexity diagrams. Such diagrams are not conducive to creating tractable models. Not having a tractable model is not conducive to publishing a paper. Not publishing papers is not conducive to having a successful career.

Read the whole thing.

Too much discipline on the left, too little on the right

Check out my latest essay on Medium, Restoring Political Health, Left and Right.

People with a temperament that is high on openness and low on conscientiousness are inclined toward the left and tend to be curious, tolerant, and willing to explore the world with a commitment to intellectual honesty. People with a temperament that is low on openness and high on conscientiousness are inclined toward the right and tend to emphasize standards of decency, restraint, and good behavior. As shorthand, I will refer to these as the left and the right, respectively. We are plagued today by an authoritarian left and a badly-behaved right. Restoring health will require work on both sides.

The opening of the essay owes something to Jordan Peterson’s observations about psychology and politics (e.g., here or in his conversation with Jonathan Haidt), as well as to his use of metaphor. But the substance of the essay represents issues that have long concerned me. A dozen years ago, I had the insights that were the seeds of The Three Languages of Politics in an essay that I called Folk Beliefs Have Consequences.

Scott Alexander on Eliezer Yudkowsky

Scott writes,

Everyone hates Facebook. It records all your private data, it screws with the order of your timeline, it works to be as addictive and time-wasting as possible. So why don’t we just stop using Facebook? More to the point, why doesn’t some entrepreneur create a much better social network which doesn’t do any of those things, and then we all switch to her site, and she becomes really rich, and we’re all happy?

The obvious answer: all our friends are on Facebook. We want to be where our friends are. None of us expect our friends to leave, so we all stay. Even if every single one of our friends hated Facebook, none of us would have common knowledge that we would all leave at once; it’s hard to organize a mass exodus.

This is Scott’s example of what Yudkowsky calls in his new book Inadequate Equilibria. Another excerpt from Scott’s review:

The Inside View is when you weigh the evidence around something, and go with whatever side’s evidence seems most compelling. The Outside View is when you notice that you feel like you’re right, but most people in the same situation as you are wrong. So you reject your intuitive feelings of rightness and assume you are probably wrong too.

…Eliezer warns that overuse of the Outside View can prevent you from having any kind of meaningful opinion at all.

My thoughts:

1. By the time this post goes up, I will have finished the book (recall that I typically schedule posts two or more days in advance). When I finish it, I am likely to write a long review.

2. The book is worth your time and your money.

3. I believe that Yudkowsky describes a real problem. Rather than call it “inadequate equilibria,” I would use a term popular in mathematical economics, “local optimum.” A group can find itself at a local optimum that is not the global optimum. It remains stuck at the local optimum because it resists going downhill to eventually go uphill.

Yudkowsky is focused on what I would call an intellectual local optimum. That is, it is possible for people to be stuck in a set of beliefs (leading to actions) that are difficult to discard but far from the global optimum. This is the way David Colander and Roland Kupers describe the state of economic thinking in their book Complexity Economics, which I described as

highly ambitious, always stimulating, and often frustrating.

I expect to say the same thing about Inadequate Equilibria. It is even more frustrating.

[UPDATE: I did indeed finish the book. I am glad that it stimulated me to think about the topic and to write an essay. But I think that you will find my essay on the topic will be more concise and more helpful than the book itself. I expect to have the essay up later this week on Medium.]

Does tutoring work?

In 1994, Benjamin S. Bloom wrote,

Using the standard deviation (sigma) of the control (conventional) class, it was typically found that the average student under tutoring was about two standard deviations above the average of the control class (the average tutored student was above 98% of the students in the control class). The average student under mastery learning was about one standard deviation above the average of the control class (the average mastery learning student was above 84% of the students in the control class)

The reader who sent me the link to this paper asked whether it invalidates the Null Hypothesis. The researchers experiments rather than observational studies, so I will give them that. But

1. Usually, educational interventions have small effects. The effect of “mastery learning” of one standard deviation seems rather implausibly high, considering its definition.

Formative tests (the same tests used with the conventional group) are given for feedback followed by corrective procedures and parallel formative tests to determine the extent to which the students have mastered the subject matter.

That does not sound like something that would cause a one-standard deviation difference. My guess is that these findings would not replicate if they were undertaken by different researchers.

2. Even when interventions show large effects for a single subject in a single year, the effects tend to fade out. That is, if you examine the experimental group and the control group three years later, any difference has vanished. Even if these results replicate in the short term, they do not invalidate the Null Hypothesis if they suffer from fade-out.

3. We do not know how what would be necessary to enable tutoring to scale. Bloom seems to believe that tutoring works by adapting to the needs of the student. If so, then my guess is that the process of matching tutoring style to student characteristics would be quite a challenge.

Disaggregating the economy: California

Carson Bruno wrote,

between 2009 and 2014, the Silicon Valley metro areas – a region that accounts for just 1/5th of the state’s population – accounted for 50% of California’s private industry real GDP growth.

Steve Baldwin adds,

a far more accurate assessment of [California’s] economy, [Richard] Rider writes, would be per capita GDP as compared to the rest of the country. After adjusting the GDP figures to account for the cost of living (COL), the Golden State ends up with a paltry 37th place ranking within the U.S.A., with a $45,696 per capital GDP. Even rustbelt states, such as Michigan and Ohio, have a higher adjusted per capita GDP.

There are parts of California where adjusting for the cost of living makes incomes lower than they might otherwise appear to be. Other parts of California have low incomes, but this is alleviated slightly by a lower cost of living.

It is difficult to think of California as a homogeneous economy with a single GDP factory. It is even more problematic to try to look at the entire United States through that lens.