In a Q&A, he writes,
My critique is of what I call “metric fixation.” The key components of metric fixation are the belief that it is possible and desirable to replace judgment, acquired by personal experience and talent, with numerical indicators of comparative performance based upon standardized data (metrics); that the best way to motivate people within organizations is by attaching rewards and penalties to their measured performance, rewards that are either monetary or reputational (college rankings, etc.); and that making the metrics public makes for greater professional “accountability” — as if only that which can be counted in some standardized way makes for professional probity. My book is about why this so often fails to have the desired effects and leads to unintended negative outcomes, which, after decades of experience, ought to be anticipated.
Read the whole thing. His book is The Tyranny of Metrics.
Sounding rather opposed is Bryan Caplan, who writes,
If you’re teaching something existing tests can’t detect, write a better test! But if you’re teaching something no conceivable test can detect, you probably aren’t teaching anything at all.
Bryan seems to be saying that everything one can learn is measurable in some way. Can you test for curiosity? For intellectual humility? For willingness to question one’s own beliefs?