<?xml version="1.0" encoding="UTF-8"?><rss version="2.0"
	xmlns:content="http://purl.org/rss/1.0/modules/content/"
	xmlns:dc="http://purl.org/dc/elements/1.1/"
	xmlns:atom="http://www.w3.org/2005/Atom"
	xmlns:sy="http://purl.org/rss/1.0/modules/syndication/"
	
	>
<channel>
	<title>Comments on: Null Hypothesis Deniers</title>
	<atom:link href="http://www.arnoldkling.com/blog/null-hypothesis-deniers/feed/" rel="self" type="application/rss+xml" />
	<link>http://www.arnoldkling.com/blog/null-hypothesis-deniers/</link>
	<description>taking the most charitable view of those who disagree</description>
	<lastBuildDate>Mon, 21 Dec 2020 00:12:22 +0000</lastBuildDate>
		<sy:updatePeriod>hourly</sy:updatePeriod>
		<sy:updateFrequency>1</sy:updateFrequency>
	<generator>https://wordpress.org/?v=4.0.32</generator>
	<item>
		<title>By: Steve Sailer</title>
		<link>http://www.arnoldkling.com/blog/null-hypothesis-deniers/#comment-461762</link>
		<dc:creator><![CDATA[Steve Sailer]]></dc:creator>
		<pubDate>Wed, 11 Nov 2015 05:28:24 +0000</pubDate>
		<guid isPermaLink="false">http://www.arnoldkling.com/blog/?p=6024#comment-461762</guid>
		<description><![CDATA[I started advocating value-added testing a couple of decades ago, but I&#039;d sure like to see some evidence that it really works.]]></description>
		<content:encoded><![CDATA[<p>I started advocating value-added testing a couple of decades ago, but I&#8217;d sure like to see some evidence that it really works.</p>
]]></content:encoded>
	</item>
	<item>
		<title>By: Daublin</title>
		<link>http://www.arnoldkling.com/blog/null-hypothesis-deniers/#comment-461746</link>
		<dc:creator><![CDATA[Daublin]]></dc:creator>
		<pubDate>Mon, 09 Nov 2015 23:11:18 +0000</pubDate>
		<guid isPermaLink="false">http://www.arnoldkling.com/blog/?p=6024#comment-461746</guid>
		<description><![CDATA[My proximate solution is more standardized testing, so that you can find out which teachers are actually teaching anything concrete.

However, that&#039;s merely a first step, because it seems quite hard to avoid public school employees from just gaming the system. So I would also make it an even bigger priority to allow parents a choice in what school their kids go to. As Arnold frequently writes: exit &gt; voice.

I don&#039;t believe we would have good supermarkets if there was one supermarket in a given region and everyone had to go to it. Competition is important or there will never be real improvement.

That&#039;s my platform. Anyone want to vote for me? Ah well....]]></description>
		<content:encoded><![CDATA[<p>My proximate solution is more standardized testing, so that you can find out which teachers are actually teaching anything concrete.</p>
<p>However, that&#8217;s merely a first step, because it seems quite hard to avoid public school employees from just gaming the system. So I would also make it an even bigger priority to allow parents a choice in what school their kids go to. As Arnold frequently writes: exit &gt; voice.</p>
<p>I don&#8217;t believe we would have good supermarkets if there was one supermarket in a given region and everyone had to go to it. Competition is important or there will never be real improvement.</p>
<p>That&#8217;s my platform. Anyone want to vote for me? Ah well&#8230;.</p>
]]></content:encoded>
	</item>
	<item>
		<title>By: Jonathan Graehl</title>
		<link>http://www.arnoldkling.com/blog/null-hypothesis-deniers/#comment-461691</link>
		<dc:creator><![CDATA[Jonathan Graehl]]></dc:creator>
		<pubDate>Sat, 07 Nov 2015 08:13:48 +0000</pubDate>
		<guid isPermaLink="false">http://www.arnoldkling.com/blog/?p=6024#comment-461691</guid>
		<description><![CDATA[Naturally a teacher who&#039;s merely better than the other teachers in a local school will look amazing. It would be a hard choice for some folks (say they&#039;re childless and thus living or at least working in a poor neighborhood doesn&#039;t trouble them) - enjoy the comforts of more talented and better behaved children, parents and administrators, yet look mediocre by &#039;value added&#039;, or be a big fish in a stinky pond. Actually, if enough kids moved around from place to place you could probably loosely identify the good teachers at good schools who are nonetheless merely par for that environment (it seems cruel to me to punish them for that). The only reason I can think of that such an automated &quot;performance added&quot; policy won&#039;t work *if enacted* (good luck!) is that it&#039;s too hard to prevent teacher/admin cheating - and there&#039;s plenty of  that in the poorer schools; enough to worry.]]></description>
		<content:encoded><![CDATA[<p>Naturally a teacher who&#8217;s merely better than the other teachers in a local school will look amazing. It would be a hard choice for some folks (say they&#8217;re childless and thus living or at least working in a poor neighborhood doesn&#8217;t trouble them) &#8211; enjoy the comforts of more talented and better behaved children, parents and administrators, yet look mediocre by &#8216;value added&#8217;, or be a big fish in a stinky pond. Actually, if enough kids moved around from place to place you could probably loosely identify the good teachers at good schools who are nonetheless merely par for that environment (it seems cruel to me to punish them for that). The only reason I can think of that such an automated &#8220;performance added&#8221; policy won&#8217;t work *if enacted* (good luck!) is that it&#8217;s too hard to prevent teacher/admin cheating &#8211; and there&#8217;s plenty of  that in the poorer schools; enough to worry.</p>
]]></content:encoded>
	</item>
	<item>
		<title>By: Andrew'</title>
		<link>http://www.arnoldkling.com/blog/null-hypothesis-deniers/#comment-461689</link>
		<dc:creator><![CDATA[Andrew']]></dc:creator>
		<pubDate>Fri, 06 Nov 2015 21:37:27 +0000</pubDate>
		<guid isPermaLink="false">http://www.arnoldkling.com/blog/?p=6024#comment-461689</guid>
		<description><![CDATA[Assuming that, what intervention would you make to improve education on the whole based on those factors?]]></description>
		<content:encoded><![CDATA[<p>Assuming that, what intervention would you make to improve education on the whole based on those factors?</p>
]]></content:encoded>
	</item>
	<item>
		<title>By: Daublin</title>
		<link>http://www.arnoldkling.com/blog/null-hypothesis-deniers/#comment-461687</link>
		<dc:creator><![CDATA[Daublin]]></dc:creator>
		<pubDate>Fri, 06 Nov 2015 17:58:14 +0000</pubDate>
		<guid isPermaLink="false">http://www.arnoldkling.com/blog/?p=6024#comment-461687</guid>
		<description><![CDATA[I quibble with the wording in another way.

I think school should  focus less on &quot;life outcomes&quot; and more on &quot;learning useful things&quot;. As &quot;useful things&quot;, I will accept standardized tests. By this measure, I expect that teachers and schools both make a difference. That is, a teacher whose students have big score improvements, will also tend to be able to improve the scores for a new batch of students next year. I expect this to persist, to a lower degree, if you make that teacher work in a different school and thus with a different student body.

Maybe I&#039;m wrong, but that&#039;s the null hypothesis I care about. Arnold, would you claim that if a teacher raises test scores for 10 years in a row, you don&#039;t consider it likely they will do it for the next 10 years as well?]]></description>
		<content:encoded><![CDATA[<p>I quibble with the wording in another way.</p>
<p>I think school should  focus less on &#8220;life outcomes&#8221; and more on &#8220;learning useful things&#8221;. As &#8220;useful things&#8221;, I will accept standardized tests. By this measure, I expect that teachers and schools both make a difference. That is, a teacher whose students have big score improvements, will also tend to be able to improve the scores for a new batch of students next year. I expect this to persist, to a lower degree, if you make that teacher work in a different school and thus with a different student body.</p>
<p>Maybe I&#8217;m wrong, but that&#8217;s the null hypothesis I care about. Arnold, would you claim that if a teacher raises test scores for 10 years in a row, you don&#8217;t consider it likely they will do it for the next 10 years as well?</p>
]]></content:encoded>
	</item>
	<item>
		<title>By: Handle</title>
		<link>http://www.arnoldkling.com/blog/null-hypothesis-deniers/#comment-461684</link>
		<dc:creator><![CDATA[Handle]]></dc:creator>
		<pubDate>Fri, 06 Nov 2015 15:32:37 +0000</pubDate>
		<guid isPermaLink="false">http://www.arnoldkling.com/blog/?p=6024#comment-461684</guid>
		<description><![CDATA[In finance, we evaluate traders and funds not in terms of annual return, but in terms of &#039;Alpha&#039; - that is - the &lt;i&gt;difference&lt;/i&gt; in the rate of return they achieved vs what was expected, which can be estimated with some suitable market index of comparable riskiness.

So, in education, we might try evaluation teachers with &#039;Educational Alpha&#039;, that is, not their average test-score yield, but the &lt;i&gt;extra&lt;/i&gt; yield they get vs. what we would expect for the kids, given their statistical profile at the beginning of the year.  

That&#039;s a much fairer way to evaluate performance.  Of course, lots of people aren&#039;t very interested in fair performance measures becoming public knowledge.

For the estimation model, I&#039;d guess the most predictive elements in any factor analysis would be IQ and past grades and test performance.  That model would not be PC, which is too bad, because it would probably show that the constant disparagement thrown at &#039;bad schools&#039; as well as the adulation of &#039;good schools&#039; is mostly a bunch of undeserved blame and credit given to people who probably have similar levels of performance measured in this &#039;value-added above expectations&#039; manner.

If the model&#039;s expected student test-score yields have low dispersion and average, say, &quot;+10 points&quot;, and a teacher shows a persistent ability to get a long-run trend average of +15 points, then he or she has &#039;Educational Alpha&#039; of 50.

The average Educational Alpha is defined as 0, and the null hypothesis says that most teachers score very close to zero, with a low standard deviation.

Still, I&#039;d expect &lt;i&gt;some&lt;/i&gt; special teachers to consistently score in the small positive numbers, and so I might be tempted to answer the question &#039;yes&#039; too, though with the above caveats.

Still, how many super-teachers with an EA above, say, 10, are we talking about.  Raymond Wolters wrote this about Teach For America:&lt;blockquote&gt;At Harvard the number of applicants increased from 100 in 2007 to 293 in 2010…. Even when choosing at Harvard and Yale, however, TFA selected only a minority of the candidates. This led one wry journalist to say that the solution to America’s educational problem was at hand: “Evidently, all we have to do is to fire all the schoolteachers and replace them with the best Harvard graduates—but not the run-of-the-mill Harvard grads. Just the best Harvard graduates.”&lt;/blockquote&gt;]]></description>
		<content:encoded><![CDATA[<p>In finance, we evaluate traders and funds not in terms of annual return, but in terms of &#8216;Alpha&#8217; &#8211; that is &#8211; the <i>difference</i> in the rate of return they achieved vs what was expected, which can be estimated with some suitable market index of comparable riskiness.</p>
<p>So, in education, we might try evaluation teachers with &#8216;Educational Alpha&#8217;, that is, not their average test-score yield, but the <i>extra</i> yield they get vs. what we would expect for the kids, given their statistical profile at the beginning of the year.  </p>
<p>That&#8217;s a much fairer way to evaluate performance.  Of course, lots of people aren&#8217;t very interested in fair performance measures becoming public knowledge.</p>
<p>For the estimation model, I&#8217;d guess the most predictive elements in any factor analysis would be IQ and past grades and test performance.  That model would not be PC, which is too bad, because it would probably show that the constant disparagement thrown at &#8216;bad schools&#8217; as well as the adulation of &#8216;good schools&#8217; is mostly a bunch of undeserved blame and credit given to people who probably have similar levels of performance measured in this &#8216;value-added above expectations&#8217; manner.</p>
<p>If the model&#8217;s expected student test-score yields have low dispersion and average, say, &#8220;+10 points&#8221;, and a teacher shows a persistent ability to get a long-run trend average of +15 points, then he or she has &#8216;Educational Alpha&#8217; of 50.</p>
<p>The average Educational Alpha is defined as 0, and the null hypothesis says that most teachers score very close to zero, with a low standard deviation.</p>
<p>Still, I&#8217;d expect <i>some</i> special teachers to consistently score in the small positive numbers, and so I might be tempted to answer the question &#8216;yes&#8217; too, though with the above caveats.</p>
<p>Still, how many super-teachers with an EA above, say, 10, are we talking about.  Raymond Wolters wrote this about Teach For America:<br />
<blockquote>At Harvard the number of applicants increased from 100 in 2007 to 293 in 2010…. Even when choosing at Harvard and Yale, however, TFA selected only a minority of the candidates. This led one wry journalist to say that the solution to America’s educational problem was at hand: “Evidently, all we have to do is to fire all the schoolteachers and replace them with the best Harvard graduates—but not the run-of-the-mill Harvard grads. Just the best Harvard graduates.”</p></blockquote>
]]></content:encoded>
	</item>
</channel>
</rss>
