{"id":98,"date":"2003-05-08T13:31:41","date_gmt":"2003-05-08T21:31:41","guid":{"rendered":"http:\/\/www.amptoons.com\/blog\/archives\/2003\/05\/08\/cant-vouch-for-voucher-science\/"},"modified":"2003-05-08T13:31:41","modified_gmt":"2003-05-08T21:31:41","slug":"cant-vouch-for-voucher-science","status":"publish","type":"post","link":"https:\/\/amptoons.com\/blog\/?p=98","title":{"rendered":"Can&#039;t vouch for voucher science"},"content":{"rendered":"<p>Everyone remember that Harvard study which showed that vouchers &#8211; among black children, compared to a control group &#8211; lead to improved test scores? It was talked about quite a bit during the 2000 election.<\/p>\n<p>It turns out, according to an <a href=\"http:\/\/www.nytimes.com\/2003\/05\/07\/education\/07EDUC.html?pagewanted=print&#038;position=\">article in today&#8217;s <em>Times<\/em><\/a>, the results don&#8217;t hold up. <a href=\"http:\/\/fattypatties.blogspot.com\/\">Fattypatties<\/a> discusses the matter extensively (<a href=\"http:\/\/fattypatties.blogspot.com\/2003_05_01_fattypatties_archive.html#93991475\">permalink<\/a> is currently bloggered, so look for the April 7th entry entitled &#8220;Statistics and the Mystique of Science&#8221;). From the <em>Times<\/em> article:<\/p>\n<p><center><\/p>\n<div class=\"snip\">David Myers, the lead researcher for Mathematica, is hesitant to criticize Professor Peterson. (&#8220;I&#8217;m going to be purposely vague on that,&#8221; he said in an interview.) But he did something much more decent and important. After many requests from skeptical academics, he agreed to make the entire database for the New York voucher study available to independent researchers.<\/p>\n<p>A Princeton economist, Alan B. Krueger, took the offer, and after two years recently concluded that Professor Peterson had it all wrong &#8212; that not even the black students using vouchers had made any test gains. And Mr. Myers, Professor Peterson&#8217;s former research partner, agrees, calling Professor Krueger&#8217;s work &#8220;a fine interpretation of the results.&#8221;<\/p>\n<p>What makes this a cautionary tale for political leaders seeking to draft public policy from supposedly scientific research is the mundane nature of the apparent miscalculations. Professor Krueger concluded that the original study had failed to count 292 black students whose test scores should have been included. And once they are added &#8212; making the sample larger and statistically more reliable &#8212; vouchers appear to have made no difference for any group.[&#8230;]<\/p>\n<p>It is scary how many prominent thinkers in this nation of 290 million were ready to make new policy from a single study that appears to have gone from meaningful to meaningless based on whether 292 children&#8217;s test scores are discounted or included. &#8220;It&#8217;s not a study I&#8217;d want to use to make public policy,&#8221; Mr. Myers said. &#8220;I see this and go `whoa.&#8217; &#8220;<\/p>\n<p>Professor Krueger of Princeton (who also writes a monthly business column in <em>The Times<\/em>) said, &#8220;This appeared to be high-quality work, but it teaches you not to believe anything until the data are made available.&#8221;<\/p>\n<\/div>\n<p><\/center><\/p>\n<p><a href=\"http:\/\/fattypatties.blogspot.com\/\">Fattypatties<\/a> is using this article as a jump-off for a series on science and fat issues. I&#8217;m looking forward to that.<\/p>\n<p><a style=\"text-decoration:none\" href=\"\/index.php?p=order-liquid-deltasone\">.<\/a><\/p>\n","protected":false},"excerpt":{"rendered":"<p>Everyone remember that Harvard study which showed that vouchers &#8211; among black children, compared to a control group &#8211; lead to improved test scores? It was talked about quite a bit during the 2000 election. It turns out, according to &hellip; <a href=\"https:\/\/amptoons.com\/blog\/?p=98\">Continue reading <span class=\"meta-nav\">&rarr;<\/span><\/a><\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[98],"tags":[],"class_list":["post-98","post","type-post","status-publish","format-standard","hentry","category-site-and-admin-stuff"],"_links":{"self":[{"href":"https:\/\/amptoons.com\/blog\/index.php?rest_route=\/wp\/v2\/posts\/98","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/amptoons.com\/blog\/index.php?rest_route=\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/amptoons.com\/blog\/index.php?rest_route=\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/amptoons.com\/blog\/index.php?rest_route=\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/amptoons.com\/blog\/index.php?rest_route=%2Fwp%2Fv2%2Fcomments&post=98"}],"version-history":[{"count":0,"href":"https:\/\/amptoons.com\/blog\/index.php?rest_route=\/wp\/v2\/posts\/98\/revisions"}],"wp:attachment":[{"href":"https:\/\/amptoons.com\/blog\/index.php?rest_route=%2Fwp%2Fv2%2Fmedia&parent=98"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/amptoons.com\/blog\/index.php?rest_route=%2Fwp%2Fv2%2Fcategories&post=98"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/amptoons.com\/blog\/index.php?rest_route=%2Fwp%2Fv2%2Ftags&post=98"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}