Our friend Max Brantley over at the Arkansas Times seems to trumpet every marginally negative charter school study story rumor that rolls across his desk, especially if the story appears in the New York Times (charter schools are thriving in NYC by the way). Yet somehow he missed a screening of a charter school movie playing at the same LR film festival he attended, and he seems to miss most of the positive stories that speak well of charter schools. So we thought Max and those like him in the state would be happy to hear some more great news about KIPP (see earlier good news about KIPP here), a charter school operator who is expanding in Arkansas.
Mathematica released a report today that takes a close look at academic performance in 22 KIPP middle-schools across the nation. You can find the full report here and the Ed Week article here. The report makes use of a matched longitudinal dataset as well as data from the traditional districts around the KIPP schools to answer several interesting questions.
Do KIPP schools take the best, brightest, and whitest from the traditional public schools? The resounding answer from the report is NO.
We find that students entering these 22 KIPP schools typically had prior achievement levels that were lower than average achievement in their local school districts.
**********
On average, KIPP middle schools have student bodies characterized by higher concentrations of poverty and racial minorities, but lower concentrations of special education and limitedEnglish proficiency (LEP) students, than the public schools from which they draw.
What about retention? Do KIPP schools simply counsel out those kids who can’t cut it? Again, the data demonstrate that retention rates at KIPP schools do not differ significantly (higher or lower) from the surrounding traditional school districts despite more rigorous monitoring.
Cumulative rates of attrition vary widely in different KIPP schools, but we did not find systematically higher (or lower) levels of attrition among these KIPP middle schools as compared with other schools within their districts.
However, the report does find a couple of important differences between the KIPP schools and their traditional counterparts. The first difference is that KIPP is more likely to require students to repeat a grade. This finding is meaningful because there is some evidence that retention programs help struggling kids reach higher achievement in the future.
The second difference is that students who attended KIPP schools exhibited higher academic achievement in math and reading across multiple statistical specifications.
Within two years after entry, students are experiencing statistically significant, positive impacts in 18 of 22 KIPP schools in math and 15 of 22 KIPP schools in reading.
Not only are the results positive but they are also statistically significant and meaningfully large. The additional learning accumulated by the average KIPP student over the 3 year study period was equivalent to an additional 1.2 years of learning in math and 0.9 years in reading. To put it another way, the average KIPP school produced gains that would cut the black-white test score gap in half in math and by a third in reading over three years.
Now I’m sure there will still be the Debbie Downers out there who will try to downplay the continued positive findings for KIPP. Some people just won’t let evidence stand in the way of their beliefs. But I think we should be heartened that the KIPP model continues to demonstrate success with some of our poorest students.
Others will surely say that KIPP is not a workable solution because it cannot be scaled to help all the kids who might need it. But I say abandoning KIPP because you believe it cannot be taken to scale is like firemen standing outside an apartment building in a poor neighborhood watching it burn, explaining their inaction by claiming that they could not save everyone.