My headline is not intended to demean the LA Times. Indeed, many are praising the three reporters from the LA Times, who accessed student performance data (with a FOIA request) from the gigantic Los Angeles Unified School District and put together a comprehensive report on teacher effectiveness. While some of their conclusions may be obvious, the work the newspaper is doing so that average parent and taxpayer (and indeed teacher) can know more about teacher effectiveness is very important. In my view, this is an interesting story of enterprising reporting and the “publicness” of taxpayer-supported institutions.
Here is the first not-very-surprising takeaway message: When it comes to kids and learning, TEACHERS MATTER … A lot. (But, we all knew this anyway …)
And the second not-very-surprising takeaway message: Some teachers do a much better job, year-after-year, than others. And this matters a great deal for the students. (Most of us knew this also, but we are a bit more careful about saying this out loud …)
Back to the story … here is a quick overview:
In a new series in the Los Angeles Times entitled “Grading the Teachers: Who’s Teaching L.A.’s Kids?”, the authors evaluate the performance of more than 6,000 third- through fifth-grade teachers. The controversy is not focused around the concept of evaluating the performance of teachers. Many critics of the LA Times report are quick to share that they also support teacher evaluations, and that all teachers are evaluated annually. Unfortunately, however, most standard evaluations are criticized for being toothless. As US Secretary of Education Arne Duncan stated just yesterday in Arkansas, “In many districts, 99 percent of teachers are rated satisfactory, and most evaluations ignore the most important measure of a teacher’s success, which is how much their students have learned.”

With this as background, the three authors from the LA Times, Jason Felch, Jason Song and Doug Smith, use a statistical measure called value-added analysis to rate the teacher’s performance based on their students’ progress on standardized tests from year to year. As the authors write, this strategy helps the authors get around some of the common complaints about using student test scores to evaluate teachers. They say: “Each student’s performance is compared with his or her own in past years, which largely controls for outside influences often blamed for academic failure: poverty, prior learning and other factors.”
This story is interesting because researchers are just now beginning to use student test data more heavily in an attempt to rate the performance of schools and educators, but this report is likely the first in the country in which such ratings will be made public. While it is uncomfortable to imagine employee ratings being made public, it is even more uncomfortable to acknowledge that many of our students are in classes with teachers who are not enriching their learning. (Indeed, we at the UA understand that working in a public entity which appropriately demands that we be transparent and share our information and communication with the public can sometimes be uncomfortable!)
On the flip side, however, it is worth noting that the authors make no allegations that most teachers are not succeeding; in fact, they spend a great deal of time highlighting the work of the great teachers, according to the value-added analysis. They speak of Miguel Aguilar, who works with fifth-graders. On average, his students start the year in the 34th percentile in math in the district — when they leave his classroom at year-end, they walk out at the 61st percentile. The authors praised this teacher as nurturing outstanding learning gains. They walked through the classrooms of teachers throughout the district and claimed that teachers rated effective had a few common characteristics:
“On visits to the classrooms of more than 50 elementary school teachers in Los Angeles, Times reporters found that the most effective instructors differed widely in style and personality. Perhaps not surprisingly, they shared a tendency to be strict, maintain high standards and encourage critical thinking. But the surest sign of a teacher’s effectiveness was the engagement of his or her students — something that often was obvious from the expressions on their faces.”
In any event, it is certainly worth checking out this article. I also found an NPR interview by Robert Seigel with reporter Jason Felch to be quite interesting. The reporter very clearly describes the methods and ALSO very clearly describes its limitations. Among his interesting points were:
1. We all seem to know this, but it is worth reiterating — Individual teachers really matter; the differences between teachers can be enormous. differ in their effectiveness. It is obvious, but it still seems to make a huge and controversial splash each time it is documented! Perhaps we should stop brushing this fact under the rug and continuing to treat all teachers as if they were the same because they are doing the same job. Many teachers are really, really good and perhaps policymakers should be doing more to ensure we keep them.
2. Felch admitted they struggled with the decision to release individual teacher rankings. They decided, however, that the importance of sharing this information outweighed the negatives of the potential discomfort that would likely come along with the release. He said, and I paraphrase, “It would be difficult to have this information, on which teachers were effective and which were not and to not release it … ignoring the information is not the answer.”
3. Felch was VERY clear in stating that these ratings are not the sole measure of a teacher. That is, there are certainly other things that we would like our teachers to do (make children feel comfortable, help them learn to socialize with peers, enhance their self-esteem, etc.) and parents care about these as well. This measure only tells parents how effective teachers are at raising students’ performance on standardized assessments. Felch does reiterate, however, that this is an important part of a teacher’s job.
Finally, I think it is worth listening to this piece as Mr. Seigel and Mr. Felch do a nice job of exploring a controversial question, tackling complicated questions and discussing them in user-friendly ways, and they do so in only 5 minutes. Looks like this question of how to best measure teacher effectiveness is not going away ….