91直播

Special Report
Federal

Quality of Evaluations Draws New Attention As Stimulus Aid Flows

By Stephen Sawchuk 鈥 April 21, 2009 4 min read
  • Save to favorites
  • Print
Email Copy URL

The nation鈥檚 oft-criticized systems for evaluating the quality of its educator workforce are poised to receive increased scrutiny, thanks to an Obama administration plan to require school districts to disclose how many teachers perform well or poorly.

Although nearly every state requires districts to evaluate teachers, the instruments are typically designed locally. And as both policy experts and some union leaders attest, they are frequently of poor quality, not based on standards of good teaching, and incapable of rendering fine-grained, fair judgments about teacher performance.

Policy experts widely view the U.S. Department of Education initiative, which is part of the implementation of the federal economic-stimulus package鈥檚 aid to education, as an attempt to collect baseline data on teacher evaluations and to promote an overhaul of those systems. It could also, they say, pave the way for shifting the 鈥渉ighly qualified鈥 teacher provisions of the No Child Left Behind Act from a focus on paper credentials to one on outcomes.

鈥淭o me, it means that there鈥檚 real recognition at the highest level that ... if we鈥檙e going to do some of the other human-capital reforms on the table, like trying to link compensation and tenure decisions to performance, then evaluation is kind of the linchpin,鈥 said Raegen T. Miller, the associate director for education research at the Washington-based Center for American Progress, a Democratic-leaning think tank.

But, experts add, the initiative鈥檚 success will depend on the administration鈥檚 follow-up steps鈥攊ncluding the metrics the Education Department sets for reporting evaluation data, and what steps it expects states and districts to take with the resulting data.

鈥淚 think this is a big black hole, and I鈥檓 not sure how [the federal government] is going to do it,鈥 said Julia Koppich, a San Francisco-based consultant on teacher issues. 鈥淭his is very difficult, high-stakes work.鈥

Details Coming

The guidance given to states earlier this month by the Education Department on how to spend the first round of education aid鈥$32.5 billion鈥攗nder the American Recovery and Reinvestment Act requires that they report on the number and percentage of teachers and principals scoring at each level on local districts鈥 evaluation instruments. States must also disclose whether the evaluation tools take student performance into account. (鈥淔irst Education Stimulus Aid Flows to States,鈥 April 8, 2009.)

The teacher-evaluation requirement falls under an 鈥渁ssurance鈥 states must submit saying that they will take steps to improve the effectiveness of teachers and increase access by low-income and minority students to effective teachers. The department hasn鈥檛 yet set a deadline for states to begin reporting.

Evaluation Methods

Districts use different methods to measure teacher performance. The results are used鈥攚ith varying degrees of success鈥攖o provide teachers with feedback for improvement and for formal accountability decisions.

Checklist
Observers rate teacher performance on a checklist of input-based factors, typically summing up a teacher鈥檚 performance as either 鈥渟atisfactory鈥 or 鈥渦nsatisfactory.鈥

Performance-based Observation
The system uses measures describing teacher performance at four or five escalating levels of performance.

Peer Review and Assistance
Principals assign struggling teachers to 鈥渃onsulting鈥 teachers for a specified period of intense support. Teachers who do not improve are recommended for dismissal or nonrenewal鈥攄epending on the system鈥攂y a committee of both administrators and teachers. Cincinnati and Toledo, Ohio, and Montgomery County, Md., are examples.

Value-added
This model links students鈥 year-to-year test scores to teachers, and attempts to screen out other factors, such as family-income level, to determine teachers鈥 contributions to achievement growth. It is used informally in some Ohio districts and in New York City.

Mixed Methods
Multiple measures of performance are included. Schools in the Teacher Advancement Program use value-added data in conjunction with performance-based observation.

Source: 91直播

In a letter sent to governors with the guidance, Secretary of Education Arne Duncan clarified that states need only submit an assurance that they plan to report. To receive the second round of stimulus funds, $16 billion, they must show that they have developed the capacity to file such reports.

The lack of detail on what districts and states should do with the data they eventually gather and report has raised some skepticism within the education policy world.

鈥淭he best possible scenario is that, in fact, there is a lack of information on teacher evaluations, and this reporting creates a tidal wave of support to get something done here,鈥 said Andrew J. Rotherham, publisher of the Washington-based think tank Education Sector.

But the publishing of performance results does not always guarantee action by state and local policymakers, he cautioned. President George W. Bush鈥檚 administration held such a theory about the test-score reporting requirements in the early days of the NCLB law, and many states and districts chose to obscure the data rather than act on it, he said.

鈥淚 just think it鈥檚 a tough lift,鈥 said Mr. Rotherham, who served as an education aide to President Bill Clinton. 鈥淭he systems look the way they do because of politics.鈥

Touchy Issues

The creator of a widely adopted teacher-evaluation system said that any data generated from the reporting requirements will be hard to parse accurately without contextual information.

鈥淚 don鈥檛 think that the proportion of teachers rated at each of the levels is, actually, particularly important in itself. The teachers might all be really good,鈥 wrote Charlotte Danielson in an e-mail. 鈥淏ut ... it may reflect a symptom of something else, such that there really aren鈥檛 any standards, and that site administrators can鈥檛 tell the difference鈥 in teacher performance.

Districts moving to develop better systems are likely to confront several hot-button choices, including two that drive much of teachers鈥 concern about evaluations: who conducts them, and whether they include objective measures of student performance, such as test scores.

Teachers鈥 unions have long argued that many principals are not trained to make such judgments, and thus cannot do so fairly and uniformly. More recently, union leaders have objected to the linking of student test scores to individual teachers, both for technical reasons and out of fear that such links would encourage 鈥渢eaching to the test.鈥

鈥淵ou have on one side of the pendulum evaluation done exclusively through principal observation, and on the other side done through the lens of individual test scores, which is equally flawed,鈥 said Randi Weingarten, the head of the 1.4 million-member American Federation of Teachers.

Ms. Weingarten said she hopes the stimulus requirements will spur the creation of 鈥渇ar more robust, more accurate, more appropriate, multiple-measured instruments that can be collectively bargained and used in districts throughout the country.鈥

A version of this article appeared in the April 22, 2009 edition of 91直播 as Quality of Evaluations Draws New Attention As Stimulus Aid Flows

Events

This content is provided by our sponsor. It is not written by and does not necessarily reflect the views of 91直播's editorial staff.
Sponsor
Student Well-Being Webinar
Improve School Culture and Engage Students: Archery鈥檚 Critical Role in Education
Changing lives one arrow at a time. Find out why administrators and principals are raving about archery in their schools.
Content provided by 
School Climate & Safety Webinar Engaging Every Student: How to Address Absenteeism and Build Belonging
Gain valuable insights and practical solutions to address absenteeism and build a more welcoming and supportive school environment.
Student Well-Being K-12 Essentials Forum Social-Emotional Learning 2025: Examining Priorities and Practices
Join this free virtual event to learn about SEL strategies, skills, and to hear from experts on the use and expansion of SEL programs.

EdWeek Top School Jobs

Teacher Jobs
Search over ten thousand teaching jobs nationwide 鈥 elementary, middle, high school and more.
Principal Jobs
Find hundreds of jobs for principals, assistant principals, and other school leadership roles.
Administrator Jobs
Over a thousand district-level jobs: superintendents, directors, more.
Support Staff Jobs
Search thousands of jobs, from paraprofessionals to counselors and more.

Read Next

Federal Can Trump Ax the Education Department Without Congress?
Trump has been flexing his power through executive orders, and there's the potential for one targeting the Education Department.
7 min read
The U.S. Department of Education in Washington, D.C., is pictured on Feb. 21, 2021.
The U.S. Department of Education in Washington, D.C., is pictured on Feb. 21, 2021. President Donald Trump could issue an executive order to downsize the department. It would have limitations.
Graeme Sloan/Sipa USA via AP
Federal Top House Lawmaker Supports Trump's Bid to 'Depower' Education Department
The House education committee chairman believes "even the best-meaning bureaucrat" can't understand what's happening in local schools.
5 min read
Rep. Tim Walberg, R-Mich., speaks during an event at the COP28 U.N. Climate Summit on Dec. 9, 2023, in Dubai, United Arab Emirates.
Rep. Tim Walberg, R-Mich., speaks at the U.N. Climate Summit on Dec. 9, 2023, in Dubai. Walberg, the newly minted chair of the U.S. House's education and workforce committee, said at a Tuesday event that he wouldn't stand in the way of President Donald Trump's efforts to diminish or close the U.S. Department of Education.
Joshua A. Bickel/AP
Federal Title IX, School Choice, 鈥業ndoctrination鈥欌擧ow Trump Took on Schools in Week 2
It was a week in which the newly inaugurated president began wholeheartedly to act on his agenda for schools.
8 min read
Republican presidential nominee former President Donald Trump arrives at an election night watch party at the Palm Beach Convention Center on Nov. 6, 2024, in West Palm Beach, Fla.
Donald Trump arrives at an election night watch party at the Palm Beach Convention Center on Nov. 6, 2024, in West Palm Beach, Fla. Trump's second week in the White House featured his first direct foray into policymaking aimed directly at schools.
Evan Vucci/AP
Federal Then & Now Why Can't We Leave No Child Left Behind ... Behind?
The law and its contours are stuck in our collective memory. What does that say about how we understand K-12 policy?
6 min read
Collage image of former President G.W. Bush signing NCLB bill.
Liz Yap/91直播 and Canva