This article has been retrieved   times since May 6, 2005

Toward an Objective Evaluation of Teacher Performance: The Use of Variance Partitioning Analysis1 Eduardo R. Alicias, Jr. New England College The Philippines Citation: Alicias, E. R. Jr. (2005, May 6). Toward an objective evaluation of teacher performance: The use of variance partitioning analysis, VPA. Education Policy Analysis Archives, 13(30). Retrieved [date] from http://epaa.asu.edu/epaa/v13n30/. This article was accepted by the previous Editor, Gene V Glass (1993-2004). Abstract Evaluation of teacher performance is usually done with the use of ratings made by students, peers, and principals or supervisors, and at times, selfratings made by the teachers themselves. The trouble with this practice is that it is obviously subjective, and vulnerable to what Glass and Martinez call the “politics of teacher evaluation,” as well as to professional incapacities of the raters. The value-added analysis (VAA) model is one attempt to make evaluation objective and evidenced-based. However, the VAA model—especially that of the Tennessee Value Added Assessment System (TVAAS) developed by Dr. William Sanders—appears flawed essentially because it posits the untenable assumption that the gain score of students (value added) is attributable only and only to the teacher(s), ignoring other significant explanators of student achievement like IQ and socio-economic status. Further, the use of the gain score (value-added) as a dependent variable appears hobbled with the validity threat called “statistical regression,” as well as the problem of isolating the conflated effects of two or more teachers. The proposed variance partitioning analysis (VPA) model seeks to partition the total variance of the dependent variable (post-test student achievement) into various portions representing: first, the effects attributable to the set of teacher factors; second, effects attributable to the set of control variables the most important of which are IQ of the student, his pretest score on that particular dependent variable, and some measures of his socio-economic status; and third, the unexplained effects/variance. It is not difficult to see that when the second and third quanta of variance are partitioned out of the total variance of the dependent variable, what remains is that attributable to the teacher. Two measures of teacher effect are hereby proposed: the proportional teacher effect and the direct teacher effect. 1Copyright Registration No. O 2004-037, February 26, 2004, The National Library, Manila, The Philippines. Access this article in PDF format.

The World Wide Web address for the Education Policy Analysis Archives is epaa.asu.edu Editor: Sherman Dorn, University of South Florida Production Assistant: Chris Murrell, Arizona State University General questions about appropriateness of topics or particular articles may be addressed to the Editor, Sherman Dorn, epaa-editor@shermandorn.com. The Commentary Editor is Casey D. Cobb: casey.cobb@uconn.edu. EPAA Editorial Board Michael W. Apple University of Wisconsin David C. Berliner Arizona State University Greg Camilli Rutgers University Linda Darling-Hammond Stanford University Mark E. Fetler California Commission on Teacher Credentialing Gustavo E. Fischman Arizona State Univeristy Richard Garlikov Birmingham, Alabama Gene V Glass Arizona State Univeristy Thomas F. Green Syracuse University Aimee Howley Ohio University Craig B. Howley Appalachia Educational Laboratory William Hunter University of Ontario Institute of Technology Patricia Fey Jarvis Seattle, Washington Daniel Kallós Umeå University Benjamin Levin University of Manitoba Thomas Mauhs-Pugh Green Mountain College Les McLean University of Toronto Heinrich Mintrop University of California, Los Angeles Michele Moses Arizona State University Gary Orfield Harvard University Anthony G. Rud Jr. Purdue University Jay Paredes Scribner University of Missouri Michael Scriven University of Auckland Lorrie A. Shepard University of Colorado, Boulder Robert E. Stake University of Illinois—UC Kevin Welner University of Colorado, Boulder Terrence G. Wiley Arizona State University John Willinsky University of British Columbia EPAA Spanish & Portuguese Language Editorial Board Associate Editors Gustavo E. Fischman Arizona State University & Pablo Gentili Laboratório de Políticas Públicas Universidade do Estado do Rio de Janeiro Founding Associate Editor for Spanish Language (1998—2003) Roberto Rodríguez Gómez Universidad Nacional Autónoma de México Argentina Alejandra Birgin Ministerio de Educación, Argentina       Email: abirgin@me.gov.ar Mónica Pini Universidad Nacional de San Martin, Argentina       Email: mopinos@hotmail.com, Mariano Narodowski Universidad Torcuato Di Tella, Argentina       Email: Daniel Suarez Laboratorio de Politicas Publicas-Universidad de Buenos Aires, Argentina       Email: daniel@lpp-buenosaires.net Brasil Gaudêncio Frigotto Professor da Faculdade de Educação e do Programa de Pós-Graduação em Educação da Universidade Federal Fluminense, Brasil       Email: gfrigotto@globo.com Vanilda Paiva       Email:vppaiva@terra.com.br Lilian do Valle Universidade Estadual do Rio de Janeiro, Brasil       Email: lvalle@infolink.com.br Romualdo Portella do Oliveira Universidade de São Paulo, Brasil       Email: romualdo@usp.br Roberto Leher Universidade Estadual do Rio de Janeiro, Brasil       Email: rleher@uol.com.br Dalila Andrade de Oliveira Universidade Federal de Minas Gerais, Belo Horizonte, Brasil       Email: dalila@fae.ufmg.br Nilma Limo Gomes Universidade Federal de Minas Gerais, Belo Horizonte       Email: nilmagomes@uol.com.br Iolanda de Oliveira Faculdade de Educação da Universidade Federal Fluminense, Brasil       Email: iolanda.eustaquio@globo.com Walter Kohan Universidade Estadual do Rio de Janeiro, Brasil       Email: walterko@uol.com.br Canadá Daniel Schugurensky Ontario Institute for Studies in Education, University of Toronto, Canada       Email: dschugurensky@oise.utoronto.ca Chile Claudio Almonacid Avila Universidad Metropolitana de Ciencias de la Educación, Chile       Email: caa@rdc.cl María Loreto Egaña Programa Interdisciplinario de Investigación en Educación (PIIE), Chile       Email: legana@academia.cl España José Gimeno Sacristán Catedratico en el Departamento de Didáctica y Organización Escolar de la Universidad de Valencia, España       Email: Jose.Gimeno@uv.es Mariano Fernández Enguita Catedrático de Sociología en la Universidad de Salamanca. España       Email: enguita@usal.es Miguel Pereira Catedratico Universidad de Granada, España       Email: mpereyra@aulae.es Jurjo Torres Santomé Universidad de A Coruña       Email: jurjo@udc.es Angel Ignacio Pérez Gómez Universidad de Málaga       Email: aiperez@uma.es México Hugo Aboites Universidad Autónoma Metropolitana-Xochimilco, México       Email: aavh4435@cueyatl.uam.mx Susan Street Centro de Investigaciones y Estudios Superiores en Antropologia Social Occidente, Guadalajara, México       Email: slsn@mail.udg.mx Adrián Acosta Universidad de Guadalajara       Email: adrianacosta@compuserve.com Teresa Bracho Centro de Investigación y Docencia Económica-CIDE       Email: bracho dis1.cide.mx Alejandro Canales Universidad Nacional Autónoma de México       Email: canalesa@servidor.unam.mx Rollin Kent Universidad Autónoma de Puebla. Puebla, México       Email: rkent@puebla.megared.net.mx Perú Sigfredo Chiroque Instituto de Pedagogía Popular, Perú       Email: pedagogia@chavin.rcp.net.pe Grover Pango Coordinador General del Foro Latinoamericano de Políticas Educativas, Perú       Email: grover-eduforo@terra.com.pe Portugal Antonio Teodoro Director da Licenciatura de Ciências da Educação e do Mestrado Universidade Lusófona de Humanidades e Tecnologias, Lisboa, Portugal       Email: a.teodoro@netvisao.pt USA Pia Lindquist Wong California State University, Sacramento, California       Email: wongp@csus.edu Nelly P. Stromquist University of Southern California, Los Angeles, California       Email: nellystromquist@juno.com Diana Rhoten Social Science Research Council, New York, New York       Email: rhoten@ssrc.org Daniel C. Levy University at Albany, SUNY, Albany, New York       Email: Dlevy@uamail.albany.edu Ursula Casanova Arizona State University, Tempe, Arizona       Email: casanova@asu.edu Erwin Epstein Loyola University, Chicago, Illinois       Email: eepstei@wpo.it.luc.edu Carlos A. Torres University of California, Los Angeles       Email: torres@gseisucla.edu