Schedule a Live Demo

Visit the Learning Sciences Marzano Center

Advancing the field of teacher and leader effectiveness.










iObservation Videos

You Are Watching:

Dr. Marzano Outlines the Sources for Teacher Evaluation Data

Video Transcript

One of the more powerful features of the iObservation system is that a teacher can have feedback from multiple sources relative to their performance in a particular strategy or area if you will. That’s important to have multiple sources for feedback.

Let me give you an illustration. Let’s say I as the teacher have decided that I want to work on my ability to chunk content into small digestible bits over a period of time, and I want to get a feel for how I am doing. One source of feedback to that is my own self rating, but I want more pieces of information. Another piece of information could be from a formal observation that was made of me, and I may cue the observer to give me a rating on the scale as to how well you think I am doing on this area.

Another source could be from a peer if the school is open enough to have peers interact with other peers relative to instructional strategies. You could invite a peer in and say “please look at me relative to this.” Our walkthroughs come into this. If by chance a walkthrough had occurred and they give me a score on this particular area called “chunking” that’s another piece of data. A final area is that you can survey students and a few of the places we have worked at have done that. They’ve actually created surveys asking the students about the teacher’s performance on specific strategies.

With all of those sources of information, I have multiple perspectives on my own performance. A technique I like, instead of relying on any one as the absolute score, you use all sources of information to come up with the best estimate of a teacher’s true score at any point in time.

Let me explain that concept of coming up with a true score. Within measurement theory the score that you receive from any rater, they call it the observer score, actually is only an estimate of what you really deserve. It’s called the true score. The true score is something that’s unobservable. It’s very hard to actually pinpoint, and the more surfaces of data we have the better we can estimate that true score. Another way of looking at this is the teacher has their own self rating, a rating from a peer that they invited in, a rating from a walkthrough, a rating from a formal observation and they surveyed some of their students as to their use of a particular strategy. Now they take all of that information and build a logical case for a certain scorer. Usually what will happen is that they will say “Out of these 5 scores, there are three of these that basically say I one thing, and the other two are maybe different scores.” Well, that’s a logical case right there. There are three of these that say I am at a “two level”. I’m not making the egregious errors, but I still haven’t mastered the strategy yet at a fluent level.

So, a teacher uses multiple data points to then justify their true status at that point in time, and that can be a negotiated score actually meet with a supervisor and say “that’s why I think I’m a two or a three or whatever it is.”

 

Dr. Marzano Describes How to Use Student Data in Evaluations Dr. Marzano Describes How to Use Student Data in Evaluations Dr. Robert Marzano explains the role student achievement data should play for effective evaluations and teacher support. Dr. Marzano Outlines the Sources for Teacher Evaluation Data Dr. Marzano Outlines the Sources for Teacher Evaluation Data Dr. Robert Marzano lists the sources for data on teachers that should be part of a effective and accurate evaluation system. Dr. Marzano Asks, “Are Students Learning What Teachers are Teaching?” Dr. Marzano Asks, “Are Students Learning What Teachers are Teaching?” Dr. Marzano questions whether current student achievement data is an accurate reflection of instructional practices or teacher effectiveness. The Role of Deliberate Practice in Developing Expertise The Role of Deliberate Practice in Developing Expertise Dr. Marzano describes deliberate practice as more than just implementing an instructional strategy; it is creating a targeted focus on improving pedagogical skills with opportunities to receive feedback and observe exemplary models. Implementing Strategies to Get Student Gains Implementing Strategies to Get Student Gains Dr. Marzano notes that a teacher's use of research-based strategies does not automatically suggest that students have learned. In order to impact learning, teachers must track their own growth against gains observed in student performance. Dr. Marzano Explains the Need to Align Walkthroughs, Teacher Evaluations & Professional Development Dr. Marzano Explains the Need to Align Walkthroughs, Teacher Evaluations & Professional Development Dr. Marzano explains the most critical error hindering districts from their efforts to enhance teaching and learning: misaligned classroom walkthrough, teacher evaluation, and professional development. Dr. Marzano Describes 3 Phases in the Development of a District System Dr. Marzano Describes 3 Phases in the Development of a District System Dr. Marzano recommends phases in which districts can engage to support teachers to incrementally improve their teaching each year as it relates to student achievement. Why Most Classroom Walkthroughs are Ineffective Why Most Classroom Walkthroughs are Ineffective Dr. Robert Marzano reflects on limitations of most classroom walkthrough and teacher observation systems. Dr. Marzano Expresses Concerns About the Misuse of His Research with Walkthroughs Dr. Marzano Expresses Concerns About the Misuse of His Research with Walkthroughs Dr. Robert Marzano expresses concerns about the inaccurate association of his name with other classroom walkthrough and teacher observation systems. Announcing the Marzano Art & Science of Teaching Observation and Feedback Protocol Announcing the Marzano Art & Science of Teaching Observation and Feedback Protocol Dr. Robert Marzano explains why he is against classroom walkthrough systems that only focus on a narrow set of strategies and introduces his Art & Science of Teaching Observation and Feedback Protocol in iObservation. Looking Beyond High-Yield Strategies Looking Beyond High-Yield Strategies Dr. Robert Marzano recommends moving beyond a simple checklist of strategies to using high-probability strategies that reflect and honor the complexity of the teaching/learning process. Dr. Marzano Addresses the Critical Need for a Robust Model of Instruction Dr. Marzano Addresses the Critical Need for a Robust Model of Instruction Dr. Robert Marzano defines a robust and comprehensive model of instruction and suggests how districts can integrate his Observation and Feedback Protocol into their own existing models. Dr. Marzano Describes PLCs in iObservation Dr. Marzano Describes PLCs in iObservation Drs. Robert Marzano and Debra Pickering describe their excitement about the strength of iObservation in developing professional learning communities (PLCs). Fidelity of Program and Practice Fidelity of Program and Practice Dr. Robert Marzano defines the highest level of implementation in terms of how districts and educators can adapt programs and models to fit their contextual situation. Marzano Art & Science of Teaching Observation and Feedback Protocol in iObservation Marzano Art & Science of Teaching Observation and Feedback Protocol in iObservation Dr. Robert Marzano shares his excitement about synthesizing nearly 40 years of his research reflected through the Art & Science of Teaching Observation and Feedback Protocol in iObservation. Leadership with a Singular Focus on Instruction Gets Results Leadership with a Singular Focus on Instruction Gets Results Dr. Robert Marzano highlights what research tells us about effective district and school leadership practices that get results. Dr. Marzano Explains the Power of a Common Language of Instruction Dr. Marzano Explains the Power of a Common Language of Instruction Dr. Robert Marzano explains why a common language/model of instruction is the foundation for improving teaching and learning. Dr. Robert Marzano: “My Online Master’s Degree is a Dream Come True” Dr. Robert Marzano: “My Online Master’s Degree is a Dream Come True” Dr. Robert Marzano has developed a master's degree in the Art and Science of Teaching that he would have enjoyed experiencing himself as a teacher. Dr. Robert Marzano’s Online Master’s Degree Dr. Robert Marzano’s Online Master’s Degree Dr. Robert Marzano explains how his new online master's program can increase pedagogical skills in such a way that enhances student achievement and perhaps even personal satisfaction. Distinguishing Evidence from Research Distinguishing Evidence from Research Drs. Robert Marzano and Debra Pickering discuss the distinction between research-based theories, which are situational vs. evidence-based practices, which are contextual. Dr. Douglas Reeves Announces His Leadership Performance Matrix in iObservation Dr. Douglas Reeves Announces His Leadership Performance Matrix in iObservation Dr. Douglas Reeves explains his new vision for leadership assessment and coaching as presented in the Leadership Performance Matrix, powered by iObservation. He also shares key tips to improved leadership performance.