Schedule a Live Demo

Visit the Learning Sciences Marzano Center

Advancing the field of teacher and leader effectiveness.










iObservation Videos

You Are Watching:

Distinguishing Evidence from Research

Video Transcript

The term “research-based” is used quite a bit in K-12 education right now. Here’s basically what that means: that someone has looked at the research and said, “This particular strategy has research behind it, therefore we should use it in our classroom, or we should use it in our school, we should use it in our district.” “Evidence-based” is something above and beyond that. “Evidence-based” means that teachers in your school or your district as a whole have said, “Well, let’s gather our own information about how well these strategies work.” What we know is that research is always situated—a study was done in a particular context. It doesn’t mean that the strategy as done in that particular context works perfectly in your context as a classroom teacher, or your school, or your district. It has to be tried in your particular context. Now that means gathering evidence. That means gathering information. It could be quite informal. It could just be teachers sitting down and talking about how well it worked for them. It could also be more formal. For example, you can gather evidence as to how well a teacher was using a strategy and its relationship to student achievement. Of course, then you have to gather information about student achievement—how well they did on a test that was designed specifically for the content that was being taught during a given lesson. That evidence could even be asking students, “How well do you think you did on this lesson?” or, “How much did you learn?” By the way, that simple question right there, research indicates it’s one of the strongest correlates with student achievement. Just asking students what they know is highly correlated with what they actually know. That was a study by John Hattie when he looked at about 138 variables and rank-ordered them in terms of their relationship/correlation with student achievement. I believe that was the #1 variable, asking students what they know is pretty decent, if they feel they can answer it anonymously in an unthreatening fashion.

There’s a lot of ways of gathering information about how teachers are doing and how students are doing, but that’s a lot of data and that has to be put together in a way where you can correlate the data, match this up with this, and charts and graphs. Of course, that takes technology. So when I saw the iObservation platform, and the ability to do that and how easy it is to do—gather information about teachers and how they’re using strategies, and then student achievement—I thought, “Ok, this does it. We can actually do this right now.” By hand, it would be practically impossible, and when I mean “practical,” I mean in a practical sense it would be impossible to gather that data on teachers and students and then use it. Boy, now it’s so easy to gather it! There’s so many ways of gathering that information, and then once it’s in the system you can look at that from individual teachers, to classes, to grade levels, to the different populations. I think we’re kind of at a breakthrough period here. Technology is finally giving us the tools that allow teachers and supervisor administrators to have those conversations that are geared toward improving teacher pedagogical skill and, ultimately, student achievement.

DEBORAH PICKERING: 3:20
One of the things I’ve been doing for 20 years is taking research to the field, taking research to teachers. And they embrace it. When you get resistance from teachers is when they feel like that you’re coming to tell them what to do. What we do, Marzano Research Lab and everyone I know who is doing consulting, we go to teachers and to principals and administrators, and say, “We’re not here to tell you what to do, but we are here to tell you what has a high probability of working. No guarantees, but a high probability of working.” And that’s really fun, to say, “This is how it works, this is when it works. Here’s the probability it’s going to work, it’s worth your time.” What has to happen after that is the most important thing. So that’s “research-based,” and I love that schools embrace “research-based.”

Now they have to move to “evidence-based.” “Evidence-based” means that now the stakeholders, and the school and district have to go and see if it works in their classrooms. They collect evidence. They collect student work. They interview students. They observe and videotape classrooms. They use all of that evidence to determine if these research-based strategies are actually working here, and use evidence to do that. The best professional development experiences I’ve had over twenty years is when, after going into the classroom and bringing evidence back to the table, teachers then interact about what worked and didn’t work. Equally important. What worked, that’s kind of cool, I’ll keep doing that. Why didn’t it work? What didn’t work? Where it worked, but not with these students. Those conversations, informed by evidence, is the best professional development I’ve ever seen. So moving from “research-based” to “evidence-based,” which means it lives in your district, is I think the most important movement, and a platform like this I think will help us get there.

Dr. Marzano Describes How to Use Student Data in Evaluations Dr. Marzano Describes How to Use Student Data in Evaluations Dr. Robert Marzano explains the role student achievement data should play for effective evaluations and teacher support. Dr. Marzano Outlines the Sources for Teacher Evaluation Data Dr. Marzano Outlines the Sources for Teacher Evaluation Data Dr. Robert Marzano lists the sources for data on teachers that should be part of a effective and accurate evaluation system. Dr. Marzano Asks, “Are Students Learning What Teachers are Teaching?” Dr. Marzano Asks, “Are Students Learning What Teachers are Teaching?” Dr. Marzano questions whether current student achievement data is an accurate reflection of instructional practices or teacher effectiveness. The Role of Deliberate Practice in Developing Expertise The Role of Deliberate Practice in Developing Expertise Dr. Marzano describes deliberate practice as more than just implementing an instructional strategy; it is creating a targeted focus on improving pedagogical skills with opportunities to receive feedback and observe exemplary models. Implementing Strategies to Get Student Gains Implementing Strategies to Get Student Gains Dr. Marzano notes that a teacher's use of research-based strategies does not automatically suggest that students have learned. In order to impact learning, teachers must track their own growth against gains observed in student performance. Dr. Marzano Explains the Need to Align Walkthroughs, Teacher Evaluations & Professional Development Dr. Marzano Explains the Need to Align Walkthroughs, Teacher Evaluations & Professional Development Dr. Marzano explains the most critical error hindering districts from their efforts to enhance teaching and learning: misaligned classroom walkthrough, teacher evaluation, and professional development. Dr. Marzano Describes 3 Phases in the Development of a District System Dr. Marzano Describes 3 Phases in the Development of a District System Dr. Marzano recommends phases in which districts can engage to support teachers to incrementally improve their teaching each year as it relates to student achievement. Why Most Classroom Walkthroughs are Ineffective Why Most Classroom Walkthroughs are Ineffective Dr. Robert Marzano reflects on limitations of most classroom walkthrough and teacher observation systems. Dr. Marzano Expresses Concerns About the Misuse of His Research with Walkthroughs Dr. Marzano Expresses Concerns About the Misuse of His Research with Walkthroughs Dr. Robert Marzano expresses concerns about the inaccurate association of his name with other classroom walkthrough and teacher observation systems. Announcing the Marzano Art & Science of Teaching Observation and Feedback Protocol Announcing the Marzano Art & Science of Teaching Observation and Feedback Protocol Dr. Robert Marzano explains why he is against classroom walkthrough systems that only focus on a narrow set of strategies and introduces his Art & Science of Teaching Observation and Feedback Protocol in iObservation. Looking Beyond High-Yield Strategies Looking Beyond High-Yield Strategies Dr. Robert Marzano recommends moving beyond a simple checklist of strategies to using high-probability strategies that reflect and honor the complexity of the teaching/learning process. Dr. Marzano Addresses the Critical Need for a Robust Model of Instruction Dr. Marzano Addresses the Critical Need for a Robust Model of Instruction Dr. Robert Marzano defines a robust and comprehensive model of instruction and suggests how districts can integrate his Observation and Feedback Protocol into their own existing models. Dr. Marzano Describes PLCs in iObservation Dr. Marzano Describes PLCs in iObservation Drs. Robert Marzano and Debra Pickering describe their excitement about the strength of iObservation in developing professional learning communities (PLCs). Fidelity of Program and Practice Fidelity of Program and Practice Dr. Robert Marzano defines the highest level of implementation in terms of how districts and educators can adapt programs and models to fit their contextual situation. Marzano Art & Science of Teaching Observation and Feedback Protocol in iObservation Marzano Art & Science of Teaching Observation and Feedback Protocol in iObservation Dr. Robert Marzano shares his excitement about synthesizing nearly 40 years of his research reflected through the Art & Science of Teaching Observation and Feedback Protocol in iObservation. Leadership with a Singular Focus on Instruction Gets Results Leadership with a Singular Focus on Instruction Gets Results Dr. Robert Marzano highlights what research tells us about effective district and school leadership practices that get results. Dr. Marzano Explains the Power of a Common Language of Instruction Dr. Marzano Explains the Power of a Common Language of Instruction Dr. Robert Marzano explains why a common language/model of instruction is the foundation for improving teaching and learning. Dr. Robert Marzano: “My Online Master’s Degree is a Dream Come True” Dr. Robert Marzano: “My Online Master’s Degree is a Dream Come True” Dr. Robert Marzano has developed a master's degree in the Art and Science of Teaching that he would have enjoyed experiencing himself as a teacher. Dr. Robert Marzano’s Online Master’s Degree Dr. Robert Marzano’s Online Master’s Degree Dr. Robert Marzano explains how his new online master's program can increase pedagogical skills in such a way that enhances student achievement and perhaps even personal satisfaction. Distinguishing Evidence from Research Distinguishing Evidence from Research Drs. Robert Marzano and Debra Pickering discuss the distinction between research-based theories, which are situational vs. evidence-based practices, which are contextual. Dr. Douglas Reeves Announces His Leadership Performance Matrix in iObservation Dr. Douglas Reeves Announces His Leadership Performance Matrix in iObservation Dr. Douglas Reeves explains his new vision for leadership assessment and coaching as presented in the Leadership Performance Matrix, powered by iObservation. He also shares key tips to improved leadership performance.