This week, the House Education Committee just voted to abolish our state standards in schools linked to English, Math, and Science. Not amend these, not tweak, but abolish all of them! Their reason: Our ISAT scores that are based on these don’t seem to be moving much. I agree that our test scores are pretty lackluster, but something important to consider: Is it the standards or the tests? Many of these numbers work on the premise that the ISAT, our standard achievement exam, is an accurate measure of what is going on in schools, but is it? Since I’ve administered this exam several times, I’d like to add some information to how schools get an ISAT score that may help to illustrate the problem. 

At the secondary level, ISAT tests are taken only in 8th and 10th grade. There are four ISAT exams: 2 math, 2 English. ISAT English covers reading comprehension, vocabulary, etc, and math is a mix of Algebra and Geometry principles. This year, we are supposed to start using the ISAT Science exams too, but this is new. Available study guides consist of 90 question packets (without answers!) in math and English. Schools can also use Interim (practice) exams to prepare their students, which are basically just practice sessions of taking the exam. Outside of looking at the sample questions (without answers), educators are not supposed to see the contents of an ISAT exam, and recording these by schools is prohibited. A school’s ISAT score consists of how well its 8th or 10th graders did on 4 exams that the school has very little material to prepare kids with on tests that teachers are never allowed to see.

Students often have little buy in because the ISAT affects them in no meaningful way. It’s not for a grade, doesn’t need to be passed, and isn’t a graduation requirement. Unlike the SAT or ACT, the ISAT will not help students get into college. The 4 exams typically take between 4-6 hours. Once we add the science, it will take many students between 7-8 hours to finish all the exams. If students guess on their exams to finish quickly, there is no consequence just as there is no reward if students score well. So from the student perspective, the state wants you to spend about 6-8 hours taking exams that will not help your grades, not qualify you for any colleges, and is not needed to graduate. And we are counting on their altruism to care about the results.

Also, teachers have little connection to the ISAT. There are only two subjects tested, and only in 8th and 10th grade. How does a 12th grade English teacher prepare her students for the 10th grade ISAT exam? How does a 10th grade Art teacher prepare his students? Because it only covers 2 subjects and has so little study material, it’s nearly impossible for teachers to weave ISAT materials into their course curriculum. If you are covering the standards in your classroom, you must assume the test is standard based without ever knowing or seeing what types of questions your kids will be asked. Also, if you don’t teach one of the grade levels or subjects, I guess you assume you are helping your school’s ISAT score if you are teaching to the standards even though your subjects and your kids are past the grade level we tested. 

Even administrators have difficulty making the ISAT important. While ISATs typically do count for evaluation, since it’s not subject specific, administrators must use the same school score for all teachers. How does the administrator evaluate the economics teacher to a test over Algebra and Geometry? Additionally, the school’s score will be determined only by how test takers in specific grade levels will do. Sophomores are usually 25% of a school population, which means that typically, 75% of the students (and those who teach them) are not counted for a school’s “definitive” ISAT score. How does the admin get her 11th grade teachers to help improve the school’s ISAT score? What administrators must do in evaluation is assign one ISAT score to the school and use it for all their teachers. That means that if one teacher is teaching to the standards, and another is not, they both receive the same school ISAT score on their evaluations. 

This means that the “definitive” ISAT score given to the school by the state is actually how a small segment of the students-who will benefit in no way from the exam-score during specific grades. In theory, these students will be prepared for this exam by teachers, the majority of which don’t teach the subject or the grade levels the students will be tested in. Again, in theory, these teachers are helped by school administrators who cannot measure their individual contribution to the exam due to its standardized nature. So how is anyone in the building supposed to affect ISAT performance in any meaningful way? It’s a Mickey Mouse system, which is why the only folks who really care about these tests are Eduwonks and people with an agenda.

So now the reader has front line knowledge of how the ISATs actually work in schools. Are the standards the issue or the way we test on these standards? And is it fair to rank schools on their performance is such a flawed system?

Clayton Trehal has been an educator for 19 years and a school administrator for 7 years.