Skip to Content

This content is supported by a grant from the Bush Foundation.

Minnesota test-results takeaway: 'Our kids did not get dumber overnight'

students
REUTERS/Sergio Perez
The complexity of understanding what a test does and doesn’t measure is one reason policymakers here and around the country often advocate assigning schools stars or letter grades or some other designation that is supposed to convey simplicity.

Today your local newspaper doubtless carries the hotly anticipated results of the 2013 Minnesota Comprehensive Assessments (MCAs), the standardized tests used to determine the number of students who are proficient at math, reading and science.

If you’re like most people you crack it open, start tripping over the acronyms by which the sundry exams are identified, begin sinking into a quagmire of terms like “cut scores” and “weighted norms” and grab frantically for the false security of the one thing that seems easy: The percentage of students passing in your corner of Lake Wobegon.

I have a better idea. Roll that paper up and use it as a prod to herd your friendly neighborhood psychometrician — you know, the nerds who create the tests — into a pen where we’ll keep them for a few months to determine whether we as a state have finally arrived at a workable, meaningful testing regime.

If the next set of results bears out this promise, we can let them out and start paying attention again. The next set of results being Minnesota’s Multiple Measurements Ratings (MMR), which combine proficiency, yearly growth and the rate at which a school or classroom is closing the achievement gap.

Due out around Oct. 1, the MMRs reveal which schools are making accelerated gains with students who start out behind, which are lagging or succeeding with both proficiency and growth, as well as schools that have student bodies that start out highly proficient yet don’t make big strides. A homegrown system, they provide a much more sound basis for making judgments about a school’s strengths and weaknesses.

Definition of proficiency changed

What’s that? You already looked at today’s less nuanced numbers and, frighteningly — and incorrectly, let’s just get that right up front — it appears reading proficiency statewide has plummeted? Worse you fear you’ve heard the explanation — that that’s because a new, much tougher test was brought online this year — before? Sounds like some context is in order.

First, the takeaway: Math scores are flat statewide with 61 percent proficiency, but up five points over 2011. They are up 3 percentage points for the second year in a row in Minneapolis, and 3 points to 44 percent in St. Paul. Neither district made significant strides in narrowing yawning gaps between affluent learners and poor.

Commissioner Brenda Cassellius

The crude number of students scoring proficient in reading plummeted, from 76 percent to 57 percent statewide. But that reflects a change in the definition of proficiency, not a decrease in students’ knowledge.

“Proficiency is not dropping,” state Education Commissioner Brenda Cassellius said Monday. “Our kids did not get dumber overnight.” Rather, the tests have gotten harder over the last decade-plus.

Designed to comply with NCLB

Administered in grades 3-8 and then once again in high school, the MCAs are the tests that were designed to comply with No Child Left Behind (NCLB), the 2001 federal education-reform mandate. In their first iteration, they were supposed to reveal, by race, disability status and English-language facility, whether a school was failing some or all of its students.

The data confirmed, of course, that lots of schools were in fact failing large numbers of poor minorities. But beyond that many of the tests were lousy. They did not measure individual students’ performance from one year to the next or show where their gaps in knowledge lay. So they were useless to teachers and school administrators, many of whom then administered more tests in an effort to glean useful information.  

On a policy level, NCLB did not set a single standard for proficiency. And because there were penalties associated with the failure to increase performance, some states — Minnesota was not among them — reacted by lowering their bars.

A consortium of state education leaders got together and decided it was time for tests that not only set a single, high benchmark for performance but that measured for things that higher education and employers were looking for, such as problem-solving skills, creativity and critical thinking. Minnesota’s teachers were among those who helped to design and test the Common Core Standards (CCS), which were to be adopted voluntarily.

Minnesota was already preparing to roll out an even tougher math exam, so it adopted only the new Common Core reading standard. And it began working on test that, much like those many districts were already using to glean data teachers could use, would measure individual students’ fall-to-spring progress and reveal specific knowledge gaps.

In 2011, the new math test was administered for the first time. Proficiency levels fell.

In 2013, the new reading test was administered for the first time. In addition to requiring higher-level thinking, it has a higher standard for proficiency. And so while passage rates for math scores fell about 10 points in 2011, in reading this year the drop was more like 20-30 percent.

Which is not to say that Minnesota’s students became less proficient. The test wizards at the state Department of Education have figured out how to control for differences in the new and old reading tests. So when the MMRs are released in a few weeks, it should be possible to identify trends.   

“It’s really a nightmare for testing people to try to explain,” said Dave Heistad, Bloomington Public Schools’ director of research, evaluation and assessment and one of the region’s best brains on exams.

“For a parent looking at an individual child’s results, proficiency” — as in, is the student on track — “is important,” he explained. “But if you’re going to look at a school, you really need to look at growth.

Growth is key

“So the state and schools need to do a good job explaining the MMR,” Heistad continued. “If proficiency goes down [with different or more rigorous tests] but growth is strong, a school is OK.”

The complexity of understanding what a test does and doesn’t measure is one reason policymakers here and around the country often advocate assigning schools stars or letter grades or some other designation that is supposed to convey simplicity. Unfortunately these under-nuanced approaches haven’t worked much better.

Heistad thinks he might be approaching a more useful system. Because the newest generation of tests is tied to college-readiness benchmarks, it’s possible to create a graphic that shows where a student is relative to the average score of someone headed to a four-year college, to a specific school such as the University of Minnesota or even an elite one like Carleton College.

“You can now tell by fifth grade whether a kid is on track for college, and you can do something about it if they’re not,” he said.

His predecessor in the job, Jim Angermeyr, is more skeptical. He fears that years of changing standards and the corresponding dips in proficiency invites the general public to simply start ignoring the data.

Educators, meanwhile, are now primed to swing into action when a student is not proficient, Angermeyr added. Students’ schedules, class assignments and other things often are changed in response, potentially putting them on a lower track.

“The discussion about the higher standards is good, the idea of focusing on preparing kids for college is good,” he said. “I think schools need to be very careful about identifying kids as non-proficient based on these Common Core Standards.”

Worse, he fears, any drop in perceived proficiency, whether real or not, could become a policy cudgel to be swung by anyone who has a vested interest in continuing to label some schools as failing: “Some of us who are still cynical wonder about the political motivation behind this.”

Cassellius, meanwhile, has a fairly simple message. It’s taken well over a decade for Minnesota to come up with a set of standards that are high enough and driving for the right results.

Teachers can use results quickly

The new exams come with practice tests teachers can administer in the fall so that they can use the results, now available very quickly online, to individualize instruction throughout the year, she said Monday.

And they align beautifully with the end game of college- and career-readiness, Cassellius added. The kinds of thinking the Common Core tests require for proficiency are the ultimate goal.

“This is what we ask our kids to do in college,” she said. “The whole goal is not to have to take remedial coursework in college.”

“Now that we’ve done this” — replace inadequate tests with better ones — “let’s stop changing the goalpost on our teachers,” said Cassellius. “Let’s respect them and give them the time to build their toolkits.”

“This is not a walk in the park,” she said. “But I think it’s a much more honest and transparent picture.” 

Get MinnPost's top stories in your inbox

Related Tags:

About the Author:

Comments (7)

Deja vu all over again

Argh!

High-stakes testing is not an accurate or useful measure of a child’s proficiency. For that, parents, the school districts and the state will need to use something far more time-and-energy-consuming. Paying attention to a teacher’s evaluation might be a good start, but if you among those who begin discussions of public education with the assumption that teachers are, by their nature, liars and cheats, then don’t bother with what the teachers might say and look instead at a portfolio of the student’s work, accumulated during the school year in question. It will either show some degree of competency and/or improvement in knowledge and skills or it won’t.

College admission is not, and should not be, the measure of whether or not a graduating high school senior has received a basic, functional level of education. We ought to be raising citizens, not employees. Colleges and universities, especially in recent years, are in the process of being corporatized, and are increasingly beholden to entities ranging from the federal government to your friendly local hedge fund manager or a corporate foundation. This seems largely a result of decreasing, sometimes drastically decreasing, support from the state, a trend that has been widely measured, and which is inexcusable.

This is all a “nightmare to explain” to the public because, in large measure, we’re starting from the illogical premise that schools somehow succeed or fail.

They don’t.

Schools are bricks and mortar, and collections of adults and children. So far as I can tell, Minnesota teachers are not a collection of knuckle-dragging illiterates who’ve mistakenly been put in charge of classrooms all over the state. Policy makers keep trying to make teachers responsible for the fact that kid ‘x’ doesn’t do her homework — possibly for very good, even heart-rending, reasons — and therefore can’t do anything with fractions, or biology, or writing the English language. Schools do not fail. Occasionally, with individual students, a teacher will fail, but if that were as widespread as the malevolent foes of public education would have us believe, we’d all be illiterates, unable to make change for a dollar, and incapable of reading road signs.

What’s failing are *students,* and while there’s much discussion, well-intended and often quite sophisticated, about the achievement gap between affluent kids and all the others who aren’t, and that gap is unconscionable and real, we keep avoiding the the most obvious likely causative agent (poverty and the culture it engenders) because it’s politically inconvenient to deal with, and instead pile blame on people who generally have little to no control over the lives of the people whose achievements are being so badly measured by high-stakes tests.

The single most reliable predictor of a student’s academic achievement (not perfect, mind you, but better than the vast majority of others) remains the socioeconomic status of that student’s parents. That was true half a century ago, and continues to be the case, modern tests notwithstanding. Current tests and their results may, in fact, be more honest and transparent than previous ones, but they’re still high-stakes tests which do little to show anything more than that a particular kid on a particular day did a good or less-than-good job of taking a particular test. That they’re less awful than their predecessors doesn’t strike me as a ringing endorsement.

A wonderful and insightful comment, Ray

Thank you.

complacency

Regardless of what these tests show the US educational system is falling behind the rest of the industrialized world. We have to understand we are not just competing against WI students, our children are competing against students in Asia and Europe who in many cases go to school year round.

If it is the case that our

If it is the case that our students are competing against the world, then we're doing pretty darn well. If Minnesota was a country we'd be fourth in the world in primary and secondary education. Try again.

Minnesota is nowhere near 4th

Minnesota is nowhere near 4th in the world in primary and secondary education. In TIMSS (8th grade) mathematics, Korea, Singapore, Taiwan, Hong Kong, Japan, and Massachusetts finished higher than Minnesota, with Russia and North Carolina about the same, while in science Singapore and Taiwan remain significantly higher, and Minnesota scores in a statistically similar manner with eight other systems (Massachusetts, Korea, Japan, Finland, Alberta, Slovenia, Russia, and Colorado). In PISA reading, Minnesota was surpassed by Shanghai (which does not participate in TIMSS), Korea, Finland, Hong Kong, Massachusetts, Singapore, Vermont, New Zealand, Japan, and Canada, while in PISA mathematics Minnesota fell behind Shanghai, Singapore, Hong Kong, Korea, Finland, Taiwan, Liechtenstein, Switzerland, Massachusetts, Japan, Canada, and the Netherlands. I would also like to point out that in many of these countries, such as Switzerland, students are learning at least two foreign languages at the same time they are learning the above subjects, while in most cases students in Minnesota (and elsewhere in the United States) are learning, for practical purposes, none; that students in a country like Singapore are outperforming Minnesota in English language reading tests when English is not their mother tongue, but a second language studied in school; and that students in countries like Canada and, increasingly, others are likely to stay in school longer than ours do and so surpass us in educational attainment as well as achievement -- and all for less money spent per student.

Minnesota is world class!

About two years ago, the national testing results were disaggregated, and each state was treated as a separate nation. When the states' results were plugged in to the World rankings, Minnesota and Massachusetts were consistently in the top five with Finland and Singapore.

Not much is made of this result because politically it doesn't feed the narrative that the media and the reformers have created. Instead we look to the charter school movement, Teach For America and the Bill and Melinda Gates Foundation for our solutions. (For the most part these organizations have no classroom experience...just experience in making money.)

Why won't anyone admit that children who start school ready to learn and with verbal and mathematical skills will continue to stay ahead of those who aren't ready for school? Those advantaged children will usually expand the learning gap. How do you tell them not to learn?

Now there may be some students who can close that "learning gap," but if the group that is ahead keeps learning, the gap will continue. It is much better to focus on the changes within each individual student. If they are making progress, we are educating them. If they can reach a some benchmarks along the way, we can make them adult learners.

Adult learners? Yes. Most of us didn't stop learning when we left high school or college. It is how we are prepared to learn that important, so when we are on our own we can make ourselves productive adults. I would think that there are some very accomplished adults, who own businesses, or work in positions of great responsibility, but were not at the top of their graduating classes.

Bill Gates was a college dropout. He found a way around formal education. Perhaps Gates wishes he would have stayed in school longer. At any rate, there was a gap between Gates and the students he went to college with. He found a way around that problem. Most of the rest of us did too!

"Minnesota’s teachers were

"Minnesota’s teachers were among those who helped to design and test the Common Core Standards (CCS), which were to be adopted voluntarily."

Who we're the Minnesota teachers who designed the test? It's a fallacy to assert that teachers designed these standards. Those with no educational background designed these standards and then forced them upon states.

And the standards were adopted voluntarily? I have to disagree. The standards were schools' only reprieve to NCLB's punitive effects. Schools had no choice but to adopt the Common Core.