student desks
Credit: Creative Commons/John

As educational researchers and teachers, we are hearing more and more discussion from educators, communities, and policymakers regarding “learning loss.” Within concerns about pandemic recovery efforts, there is a presumed urgency to fight against a loss of learning — so much so that legislation, district policies, and classroom practices are being organized to combat this loss. We are sensing some tension and anxiety around learning loss and wonder what it will mean for teachers and students.

“Learning loss” seems like a very real problem in need of being addressed. However, like others, we question what is being articulated through the use of terms like “learning loss.” We are critiquing the notion of learning loss for how it is assessed, how it frames learning in deficit perspectives, and for the damaging work it can do through policy.

To be clear, we do agree with the idea that “the COVID-19 pandemic has disrupted traditional forms of education and continues to create challenges for K–12 school systems in the United States and the students they serve” (Kuhfeld, Tarasawa, Johnson, Ruzek & Lewis, 2020, p. 2). And while students leaving schools, or not being accounted for, is absolutely of concern, any hasty calls to action may perpetuate misconceptions and cause lasting damage to young people, teachers and schools.

Perhaps unintentionally, “learning loss” demonizes some family and community experiences, while maintaining oppressive, dominant race and class-based views of education. Could something other than school-based, oppressive structures (like testing, in particular) become indicative of students’ learning?

Many of the studies that point to the reality of learning loss (see the NWEA studies for example) are built on year-to-year testing comparisons of students returning from summer breaks, and assessing what academic skills have been lost. This model for measuring learning loss presumes that completely different scenarios are comparable.

Perhaps most importantly, this comparative move evades the question of whether learning loss can and should be measured.

Jennifer Diaz
[image_caption]Jennifer Diaz[/image_caption]
Left unquestioned, this seeming “loss” will be measured. It will become visible through testing that is aligned with state learning standards, outcomes, and (new) policy measures. Within this logic, students will be — and already have been — “welcomed” back to school by tests. In efforts to prove the realities of assumed deficits and fix the problem, the tests will appear to show the learning that students apparently lost.

What appears as a benevolent mode of operation effectively reinserts comparative and deficit theories of learning that further marginalize students of color, students with learning disabilities, multilingual learners and students experiencing poverty. The data and outcomes that are the driving force behind efforts aimed at fixing learning loss may seem necessary for states and districts. However, they will be harmful to teachers and students because of how that “loss” is located and made measurable. Presumably it will be possible to identify who demonstrates the greatest deficits, using comparative measures that point to some students and teachers as the problems to fix.

The “post-pandemic” policies may stake claims as equity projects — represented as special programs or monetary resources aimed at “remedying learning loss.” Yet, legislative policy and schooling practices enacted in response to “learning loss” should center equity in ways that address the education debt and continued education disparities. Without attending to the inequity that existed long before the pandemic, education will continue to pathologize and marginalize certain youth and teachers.

Joaquin Muñoz
[image_caption]Joaquin Muñoz[/image_caption]
If the conversation will be framed by “learning loss,” it is important to consider the loss we are ignoring. What critical knowledge about intercultural competency, about anti-racism and anti-oppression, about history, about the needs of Black, Indigenous and People of Color communities are we losing? Will the policies and practices enacted to respond to “loss” also address loss of joy or loss of identity, as Dr. Gholdy Mihammad points out?

This is a moment for advocacy. A moment where teachers, schools and communities can voice a belief in collective resiliency that expand visions of who students are and can be through education. This is a time for nurturing humane pedagogies and policies that acknowledge the complexities of lived experience and hear students’ dynamic stories of enhanced learning. Our advocacy work can produce multidimensional pictures of children and their communities, value student’s funds of knowledge, and reject subtractive schooling. What can we create by troubling “learning loss” and moving toward the real work of critically centering equity?

Jennifer Diaz, Ph.D., is an associate professor in the Education Department at Augsburg University. Joaquin Muñoz, Ph.D., is an assistant professor in the American Indian Studies Department at Augsburg University. 

WANT TO ADD YOUR VOICE?

If you’re interested in joining the discussion, add your voice to the Comment section below — or consider writing a letter or a longer-form Community Voices commentary. (For more information about Community Voices, see our Submission Guidelines.)

Join the Conversation

38 Comments

  1. I had to dig a little to find the right-wing billionaires on this one, but I found them – they fund NWEA, which actually sells standardized tests. Shocker that those tests are part of the proposed solution here.

    1. At some point in life one is going to be tested on their ability to do a job. If one can’t pass a standardized test, you can give all the excuses/rationals/blame in the world, you’re just delaying the inevitable.

      1. The problem is that standardized tests have very little to do with job performance, or really anything under normal circumstances. With the added variables from the pandemic, they are utterly worthless. These people are pushing garbage. And their evidence is provided by those who profit off testing.

          1. Nonsense. Its the idea that standardized testing has any merit that us supported by zero facts. That’s why they trot out people like Diaz and Munoz to push the testing companies findings about testing.

            Yeah, god forbid you listen to teachers on what works in education. Lets take it from the right-wing billionaires who fund the nonsense in articles like this.

            1. Remove testing and replace it with subjective assessment. Then we find out Senator A has a kid at Ivy A, Senator B has kid at Ivy B, and Past President has kids at Ivy C. All admitted due to a “rigorous assessment” of their potential. Cause they attended a “Save the Giraffe” in Zimbabwe and attended a round table with Beyonce on racism and poverty.

              <Meanwhile poor Chinese and Vietnamese restaurant owners kid wonders why he/she was denied despite having perfect academic record and test scores. Their "assessed potential" was lacking, cause they didn't attend a conference on race an poverty with Beyonce and probably missed a Bruce Springsteen sing along of poverty in America.

              That's right, remove any fact based assessment with the end result of No Accountability and a Guilded Age for the Connected. And yes complete free ride for the Unions in running schools to the ground.

              1. Glad that we agree that admission to Ivy League schools primarily measures how wealthy and connected the student is and has little to do with academic ability. After the recent scandals with parents purchasing admission to these schools I don’t know why anyone would consider a diploma from one of these schools as anything special. Unless your primary motivation is to gain access to wealthy people so your child can make wealthy friends (or find a wealthy spouse) it is better to send your kid to a state school and save the money.

                1. I point to how the system is now gamed and gamed further when you remove any objective measure. And i used what happens in Ivy leagues. Think that’s not going to happen or doesn’t already happen in competitive public schools ? The Admission Scandal happened at USC which isn’t an ivy league school.

                  The primary motivation isn’t to get access to wealthy kids. It’s to get a better education. Are you saying a Computer Science from Stanford is the same as one from the U ?

                  Why don’t you comment or provide recommendations on how you’re going to avoid gaming of the system ?

      2. We’ve had this conversation before. There is no evidence that standardized tests actually measure student aptitude. Standardized test scores are highly correlated with affluence, not intelligence. Furthermore, GPA is more predictive of college success than standardized test scores–and no, I’m not going to link you to the studies because they’re easily accessible and I’m not going to do the work for you. Finally, equating standardized student testing with having to pass a forklift certification exam is preposterous. They’re completely unrelated measurements. As a professional, the only relevant test I had to pass was the patent bar exam. The rest were gateway exams for more school, and I can tell you that if you have the right tools (e.g., time and money), you can get a good score on almost all of them without having to be any more talented or intelligent than average. The fact that you can study to improve your score is proof that they’re not measuring general aptitude or intelligence, but rather measuring the ability to take the test–and there is absolutely no real world application. No one takes standardized tests for a living outside of companies that make standardized tests.

        1. We’ve had this conversation before. And the last time you posted supposed links I used tithe very links to prove that there was indeed a correlation between standardized tests and outcomes. A $ 20 Peterson’s guide is not some great barrier to for the poor and middle class. And actually in the discussion about libraries you were the one pooh poohing my suggestion that these books shouldn’t be borrowed under the no fine policy cause it hurt poor students.

          One can understand if a score is say within a ten to fifteen percent differential due to unmeasurable or extraneous factors. But in actuality you want to claim ANY difference is irrelevant. That is not a scientific observation but rather a desired political observation.

          If a student after say ten years of English, Math in school gets say thirty percentile vs someone who scores eighty or ninety percentile; and you wish to state they’re both equally placed to attend college , that’s pure politics. That’s how you end up with our favorite political children and nieces of politicians who were admitted to these institutions and can’t hold a job.

          1. You didn’t. The data in those articles simply didn’t support your opinions. And every article I’ve seen that offers and opinion similar to yours provides no data to support those opinions. At best, they say that, in the absence of data to support their opinions, we should proceed with caution on abandoning standardized testing. The problem with that is that there IS data to the contrary, not an absence of data.

            1. Your basically not posting that link causes pointed out that it actually shows an 80 percent correlation between scores and college performance. They never said “absence of data”. Common post that link rather than giving your “interpretation”

            2. https://www.insidehighered.com/news/2016/01/26/new-research-suggests-sat-under-or-overpredicts-first-year-grades-hundreds-thousands

              Here is the link. Take a look at the findings. At worst they found lack of predictive ability for 20 percent. Let me translate that. It means SAT predicts 80 percent of the time at a minimum. And you want to claim there is no predictive capability despite 80 percent results ?

              “In looking at scores, by gender, on the mathematics portion of the SAT, he found that at 16 percent of colleges, the predictions were inaccurate for either male or female students at those colleges. He said that there wasn’t a clear pattern — sometimes female applicants are being hurt with predictions that they won’t do as well as they will. Other times it is the opposite. That would be about 80,000 people in the sample.
              Similarly, when comparing scores for white and Latino students on the mathematics section, he found a lack of predictive accuracy at 19 percent of colleges. This gap affected about 65,000 people. (The number of students affected by findings varies based on the size of the colleges where the researchers identified problems.)
              And when the researchers looked at the critical-reading section of the SAT and compared black and white applicants’ scores, they found that the predictions didn’t work at about 20 percent of colleges, again affecting about 65,000 people”

  2. Thanks for speaking up, but you didn’t need to be so polite. “Presumably it will be possible to identify who demonstrates the greatest deficits, using comparative measures that point to some students and teachers as the problems to fix.” No it won’t. The numbers that get generated by the tests that will be given this spring are garbage numbers.

    The numbers are going to be insensitive to even more factors than is the case in years when there’s not a global pandemic. Was the student’s school in person, or remote, or hybrid; did the student have adequate tools to do whatever mode of learning was attempted? Did the teacher of that student have adequate training for the mode attempted. Did the teacher have adequate tools for the mode attempted. What was the death rate for the student’s community, or do think that people dying doesn’t affect how students perform on tests? Was the community open or closed? Did everyone wear masks or not? The testing industry needs to start over or, more honorably, quit taking money out of the education system until they can validate tests that account for all of the variables students experience. They didn’t do it before, and I don’t expect they will do it now. It is important that we point out the invalidity of the tests for which the testing industry is being paid with taxpayer dollars.

    1. The agenda here is the testing. They reference an organization the profits off testing. It doesn’t matter that the numbers are complete garbage – what matters is who is paying for this.

      1. If a testing company makes money (the horror), their tests are all invalid. Does that same logic apply to a vaccine company ? Its just a never ending series of excuses to find fault / blame with everyone else except the person in the mirror.

        1. No, of course not. The problem isn’t making profits. I certainly hope the vaccine companies profit, because their products will save millions of lives.

          The problem is that the product here -standardized tests – is garbage. And so when people pushing standardized testing base their arguments on falsehoods from those who profit from that product, their motives and honesty should be questioned.

          1. Again. George Bush was evil because of No Child Left Behind. Union only educators had better ideas. Twelve plus years later, progress ? Nah. Just more blame to pass around.

            Testing works. It’s just that it’s inconvenient cause it highlights failure.

            1. “George Bush was evil because of No Child Left Behind.”

              Well, not just because of NCLB, but that was a big part of it.

              “Union only educators had better ideas.”

              That’s setting the bar pretty low, but I would trust the judgment of professional educators over that of political professionals.

              “Testing works.”

              At what? Generating profit for testing companies, sure, but does it do anything other than create an artificial metric? Are the tests really measuring anything that is actually related to a student’s education, or are they just generating random, albeit convenient, numbers?

              Put another way, are the “failures” being highlighted anything more than a “failure” to accomplish a particular task at a particular time?

              1. “That’s setting the bar pretty low, but I would trust the judgment of professional educators over that of political professionals.”

                And the results ? Or is that an inconvenient question ?

                “At what? Generating profit for testing companies, sure, but does it do anything other than create an artificial metric? Are the tests really measuring anything that is actually related to a student’s education, or are they just generating random, albeit convenient, numbers?”

                Yes it works. It measures Academic progress or lack of there of. Any evidence of success of a non testing process that has produced results ? Nope/Nada/Zippo.

                A Summary : Excuses, excuses, excuses.

                1. Raj, I utterly crushed every standardized test I ever took, like 99th percentile, over 30 on ACT etc… Wanna guess my college GPA? 2.5. Standardized testing tests rote learning, period. I happen to have an above average ability to memorize information, making standardized testing a breeze. Great for me in 1997, not so great now when when every man, woman, and child carries the sum total of human knowledge in their pocket, wherever they go. Standardized testing is a relic of the past, who would you saddle the kids of today and tomorrow with it, when its serves utterly no purpose?

                  1. Matt, you write very eloquently on Minnpost. Disregard that I disagree with about say 100 percent of it. Obviously that writing talent didn’t come from rote a ability to regurgitate. The test accurately measured your abilities, I’m confident. What you did with those abilities in college I don’t want to know.

                    1. The point remains the same Raj, you advocate a system from of the past that has no bearing on the future. What writing talent I may have was never measured by a standardized test, nor were those tests indicative of my academic success, or lack thereof, so what exactly ARE they measuring? What use is it to anyone?

                    2. The system I advocate has uplifted millions of immigrant children and others based on the social capital these communities have invested in education. No other path has provided any measurable progress in such achievements as compared to such “investments”.

                      We have decades of feel good programs and other boondoggle programs to measure against. And of course it’s so easy and convenient to avoid any such measurement. Onwards , full speed ahead , to the next boondoggle.

            2. He wasn’t evil, just misguided. Testing doesn’t work. Its a poor measure of school effectiveness. And what is does is dissuade good teachers from working at underperforming schools. If you teach in Edina, you are deemed a good teacher. Go to North Minneapolis, and you aren’t. Its garbage.

              1. “Its a poor measure of school effectiveness.”

                Nope. It could be used to measure school progress, within its own socio economic cohorts.

                ” And what is does is dissuade good teachers from working at underperforming schools. If you teach in Edina, you are deemed a good teacher. Go to North Minneapolis, and you aren’t. Its garbage.”

                Actually what dissuades teachers from working at underperforming schools are the School Boards and Unions who believe they and only they have all the answers. A fair system would attract teachers who are motivated to address issues.

                But then School Boards these days are nothing more than proxies for the political parties. And any accountability is BAD. Just more money, more money, more money.

                1. That’s pure nonsense. Teachers hate testing. And it does deter them from going to schools in low-income areas within a district. Its the same admin and union. The tests just make it seem that you are a bad teacher if you teach at a low income school. Its garbage.

                    1. There are few times where being a stickler about spelling and grammar are really important. This is one of those times. Your spelling and punctuation mistakes are exactly the thing that a standardized test might use to identify you as someone unworthy of college. Yet, I’m sure that it’s not central to your success as an adult. Don’t get me wrong, grammar and spelling errors annoy the bejeezus out of me, and yes, I often assume a lack of intelligence when someone makes them. But it turns out that people can communicate effectively even when they’re not following grammar rules. For example, you might start a sentence with “but” or “and” as I just did, and not offend anyone of importance. In fact, I listened to a judge who believed that appropriate use of conjunctions at the beginning of a sentence was part of effective communication when used appropriately (though still grammatically incorrectly). It’s still wrong on the tests, but a lawyer can get away with it. That same judge nitpicked on a bunch of silly grammar issues that she would get annoyed at. Of course, she insisted that it wouldn’t affect her decisions, but I know better. No one is the most reasonable and rational when they’re annoyed. Do you want to know what annoyed her? Adverbs. Perfectly good adverbs that every standardized test LOVES to test you on.

                      Interestingly, LSAT scores are often used to filter out who gets to go to law school. Yet, they are only predictive (and only poorly so) of 1st year law school grades, but not at all predictive of 2nd or 3rd year grades. Importantly, LSAT scores have no correlation of attorney skill or success. It’s notable that these data were generated by the organization that creates and administers the LSAT test. I’m sure they were a bit bummed about that, but they certainly did their best to make more out of their 0.36 (poor) correlation than anyone who actually understood what correlation means. https://abaforlawstudents.com/2016/07/14/grit-and-grind-your-way-to-success-in-law-school/

                  1. If my spelling and grammar hurt my admission chances then I’d apply to schools that were looking for more technical aptitude. Yes that would’ve made me ineligible/ low probability candidate for certain schools, while others would’ve welcomed me with a condition of remedial English etc. At least my scores would’ve presented a clear picture for them to make an informed decision. I’ve been willing to let chips fall where they may for me and my family based on such an accurate portrayal. Just like millions of Asian dads who spoke English like me and pushed their kids to do better.

                    You may be a stickler for English. Good for you. However you certainly ain’t a stickler for rigorous analysis . The law school correlation was within each school and not across schools. Which means at an easy law school every one could get an A, while at a hard law school they will not admit anyone below a certain LSAT score. So how do you validate a LSAT score – GPA correlation in a tough law school when they don’t have a testable subset below a certain LSAT ?

                    “Since correlation studies are conducted for individual schools and school-specific results are reported only to the schools whose data were analyzed, “

                    On the other hand the LSAT correlation is clearly evident when the measured outcome was a standardized result as in the case of a bar exam.l

                    https://abovethelaw.com/2016/04/lsat-scores-v-bar-exam-performance-how-did-your-law-school-do/

                    “These results are what you’d expect from top-tier law schools. What happened at law schools that are considered less esteemed by the rankings gods at U.S. News?

                    As far as we know, Texas Southern and Charlotte have the lowest median LSAT scores out of the 203 law schools in the United States (200 with full accreditation and three with provisional accreditation). This is what their numbers look like in terms of median LSAT scores versus bar passage rates. One word can best describe these results: ouch.”

                    https://lawschooltransparency.com/reform/projects/investigations/2015/documents/NLBPS.pdf


                    In addition to LGPA and LSAT score, several other variables were examined for their unique contributions. Although the other variables were related to bar examination outcomes, they also were strongly related to LGPA and/or LSAT score. Once those two variables were in the model, many of the other variables did not add significant unique information and therefore did not improve the fit of the model. Those that did not yield significant model improvement include SES, law school stratum (a grouping of law schools based on median LSAT scores), and sex. UGPA and an index of undergraduate-school selectivity provided statistically significant model fit but negligible improvement in the amount of variance accounted for by the model. This result is a likely consequence of the relationships of either UGPA or undergraduate school selectivity with both LSAT score and LGPA. These findings were consistent with those reported in earlier studies of bar examination outcomes.”

  3. “Without attending to the inequity that existed long before the pandemic, education will continue to pathologize and marginalize certain youth and teachers.” – Your article is premised on the hypothesis that there are these massive inequities in education which lead to these massive gaps in tests scores etc. Great. You’ve come to the right place in Minnpost.

    However do tell me what great inequities exist in Minnesotas education system that funds each student at least $10,000 per student. Are you stating that when a third grader of some groups are starting to lag behind his white counterpart its because of inequities ? Really ? Third Grade is when one starts noticing the gaps. Are these communities deprived of access to books in the library, are schools lacking a simple learning book or other learning mediums. You cannot and will not point to any such deprivation. As an child , when i went to school we did not have much more than those facilities.

    If there are such inequities how come some other minority communities like Chinese and Vietnamese communities , who also come from poor backgrounds, beat their white counterparts. Starting in third grade.

  4. The level of abstraction in the language of this opinion piece should make anyone suspicious.
    Equity? The nerve. The state forced EL teachers to administer the ACCESS test as soon as students returned to in person instruction. Instead of being welcomed back and allowed a chance to learn what it’s like to be in school (as much as it can be school given the various COVID related precautions), EL students were pulled from those classrooms and given a test that takes 4 days to administer. For what? If the state’s intent was to make those kids feel different from the other kids, they succeeded. Honestly, it doesn’t get much more bald faced than that. This need to harvest data or sell testing is dehumanizing, and it’d be great if a journalist could follow up on it.
    Wouldn’t it be more humane to allow students to at least settle in and get to know this new environment and what it is to be a student in a school again before having them take this test?
    The need for data has become more valuable to policy makers than the kids it comes from.

    1. Minnpost loves the corporate education reformers. There’s never enough testing.

      1. To be fair, it’s a Community Voices piece. Minnpost publishes them because someone submitted them. You could submit one, too! That said, it would appear that there is a concerted effort by these special interest groups to appear charitable and understanding to get liberals to buy into their new brand of testing. Down with the ACT! Up with the NEW TEST! Same as it ever was.

        1. After decades of running urban schools with nothing to show for, blaming the tests is just the next excuse. If one can’t get say 3 out of 10 questions on a Minnesota state math test, you. And blame the rich, the billionaires, the Republicans…in short everyone else., but it convinces no one except the left wing echo chamber

          InSan Francisco and Boston where they want to remove testing, where is the poverty variant there?

  5. Seeing Shapes in the Clouds

    For those who care about education, and I believe these authors do, I’d like to hold this opinion piece up as an example of what not to do. We’d like to act. We’d like to correctly frame learning loss; perhaps we should abandon the whole notion and just work with what’s in front of us. We want to teach our kids humanely and give them the space to be a kid, but that’s not concrete enough for policy. That’s not concrete enough for action. Each of the following questions is a cloud waiting for each of us to interpret:

    Centering equity
    Voicing our collective resiliency
    Student’s with expanded visions of self
    Humane pedagogy
    A multidimensional picture (+bonus link to a book that looks good!)

    I wonder why the words were written given the obvious lack of care for any clear understanding. These words sound nice. They act like vacuums or potholes that hold what we want them to hold. They avoid the discomforting discourse necessary for concrete action. If issues of equality were easy, they’d have been solved by now. This tower is a bit too ivory. That’s not a racial dig. It’s a call to set your abstractions aside, come down and get your hands dirty.

    Equity is really important. I’m sure these authors would agree. It’s so important that it deserves specific and concrete language. Not links to some book that might explain what a “multidimensional picture” of a kid is. I’m not some hayseed who can’t understand, nor do I believe that all great ideas must be pragmatic.

    How about something like – now is a good time to give kids the space to be kids. Or maybe – now is a good time to give teachers the space, support, and encouragement they need to restore their students’ learning? If there’s not a more direct way to say it, all of these notions of equity and community will just remain up there harmlessly floating around. It’s a shame because equity and community are two abstractions we need to become more concrete as we look at the possibility of rebuilding both in a post-pandemic world.

    I can’t wait for our schools and teachers to “nurture” this more humane pedagogy into practice. We really can’t wait, so could you tell us what it is?

    1. I would dispute that the authors care about education. Just their corporate agenda.

    2. Agreed. Politics by politicians and bullying by parents both need to be removed from the classroom. And then there are those who ignore the science — standardized testing does nothing to predict student success that wasn’t already predicted by their socioeconomic status. Grades do. That means that teaching is effective, or grades would be meaningless. Instead, grades the the most predictive factor for student success. Maybe we should let teachers figure out how to get kids back on track, and then provide them the support they need to carry out their plans. Beyond that, we should, as a society, make sure that kids and their parents have access to mental health services inside and outside of schools to deal with the trauma of the past year. Heck, we generally need to stop treating mental health as though it’s just a buzzword. Last time I checked, you’d be less ok without your brain than an arm or a leg, yet if you break and arm or a leg it’s an emergency but if you break your brain, it’s considered a personal problem or moral failing.

Leave a comment