Why grades and scores are bad incentives

 

An edited letter to the New York Times in 2019. The paper had run a story about Alfie J Kohn’s campaign against standardised testing.

Alfie Kohn [https://www.alfiekohn.org/article/fighting-the-tests/] is right. "People respond to incentives" is true, but when the incentive is a letter or number in a little box on a report card, the incentive is unlikely to produce learners.

Anecdote: Early in my career, one of my students achieved 19/20 on a short-answer test. I saw this student in the hall, and explained the incorrect answer. The student's eyes glazed over, the first time I'd ever seen that cliche operate in real life. The student didn't care about knowing the right answer, they cared only about the score. 19/10 = 95%, that's A+, that's all that mattered. I found out later that too many of my "best" students had exactly the same attitude.

Tests and exams are at best diagnostic. For the student and teacher, they may tell how far the student has come since the last test, and may provide guidance for future learning. For other people, such as college admissions officers, they provide some data (mostly over-rated and misunderstood) about the odds that the student will continue learning.

You might as well grade students on their height. Tall ones worked hard to add an inch or two, the lazy ones just sat around and shrunk. Silly? Sure, but that's how people too often think about students. In a typical class, there's about a one year range in chronological age, and usually much more than that in psychological age, which includes cognition. We humans develop at different rates, and development is never uniform. To expect grades to show that some students are "better" than others is asinine.

The supporters of grading, significantly I think, are mostly academics, whose working life consists of grading students. It's difficult to accept that a tool you've been using all your working life is not fit for purpose.

Unfortunately, people treat grades as rankings. They look on them like scores in a game. Winners score high, losers score low. That is no way to incentivise learning.

The only real regret I have about my teaching career is that I didn’t oppose the misuse of tests and exams.

 

Christopher Smart Loves His Cat Jeoffry

 Martin Leman. Christopher Smart: My Cat Jeoffry (1992) One of the pleasures of a course in 18th century literature was discovering Christopher Smart’s poem about his cat Jeoffry. It’s a hymn, listing all the ways in which Jeoffry shows us the glory and love of the Creator. Smart rejoices in his cat, and anyone who likes cats will share his joy. But Smart’s poem celebrates any and all of God’s creatures, and the joy of loving connection between us. Martin Leman has made a lovely little book illustrating the poem. Recommended. ****

One of many links to the poem: https://interestingliterature.com/2020/08/christopher-smart-my-cat-jeoffry-analysis/

Old Ideas: John Grant on Discarded Science

 John Grant. Discarded Science (2006) A survey of superseded science, some pseudosciences,

and the occasional deliberate scam. Some, such as astrology and homeopathy, have continued to the present day. A few, such as continental drift, turned out to have a kernel of accurate insight which was developed into more or less settled science.
     Grant traces how later scientific inquiry corrected many of these early ideas. However, I don’t think he fully acknowledges the role of the human desire for explanation and understanding. We feel uncomfortable when faced with the inexplicable. So we concoct comforting theories, based on whatever evidence we have, and always informed with whatever assumptions about reality make sense at the time. He does once in a while show how discoveries in one area prompt new ideas in other areas. For example, Mesmer’s notions of “animal magnetism” made sense at a time when magnetism was not well understood, but experiments had begun to reveal how it worked.
     An entertaining survey. I’m keeping it for reference. Recommended. ***

What it's Like To Be Someone Else: An Anthropologist on Mars (Oliver Sacks)

 Oliver Sacks. An Anthropologist on Mars (1995) The title quotes Temple Grandin, one of seven people whose brains function outside the range now labelled “neurotypical”, a term Sacks never used.
     The book begins with “Jonathan I”, an artist whose suffers a high fever, and wakes up unable to see colour. He’s even unable to remember colour. Being achromatic (lovely word, I think) is barely imaginable by anyone who grew up with black-and-white films. But being unable to recall colour, that’s impossible for us to imagine.
     Sacks’s gift is to convey something of the feeling of what it’s like to be the persons he describes. In doing so, he provides evidence that we perceive only what the brain can construct from the inputs of the senses, and that perceptions will vary with differences in the brain. People who are born with unusual brains, or who suffer lesions in the brain, are natural experiments in the range of possible human existence.
     For Sacks also sees that we are what we perceive. Changes in our perceptions are also changes in our selves. Our sense of self, our self-awareness, is part of the totality of perceptions that give us the experience of reality. Sacks’s case histories show that while we cannot fully imagine another person’s experience, we can know where and how our experience differs from that of others.
    Science is the attempt to describe, and the arts are attempts to share, our common experience. Sacks is one of the rare people who can combine these two modes of insight. Any of his books are worth reading. ****

Do you see what I see? (Hallucinations: Oliver Sacks)

     Oliver Sacks. Hallucinations (2012) A posthumous work assembled from Sacks’s notes and drafts. The result is a somewhat gappy discussion and occasionally rough style, but it still adds up to what to me appears a thorough survey of what’s known and unknown about hallucinations.
     Hallucinations are illusions, but they are almost always known to be illusions. Neurological research shows subtle differences between perception, illusion, hallucination, and memory. All involve the brain areas of sensory perception, but the limbic system and the frontal cortex behave differently. While we generally think first of visual hallucinations, hallucinations happen for every sense, as do illusions. Sacks as usual uses case histories to demonstrate the nature of different types of hallucination.
     I learned much. One thing is that the zig-zagged glittering visual aura that precedes most migraines is probably more common as the sole symptom of migraine. (Variations of it also precede epileptic seizures.) Since I experience that aura myself roughly once every other month or so, this information is somewhat reassuring.
     Another interesting fact is that people deprived of sight (even temporarily) experience visual hallucinations. These are oddly similar both in the content and in how the content changes over time.
      But mostly what I learned reinforces the hypothesis that the brain constructs the experience of what we are pleased to call reality. The centre of that experience is the self, the “I”. Sensory deprivation changes the “I”, not merely what the “I” sees or doesn’t see. Many people who lose their sight eventually are no longer able to remember their past visually, for example. But memories are at the core of our sense of self. We are not only our present experience, we are our memories.
     Another very good read. Recommended. ***½

The Best of Herman (Jim Unger)

 Jim Unger. The Best of Herman (1993) A re-read, and as pleasurable as before. Whatever role Herman plays, he’s always the schlemiel that never quite wins, who faces defeat at everything he attempts. But he never gives up. His life skill is endurance, and sometimes wry, sometimes realistic, sometimes grudging acceptance of the losing hands life deals him. Herman is Everyman. The effect is an odd kind of hope. If tomorrow doesn’t appear to shape up as any better than today, at least we can hope that it won’t be much worse. Whatever disaster is heading our way, it will be at least survivable. ****

When People aren't What They Seem To Be: Prayers for the Dead (Faye Kellerman)

Faye Kellerman. Prayers For the Dead (1996) Prominent and much admired heart surgeon Azof Sparks turns up nastily dead in a back alley. He was not what he seemed to be, nor are his family, which misleads Detective Lt Peter Decker. Rena’s long-ago connection with the family complicates the case, as do the usual attempts by family members to protect each other.

     Kellerman’s casual incorporation of the details of practiced Judaism is one of her strengths. But it’s her characters that impress me most. Even the secondary ones have unguessed depths. It’s the (I think deliberately) incomplete backstories that make the characters believable. We never fully understand or know the people that are closest to us, let alone those we know merely as acquaintances or regular figures in our daily rounds. We know most fictional characters better than we know most real people. But not in Kellerman’s books. The mysteries of being human are central to her fictions. I feel that although the criminal has been found, their motives are never fully understood. A satisfying read.***