On being realistic (sometimes there is no shortcut)

As you may have heard, June SAT scores are back. And if you’re reading this, chances are you’re looking to improve your score this summer and thinking about what might be possible. Maybe you want to crack 1800…or 2000…or even 2300. You’ve got about three months, which is plenty of time to accomplish…something. If you’re unhappy with what you’ve managed to accomplish on your own, you might be thinking about thinking about taking a class or working with a tutor, or maybe you’re just planning to keep plugging away on your own. Regardless of your (or your child’s) situation, however, there are some things you should keep in mind.

So a little reality check. Some of this is going to sound awfully blunt, and probably more than a little harsh, but here are some things to keep in mind:

The SAT is hard.

Good grades are no guarantee of a high score.

Your score is the result of what you know, whether you can apply that knowledge instantaneously and under pressure, and how well you manage yourself on the particular test you happen to get; it is not something you are entitled to because you attend a particular school or have spent x amount of time or money being tutored, or even because you work hard.

Most people will, by definition, score somewhere around average.

If there really were tricks you could use to ace the exam, lots of people would get perfect scores instead of about 300 out of 1.5 million.

However hard you think you are working, there are other students out there who are putting in much, much more. If you want to equal — or surpass them — you need to be willing to work just as hard.

You are being compared to hundreds of thousands of your peers, including the very top students in the United States and some in other countries; the curve is designed to reflect that.

A tutor is not a miracle worker.

There is a skill level below which short-term strategy-based prep is usually not effective. A score below 600 after a significant amount of prep is usually a good indicator that there are a number of fundamentals missing, although higher scorers are often missing particular key skills (e.g. identifying the topic of a passage) to various degrees.

If you are missing skills, getting to the next level will require a huge amount of work, whether your score goal is 1600, 2000, or 2400. It’s as much about where you’re starting from as it is about where you want to go.

The SAT does not work like tests in school. It’s designed to gauge how well you can apply your knowledge, not whether you can simply cram in a bunch of words and formulas, to be forgotten as soon as you walk out of the exam room. If you haven’t mastered skills to the point where they’re automatic, you will not be able to apply them — or even be able to figure out when to apply them — to the test.

Today’s eleventh and twelfth grade textbooks are written at the same level that ninth grade textbooks were written at fifty years ago. If you don’t read anything other than textbooks and Sparknotes summaries, with the occasional Wikipedia article thrown in, you will most likely not be prepared for Critical Reading.

No tutor can compensate for two or five or ten years of accumulated deficits in a couple of months, never mind four or five sessions, and it is not fair or realistic to expect one to do so. A student who doesn’t know words like “surrender” and “compromise” and “permanent,” or who has reached the age of 17 without being able to consistently recognize the difference between a sentence and a fragment, is going to hit a wall unless they are willing to spend huge  amounts of time filling in some of those gaps on their own.

Now that I’m starting see lots of students who are missing important middle-school vocabulary and some who are missing basic elementary school vocabulary, I realize that Stanley Kaplan knew what he was talking about when he said that SAT prep should begin in kindergarten.

While the majority of my students improve, sometimes very dramatically, some of them do not; occasionally, their scores even go down. And students who come to me for a handful of sessions with middling scores, genuine knowledge gaps, and an unrealistic sense of just how much work they’ll need to put in to get the next level, rarely see any significant progress. (Note: taking three or four practice tests doesn’t count for much when there are people taking twenty or thirty…or more.) On the other hand, someone who has all the basics in place and just needs a little push to get to the next level might get where they want to be in a session or two. I’ve seen it happen more than once, but those people really did have things pretty much in order to start with.

I do my best to be really clear about just what I can and cannot likely accomplish in a given timeframe, but it’s a very fine line between being honest and being discouraging. I don’t want to turn away someone I could genuinely end up helping. I’ve seen enough kids pull off huge and unexpected jumps to know that it’s not my place to judge what someone is or is not ultimately capable of doing, but I don’t want to encourage people to harbor unrealistic expectations either.

I realize, by the way, that I probably shouldn’t admit all of this publicly — doing so can’t possibly be good for business — but given how convinced everyone seems to be about the existence of quick fixes, I feel responsible for saying something.

At some level, I think that the test-prep industry’s claim that there really are little “tricks” has become so ingrained in people’s psyches that they don’t fully grasp just how hard it is to raise a score, especially a Critical Reading score, until they see that 490 or 550 or 570 staring at them — again — from the computer screen. It seems impossible that they should have done what seemed (to them) like a huge amount of work and paid a lot of money, only to end up right back where they started. They don’t understand just how precisely the test has been calibrated to keep producing the same results. They hire a tutor because they think there really is some sort of magic shortcut (more than one parent has said I must know “all the tricks,” wink-wink, nudge-nudge) and are consequently very rudely shocked by just how hard they or their child will have to work to break through to the next threshold.

No matter how upfront I am about the limits of my abilities, though, I still feel responsible (and vaguely disingenuous, even though I’ve made it clear that I can promise nothing) when a student doesn’t improve. Then I start to wonder whether other tutors really do have secrets that I don’t know about.

Believe or not, I’m not trying to discourage anyone who’s less than over-the-moon about their SAT or ACT score. If you’re planning to study for this summer (and yes, I will post some actual test tips, not just whine about the decrepit state of the American school system, although I might have to get a few more posts about that in before I move on), by all means, you might actually succeed in raising your score hundreds of points.

Occasionally, like yesterday, I’ll get an email from a kid who did nothing other than work through my books and practice diligently, but who nevertheless managed to raise his CR and Writing scores by 400 points. Emails like that make my day, actually my week. They reassure me that people who put in the work actually can improve by that much, regardless of what the College Board claims.

Basically, you get out what you put in, tutor or no tutor. Most of my best students, the ones who make the 100, 150+ point improvements per section, have been incredibly self-driven. They experimented with strategies, hunted down old exams on the Internet, and read Oliver Sacks for pleasure; and when they came to me with questions, it was because they had worked through things as far as they possible could and were genuinely stuck. The ones who were dragged by their parents, who would clearly rather have been somewhere else… Well, some of them actually improved rather impressively, too (didn’t think I was going to say that, did you?), but they did stop short of their potential. The ones who did the work in only the most perfunctory manner, however, the ones who showed no interest in really understanding the test, and who expected me to give them a secret that would allow them to reach their goal without really having to think…Would you really be surprised if I told you that they almost always ended up disappointed?

So don’t think that improving is impossible. Lots of people do it, sometimes by quite a bit. But don’t expect a 200-point improvement to fall in your lap either. Or, for that matter, be hand delivered to you on a silver platter.

The answer isn’t always *in* the passage

A while back, a student who was trying to raise his Reading score came to me with complaint: “Everyone always says that the answer is right there in the passage,” he told me. “But I feel like that’s not always the case.”

He was right, of course. He’d also hit on one of the many half-truths of SAT prep, one that frequently gets repeated with the best of intentions but that ends up confusing the heck out of a lot of people.

As I’ve written about before, most SAT prep programs spend a fair amount of time drilling it into their students’ heads that the only information necessary to answer Critical Reading questions can be found in the passages themselves, and that test-takers should never, under any circumstances, use their own knowledge of a subject to try to answer a question. They’re right (well, most of the time, but the exceptions are sufficiently rare and apply to so few people that they’re not worth getting into here).

In trying to avoid one problem, however, they inadvertently create a different one. The danger in that piece of advice is that it overlooks a rather important distinction: yes, the answer can be determined solely from the information in the passage, but the answer itself is not necessarily stated word-for-word in the passage.

A lot of the time, this confusion stems from the fact that people misunderstand the fact that the SAT tests, among other things, the ability to move from concrete to abstract. That is, to draw a connection between specific wordings in the passage and their role within the argument (emphasize, criticize, assert, etc.). The entire POINT of the test is that the answers to some questions can’t be found directly in the passage.

Correct tend to either describe what is occurring rhetorically in the passage or paraphrase its content using synonyms (“same idea, different words”). You need to use the information in the passage and then make a cognitive leap. It’s the ability to make that leap, and to understand why one kind of leap is reasonable and another one isn’t, that’s being tested. If you only look at the answer choices in terms of the passage’s content, they won’t make any sense, or else they’ll seem terribly ambiguous. Only when you understand how they relate to the actual goal of the question do they begin to make sense. In other words, comprehension is necessary but not sufficient.

While knowing all this won’t necessarily help you figure out any answers, it can, at the very least, help to clarify just what the SAT is trying to do and just why the answers are phrased the way they are. If you can shift from reading just for content to reading for structure — that is, understanding that authors use particular examples or pieces of evidence to support one argument or undermine another — the test starts to make a little more sense. And if you know upfront that the answer is unlikely to be found directly in the passage and that you need to be prepared to work it out yourself, you won’t waste precious time or energy getting confused when you do look at the choices. And sooner or later, you might even get to the point of being able to predict some of the answers on your own.

Finally, some common sense…

From The Faulty Logic of The Math Wars:

A mathematical algorithm is a procedure for performing a computation. At the heart of the discipline of mathematics is a set of the most efficient — and most elegant and powerful — algorithms for specific operations. The most efficient algorithm for addition, for instance, involves stacking numbers to be added with their place values aligned, successively adding single digits beginning with the ones place column, and “carrying” any extra place values leftward.

What is striking about reform math is that the standard algorithms are either de-emphasized to students or withheld from them entirely. In one widely used and very representative math program — TERC Investigations — second grade students are repeatedly given specific addition problems and asked to explore a variety of procedures for arriving at a solution. The standard algorithm is absent from the procedures they are offered. Students in this program don’t encounter the standard algorithm until fourth grade, and even then they are not asked to regard it as a privileged method

It is easy to see why the mantle of progressivism is often taken to belong to advocates of reform math. But it doesn’t follow that this take on the math wars is correct. We could make a powerful case for putting the progressivist shoe on the other foot if we could show that reformists are wrong to deny that algorithm-based calculation involves an important kind of thinking.

What seems to speak for denying this? To begin with, it is true that algorithm-based math is not creative reasoning. Yet the same is true of many disciplines that have good claims to be taught in our schools. Children need to master bodies of fact, and not merely reason independently, in, for instance, biology and history. Does it follow that in offering these subjects schools are stunting their students’ growth and preventing them from thinking for themselves? There are admittedly reform movements in education that call for de-emphasizing the factual content of subjects like biology and history and instead stressing special kinds of reasoning. But it’s not clear that these trends are defensible. They only seem laudable if we assume that facts don’t contribute to a person’s grasp of the logical space in which reason operates.

In other words, reform movements are largely based on the rejection of a “reality-based” concept of education. We couldn’t possibly have anything as piddling as facts interfering with the joy and beauty of learning. If a child wants to believe that 2+2 =5, shouldn’t they be praised for thinking independently?

In all seriousness, though, there’s something borderline sadistic about schools refusing to teach actual, well-established knowledge, knowledge that makes learning easier. Not every student is genius capable of re-deriving the Pythagorean theorem on their own. Yes, by all means, teach students to understand why things are true – I’ve heard from math tutors who constantly encounter kids who do just fine in calculus because they’ve learned when to plug in about four formulas but who fall down on comparatively basic SAT math because they don’t really understand why things work the way they do, or how to apply simple formulas when they’re presented in unfamiliar ways. The point is, teach them something, don’t just let them flail around trying to figure it out on their own.

What’s the point in all those centuries of accumulated knowledge if schools are just going to toss it out the window?

Some thoughts about tracking

Some thoughts about tracking

Apparently tracking is making a comeback. I was actually unaware that it had disappeared in the first place, but given that I generally try my hardest to remain immune to the latest fads emanating from education schools, that’s not exactly a surprise. As the product of twelve years of tracked classes, however, I find the subject somewhat interesting. Now granted that in my deliberate (and obstinate) ignorance of educational theory leaves me with little to offer beyond personal anecdote, but as someone who got to see tracking from both the top and bottom — and who got to see both the advantages and the disadvantages of that system — I think I can offer a few insights.

I attended a high school that tracked strictly, beginning in ninth grade: all subjects were divided into standard and honors tracks, with some subject further broken down into Basic, Standard, Honors, and AP. (more…)

The SAT and…crossword puzzles?

The SAT and…crossword puzzles?

When people ask me whether I enjoy my job, my usual response is something along the lines of, “Some people do crossword puzzles, I write SATs” — the implication being that I view the test as a sort of amusing intellectual game. The other implication, of course, is that I don’t actually do crossword puzzles.

Or, well, didn’t.

A couple of weeks ago, while I was walking downtown with a friend, I got hungry and made him sit with me in Koreatown while I indulged a late-night craving for kimbap. In return, he proceeded to pull out the NYT crossword puzzle and insist that I help him with it. I groaned and told him for the thousandth time that I’m just not good at crossword puzzles (I write SATs, isn’t that enough?!), but he wouldn’t take no for an answer, and after I managed to figure out a couple of clues (“River’s movement?” Ebb and flow), I sort of had to admit that was having fun. (more…)

Feeling is not learning

Stupidity from the New York Times opinion page. According to NY public middle school teacher Claire Needell Hollander:

New teachers may feel so overwhelmed by the itemization of skills in the Common Core that they will depend on prepared materials to ensure their students are getting the proper allotment of practice in answering “common core-aligned” questions like “analyze how a drama’s or poem’s form or structure … contributes to its meaning.” Does good literary analysis even answer such questions or does it pose them?

Excuse me? Studying the relationship between form and meaning is the point of literary analysis. An English teacher who doesn’t understand that has no business teaching English, no matter how “geeky” or enthusiastic she might be about her subject. Talking about feelings is what you do at a book club. Or in therapy. Ms. Hollander’s question calls to mind a teenager’s reaction when faced with a concept she doesn’t quite understand — rather than admit her perplexity, she clumsily tries to suggest that the whole thing never made sense in the first place.

To be fair, I understand her fear that schools will strip the (few) remaining bits of life from classrooms across the United States, but at least in theory, the Core’s emphasis on understanding that texts don’t magically come into existence, that they convey meaning through a series of specific choices about structure, diction, imagery, register, and so on, is one of the things that it gets right! Without understanding how texts are constructed, how things like irony, wordplay, and metaphor work, students have no tools for making literal sense out of challenging works. After years of teachers like Ms. Hollander, they have literally *never* been asked to read a text closely — fiction, non-fiction, nothing. As I’ve heard from so many students staring down baffling Critical Reading passages, “it’s just a bunch of words.”

I would be interested to know what Ms. Hollander proposes to a student doesn’t have an emotional reaction to what she’s reading? What would she suggest? That the student just keep reading until she feels something? Eventually, she’ll just learn to fake it, but she certainly won’t learn anything. Worse yet, what if a student can’t even really understand what he’s reading? (I haven’t met many middle-schoolers — or, for that matter, many high school juniors — who could really “get” The Color Purple, never mind grapple with the issues it raises in anything but the most clichéd manner, but perhaps Ms. Hollander’s students are an exceptionally precocious bunch.) Or what about a student who had the “wrong” kind of emotion (presumably one who didn’t feel sufficiently upset about Celie’s victimhood)? What would Ms. Hollander do then?

To be clear, I’m not advocating an approach that mechanically reduces literature down to a series of dry rhetorical figures in order to avoid any discussion of the actual ideas it contains — when I was studying in Paris, I loathed that aspect of the French system — but rather one that takes into account the fact that understanding how texts say what they say is a crucial part of appreciating what they say. The best teachers I had, both in English and otherwise, were intensely passionate about their subjects, and they conveyed that passion in ways that made what they had to say unforgettable. But they never confused their love for their subjects with the kind of facile touchy-feelyness advocated here.

Thank you to Emory University English professor Mark Bauerlein for pointing out that this kind of “therapeutic” approach is actually quite manipulative. Describing a typical middle-school assignment, he writes:

Most specimens of narrative writing in the [Demonstrating Character] units involve some sort of personal experience, reflection, or opinion. One from a 7th-grade unit on Civil Rights may be the very worst, which asks students to pretend they were witnesses to the horrific bombing of the 16th Street Baptist Church and a friend was seriously injured. “What emotions are you feeling?” it proposes. “How will these events affect your future? What will you do to see that justice is served?”

As a college teacher of freshman English, I can see no sense in these assignments. They don’t improve critical aptitude, and they encourage a mode of reading and writing that will likely never happen in a college major or their eventual job. There is a theory behind it, of course, holding that only if students can relate to their subjects will they do their best and most authentic writing, not to mention explore and develop their unique selves.

The notion sounds properly student-centered, the motives educational, but in practice few 14-year-olds have the intellectual and emotional equipment to respond. Puberty turns them inside out, the tribalisms of middle school confound them, the worlds seems awfully big, the message of youth culture impart fantastical versions of peers, and they’re not sure who they are.

What lurid imaginings do we throw them into when we tell them to witness a bombing? Do we really expect 7th graders to ruminate upon their integrity? Ponder these assignments closely and they start to look less benevolent and more coercive. One of them in an 8th grade unit on “Adolescent identities” mentions a short story involving self-sacrifice, then says,

Think of a time in your life where you have put someone else’s needs or wants, like a family member or friend, ahead of your own desires. Convey to an audience of your peers what the circumstances of that time were, who you sacrificed for and what led you to that decision.

A 14-year-old receiving it must wonder just how self-sacrificing he must appear. If the student doesn’t remember too much and still has to fill more pages, she will fabricate the necessary details. Should he admit to having resented the self-sacrifice? Should she congratulate herself for her good deeds? The whole exercise involves so many tricky expectations that the student wonders what implicit lesson he should take from it. (https://educationnext.org/the-me-curriculum/)

And furthermore:

Without focused training in deep analysis of literary and non-literary texts, students enter college un-ready for its reading demands. Students generally can complete low-grade analytical tasks such as identifying a thesis, charting evidence at different points in an argument, and discovering various biases. But college level assignments ask for more. Students must handle multi-layered statements with shifting undertones and overtones. They must pick up implicit and explicit allusions. They must expand their vocabulary and distinguish metaphors and ironies and other verbal subtleties.

Those capacities come not from contextualist orientations (although “outside” information helps), but from slow, deliberate textual analysis. The more teachers slip away from it, the more remediation we may expect to see on college campuses, a problem already burdening colleges with developing capacities that should have been acquired years earlier. Indeed, when ACT pored over college-readiness data from 2005, it found that “the clearest differentiator in reading between students who are college ready and students who are not is the ability to comprehend complex texts.” More reader response exercises for 9th-11th-graders are only going to exacerbate the problem.(https://educationnext.org/not-just-which-books-teachers-teach-but-how-they-teach-them/)

Amen.