The importance of understanding Critical Reading passage structure

Please note: this post was written in regard to the Reading section of the old (pre-2016) SAT. While it is still applicable to some social and natural science passages, which frequently discuss old models or theories vs. new/emerging ones, the overall writing tends to be more straightforward and journalistic than it was on the old test. If you are studying for a graduate exam such as the GRE, the GMAT, or the LSAT, however, the passages on those tests continue to be more more academic in nature.  

While working with Debbie Stier this past weekend, I had something of an epiphany about the Critical Reading section (I think Debbie had a Critical Reading epiphany as well, but I’ll let her discuss that herself!). It is has to with the structure of many passages and the significance of that structure in terms of the SAT’s larger goal.

Let me back up a moment. In all the brouhaha over the “real meaning” of the SAT, it is to forget that it — like the ACT — is essentially a measure of college readiness. Regardless of what the SAT started out as, it is now recognized as a having validity only as a predictor of freshman college grades. And in my experience, a student’s comprehension of the passages on the Critical Reading section is, in general, a remarkably accurate gauge of whether she or he is prepared to handle college-level reading and thinking.

Here’s why: one of the classic structures of SAT passages — and indeed of passages on pretty much all of the graduate exams, including the GRE, the LSAT, and the GMAT — is exactly the same as one of the most common structures of an academic article.

Part I: Introduces the topic, often through an anecdote. Provides general and/or historical overview

Part II: What “they” say

Discusses the standard interpretation, “received wisdom” surrounding that topic

Part III: Problematizes the standard interpretation: raises objections, points out inconsistencies and places where the argument doesn’t hold up

Part IV: What “I” say

Offers own interpretation, either in the form of a more nuanced version of the standard interpretation or, on occasion, the complete opposite of the standard interpretation

Why is it so important to be able to distinguish these parts, to be able to understand what an author offers up as standard interpretation versus what she or he actually thinks?

Well, because that’s exactly what college-level thinking ultimately entails: being able to understand and synthesize other people’s arguments in order to be able to formulate a well-reasoned, well-supported response with precision and nuance. And it is impossible to formulate such a response without truly understand how the existing arguments work and what their implications are.

If you take an economics class and reading an article about the limits of Keynesian theory, for example, you need to be able to distinguish the description of Keynesian theory from the author’s discussion of the standard interpretation of Keynesian theory (what other people think) from the author’s own argument (what I think) in order to even begin to think up a response.

The world of academia essentially consists of an ongoing dialogue between scholars, sometimes separated by hundreds of years — sometimes the result is brilliant and sometimes it’s nothing more than inane and petty squabbles (far more the latter than the former!), but it’s a dialogue nonetheless.

This is not something one is generally made aware of in high school, where the goal is simply to memorize and regurgitate as much information as possible in the shortest period of time, but it is the underlying context for much of what shows up on the SAT. And simply having that knowledge can go a long way toward putting Critical Reading into perspective.

Make sure you understand what the questions are actually asking

This post was inspired by Akil Bello’s Best SAT Prep Tip Ever on the Bellcurves blog. While I agree 100% that reading the full question (along with reading full answers) is indeed one of the most important things you can do on the SAT, I also think that advice takes a bit too much for granted because it assumes that most test-takers will understand what a question is asking, provided that they read it carefully enough. In my experience, however, that’s simply not the case.

I think there’s a tendency to forget that vocabulary issues can crop in passage-based questions themselves as well as in passages and answer choices. If you don’t understand precisely what a question is requiring you to do when it asks you which of the following would most undermine a given theory, it’s very hard to answer that question correctly!

Take inference questions. When a question asks you make an inference about what a particular person mentioned in a passage would believe, it is generally asking you to make a reasonable assumption about that person’s beliefs based on specific information that the author says about that person. It is not simply asking you to summarize what that person says or believes. It is asking you to form a general, often more abstract idea that will not be found word-for-word in the text. But if you don’t make that distinction, if you just try to summarize what the person says or thinks, you’ll be lost when you look at the answer choices.

Or, to give a slightly more concrete example, it will be very hard for you to answer a question that uses the word “analogous” if you don’t really know what that means.

So I’m going to suggest two things.

First, treat any unfamiliar vocabulary you find in the actual questions the exact same way you would treat any other SAT vocabulary — write it down and learn it.

Second, try rephrasing the questions in your own words to make sure you actually understand what you need to do. For example, if a question asks you what “transition is marked” in a particular line, you can rephrase it as “what change happens in the passage here?” Define, sum up, simplify. Whatever you have to do to make sure you understand.

Some thoughts about strategy-based test prep

When proclaiming that the SAT and the ACT are not tests that can be effectively coached, the College Board and the ACT like to trot out the following statistic, courtesy of the National Association for College Admissions Counseling

Existing academic research suggests average gains as a result of commercial test preparation are in the neighborhood of 30 points on the SAT and less than one point on the ACT, substantially lower than gains marketed by test preparation companies.

Let’s take a moment and unpack this assertion. First, one of the key words here is “commercial test prep” (e.g. Kaplan and Princeton Review); nowhere is tutoring through “boutique” companies or private tutoring mentioned. As someone who has helped more than one student increase their verbal scores alone by 350+ points on the SAT and 10+ points on the ACT, I have some grounds for disputing the idea that the shortcomings of commercial test-prep should not be extended to test-prep in general.

That’s not, however, what I really want to focus on here. What interests me, rather, is the idea of average gains and the way in which that average was determined. I’ve been thinking about this thanks to Debbie Stier, who put up a very interesting blog link to the following article by cognitive psychologist Daniel Willingham, a professor at the University of Virginia.

Willingham makes the point that:

When a teacher presents a reading strategy to students, we can assume that there are three types of students in the class: students who have already discovered the strategy (or something similar) on their own, students who are not fluent enough decoders to use the strategy, and students who are good decoders but don’t know the strategy. Only the last group of students will benefit from reading strategy instruction. When a researcher finds an average effect size of d=0.33 for teaching students the strategy, that effect is probably actually composed of many students who showed no benefit and a smaller number of students who showed a large benefit.

I think that something very similar is going on in many strategy-based prep classes. My guess is that only around half of the people who take those tests (those scoring 500+) actually have solid enough literal comprehension skills to even make any sort of strategy-based prep worthwhile.

What this means is that if someone’s comprehension skills are truly up to par (meaning, more or less, that they can pick up a College Board Critical Reading passage at random, understand the gist of it, and summarize the main point and tone), they actually stand to benefit immensely from strategy-based prep. It probably won’t help for the ones scoring 750+ from the start because they’re already using many of the standard strategies, even unconsciously, but for many of the still-small percentage scoring in the 600 to low 700 range, the increase can be very substantial. Many of the ones who persistently score in the 500s, however, won’t succeed in raising their scores at all because they lack the core skills on which to base the strategies they learn.

This points to a disturbing conclusion: the real problem isn’t that people can game the test by learning strategies (aka “tricks”) but rather that many test-takers don’t even even have strong enough comprehension skills to be helped by those strategies in the first place.

The zen of test prep

The zen of test prep

I used to use the words “zen” and “test prep” in the same sentence only in the most tongue-in-cheek manner, but I’ve been thinking about it seriously of late, and I actually think there’s a connection.

First, though, lest you think I’ve gotten all new-agey, let me make it clear that I am not talking about meditating in order to get yourself in test-taking mode or reduce your anxiety or anything of that ilk. There are test-prep companies that do that sort of thing, but I’ll refrain from voicing my opinion about them. Suffice it to say that I am a firm believer in the principle that the best way to reduce test anxiety is simply to master the material on the test.

What I’m talking about is the attitude with which you approach the entire test-preparation process. One of the things I’ve noticed is that students who come to me knowing that they have big gaps in their knowledge and that they don’t really know what they’re doing tend to end up with higher scores in the long run than students who come to me with relatively high scores, convinced that they only have to find the one trick that’ll make everything perfect. (more…)

Strategies for finishing ACT Reading faster

The most common issue that students have on ACT Reading is time. Granted, the timing is tight: 35 minutes for four passages and 40 questions, or precisely 8 minutes and 45 seconds per passage/ten question set. The timing, however, is not the whole story.

In reality, what presents itself as a time issue is often something else entirely. Most people assume that they have problems on ACT Reading because they can’t read fast enough when the real problem is that they don’t know how to read effectively enough to locate the requisite information in time. Yes, it is true that many ACT Reading questions are detailed-based and require the identification of a particular fact buried in the middle of a paragraph, but what many test-takers overlook is the fact that there are many strategies they can employ to quickly locate the necessary information — even if they have no recollection whatsoever of where it is.

In a roundabout way, the ACT can actually be more of a reasoning test than the SAT, and if you really want to improve your score dramatically, you need to treat it like one. Simply reading each passage fully, trying to absorb all of the information, and then going through the questions in order will have little to no long-term effect on your score.

The bottom line is that if you want to get through all four passages in time and obtain a high score, you must be willing to be flexible and shift your strategy to fit the question.That includes doing the following:

1) Skip around

When students with solid comprehension skills get stuck below a certain score on ACT Reading, it’s usually not because they spend a little too much time on every question, but rather because they spend far too much time on a handful of questions. When they learn to identify those potentially time-consuming questions upfront and go into the test planning to skip them, their score often jumps two or three points right away.

In general, if a question looks hard or time-consuming, skip it upfront and come back to it if you have time. Figure out a marking system so that you don’t forget do so. Your goal is to get as many questions right as you possibly can, so don’t sacrifice questions you can answer easily for questions that will take a lot of time and that you may not even get right. For example, if you know that “main point” questions are consistently problematic, don’t even look at them until you’ve answered every other question that set.

2) Learn to distinguish between “detail” passages and “argument” passages and treat them accordingly

For passages that focus more on details or descriptions without a real point, you can ignore this process; it won’t really get you anywhere.

For the passages that do focus on a single argument, however, you need to take the time to both determine and write down the main point. Keeping that information in mind when you answer the questions can save you unbelievable amounts of time.

3) Learn what information you can skip initially

This is another strategy that comes primarily into play when you’re dealing with a straightforward “argument” passage. Whenever you encounter a topic sentence that clearly indicates that the rest of the paragraph will just offer supporting details, you can skip the rest of the paragraph. If a question asks specifically about those lines, you can go back and read them closely, but remember: the topic sentence has already told you why those details were important, and there’s a decent chance that’s what the ACT will ask about.

4) Think logically about where information is most likely to be located

This may sound obvious, but very often when asked to locate a piece of information that they don’t recall, people begin re-reading the passage from the beginning. Don’t. If the passage discusses a movement chronologically and the question asks about an event that clearly must have happened toward the end of the movement, focus on the end of the passage.

In addition, when you’re trying to locate information that you simply don’t remember reading, just focus on the topic sentences to help you figure out where the topic is discussed. If you try to skim through the interiors of paragraphs, you’ll most likely just end up lost.

5) Circle major transitions and important information…

and don’t forget to consult those spots when you look back. That’s where the information that gets asked about will probably be. It’s a waste of time to make notes if you just end up ignoring them and skimming through random sections.

6) Take shortcuts

The ACT can be exactly like the SAT here, in the sense that there’s often a “back door” that will let you quickly answer what appears to be a complicated question.

For example: if a question asks about the order of a series of events and the answers list four different combinations, each with a different event first, you just have to figure out the first event. By default, only the answer that lists that event first can be right.

7) Learn when to look at the answers first and when to look at the passage (or your notes) first

Again, this requires that you be willing to shift your strategy to fit the question. If it’s a main point of passage question, you need to consult your notes about the main point. If it’s a main point of paragraph question, you need to read the topic sentence of the paragraph in question. If it’s an “all of the following EXCEPT’ question, you need to look at the answer choices first. You just have to do whatever will get you the answer fastest.