Tuesday, June 26, 2012

Another idiotic "calculators = bad" article

The Slate article, "Why Johnny Can't Add Without a Calculator" is so poorly argued that I even hesitate to cite it here, but it's getting so much play that somebody has to rebut it.

Konstantin Kakaes's argument essentially boils down to three elements:

  1. Many math teachers who use technology do so ineffectively.
  2. Many students who are taught mathematics with calculators don't have a good grasp of basic arithmetic, or other "traditional" mathematics.
  3. A few teachers teach math successfully without calculators to some students, where "successfully" is defined as "according to traditional criteria."

    Therefore, teaching math with calculators results in students who can't do math.
Although I would agree with #1, I would take it further:  for as long as there have been math teachers, there have been many ineffective math teachers, with or without technology.  As Kakaes himself acknowledges late in the article (when he claims that software won't be able to teach children "any time soon"), teaching (anything) is a complex process.  Teaching math requires actually understanding math, and people who understand math have always been in short supply, in and outside of the teaching profession.  So a different, simpler explanation for the failure of students to learn math is that there aren't a lot of excellent (or even mediocre--see my previous post) teachers out there teaching math.

A bigger problem with Kakaes's argument is that, if it were true, we would expect to see declining math achievement in the U.S.  In fact, the opposite is true.  TIMSS and NAEP scores have been rising steadily for the last twenty or so years--the exact time period in which calculators became standard equipment in high school mathematics classrooms.  To mention one statistic, the number of students in the U.S. passing the AP Calculus BC exam each year--half of which is no-calculator--is now more than five times the number who even took the exam in any year in the 1980's.

In fact, I would argue that calculators have made possible one of the great sea changes in mathematics education in the western world.  In 1960, there was a dropout rate of 27%, and of the 73% of U.S. students who graduated from high school, very few took any math beyond geometry or trigonometry, which was still a course offered at many colleges.  In 2009, there was a dropout rate of 8.1%, and of the 91.9% of U.S. students who graduated from high school, something like 50% (77% in 2004) had trigonometry or higher.  Put differently: we are now in a world in which about half of U.S. students are expected to learn substantial amounts of advanced algebra and trigonometry before graduating from high school.  Technology makes it possible, as great teachers like my friends John Benson and Natalie Jakucyn, to name two have shown, to increase students' access to higher mathematics. With technology, it's possible for a student who doesn't know how to add fractions to learn what a derivative is, what it means, and what you can do with it--and how to let a computer do the computations that he needs to use the derivative in an actual application.

Finally, Kakaes never engages what is, to me, the central question technology poses to the mathematics teacher, namely, what of the traditional pencil-and-paper mathematics is worth teaching?  Kakaes writes:
If you learn how to multiply 37 by 41 using a calculator, you only understand the black box. You’ll never learn how to build a better calculator that way.
Besides the inaccurate alarmism of his example--even calculator-active elementary school curricula like Trailblazers and Connected Math expect that students will be able to multiply two-digit numbers by hand (and explain their computations, a higher cognitive skill than was demanded in my day)--he proves too much.  If it were necessary to teach everyone a skill to ensure the supply of programmers able to create machines in the future, we would presumably also teach the following:
  • Computation of decimal approximations of square roots, using the "two digits at a time" method found in old textbooks, or continued fractions, or the Babylonian method.
  • Approximations of transcendental functions using Taylor series.
  • Approximations of trignonometric functions using matrix multiplication (faster and better for most angles, actually).
  • Approximations of transcendental functions using tables and linear interpolation.
But while there's a pedagogical value to each of these (my advanced students think that continued fractions are pretty cool, as any number theorist will attest), we just don't teach them anymore.  Why would we?  It's inconceivable that anyone would need to know these values accurately without a calculator, and while Kakaes is correct that many university math departments are stuffed full of old-fashioned mathematicians, even they use calculators (actually, Mathematica or Maple) to do these problems--and expect their students to do the same.  My point is just that we all agree that there's a line to be drawn between what math students should be able to do by hand and what they can (and should) use a calculator for--we're only arguing about where that line is.  

That line is porous at best.  Zalman Usiskin has pointed out (in his NCTM Yearbook article on technology), even paper-and-pencil algorithms are technology, every bit as much as computer software.  Old-fashioned long multiplication, as I've pictured it at right, is one:
This "killer app" version is fast and correct if you actually do it right--but many students find it hard to understand, hard to apply consistently, and--in practice--extremely inaccurate, because the most common errors (not shifting the second row over, for example) actually have huge effects on the results.  Other algorithms (partial products, estimation with corrections, etc.) are not as fast, and (sometimes) only produce approximate answers.  But students can actually understand and explain them, and apply them correctly.  And if you really need a completely accurate answer quickly, in a grocery store or at a worksite, wouldn't you do what I do -- that is, pull out the calculator on your phone?


Kakaes does raise some valid points.  Technology by itself isn't the sole indicator of high-quality math instruction:  there's lots of low-quality math instruction with technology (just as there's lots of low-quality math instruction without technology).  Promethean boards do not raise outcomes by themselves.  And (as Sugatra Mitra says, in his argument for why technology can be transformative for the poorest children), for kids in affluent districts (which, by his standards, is much of the U.S.), the marginal impact of any given new technology might be quite low.  But as Zalman argues, the question is never "should we teach students to use technology?", but "which technologies should we teach students to use?"  That question--not this fake "can Johnny learn math with a calculator?" question--is where the discussion should start.


Update:  A version of this article is now a posted response on Slate!  

8 comments:

  1. Your argument regarding increasing NAEP scores and AP Calculus participation is disturbing. Since you authored a book that includes statistics as a topic, I am sure that you are familiar with the concepts of lurking and confounding variables. In the past 20 or 30 years there have been many changes in the way math is taught (including increased calculator use), as well as very significant changes to the AP test, and probably changes to the NAEP test as well. To imply that changes in calculator use would have a bigger impact than all the other changes combined, without justification, is just lazy rhetoric.

    The original article is simplistic. There is effective and ineffective teaching with and without calculators or other technology. The decision to use technology is usually not made in isolation. If I decide to incorporate more technology, I will very likely change the content that I am teaching as well. In a way, it really doesn't make sense to compare students using a lot of technology with those that don't - the learning goals are not the same for each group.

    ReplyDelete
  2. Well, I didn't mean to imply that calculators alone were responsible. I do believe they are a significant factor, although you're right that these statistics alone don't prove (or disprove) that. What I've seen in my classes is that calculators give students with weak computational skills access to higher mathematical concepts and to mathematical reasoning.

    As I describe in the Slate piece, many students in my AP Calculus AB class this year had weak algebra or arithmetic skills, but because they were able to use calculators to do the computational "heavy lifting", they could attack lots of problems about derivatives successfully. By the end of the course, virtually every student could explain what a derivative was, how it is calculated (including the explicit limit definition and an intuitive "in plain words" explanation), what it's used for, how to use it, and what it might mean in various contexts. That's a tremendous amount of calculus knowledge. They even understood and could follow the procedures involved in related rates and optimization problems, provided they could use a calculator for some or all of the computational pieces. In "the good old days," those students would never have had the opportunity to take calculus, and even if they did, it would have been hard for them to show what they knew and could do without drowning in what they couldn't.

    ReplyDelete
    Replies
    1. As I describe in the Slate piece, many students in my AP Calculus AB class this year had weak algebra or arithmetic skills,

      How well do your students do on the AP Calculus exam?

      I have found far too many examples lately of entire AP Calculus classes scoring a 1. You can't apply calculus without algebra and I doubt these teacher would sequence their own children this way.

      Bob Hansen

      Delete
  3. I agree with much of what you say and I don’t believe the author of the original article has a good understanding of the issues. I am with you on technology clearly having an important role in math education with a lot of differing and valid opinions on what that role should be. I think rote pencil and paper computation has limited value (mental computation is helpful). I have had very similar experiences to yours with calculus students.

    Almost all of the reasonable arguments on technology use are a combination of opinion, personal experience, and anecdotal evidence. We shouldn’t pretend otherwise. I value your thoughts and opinions. But, the more math folks blur the line between an association between two variable (calculator use & AP tests) and causation, or reference poorly done studies, the more credibility we math folks lose.

    In the last 10 years AP US History & AP English participation has gone up at a higher rate than AP Calculus. In the last 20 years the number of AP Calculus exams has gone up by a factor of 4, while the total number of AP exams has gone up by a factor of 7 (of course the comparison is distorted by the addition of new exams over the years – couldn’t find #s for US and English). Both math and reading NAEP scores increased over the past 20 years, though math did increase by more. Everything is going up, so it seems likely there are many factors at play. It is difficult if not impossible to separate out increases/decreases due to changes in technology use, increased exposure to standardized tests, demographic changes, changes in the tests themselves, and a hundred other variables that made a difference. If you are going to compare dropout rates from 1960, I would guess that the civil rights movement and the war on poverty had a far greater impact than any changes in pedagogy.

    ReplyDelete
  4. ...paper-and-pencil algorithms are technology, every bit as much as computer software.

    That is an illuminating point I'd never really thought about before. Algorithms are just technology, and memorizing "the standard algorithms" (or the "times table") involves no more real thought than knowing the right keys to hit on a calculator or computer.

    Is there some free online copy of Usiskin's article?

    ReplyDelete
  5. This comment has been removed by a blog administrator.

    ReplyDelete