Monday, June 23, 2014

Testing, Testing

As my ITRW friends know, I'm in my second "semester" of a graduate program, which means that I'm buying textbooks, frantically getting readings done ... and taking tests.  Last week was a doozy:  I had two weeks, and a maximum of two weeks, to pass the statewide online test certifying me as a "teacher-evaluator".  What did I learn from this process?

  1. For starters, as high-stakes as this test is -- every principal, assistant principal, suburban department chair, etc. has to pass it OR LOSE THEIR JOB -- we had two tries.  That is, you could take any portion of the test, fail it, and after 24 hours take it again. The cynical among us would say "Of course you get two tries, otherwise there wouldn't be anyone left to turn on the lights in schools." But the reality is this: when it's really important to get person X up to a particular level of competence in skill Y, we almost always give them multiple tries. How many residents are dismissed for missing the vein the first time? And how many times do we give students the opportunity to retake a test at no penalty?
  2. Second, we were encouraged to do the training together; in fact, virtually everyone from the network chiefs on down told us to take the tests together. Most of the hardest test consisted of watching videos and arriving at performance ratings (along the eight components of Danielson's Dimensions 2 & 3) for the class, and watching with other people--and talking with them about what we saw--was incredibly valuable. I wound up doing the videos on my own (have you tried to schedule a six-hour testing window during the day, with other people, when you have kids?) but the times I did sample videos with other people I learned much more than studying on my own. How often do we provide structures and encouragement for kids to work together on their tasks--and assessments?
  3. Third, we didn't have to study: once you opened the training modules, you could go straight to the assessments. You could also dip into any of the lessons in any order. So when you felt ready, you could go ahead and try the test. (Remember, you get two tries.) How often do we give students this option?
But the most important thing I learned from the experience wasn't about designing assessments, or even structuring instruction. My big takeaway was this: I was terrified. Even with everyone I know assuring me that I'd pass, even knowing that my score beyond pass/nopass was irrelevant, even knowing that my practice tests were all well above the mark, I found the experience of waiting to take the test and then actually getting going practically unbearable. 

Now, we don't tell high school students that they'll lose their jobs if they don't pass Friday's math test. But we do tell them that they need straight A's to get into "top colleges" (and if we don't tell them this, they certainly hear it from everyone else around them), and so an A (or B+) is, for our top students, effectively the passing grade--a much higher threshold than I had to cross. And as adolescents, they're not as good at dealing with stress as most adults (or at least as the "optimal" adult). What I'm getting at is this: I left my office convinced that most of our students--and most of our strong students--find testing incredibly stressful. And while I may have "known" that before, I'm not sure I felt it. I'm not sure what to do about this, but I know that I'll think about testing very differently this year.

So maybe that's the pedagogical payoff for attending graduate school.

Monday, June 16, 2014

The Way, Way Back

As we wind up this year, I've been thinking about last summer's awesome movie The Way, Way Back, and not just because it's about a fourteen-year-old on summer vacation.  The movie starts with a long scene introducing Duncan (the aforementioned fourteen-year-old) as a kid who's just kind of, well, a shlump.  His mom's boyfriend thinks so, and while we realize that this adult's criticism is way too harsh, you have to see his point: Duncan is sullen, introverted, and, apparently, completely nonspecial.

Over the movie--and I won't spoil the whole plot for you--Duncan finds a second home at a local water park, where he takes on a new identity as "Pop 'n Lock", the park's indispensable factotum and MVP.  We see him going back and forth between "Duncan," still-awkward fourteen-year-old, and "Pop 'n Lock", master of every detail and every need in the park.  Although Duncan gains a little confidence at home, his mom (and his mom's boyfriend) don't get to see any of his alter ego until ... well, I won't give it away.  It's good.

The point is that I think we have a lot of students like Duncan, students who are mostly unremarkable, even substantially less than remarkable, at school, but who totally shine in some part of their life outside of school.  This is the kid who is super-responsible and on-the-ball at her job at Starbucks; or who's a realistically-aspiring professional dancer; or who keeps track of two younger siblings and three cousins, does the grocery shopping, and puts food on the table every night while mom is at work. These kids are stars. But what we teachers see is the late homework assignment, the "C" quiz, the half-checked-in, half-checked-out stare at school. We don't see the stars.

More often than not, these kids are not middle class, and not white. One of the privileges many (certainly not all) white, middle-class kids experience is not having these kinds of burdens, or if they have them, they often know that they're as much assets as deficits, and that the student's job is to alert me early about the constraints and plan with me to work around them. They send us emails like "Hey, Mr. K, I wanted to give you the heads up that we have rehearsals every afternoon and evening for the next two weeks, so I might wind up one or two assignments behind. Can you tell me what I should focus on the most if I have to do triage?"

I think other students don't know that we care, and often don't think that we necessarily should care.  Many of my minority students have an overt "no excuses" attitude, which is refreshing except for when there really are extenuating circumstances. Yes, if I'd known your sister was in the hospital all last week, I would have been happy to let you take Friday's quiz on Monday.  But on the positive side, I don't think they know that we want to see them at their best--even if their best isn't what we see at school.

I don't have an easy solution for this problem. I think it helps to tell kids what we look for and want to know about, and if we coach them on the kinds of things that might qualify as reasonable exceptions.  (A long time ago I stopped writing "late assignments will not be accepted" on my assignment sheets, and started writing instead things like "under ordinary circumstances, I won't accept this assignment late," with details that described some truly extraordinary circumstances.)  And I think it helps to ask kids about what's going on in their lives outside of school. But the most helpful thing may be to remind ourselves, when we see a kid who seems like a Duncan, that more often than we might think, there's probably a setting in which that kid is really a Pop'n'Lock.

Tuesday, June 10, 2014

Cutoffs, and the last week of classes

So now that CPS is in all-out last-week-of-classes mode, I have a few gripes. They all relate to cutoffs.

Remember cutoffs?  When you got a hole in the knees of your jeans, you'd just cut them off into shorts, and they'd look like this:
After a while, though, the ends would start to fray, and they'd look more like this:
So you'd trim up the shorts, and the cycle would begin again.  Eventually they would look like this:
516x387_ac.jpg (516×387)
OK, maybe not exactly, but you get my point.

The problem with the end of the year is that we have this urge to stop teaching just one or two days before the end--either because we're tired, or because we feel like the kids are tired, or because grades are already either submitted or essentially impossible to move much, so why bother giving another test, and why bother teaching when you're not going to give a test?  There are a hundred rationalizations, all of them bad.  Because then when there are three or four days left, you say "Oh, well, in a couple of days I wouldn't be teaching anyway, so ... " and the end of the year frays up a little more.  And so it goes, until suddenly you're spending an entire WEEK (or TWO weeks!) of instruction in games, "free time," movies, semi-reasonable documentaries ... anything but bona fide teaching.

What's actually wrong with this?  A few things:
  • Not teaching because there's no test (or tests are over) just teaches the kids that the test was the only reason you were teaching in the first place.
  • We all wish we had more classroom time.  Well, we do: this week, a solid 250 minutes per class.
  • Just because the curriculum for the test is over and done with doesn't mean the subject is over and done with.  What kind of teacher doesn't have a favorite poem, theorem, artist, historical event, ... that just doesn't fit into the regular curriculum?  (In fact, for me, a life-changing moment was when, the last week of school, my Brit Lit teacher read us The Love Song of J. Alfred Prufrock aloud.) There's always more to teach--it's not like we're in danger of running out of poems, problems, or paintings.
  • Finally, how is it fair that we make kids go to school and then waste their time?  My kids can play video games, watch movies, read books, doodle, and mess around with their friends just fine on their own--they don't need state-compelled school attendance to do any of these things. If the law is that kids are compelled to be in school this week, then fairness and respect for them as human beings demand that we make it worth their while.
It's not so hard.  This week, my students are finishing up a discussion about "shape space", where we measure the distance between different shapes to talk about fractal limits; learning about Markov chains and why regular Markov chains converge; and giving short presentations about explorations they did with fractional linear transformations, queuing theory, and hyperbolic geometry. They're advanced.  In other classes, I've used the time to read a cool book (like Arcadia--thanks, Mary, for the idea!), or do interesting problems we never saw before, or think about mathematical puzzles.  Or you could just get a head start on one or two interesting ideas that the kids will see the next year.

I know I'm spitting in the wind -- Emma told me yesterday that she'd "figured it out: when teachers don't want to teach, they just go on Netflix, put in a documentary, and voila--instant lesson!" That experience makes me sad.  But if we all just held the line ... or the hem ... 


Sunday, June 1, 2014

Gender Games

Two issues of gender and games that have come up in the last weeks ...

1.  My oldest daughter reports some frustration that in one of her classes, the teacher divides them into teams every day to play games (no, this is not PE, so be kind) and that, every day, one of the iterations is boys versus girls.  This way of forming teams seems like no big deal to most people, and to me that's a pretty big deal. It bothers my daughter because most of her friends are boys, but even more so because it reinforces our society's idea that there's a huge inherent difference between boys and girls.  We wouldn't separate kids by short and tall, or straight hair versus curly hair -- so why does boys versus girls seem to "make sense" to so many people?

A radio show I listened to a long time ago made the point that even in addressing classes as "boys and girls" reinforces that preoccupation with gender roles.  Don't believe it?  Imagine replacing "boys and girls" with "white children and black children".  If describing the kids by gender doesn't make a difference--as many people seem to think it doesn't -- then why does it feel so funny to use race?  Only because when we separate boys and girls in this way, we are reminding ourselves that gender differences are crucial in ways that we're less comfortable reminding ourselves that race differences are crucial.  (Although if we were honest and not all "it's the end of racism", we'd have to admit that race plays a huge role in kids' experiences in school.  But that's a different blog post.)

The point is this:  dividing kids up by gender except for activities that require gender separation (bathroom use, for example) is just lazy; it makes some kids uncomfortable, and should make all of us wonder why this difference is the one we keep reinforcing in our schools.  Don't do it!

2.  It's the end of the school year and my kids are handing in portfolios; the assignment includes a short essay on "How I got here", namely, into a hyper-advanced college-level post-calculus class while still in high school.  This year's crop follows a trend I first noticed four years ago.  Virtually every boy says something like "The first time I really loved doing math was when I was competing against [my best friend/my classmates/my archenemy/another school] in [some math competition]."  Whether it's a simple race to finish multiplication tables or a full-blown Mathcounts meet, this experience is clearly one that has turned the boys I teach on to mathematics.  On the other hand, almost none of the girls even mentions competitions; when they do, it's almost always negative.  (One girl--now a math major--once wrote "I decided I hated math when my teacher had us play this stupid game called 'Around the World'.")  And my own daughter loves math but hates competition.  So there's some interesting data.

My friend Cathy O'Neill, aka mathbabe, wrote on this issue a couple of years back, "math contests kinda suck."  As a contest author, I have to agree with the majority of her argument: our society's reliance on math contests for identifying and encouraging mathematical talent discourages a lot of girls, who either don't like contests, or don't like doing math the way that you have to in order to be successful at most math contests.  That's why we need more math circles and other places where girls can get their hands dirty doing awesome mathematics--Chicago's new math research symposium is one such.  There's a place for math contests in the pantheon of cool, challenging math activities--but the pantheon has got to get a lot bigger than that.

Saturday, March 22, 2014

Guest Blog: She likes math, but she hates math homework

Emma, 6th grade, likes math (does math circle voluntarily on Saturdays, for example), but hates math homework.  When I asked her why, she sent me the following well-thought-out response--unedited by me (okay, I deleted two commas).  Math teachers, take note!
-------------------------
As a 6th grader, here are the reasons I hate math homework, and solutions to the problems:

1) Quantity- Homework is supposed to be for us to practice what we've learned. So if you know the material, then it's a waste of time to do 20 similar problems when all you need to prove that you know the material is 4 or 5. And if you don't know, then you'll practice incorrectly, and it really won't help you to learn how to graph inequalities if you're repeating incorrect steps for any number of problems greater than that needed to prove that you know the material.

2) Quality- Having similar problems doesn't help anyone. Sure, if you want to memorize steps, it may be helpful, but in order to understand the math behind the equation and prove why you need to take the steps, you should have a variety of problems. Because in order to understand how to use a method, you should take the time to practice with different types of problems, or else you run across a slightly different problem and you don't know how to do it. 

3) Comprehension- Having problems to solve like "x+2=5. x=?" doesn't help you learn math. That's arithmetic. Arithmetic is something that you can do with a calculator. Math is knowing why x=3. And just showing your work doesn't help, because again, you're just showing your calculations, which again, could be done with a calculator. What helps is asking, "Why does x=3?" Because then you have to look up from your calculator and think about what makes the problem work.

4) Grading (as a class)- When homework is being graded as a class, then you should again focus on the logic hidden behind the problem. Ask a kid to come up to the board and prove why their answer is correct (having fewer problems would also prove to be helpful here). When you go over them by just stating the answer, it doesn't help the kids who got the answers wrong. Unless they just made an arithmetic error, they still don't get why it works, still don't understand the material, and now only know that they were wrong, which doesn't help. And as teachers, your job is not to make kids pass or fail, but to get them to learn something. 

Sunday, March 16, 2014

Three Parables of Teaching

A peril of teaching for a while--and thinking about teaching--is that everything you read becomes filtered through the question "What does this say about teaching and learning?"  But here are three short pieces that more-or-less deliberately engage issues of teaching and learning in somewhat parabolic (if not elliptic) ways.

"Shooting an Elephant," by George Orwell, captures the experience of being a new teacher (whether new to the profession, or new to a school) confronted by a discipline problem and a class or hallway full of students what you're going to do about it.  I think it also reminds us that we're never really as prepared as we think we are, that first time, and that the chances of things ending well--for the elephant surely, but also for us--are slim indeed.

Sideways Stories from Wayside School, by Louis Sachar, is full of wonderful and off-the-wall tales and fables, but it's the first one that has stuck with me:  Joe is held back during recess by Mrs. Jewl because he can't count properly.  When Joe counts a set of objects, the numbers come out in any old random order, but he always gets the number of objects right.  The (very Wittgensteinian) irony is that whenever Mrs. Jewl tries to explain to him how to count the "right" way, he does exactly what she does, and comes up with the wrong answer.  Ever since my mentor Steve Starr read me this story, I've tried to listen more and worry more about whether the student has what appears to be a robust way of getting the right answer than whether he or she is doing it my way.

Finally, Philip Roth's "The Conversion of the Jews" is the hilarious and deeply sad story of Ozzie, a young pre-teen Jewish boy in 1950's New Jersey who has a history of asking his rabbi the wrong--and by that I mean "the hard"--questions.  The story's precipitating incident is an argument in which his rabbi asserts the existence of a historical Jesus but says that he couldn't have been the Son of God as the New Testament describes because, as Ozzie quotes the rabbi, "‘The only way a woman can have a baby is to have intercourse with a man."  Ozzie asks "if He could make ail that in six days, and He could pick the six days he wanted right out of nowhere, why couldn’t He let a woman have a baby without having intercourse."  And the rabbi refuses to give a consistent answer, leading Ozzie to burst out "You don't know anything about God!" What strikes me here is that Ozzie demands only two things of his rabbi: intellectual honesty, and a modicum of kindness.  And really, for a teacher, is it reasonable to expect anything less?

Sunday, March 9, 2014

It's not how big your class is, it's what you do with it

Big news over the last couple of weeks--besides the nascent testing rebellion going on in CPS and other districts--has been the publication of Diane Schanzenbach's paper, "Does Class Size Matter?" by the National Education Policy Center.  Among this paper's key findings:
  • Old studies claiming zero or negative correlations between small classes and achievement relied on faulty meta-analysis of published data.
  • The STAR experiment in Tennessee, which was a randomized trial, showed a 0.15-0.20 standard deviation gain from assignment to classes of 13-17 rather than 22-25, with higher gains in African-American and low-income subgroups.
  • Teachers of smaller classes are able to (and, in the STAR case, did) use a variety of individualizing strategies, including tracking individual achievement, differentiating instruction, and making personal connections with students.   
  • Contrary to popular belief, these effects were larger with more experienced teachers.
  • Although the STAR study is the most comprehensive randomized study in the US, its findings are backed by other studies that managed to control for other variables in the process.
These findings are summarized as simply "All else being equal, increasing class sizes will harm student outcomes."

But I'm still a skeptic, mostly because of the phrase "all else being equal."  In particular:
  • The STAR gain of 0.15 sd requires reducing classes to about half of what they currently are in Chicago, which would require--roughly--doubling the number of teachers.  CPS currently has 22,000 teachers, and it's hard for me to imagine that the district would be able to shazam up anywhere near 22,000 additional teachers without dredging the bottom of the applicant pool.  But would these new, bottom-of-the-pool teachers actually improve outcomes?
  • The reason why you have to get down to 13-17 students per class to see the payoff is that once the denominator of an expression is large, reducing it a little doesn't increase the quotient very much.  For example, if a class lasts 50 minutes and has 30 students, each student gets at most 1 minute and 40 seconds of "air time" or attention.  If the same class has only 25 students, each student gains 20 seconds of "air time" or attention--which isn't very much. So in the real world of the class size reductions that are plausible in the short term, you're not going to see much payoff.
  • The main pedagogical advantages the small-class-size teachers had over the the regular-class-size teachers in the STAR survey were all things all teachers should be doing anyway: monitoring what individual students are doing and learning, giving students second or third opportunities to learn material they didn't get the first time, and making personal/emotional connections with their students. It's easier to do those things in smaller classes, sure, but they're hardly small-class-only techniques. In fact, studies have shown that weaker teachers placed in small classes take no more advantage of these techniques than they did in larger classes. So the STAR study suggests that teachers who are using these techniques move further than teachers who don't, which I kind of feel like we already knew.
  • In a world of finite resources, smaller classes are a trade-off.  In the US, we trade smaller classes than teachers get in other countries for more of them:  the standard load is five classes of 28-30 students (in Chicago) or 40-odd students (in much of California).  So obviously it's better to have five classes of 17 students than five classes of 28 or 40 (for one thing, you have many fewer students to keep track of).  But what if you traded back, having three classes of 45 or so students instead of five classes of 25?  You'd get an additional two prep periods a day to plan,conference with other teachers, and analyze (grade + reflect on) assessments.  That time would allow you to better pace the next day's lesson--which you could plan that day, rather than having to do a week's worth on Sunday just to be able to keep up during the week--and to learn more about teaching.  And you wouldn't have to stay up until midnight to do that.  The situation I'm describing is pretty close to what they have in China: two sections of 50 students, with most of the day devoted to planning and preparation.1
  • Back to the issue of air time:  how would getting an additional ten or twenty seconds of verbal feedback each day compare to getting written feedback on individual work every single day, which is what many Chinese classes offer?
  • Another trade-off we make is teacher quality.  Just as hiring 22,000 teachers would reduce quality, it seems reasonable that if we were willing to live with much larger classes, we might be able to increase overall teacher quality.  That's what Finland did when they first started turning their educational system around (although now class sizes are back down to about 20, which is the stated average in CPS elementary schools, as a concession to eliminating class tracking).
So what's the moral?  Better teaching clearly produces better outcomes.  Smaller class sizes have costs.  (At a district average of about $80-100K per teacher, even just an extra 10,000 teachers runs to about a billion dollars annually, which seems like a lot to pay for a five percentile point gain on tests.)  Expanding class sizes without increasing total student loads might have substantial benefits to teachers and students: increasing opportunities to work together and to plan and assess better and more frequently, with more and more individualized feedback.  Why are we talking about keeping "all other things equal" when they so rarely are?
Because veteran teachers know: it's not just how big your class is; it's what you do with it that matters.
---------------------
1.  "But China and Finland are so much more homogeneous, it's easier to teach big classes of those students!" I hear you cry.  Well, in the eight-county Chicago area, more than 50% of African-American students are in classes that are over 95% African-American, and over 25% of Latino students are in similarly segregated schools. (WBEZ)  So while the CPS system is much more diverse than China's or Finland's, it's not obvious that its classrooms are.