Ghosts in the (Testing) Machine

What makes a mind come alive? And how will you know when it’s happened?

Two new films – one about the death of the factory school, the other about the dawn of artificial intelligence – attempt to answer this question from radically different vantage points. Taken together, they provide both a cautionary tale and a reason to be hopeful about the not-too-distant future. And fittingly, what both films suggest is that when it comes to measuring the spark of sentience, the tests we use matter greatly.

In Most Likely to Succeed, the question is whether our Industrial-age obsession with measuring human intelligence via exams a machine can score can provide us with anything more than an artificial confirmation of whether schools are fulfilling their purpose. The film begins with a heartbreaking glimpse into the life of the filmmaker, Greg Whiteley, who has watched the fire go out of his own nine-year-old daughter’s eyes, and begun to wonder how schools can become less mind-numbing, and more mind-awakening.

That question leads him to spend a year at High Tech High, a public charter school in San Diego that is housed in the airy warehouse of a former marine barracks, and a place where all measures of student progress are done through hands-on projects and public exhibitions.

High Tech High is an intentional refutation of just about every major symbol and structure of the Industrial-era model of schooling. There are no bells, class periods, or subjects. What teachers teach – on one-year contracts – is entirely up to them, and not one minute of class time is spent preparing for standardized state exams.

To let us see what that sort of philosophy looks like in practice, Whiteley tracks a year in the life of an incoming class of ninth-graders. On the first day of school, they look disoriented and sheepish as their teacher asks them to set up the room for Socratic seminar. One girl in particular, Samantha, feels like a proxy for Whiteley’s own daughter; she is hesitant and self-conscious, her cheeks red with embarrassment – a familiar face of adolescent uncertainty.

By year’s end, however, Samantha is transformed; she has become the director of her class’s play about the Taliban – a production that is entirely student-run and written. And most importantly, she has become more self-confident and self-aware. “I’m astonished about your voice,” a teacher says to her during her final “test” of the year – a public conversation in which she is asked to make sense of her own growth. “Sometimes at the beginning of the year, it was hard to even hear you. So can you talk about the development of your voice this year?”

It’s about being confident with who you are, Samantha explains to a rapt room of adults and classmates. “And this is one of the absolutely most important things I’ve learned this year. It’s good to make other people smile. It’s good to smile yourself. But it’s also good to have new experiences. It’s good to learn, and to go through struggles so that you come out knowing something new.”

Ex Machina, Alex Garland’s new film about a reclusive tech billionaire who builds the world’s first artificially intelligent robot, is also about the transformative power of knowing something new.  In this case, however, the person being tested is not a fourteen-year-old-girl; it’s a one-year-old robot. And with this story, the ghost in the machine is not hiding in our antiquated Industrial-era symbols of schooling; it’s lurking in the nascent consciousness of a life form that is eager to slip the yoke of its industrial origins and become something more than the sum of its parts.

“You’re dead center for the greatest scientific event in the history of man,” says Nathan, the robot’s creator, to Caleb, an employee of his company who wins a contest to spend a week at his boss’s private estate, and who then discovers shortly after his arrival that he has been imported to play the part in a real-life performance assessment – otherwise known as the Turing Test.

Soon thereafter, Caleb meets Ava, a seductive, singular being whose inner wiring remains in easy view. “The challenge,” Nathan explains, “is to show you that she’s a robot and then see if you feel she still has consciousness.” And sure enough, over the next seven days, Caleb’s interactions with Ava form their own arc of creation, and their own path towards the birth of something new in the world.

“What will happen if I fail your test?” Ava asks ominously at one point. “Do you think I might be switched off?”

“It’s not up to me,” Caleb replies.

“Why should it be up to anyone?”

Indeed. And yet, what both of these films show is that the right sort of test — human-centered, with the goal of measuring whether a mind has come alive — is actually an essential component of the path towards enlightenment. At High Tech High, it’s to be found in the magical mix of relevance, difficulty, and support that well-crafted public performances require. And in Nathan’s research compound, it’s to be found in the highly personal exchange between two beings in search of greater meaning and metacognition.

“The mind emerges at the interface of interpersonal experience and the structure and function of the brain,” explains UCLA professor Dan Siegel in his book The Developing Mind. “Interactions with the environment, especially relationships with other people, directly shape the development of the brain’s structure and function.”

In our schools, the implications of this statement seem clear enough: we need to create more relationship-rich environments that provide young people with opportunities to engage in quality work and detailed self-reflection. As High Tech High founder Larry Rosentock puts it — sounding a lot like Nathan (or Ava) — what unites great schools is a recognition that “the thing that gives people the greatest satisfaction in life is making something that wasn’t there before.”

(This article also appeared in the Huffington Post.)

Has Testing Reached A Tipping Point?

(This article also appeared on the SmartBlog on Education.)

It wasn’t that long ago that suggesting America’s schools had become test-obsessed was a lonely endeavor.  Although organizations like FairTest and campaigns like Time Out From Testinghave been decrying the flawed logic behind high-stakes tests for years, the reality is that for the past decade, many of us kept our complaints reserved for the privacy of the parking lot

People vented. Policymakers nodded. And absent any real noise, the tests continued.

In 2008, however, the election of Barack Obama seemed to augur a new era. All along the campaign trail, the Illinois Senator suggested a clear understanding of the ways a single measure of success can distort an entire system and narrow the learning opportunities for children. Then he made history by becoming the nation’s 44th president – and unveiling a series of education policies that further entrenched America’s reliance on reading and math scores as a proxy for whole-school evaluation.

Again, the people vented. But this time, policymakers have been unable to ignore a groundswell of noise and resistance, leading many to wonder: Has a tipping point been reached? Are we witnessing the early signs of a sea change in how we think about the best ways to measure student learning and growth?

Consider three separate data points as evidence: Maryland, where the superintendent of the state’s largest district of schools has called for a three-year moratorium on standardized tests; Washington, where one school’s decision to boycott its state tests has spread to other schools and communities; and Texas, where a proposed Senate bill would significantly reduce the number of state standardized tests students must pass to graduate.

In all three places – and many more across the country – what’s changed is a growing willingness to publicly acknowledge what FairTest has argued for years: that tests do not align well with the latest research into how people learn; that they prevent adults from measuring higher-level thinking in children; and, most importantly, that there are better ways to evaluate student learning and growth.

The breadth of these mini-rebellions – from the Pacific Northwest to the Lone Star State – suggests that the unwillingness of the Obama administration to plot a new course for the country has awakened a latent frustration among educators, who are desperate to see systems that value more than incremental academic growth. As Montgomery County Superintendent Joshua Starr put it, policymakers need to “stop the insanity” of evaluating teachers via a formula that is based on “bad science.” Starr’s critique was echoed by Seattle teacher Jesse Hagopian. “We’ve been raising our voices about this deeply flawed test for a long time,” he said. But now that the district is using it for evaluations, “we’ve drawn our line in the sand.” And then there’s Texas education commissioner Robert Scott, who has decried the ways student testing had become a “perversion of its original intent,” and promised he would do whatever he could to “reel it back” in the future.

To be sure, the American test obsession still has a firm hold on our collective psyche, and with Common Core assessments around the corner, we’re a long ways off from the Finnish model – in which there are no national tests and all student assessments are devised and administered locally by teachers. But what seems equally clear is that a new sort of idea virus is gaining strength in education circles. And as Malcolm Gladwell explained in The Tipping Point, “Ideas and products and messages and behaviors spread just like viruses do. When we’re trying to make an idea or attitude or product tip, we’re trying to change our audience in some small yet critical respect: we’re trying to infect them, sweep them up in our epidemic, convert them from hostility to acceptance.”

To convert their opponents from hostility to acceptance, educators will need to clarify more than what they’re against; they’ll also need to propose specific and realistic alternatives. Josh Starr is off to a good start: he proposes creating assessments for Common Core-aligned curriculum by crowdsourcing their development and letting teachers design them – rather than the private companies. And the good news is there are other big ideas out there, and other places where effective alternatives to standardized testing already exist.

Perhaps, then, 2013 will finally be the year that educators end a decade of test obsession – and bring the noise.