Tag: new yorker

Is the Scientific Method Becoming Less . . . Scientific?

Posted on | by Sam | 6 Comments on Is the Scientific Method Becoming Less . . . Scientific?

In my ongoing search to better understand how we reconcile the creative tension between subjective and objective measures of the world — including our ongoing (and thus far) elusive search for a better way of tracking how people learn — I took note of a recent New Yorker article that cast light on some emerging problems with the ostensible foundation of all objective research — the scientific method.

In the article, author Jonah Lehrer highlights a score of multiyear studies — ranging from the pharmaceutical to the psychological — in which core data changed dramatically over time. Drugs that were once hailed as breakthroughs demonstrated a dramatic decrease in effectiveness. Groundbreaking insights about memory and language ended up not being so replicable after all. And the emergence of a new truth in modern science — the “decline effect” — cast doubt on the purely objective foundation of modern science itself.

Without recounting the article in entire, there are several insights that have great relevance to those of us seeking to find a better way of helping children learn:

  • In the scientific community, publication bias has been revealed as a very real danger (in one study, 97% of psychology studies were proving their hypotheses, meaning either they were extraordinarily lucky or only publishing outcomes of successful experiments). The lesson seems clear: if we’re not careful, our well-intentioned search for the answers we seek may lead us to overvalue the data that tell us what we want to hear. In the education community, how does this insight impact our own efforts, which place great emphasis on greater accountability and measurement, and yet do so by glossing over a core issue — the individual learning process — that is notoriously mercurial, nonlinear, and discrete?
  • In the scientific community, a growing chorus of voices is worried about the current obsession with “replicability”, which, as one scientist put it, “distracts from the real problem, which is faulty design.” In the education community, are we doing something similar — is our obsession with replicability leading us to embrace “miracle cures” long before we have even fully diagnosed the problem we are trying to address?
  • In the scientific community, Lehrer writes, the “decline effect” is so gnawing “because it reminds us how difficult it is to prove anything.” If these sorts of challenges are confronting the scientific community, how will we in the education community respond? To what extent are we willing to acknowledge that weights and measures are both important — and insufficient? And to what extent are we willing to admit that when the reports are finished and the PowerPoint presentations conclude, we still have to choose what we believe?

Education’s Blockbuster Moment

Posted on | by Sam | 2 Comments on Education’s Blockbuster Moment

A few New Yorkers ago, financial columnist James Surowiecki wrote a short piece about the downfall of Blockbuster video, and why it failed to anticipate the rapid rise of Netflix in its own backyard. Why, he postulated, did Blockbuster not read the tea leaves quickly enough to colonize the web the way it had colonized suburbia? Already blessed with a deep reservoir of customer expertise, a sophisticated system of inventory management, and a nearly ubiquitous and identifiable brand, Blockbuster was well placed to shift its business model from “bricks and mortar” to “clicks and mortar,” yet it did nothing. Which makes me wonder, what might Blockbuster’s downfall augur for the future of public education reform in America?

Click here to keep reading.

What George Washington Would Think of the 2010 Midterm Elections

Posted on | by Sam

Before I went to sleep last night — a night that, among other things, resulted in the loss of my wife’s job (she is/was Senator Feingold’s foreign policy adviser) — I happened to read Jill Lepore’s review of yet another new biography of America’s first president, George Washington. In it, she cites briefly from Washington’s renowned Farewell Address from 1796. Given that last night’s election results now mark the third election in a row that Americans have kicked a political party out of power (and we only have two, so . . .), I thought Washington’s two-century-old warnings to us seemed particularly prescient.

A central part of Washington’s legacy to us was his willingness to step away from power precisely at the point when he was most poised to consolidate it. Yet he also made sure in his farewell address to sound a few alarm bells, and urge us into “solemn contemplation, and to recommend to (our) frequent review, some sentiments which are the result of much reflection, of no inconsiderable observation, and which appear to me all-important to the permanency of (our) felicity as a people.”

In particular, Washington cautioned us to be aware of the growing trend in which “one of the expedients of party to acquire influence within particular districts is to misrepresent the opinions and aims of other districts. You cannot shield yourselves too much against the jealousies and heartburnings which spring from these misrepresentations; they tend to render alien to each other those who ought to be bound together by fraternal affection.

“All obstructions to the execution of the laws,” Washington continued, “all combinations and associations, under whatever plausible character, with the real design to direct, control, counteract, or awe the regular deliberation and action of the constituted authorities, are destructive of this fundamental principle, and of fatal tendency. They serve to organize faction, to give it an artificial and extraordinary force; to put, in the place of the delegated will of the nation the will of a party, often a small but artful and enterprising minority of the community; and, according to the alternate triumphs of different parties, to make the public administration the mirror of the ill-concerted and incongruous projects of faction, rather than the organ of consistent and wholesome plans digested by common counsels and modified by mutual interests.”

It is remarkable to think that when Washington was delivering these warnings, our country was just five years removed from the ratification of the Constitution. Yet it would make sense that his core caution then would have grown to become exponentially more relevant, and destructive, now: “However combinations or associations of the above description may now and then answer popular ends, they are likely, in the course of time and things, to become potent engines, by which cunning, ambitious, and unprincipled men will be enabled to subvert the power of the people and to usurp for themselves the reins of government, destroying afterwards the very engines which have lifted them to unjust dominion.”

America, where to from here?