When Research Matters

April 29, 2008

Book Review
When research matters: How scholarship influences education policy.
Frederick M. Hess, editor.
Harvard Education Press, 2008. 312 pp.

The whole point of education research is to pin down “what works” in education, and then to scale it up. Right? Well, maybe.

Frederick (Rick) Hess offers a new collection of essays that address that question from many perspectives. Hess directs education policy studies at the American Enterprise Institute and he co-hosts The Education Gadfly Show.

He offers this collection of essays “with the conviction that researchers, public officials, educators, journalists, and advocates would all benefit from a clearer and deeper understanding of the complex relationship between research and policymaking.”

The book’s first two chapters consider the history of the federal role in education policy and the evolving nature of educational policy research. The next three chapters address the role of research in debates over reading, NCLB, and “out-of-field” teaching.

The following section considers how research affects policy by shaping public opinion, influencing judicial decisions, and affecting the decisions of district and school leaders. The fourth section offers broader insights into the incentives that help explain the behavior of researchers and policymakers.

Some of the highlights:
Paul Manna and Michael Petrilli write that research can add substantive value to policymaking, for example influencing legislative debates that helped develop NCLB. However, members of Congress and their staff use research selectively and tend to gravitate toward findings that supported their own ideological views.

James Kim describes the problem time lag. “Research often takes several decades to bear fruit, but decision makers cannot wait for decades to help struggling readers. Consequently, the demands facing a state education official, superintendent, or teacher create pressures for immediate action and quick solutions. Research that is unavailable for decades cannot inform decision making today.”

William G. Howell describes how research is, or is not, understood by average citizens, who “evaluate academic research on the basis of information found within [a] news story … typically, the identity of the individual or institution that produced the report, a core finding or two, and a handful of quotes from experts providing commentary. Rarely more, and often less.” At the same time, “some studies can shape popular views about the state of public education in America. Scholarship can penetrate the public conscience—and for at least some citizens, the consequences can be dramatic.”

Joshua Dunn and Martin West examine how education research has influenced judicial decisions in desegregation and school finance cases. However, like Congressional staff, the Court uses social science inconsistently. “The Court, and even individual justices, often cite research-based evidence when it supports their position, and disparage or ignore it when it does not.”

Lance Fusarelli writes about the challenge of making research relevant to the day-to-day lives of educators. From the perspective of many school leaders, he writes, “the inconclusive nature of some education research, particularly the existence of conflicting studies, suggests significant disagreement about what works best, where, and under what conditions. This makes it problematic for superintendents and principals to learn and leads to confusion and mistrust among educators.”

Dan Goldhaber and Dominic Brewer lay out a supply-and-demand framework to portray the incentives motivating individuals and organizations in the education research business. They suggest that “the market for education research may not function efficiently, in the sense that not enough of the research that is needed gets done, and too much of what is not needed is produced. Incentives are misaligned. They list steps that might be taken “to increase the production of high-quality, policy-relevant education research.”

Kenneth Wong observes the different governing principles and incentives that motivate the research community and electoral-oriented policy institutions. “Researchers are more effective when they team up to provide comprehensive research analysis in response to the needs or policymakers. The Koret Task Force was invited by state policymakers in Texas, Arkansas, and Louisiana to provide statewide reform recommendations.”

In a concluding chapter, Hess says we shouldn’t be surprised by the cultural gaps that separate researchers, policymakers, and journalists. They’re just doing what existing professional incentives encourage them to do.

Research has a vital role to play in democratic policy debate, he says. “That role is not to dictate outcomes or to presume that public officials should be the handmaidens of researchers, but to ensure that public decision making is informed by all the facts, insights, and analyses that the tools of science can provide.”


Book review: Here Comes Everybody

April 9, 2008

here comes everybody

Here Comes Everybody:
The Power of Organizing Without Organizations.
Clay Shirky
Penguin Press, 2008. 327 pp.

As the invention of the birth control pill and the transistor have led to fundamental changes in society, so too has the invention of social media and the Web 2.0. Online social networks have enabled productive, collaborative groups for form—groups that are larger and more distributed than at any other time in history.

This in a nutshell is Clay Shirky’s argument in Here Comes Everybody. Shirky studies the places where our social networks and technological networks overlap. On the faculty of NYU’s Interactive Telecommunications Program, he writes and teaches on the social and economic effects of the internet.

This very readable book examines the ways that new communications technologies enable groups of like minded people to form more easily than ever before, regardless of geography.

Television didn’t kill radio, and movies didn’t kill live theater. In the same way, the Internet won’t kill news and entertainment outlets or political parties. Our traditional institutional organizations will continue to exist in this new Web 2.0 world, Shirky writes, but their influence will weaken as novel alternatives for group action develop. The more an institution or industry relies on information as its core product, the greater and more complete the changes it now faces.

Without managerial oversight, beyond the profit motive, and outside the old structures that limited group effectiveness, self-forming groups now accomplish things themselves.

In one of many an examples Shirky points to the popular online photo sharing site Flickr.com. Rather than managing or coordinating its thousands (millions?) of users, Flickr lets them coordinate themselves. Flickr simply provides a platform for them to share photos and form groups. Why was Flickr able to provide some of the first photos of the London Transport bombings in 2005? It beat many traditional news outlets because amateurs with camera phones were there when it happened, and posted their photos to Flickr. The Internet, Shirky argues, has become the first and the best group-forming network.

Another example: Blogging has enabled the mass amateurization of publishing, which makes an end-run around traditional press outlets. The change isn’t a shift from one kind of news institution to another, but rather in the definition of news. News is no longer an institutional prerogative. It’s part of a communications ecosystem, occupied by a mix of formal organizations, informal collectives, and individuals.

Shirky argues that, on balance, these changes will be beneficial. The first argument is based on net value: Although the invention of the printing press destroyed some jobs (scribes) it created many others, and the resulting spread of literacy and knowledge benefited society as a whole. The second argument on behalf of new capabilities for groups concentrates on political value. In this view, the changes increase the freedom of people to say and do as they like. An increase in freedom of speech, of the press, and of association, is assumed to be desirable in and of itself.


Book review: The Access Principle

December 6, 2007

the access principle

The Access Principle: The Case for Open Access to Research and Scholarship
John Willinsky
MIT Press. 2006. 285 pp.

We live in an historic moment. Publishing is moving from print to digital formats, and the model of ‘open access’ publishing challenges traditional methods of commercial publishing and academic publishing as well.

In The Access Principle, John Willinsky argues that open access to research archives and journals has the potential to change the public presence of science and scholarship and to help inform civic discussion and policy making.

A professor at the University of British Columbia, Willinsky argues that a commitment to the value and quality of research carries with it a responsibility to extend the circulation of research findings as far as possible, to all who are interested in it, and to all who might profit by it.

Willinsky’s case for open access is multifaceted. It draws on the spirit of copyright law, the mandate of scholarly associations, the promise of global knowledge exchanges, the public’s right to know, the prospect of enhanced reading and indexing, the improved economic efficiencies of publishing, and the history of the academic journal.

Willinsky is careful to explain that ‘open access’ does not mean ‘free access.’ Open access articles cannot be read without a substantial investment in hardware, software, and networking. The open access movement does not operate in denial of economic realities, he says; it is simply acting on a scholarly tradition that has long been concerned with extending the circulation of knowledge.

The Access Principle deals with practical matters of digitizing scholarly journals and then goes on to consider larger themes, including extending the research capacities of developing nations, increasing public rights of access to knowledge, and furthering the policy and political contributions of research.

The open access movement has drawn critics, who are alarmed at what this approach could mean for the future of scholarly publishing in general and for their pocketbooks in particular. But, Willinsky asks, what sort of market drives subscription prices and cancellations up to the point of forcing libraries to cancel journals? What sort of market ensures that the labor invested by faculty authors and reviewers results in journals that their own libraries can no longer afford?

Research knowledge has been transformed into a capitalized commodity and economic driver, he writes. The resulting corporate publishing concentration, with its relentless focus on knowledge capitalization and shareholder value, has allowed journal prices to increase well above inflation rates. University libraries cannot keep up, and even Tier 1 research institutions are dropping expensive journal subscriptions by the dozens and scores.

Online scholarly resources are now available in a variety of forms, yet it’s the research article in particular that’s at the center of a struggle, Willinsky says. The struggle is over online publishing and whether it will further contribute to, or whether it will begin to reverse, the current state of declining access to research within an otherwise expanding global academic community.

Journals that are not prepared to make their articles freely available to readers immediately on publication have a range of options for increasing access, Willinsky notes:

Journals can enable authors to deposit articles (in preprint and postprint stages) in an e-print archive run by the authors’ institutions or to post them on the authors’ own Web sites immediately on publication.

Journals can make their contents free to read online some six to twelve months after initial publication.

Journals can make their contents freely and immediately available to those working at universities in developing countries.

As an example of the difference open access can make, both to readers and to authors, Willinsky cites the journal Education Policy Analysis Archives, begun in 1993 by Arizona State University professor Gene Glass. The site attracts thousands of visitors each weekday. Compare that with the typical audience for a print academic journal where a circulation of 600 copies is common.

Submissions to the online Teachers College Record have gone up, since launching the open access site, from 75 submissions a year in 1995 to 600 submissions in 2002.

Open access is becoming part of the peculiar economics of scholarly publishing, Willinsky says. BioMed Central is part of that picture, as are the Health InterNetwork Access to Research Initiative and International Network for the Availability of Scientific Publications projects. Elsevier’s ScienceDirect provides an open index to that portion of the literature that it controls, and allows its authors to self-archive their work.

In this context, Willinsky argues, scholarly associations must ask themselves whether they will use this new publishing medium, already integral to the scholarly process, to extend and advance the circulation and exchange of knowledge. The associations need to consider the principles of access and the availability of open access publishing in the short term and the long term. They should consider cooperating with research libraries and better attune themselves to what’s in the best interest of their members and authors, as well as the cause of research and scholarship that they serve.


Book review: Educator’s Podcast Guide

August 15, 2007

educators podcast guide

“Finally, a technology that helps bridge the gap between content delivery and the video game generation,” writes Bard Williams in his new book, Educator’s Podcast Guide (International Society for Technology in Education, 2007, 279 p.).

Williams is a veteran educator and tech guru who has written 300 articles and a dozen or so books on things technological — palm handhelds, smart phones, mobile technology, and the internet. He runs an education marketing and consulting company called Techthree.

Part One of the Guide includes an introduction to podcasting, how to integrate podcasts in the classroom, and how to evaluate podcasts for classroom use. Part Two provides overviews of about 100 education podcasts arranged by content area. Topics include general education and administration, educational technology, mathematics and science, English and language arts, social sciences, fine arts, physical education and health, foreign languages, and news and research, among others.

If you want to jump in and start producing your own podcast, Williams discusses the software and hardware options and helps you think through planning the content and publicizing your product.

ISTE is a nonprofit worldwide professional organization for leaders in education technology.


Online social networking: Research and guidelines

August 15, 2007

Online social networking is increasingly used as a communications and collaboration tool of choice in businesses and higher education. As such it would be wise for schools, whose responsibility it is to prepare students to transition to adult life with the skills they need to succeed in both arenas, to reckon with it.

That’s one of the recommendations in the National School Boards Association publication, Creating and connecting: Research and guidelines on online social and educational networking. (National School Boards Association. July 2007, PDF, 12 pp.)

The report results from a study involving an online survey of more than a thousand 9- to 17-year-old students, an online survey of more than a thousand parents, and telephone interviews with 250 school district leaders who decide Internet policy.

According to the study, 96 percent of students with online access report they have used social networking technologies including chatting, text messaging, blogging, and visiting online communities like Facebook, MySpace and services designed specifically for younger children.

Yet the vast majority of school districts have stringent rules against nearly all forms of social networking during the school day, even though students and parents report few problem behaviors online.

Maybe that’s because many adults, including school board members, are like fish out of water when it comes to this new online lifestyle, the report suggests. It’s important for policymakers to see and try out the kinds of creative communications and collaboration tools that students are using, so that their perceptions and decisions about these tools are based on real experiences.


Book review: Research and educational leadership

August 1, 2007

Research and educational leadership: Navigating the new national research council guidelines.
Fenwick W. English and Gail C. Furman, Eds.
Lanham, MD: Rowan & Littlefield Education. 2007
UCEA Leadership Series: University Council for Educational Administration.

In 2002 the National Research Council published “Scientific Research in Education,” which proposed six “design principles” to nurture a scientific culture within education research. Bruce Alberts, then president of the National Academy of Sciences, wrote that the report offered “a comprehensive perspective of ‘scientifically-based’ education research “for the policy communities who are increasingly interested in its utilization for improving education policy and practice.” Within the diverse field of education, he continued, “researchers who often disagree along philosophical and methodological lines nonetheless share much common ground about the definition and pursuit of quality. This report should therefore be useful for researchers, as well as for those who use research.”
The NRC report set forth six standards. Education research should:
· pose significant questions that can be investigated empirically
· link research to relevant theory
· use methods that permit direct investigation of the question
· provide a coherent and explicit chain of reasoning
· replicate and generalize across studies
· disclose research to encourage professional scrutiny and critique.

A new book, “Research and Educational Leadership: Navigating the new national research council guidelines” responds to and takes issue with that report. While the authors agree with NRC’s call for enhanced research rigor, they doubt the ability of strict empirical research to generate insightful recommendations on educational leadership.

Co-editor Fenwick English is professor of educational leadership in the School of Education at the U of North Carolina-Chapel Hill. In his essay, English argues that leadership must be evaluated in context, and that leadership is as much an art as a science. The art of leadership is highly situational and is centered on performance, he says. The “input-output’ model commonly used in school effect studies is inappropriate. Because strict empiricism has blind spots and is unable to think outside its own self-imposed limitations, English argues, it’s not a realistic approach for evaluating leadership quality.

Co-editor Gail C. Furman is professor and program coordinator of the Educational Leadership program at Washington State U. Her essay discusses the constructivist view of educational leadership: Leadership is distributed among educators in specific school sites and is constructed by them as they work together toward their goals. In this view leadership is a shared, context-bound, dynamic phenomenon, that responds to site-specific conditions. Furman says this “new narrative” of educational leadership requires a different way of understanding leadership practice. It suggests research approaches that are incompatible with the version of “scientific” research privileged in current federal education policy.

Linda Tillman, U of North Carolina-Chapel Hill, argues that strict adherence to the NRC’s six principles overlooks racially and culturally sensitive research frameworks and marginalizes researchers who don’t use quantitative methods. The principles can impede research on significant topics such as school reform, the education of special populations, and the achievement gap, as they relate to African Americans. Strict adherence to the guidelines would likely mean a continued marginalization of research on African Americans in school leadership, she argues. Culturally sensitive research frameworks produce findings that can be useful to African Americans and other leaders of color who face the complex task of leading in diverse school contexts.

Carolyn Riehl, Columbia University, argues that no single form of leadership will likely be effective in all contexts. She asks whether new research should aim to help leaders “recapitulate modernity’s quest for rationality, certainty, and the hope for progress.” Or should it help them “learn to live more comfortably with randomness, unsolvable dilemmas, and the interplay of spirit, body, and mind?” The federal government, she argues, seems intent on focusing researchers’ attention on particular forms of research that can provide convincing evidence for the most efficient and effective ways of generating desired outcomes. If research can specify effective educational strategies, it’s assumed that practitioners can easily adopt and use these practices.

Michelle Young, U of Missouri-Columbia, addresses the growing practice of researchers publishing their findings without peer review. Two common reasons they cite are the improved timeliness of press releases over peer-reviewed journals and the desire to influence policymaking. Because ‘fugitive studies’ continue to be released, Young says, national professional organizations (perhaps AERA) should establish an independent research review board to help ensure that “even researchers who disregard elements of widely accepted research standards are held accountable.”


Ten kinds of tech users: Pew/Internet survey

May 23, 2007

73% of adult Americans are internet users and 73% use a cell phone.

About 15% of Americans neither go online nor have a cell phone.

Half (52%) of Americans have broadband access either at home or work; 42% have broadband at home.

These findings come from the Pew/Internet report, “A Typology of Information and Communication Technology Users” (7 May ).

The Pew Internet & American Life project classified Americans into different groups of technology users, ranged along three dimensions of relationships to information and communications technology (ICT): their ICT assets, their actions, and their attitudes.

The survey found that Americans sort into 10 distinct groups of users of ICT.

“Elite” tech users constitute of 31% of American adults and include four subgroups. “Middle-of-the-road” tech users constitute 20% of American adults and include 2 subgroups; and the “low tech” group constitutes 49% of American adults and includes 3 subgroups.

The survey found differences in use and attitudes among people even when they own the same devices. For example, the four subgroups making up the “elite” group of tech users display significant differences in the extent of their participation in shaping cyberspace (i.e., creating “user-generated content) and how central they believe information technology is to various facets of their lives.

The four subgroups that collectively make up the low tech users come to 49% of the general population. They are the heaviest users of old media, such as radio and TV, but do not have an inclination (or perhaps the means) to try new information and communication technology. This group is the oldest—the median age is 64, and has the lowest reported levels of household income.

There is an intra-generational pattern to information technology adoption. Not all people in or near their 30 got online at the same time, and the same is true when looking at people in their 40s and 50s. Each age cohort appears to have its technology champions who adopt early, with others then following.


Book review: Hypertext 3.0

May 23, 2007

Hypertext 3.0: Critical theory and new media in an era of globalization.
George P. Landow.
Parallax Re-visions of Culture and Society, The Johns Hopkins University Press, 2006.

This 400-page brick of a book challenges the reader, not just because it’s long, not just because it’s multidisciplinary, not just because the language is often technical, and not just because of the density of thought. It’s a challenge because it invites (and nearly requires) readers to place themselves in more than one position: as a student of communication theory, as a student of computer science, as a student of academic publishing, or as a student of literature. And as if 400 pages weren’t enough, another 20 pages of bibliography refer to print material sources and another five pages refer to electronic materials and video sources.

George P. Landow is professor of English and art history at Brown University, where he has long used hypertext in his teaching and publishing.

The Web has obviously already had a major effect on colleges, universities, and other cultural institutions, Landow says, but it has not realized many of the more utopian visions of hypertext. The limitations of our own ‘mentalware’ are more to blame than the limitations of our software, he says. “Many of us remain so deep inside the culture of the book that we automatically conceive of digital media in terms of the printed book. We base our ideas about the nature of teaching, the purpose of documents, and their relation to courses, disciplines, and universities on the mistaken assumption that electronic documents are essentially the same as printed ones. They’re not.”

Landow writes that hypertext systems have dramatically changed the roles of student, teacher, assignment, evaluation, reading list, relations among individual instructors, courses, departments, and disciplines. No wonder so many faculty find so many “reasons” not to look at hypertext, he says. “Perhaps scariest of all for the teacher, hypertext answers teachers’ sincere prayers for active, independent-minded students who take more responsibility for their education and are not afraid to challenge and disagree. The problem with answered prayers is that one may get that for which one asked, and then. .. .”

Discussions of hypertext all raise political questions, Landow says: questions of power, status and institutional change. The logic of information technologies tends toward increasing dissemination of knowledge, and so implies increasing democratization and decentralization of power. “Technology always empowers someone,” Landow says. “It empowers those who possess it, those who use it, and those who have access to it. From the very beginnings of hypertext its advocates have stressed that it grants new power to people.”

Landow says we can count on hypertext and print existing side by side for some time to come. And when the eventual shift to hypertext makes it culturally dominant, “it will appear so natural to the general reader-author that only specialists will notice the change or react with much nostalgia for the way things used to be.”

The history of the print technology and culture also suggests that, as the Web becomes even more culturally important than it already is, it will do so by enabling large numbers of people either to do new things or to do old things more easily, Landow says. The enormous number of online diaries, political and other parodies, examples of self-published fiction and poetry, and conversion tales by people with alternate lifestyles reveals that for many such a change has already taken place.


Public displays of connection

May 16, 2007

Here’s an intriguing read from BT Technology Journal written by Judith Donath and danah boyd. It discusses the phenomenon of public displays of one’s connections in a variety of online social networks. Although published in 2004, it remains fresh:
“The public display of connections is one of the most salient features of the social sites. The focus of this paper is on the social implications of this display. Why do people display their social connections in everyday life–and why do they do so in these networking sites? What do people learn about another’s identity through the signal of network display?”
More papers from MIT’s Sociable Media Group


Top posts for past 30 days

May 8, 2007