Think tanks are designed to help policy makers shape decisions by giving them evidence-based information in an apolitical format.
Who doesn't claim to be doing that? Though Sierra Club and Environmental Defense Fund were both inspired by rabid eugenics proponents who simply reframed their beliefs about the poor being vermin into the "population control" rhetoric after World War II, they still claim they are more consumer advocacy oriented than corporations that actually help people. And government-controlled panels like the International Agency for Research on Cancer agree, an expert on a pesticide who works for the private sector can't be on their pesticide working group but an anti-pesticide consultant for EDF can be.
Unsurprisingly, due to politicization of NGOs, an academic political scientist says that government employees are more likely to trust an academic report than an NGO one.
Carey Doberstein, an assistant professor of political science at University of British Columbia's Okanagan campus, published results of a randomized controlled survey experiment involving British Columbia public service staff, asking them to read and assess the credibility of various policy studies. For half of the respondents, the authorship of the studies was randomly switched but the content remained the same. Doberstein then compared the average credibility assessments between the control and experimental groups.
"There were systematic and at times extraordinarily large differences between the credibility assessments provided by these policy professionals on precisely the same policy studies, when the only part I changed was the label of who wrote it," said Doberstein. "Irrespective of the content and just by virtue of presenting it as written by an academic, the report suddenly becomes more credible in the eyes of bureaucrats."
For one report, originally authored by the Fraser Institute, the credibility skyrocketed among study participants when they read the same document thinking it came from a university academic. Another policy study, this time written by a university economist, received very high credibility assessments in the control group. But when authorship was changed to be purportedly written by the Canadian Centre for Policy Alternatives think-tank, its credibility plummeted dramatically.
"Put simply, the think-tank affiliation was a significant drag on the perceived credibility of their report and analysis," said Doberstein.
The same was true for reports said to be written by research-based advocacy groups.
Some may interpret this finding positively," he said. "That analysts in government are skeptical of reports or studies that emerge from think tanks or advocacy organizations offering analysis and conclusions that tend to align with the organization's obvious ideological position."
Yet Doberstein says having a report's credibility increase simply by changing the name of the source is concerning as it can appear that policy-relevant research contained within its pages is being ignored by government policy advisors. "We expect public servants to objectively examine the research evidence available to them. However, it seems many are taking shortcuts, and in essence giving academics a free pass."
Doberstein's study was recently published in Policy Studies Journal.
Comments