Sunday, December 07, 2014

Evidence for ‘Bilingual Advantage’ May Be Less Conclusive Than Previously Thought

This is a problem in the publishing of all scientific research.

http://www.psychologicalscience.org/index.php/news/releases/evidence-for-bilingual-advantage-may-be-less-conclusive-than-previously-thought.html?utm_source=pressrelease&utm_medium=eureka&utm_campaign=bilingualismexecutivefunction

Study results that challenge the idea that bilingual speakers have a cognitive advantage are less likely to be published than those that support the bilingual-advantage theory, according to new research published in Psychological Science, a journal of the Association for Psychological Science. This research suggests that a publication bias in favor of positive results may skew the overall literature on bilingualism and cognitive function.

“Publishing only ‘successful’ studies means that we do not have access to many valuable studies that could increase our understanding of the actual effects of bilingualism,” says lead researcher Angela de Bruin of Edinburgh University. “The ‘bilingual advantage’ has received much attention and is now often considered to be common wisdom. Especially because of its societal relevance, it is important to realize that our interpretation of these advantages may be biased by the type of studies published.”

•••••

But in informal discussions with colleagues, de Bruin and her co-authors confirmed that study results that fail to support the bilingual advantage often don’t make it to publication. Thus, they never become part of the established scientific literature — a phenomenon known as the “file drawer effect.”

To see if they could find concrete evidence for a publication bias, the researchers decided to compare studies presented at conferences with those that are eventually published. They identified 104 conference abstracts describing studies on bilingualism and executive control in any age group, presented between 1999 and 2012. They then looked to see which of those studies were accepted for publication in an international scientific journal on or before February 2014.

Of the 104 abstracts, 38% described studies that supported a bilingual advantage, 13% found mixed results that tended to support the advantage, 32% found mixed results that challenged the advantage, and 16% failed to find an advantage.

While 52 of the studies reported in the abstracts were accepted for publication, analyses indicated that some studies were much more likely to make it to publication than others.

The researchers found that the majority (63%) of the studies that supported the bilingual advantage, either partly or completely, were published; however, only 36% of the studies that mainly or fully failed to support the advantage were published.

The difference in publication rates couldn’t be explained by the specific tasks or the sample sizes used in the studies.

•••••

According to de Bruin, these findings underscore how essential it is to review the published scientific literature with a critical eye, and how important it is that researchers share all of their findings on a given topic, regardless of the outcome.

“All data, not just selected data that supports a particular theory, should be shared, and this is especially true when it comes to data regarding issues that have enormous societal relevance and implications, such as bilingualism,” de Bruin and colleagues conclude.

•••••

No comments:

Post a Comment