mamot.fr is one of the many independent Mastodon servers you can use to participate in the fediverse.
Mamot.fr est un serveur Mastodon francophone, géré par La Quadrature du Net.

Server stats:

3.1K
active users

Cory Doctorow

The dominant language of science and scholarship is English, and yet native English speakers do not have a monopoly on scientific and scholarly insights. Some non-native English speakers believe this puts them at a disadvantage when it comes to acceptance in peer-reviewed journals and citations, and pay language editors to improve their prose.

1/

But is it worth it? Does improving the quality of prose improve the perceived quality of scholarship, and with it, the likelihood of being accepted for publication in peer-reviewed journals and citation in further papers? That's the subject of "Writing Matters," a new preprint paper.

janfeld.weebly.com/uploads/1/1

2/

The paper's authors are a Kiwi economist (Jan Feld) and two plain language specialists (Corinna Lines and Libby Ross) who run a consultancy in New Zealand. They devised an ingenious experiment to determine what benefit - if any - scholars derive from paying editors to clean up their prose.

3/

They got a bunch of unedited economics papers written by PhD students, and had language specialists rate their prose quality, and also ran the text through a widely accepted empirical "grade level" estimator (Flesch-Kincaid). Then, the paper were edited by language specialists with no knowledge of economics (who would thus be unlikely to inadvertently improve the substantive claims in the papers).

4/

Finally, both versions of the papers - original and edited for clarity - were judged by economists and writing experts who were divided into experimental and control groups, with one group getting the edited versions and the other getting the original. These judges weren't told that they were reading edited or raw papers, and they weren't told (until afterward) that they were participating in an experiment about the effect of prose on the perception of scholarly quality.

5/

The results verified the commonsense conclusion: experts who reviewed the edited papers didn't just rate them as more readable - they also rated them as being better scholarship. They indicated that they would be more likely to accept the papers for conference talks and journal inclusion.

6/

And - predictably - the papers that benefited the most were those that showed the largest improvement in their prose after being edited. That is, the worst-written papers got the largest credibility boost after they were edited.

The authors conclude that the quality of writing really matters to the careers of scholars and the impact of their scholarship, and note that English writing capability is easier for native English speakers to attain than is the case for non-native speakers.

7/

What's more, they conclude that paid language editors can erase this deficit with a relatively light edit (each paper only received six hours' worth of editorial attention).

They recommend that granting bodies concerned with improving the quality of scholarship and human knowledge create funds to subsidize scholars who want their prose improved.

8/

All of this sounds right to me, but then, I'm a writer. Putting on my most skeptical hat, I am forced to admit that the study only concerns one discipline (economics) and a relatively small number of papers (30). Maybe these conclusions generalize to other subjects and maybe they'd be robust with a larger sample size - but that's not certain.

9/

More interesting is the unstated corollary: bad scholarship produced by scientists and researchers blessed with good prose may be sneaking through peer-review and into citations. Perhaps there's a "glibness privilege" that bypasses the critical faculties of fellow scholars, and gives foolish and unsupported ideas currency.

eof/