Nature Shuts Down Open Wikipedia-Like Peer Review; If You Build A Wiki, It Doesn't Mean Anyone Will Edit It

from the empty-room-problem dept

One of the bad things about the tremendous success of Wikipedia is that it's created this widespread belief that all you need to do is set up a wiki or a wiki-like tool, and people will flock to it and fill it with content. For all the hype about "user generated media" and such, it's a lot of hard work getting the system to provide enough value to get people to participate. It's also quite difficult to build the critical mass necessary to get any kind of network effects. However, with so much hype, many seem to feel that a "just build it and the masses will come" plan will work. It's not so simple. A few months back we talked about an effort to get better peer reviews in scientific journals by having a "wiki-like" system, where stories shortlisted for publication would be posted online first, and anyone could critique the paper prior to publication (and yes, the use of "wiki" here isn't particularly accurate -- but it didn't stop everyone from describing it that way). The hope was that it would be a more open process that would help avoid some of the recent scandals over peer-reviewed, published research papers that later turned out to be bogus. Instead, though, it looks like Nature is killing off the experiment after just a few months. It appears that most authors had absolutely zero interest in pre-publishing their works for the rabble to critique -- and, not surprisingly, of the ones that were published, there was very little activity in terms of peer review.

Honestly, none of this should have come as a surprise to Nature or anyone involved in the project. While we were hopeful that it would at least get some traction as an alternative method for peer review, it was pretty much doomed from the start. With no additional incentives on either side, there were few reasons for anyone to take part. There are benefits to being a part of the traditional peer review process, but there were no additional benefits to taking part in this effort. Also, it assumed that people would automatically be interested in following what stories were put up for review, when most experts in these fields have pretty narrowly focused specialties and wouldn't be much help for the vast majority of the content placed up for review. That isn't to say that the peer review process can't be improved -- and the internet and various other new technologies can certainly help. However, it's going to take a lot more thought that just throwing up an open system and claiming "it's just like Wikipedia."
Hide this

Thank you for reading this Techdirt post. With so many things competing for everyone’s attention these days, we really appreciate you giving us your time. We work hard every day to put quality content out there for our community.

Techdirt is one of the few remaining truly independent media outlets. We do not have a giant corporation behind us, and we rely heavily on our community to support us, in an age when advertisers are increasingly uninterested in sponsoring small, independent sites — especially a site like ours that is unwilling to pull punches in its reporting and analysis.

While other websites have resorted to paywalls, registration requirements, and increasingly annoying/intrusive advertising, we have always kept Techdirt open and available to anyone. But in order to continue doing so, we need your support. We offer a variety of ways for our readers to support us, from direct donations to special subscriptions and cool merchandise — and every little bit helps. Thank you.

–The Techdirt Team


Reader Comments

Subscribe: RSS

View by: Time | Thread


  1. identicon
    Posterlogo, 20 Dec 2006 @ 2:32pm

    It's because NO ONE KNEW ABOUT IT!!

    I'm a biology researcher. I read Nature weekly in print, and I peruse its website also. I still had NO idea there was any sort of open access peer review in trial at Nature until some colleague mentioned it to me. And even then I couldn't find where it was very easily on their website.

    So, in the end, I think most of your commentary is is totally irrelevant. This had nothing to do with the scientific community failing to embrace open access peer review. It had EVERYTHING to do with not getting the word out well enough.

    link to this | view in thread ]

  2. identicon
    Anonymous Coward, 20 Dec 2006 @ 3:09pm

    And even if someone knew about it, why would anyone bother supporting something that hardly anyone knows about? Or something that will get shut down soon enough (a correct prediction, as it turns out)

    Perhaps the flaw here was in comparing a botched business endeavour to something (wikipedia) that was conceived from the outset as an altruistic project. Was anyone going to shutdown wikipedia because not enough people used it or they didnt like the outcome? No way--they just worked harder at it and stuck to it. Is that necessarily going to work for nature? maybe or maybe not.

    link to this | view in thread ]

  3. identicon
    The Man, 20 Dec 2006 @ 4:57pm

    Wikis are like bloggers

    99.9% never get read. Just because you can type and save a document on the internet does not mean you are interesting.

    link to this | view in thread ]

  4. identicon
    Anonymous Coward, 20 Dec 2006 @ 4:58pm

    wiki

    I would never trust any information on a wiki. If I ever went to edit one I would put totally fake info just to screw with people. I know I am not the only one.

    link to this | view in thread ]

  5. icon
    rahrens (profile), 21 Dec 2006 @ 6:32am

    re: wiki

    Yeah, #4, and that's why you post as AC, you coward...

    link to this | view in thread ]

  6. identicon
    -sexual. He sucks balls, 21 Dec 2006 @ 7:14am

    Anonymous Coward is

    He fakes info on wiki. Wow man... congrats. You have no life.

    link to this | view in thread ]

  7. identicon
    Henry Troup, 21 Dec 2006 @ 12:10pm

    Re: wiki

    When I have a few minutes to spare, I visit Wikipedia, check recent changes, and look at the anonymous/IP address ones, to revertvandalisim by fools like you. I know I am not the only one.

    link to this | view in thread ]


Follow Techdirt
Essential Reading
Techdirt Deals
Report this ad  |  Hide Techdirt ads
Techdirt Insider Discord

The latest chatter on the Techdirt Insider Discord channel...

Loading...
Recent Stories

This site, like most other sites on the web, uses cookies. For more information, see our privacy policy. Got it
Close

Email This

This feature is only available to registered users. Register or sign in to use it.