Friday, July 13, 2007

Early response to PLoS ratings

PLoS ONE pushed out a rating systems in the latest update of their website. I though it was another quiet update but several announcements are now up.

The technical details were described by Richard Cave and Chris Surridge invites everyone to "Rate Early, Rate Often". Bora (that now works for PLoS) summed it up in a blog post as well.

And just because they make it so easy to query the data, here goes the stats 3 days after the announcement:
Number of papers queried: 611
Number of papers rated: 47
Number of ratings: 50
Ratings: Average - 75%; Max - 100%; Min - 40%

Top rated papers (all with 100%)
10.1371/journal.pone.0000288 (rated by: brembs)
10.1371/journal.pone.0000354 (rated by: brembs)
10.1371/journal.pone.0000439 (rated by: brembs)
10.1371/journal.pone.0000349 (rated by: Complexity_Group)
10.1371/journal.pone.0000351 (rated by: crusio)
10.1371/journal.pone.0000455 (rated by: crusio)
10.1371/journal.pone.0000123 (rated by: Damien)
10.1371/journal.pone.0000224 (rated by: Damien)

Maybe in the long run it would be nice to know if the user that rated is also an author in the paper :), or put a comment in the ratings suggesting that authors are not very good at evaluating their own work.

Number of users that have rated: 24
Top 3 users:
Chris_Surridge
Complexity_Group
jstajich

The lowest rating so far:
10.1371/journal.pone.0000257 (rated by:godzikc)

There is no point in trying to conclude anything from this. It was just for the fun of it. If I could make a small wish it would be have a similar way to query for the accumulated number of page views or visitors for a given DOI.