[Note: Mike asked me to scrape a couple of comments on his last post – this one and this one – and turn them into a post of their own. I’ve edited them lightly to hopefully improve the flow, but I’ve tried not to tinker with the guts.] This is the fourth in a series of posts on how researchers might better be evaluated and compared. In the first post, Mike introduced his new paper and described the scope and importance of the problem.

You’ll remember that in the last installment (before Matt got distracted and wrote about archosaur urine), I proposed a general schema for aggregating scores in several metrics, terming the result an LWM or Less Wrong Metric.

{.size-large .wp-image-12788 .aligncenter loading=“lazy” attachment-id=“12788” permalink=“http://svpow.com/2016/01/28/yes-folks-birds-and-crocs-can-pee/ostrich-peeing/” orig-file=“https://svpow.wordpress.com/wp-content/uploads/2016/01/ostrich-peeing.jpg” orig-size=“1280,720” comments-opened=“1”

I said last time that my new paper on Better ways to evaluate research and researchers proposes a family of Less Wrong Metrics, or LWMs for short, which I think would at least be an improvement on the present ubiquitous use of impact factors and H-indexes. What is an LWM?

Like Stephen Curry, we at SV-POW! are sick of impact factors. That’s not news. Everyone now knows what a total disaster they are: how they are signficantly correlated with retraction rate but not with citation count; how they are higher for journals whose studies are less statistically powerful; how they incentivise bad behaviour including p-hacking and over-hyping.

{.wp-image-12753 .size-large aria-describedby=“caption-attachment-12753” loading=“lazy” attachment-id=“12753” permalink=“http://svpow.com/2016/01/20/notocolossus-is-a-beast/notocolossus-skeletal-recon-gonzalez-riga-et-al-2016-fig-1/” orig-file=“https://svpow.wordpress.com/wp-content/uploads/2016/01/notocolossus-skeletal-recon-gonzalez-riga-et-al-2016-fig-1.jpg” orig-size=“926,484” comments-opened=“1”

I was a bit disappointed to hear David Attenborough on BBC Radio 4 this morning, while trailing a forthcoming documentary, telling the interviewing that you can determine the mass of an extinct animal by measuring the circumference of its femur.

A short one today, and a sad one. I heard last night on Twitter that Jack McIntosh has died at the age of 92. It would be hard to overstate what an inspiration he’s been to me. As a professional in a non-palaeo field who went on to do crucial work in sauropod palaeontology, he blazed a trail that I have tried in my small way to follow.

I got back on Tuesday from OpenCon 2015 — the most astonishing conference on open scholarship. Logistically, it works very different from most conferences: students have their expenses paid, but established scholars have to pay a registration fee and cover their own expenses. That inversion of how things are usually done captures much of what’s unique about OpenCon: its focus on the next generation is laser-sharp.

{.aligncenter .size-full .wp-image-12706 loading=“lazy” attachment-id=“12706” permalink=“http://svpow.com/2015/11/14/mydd-opencon-edition/ctubqnnwcaekdwi/” orig-file=“https://svpow.wordpress.com/wp-content/uploads/2015/11/ctubqnnwcaekdwi.jpg” orig-size=“1024,768” comments-opened=“1”

{.wp-image-12701 .size-large aria-describedby=“caption-attachment-12701” loading=“lazy” attachment-id=“12701” permalink=“http://svpow.com/2015/11/10/the-central-irony-of-life-in-academia/tornado-debris/” orig-file=“https://svpow.wordpress.com/wp-content/uploads/2015/11/tornado-debris.jpg” orig-size=“1920,1080” comments-opened=“1”