Developing Metrics Literacies: Competencies, dispositions, and knowledge for the critical assessment and ethical use of scholarly metrics

Authors Maddie Hare, Heather Woods, Isabelle Dorsch, Carey Ming-Li Chen, and Stefanie Haustein, discuss their groundbreaking work on the Metrics Literacies Project. The Metrics Literacies project is informed by this concept: 'an integrated set of competencies, dispositions and knowledge that empowers individuals to recognize, interpret, critically assess and effectively and ethically use scholarly metrics,' which is guided …

Guest Post: Implementing responsible research assessment – challenges of implementation

Part one of a three-part blog series summarizing the discussion of the ‘Implementing responsible research assessment’ panel, at the LIS-Bibliometrics 10th anniversary event: The Future of Research Evaluation in March 2020. Some of the questions put to the panel and their responses have been collected and grouped by theme. The panel comprised of Sarah Slowe …

AI-based citation evaluation tools: good, bad or ugly?

Lizzie Gadd gets all fancy talking about algorithms, machine learning and artificial intelligence. And how tools using these technologies to make evaluative judgements about publications are making her nervous. A couple of weeks ago, The Bibliomagician posted an interesting piece by Josh Nicholson introducing scite. scite is a new Artificial Intelligence (AI) enabled tool that …

Wrong question?

Lizzie Gadd argues that good research evaluation starts with good questions. The 2019 Ig Nobel Prize winners were announced in September.  Among my favourites was some research into the pleasurability of scratching an itch. Contrary to what the name suggests, winning an Ig Nobel prize is not an indictment of your research design or methods. …

Introducing SCOPE – a process for evaluating responsibly

Laura Himanen and Lizzie Gadd introduce a step-by-step process developed by the INORMS Research Evaluation Working Group for evaluating responsibly. We’ve got a shed load of principles now for responsible research metrics. We have DORA, the Leiden Manifesto and the Metric Tide. We also have the many bespoke sets of principles being developed by individual …