Reproducibility Rounds
Reproducibility Rounds are a new international bi-monthly webinar designed to foster open dialogue and exchange of experiences between institutions, researchers, and other stakeholders on the critical topics of research rigor and reproducibility.
Rounds are organized by the Stanford School of Medicine’s Program on Research Rigor & Reproducibility (SPORR), in collaboration with Columbia, Duke, Harvard, and Indiana, and occur every third Tuesday of the month.
If you have suggestions for a topic that should be covered in the Rounds, or would like to present, please contact us.
Additionally, if you would like to informed about upcoming rounds and SPORR activities, sign up for our Newsletter.
Next Rounds November 18
Registration link
Title: How Reproducible is Health Science Research?
Speakers:
Niklas Bobrovitz, MD, MSc, DPhil is a third-year emergency medicine resident in the FRCPC program and a research associate in the Centre for Health Informatics at the University of Calgary.
Stephana Moss, MSc, PhD, is an assistant professor and research chair in community-based research and health equity as well as the director of research in medicine in department of pediatrics at Dalhousie University.
Abstract: We will discuss the methods, results, and implications of a series of scoping and systematic reviews that synthesized evidence on the reproducibility of health sciences research. Specific aims of the projects included describing and categorizing methods and metrics used to quantify reproducibility, synthesizing estimates of the prevalence of reproducible research, and characterizing factors associated with reproducibility. We will describe our dataset of 1,340 articles with a focus on the sub-set with empirical data. We will report on the seven methods used for conducting reproducibility research, 38 metrics to quantify reproducibility, 180 estimates of the prevalence of reproducibility, and 234 factors associated with reproducibility which we grouped into modifiable and non-modifiable categories. Finally, we will discuss the significant heterogeneity in the evidence and challenges in synthesizing this data.
Previous Rounds:
2025:
September 16: Prof. Nichole E. Carlson, MD, PhD: Non-Reproducibility of Real-World Data Research: A Case Study (Video Recording).
May 20: Prof. Olavo Amaral, MD, PhD: Estimating Replicability of Lab Biology Research at a National Level: Results and Lessons from the Brazilian Reproducibility Initiative (Video Recording). Slides
March 18: Naomi Schrag and Roger Lefrot: Rigor and Reproducibility Efforts at Columbia University (ReaDI): Successes and Challenges (Video Recording)
February 18: Nafisa Jadavji, Susan McClatchy, Hao Ye, Flavio Azevedo: Reproducibility Training Initiatives. (Video Recording)
January 21: Timothy M. Errington: Replicating 193 Preclinical Cancer Biology Experiments: Lessons, Surprises, and Future Directions (Video Recording)
2024:
November 19: Leah J. Welty and Manisha Desai: How to Improve Reproducibility of Team Science: A CTSA BERD*s Eye View (Video Recording)
October 22: Shai Silberberg and Devon Crawford: Why Talk (and What to Do) About Research Quality? A Perspective from Within the NIH. (Video recording)
2023:
SPORR organized two webinars primarily aimed for the researchers of Stanford School of Medicine:
May 31: Ivan Oransky (Co-Founder of Retraction Watch) - How Bibliometrics & School Rankings Reward Unreliable Science and What Can Be Done About It. (Video Recording). This talk was turned into an opinion piece published in the BMJ journal on 17 August 2023.
Apr 12: Michael Eisen presented Changes at eLife.