Skip to 0 minutes and 2 seconds A couple of other points, that I think are useful as we think about the spread of these ideas, or making them more attractive or encouraging people to use new tools. Convincing people that the tools are useful to them seems to be a really important incentive. And again, there are different ways to frame, say, writing up a pre-analysis plan. One way to frame it is, “God, it’s this really awful thing you have to do before you write a paper,” and it’s this burden. The other way is, “Hey, it makes your research better.” To think through the design before you actually launch the study.
Skip to 0 minutes and 32 seconds You’re going to find mistakes, you’re gonna improve what you’re doing and you’re going to be more likely to get published. So, to the extent that researchers understand, if it’s true, understand that you can do better research with these methods, that’s going to be a very powerful incentive to adopt them And again, the other thing that’s going to encourage the spread of new tools, is gonna be training the next generation. Really, you know, having these tools disseminate widely. Encourage people to think about them and use them.
Skip to 1 minute and 3 seconds If you don’t have as much at stake, if you don’t have a whole lifetime worth of research that was carried out with methods that may not be as credible, you know why not use the most credible approaches. I think it’s going to be insiders who have built up a lot of work in an area that are going to resist change the most. That’s what Kuhn would say, that’s totally logical. There’s sort of a clean slate with new scholars. You know, these transparency methods, registration, pre-analysis plans, data sharing, all these things could become adopted very quickly. You know in labor economics and development economics, in 5 or 10 years, there was a huge shift in the nature of research.
Skip to 1 minute and 39 seconds So the same thing could happen. It could be that in a relatively short amount of time these approaches are widely used, but again, there could be divergence. And I think, I had to put money on what’s going to happen, it may look something like this. There may be subgroups of scholars and political science psychology and economics. Subfields where the methods take off and others where they don’t for a while. Maybe, eventually, they’ll spread everywhere.
How to spread transparency
In our final video, I discuss what we can do as scientists, publishers, and policymakers to encourage the spread of research transparency principles. Researchers must be convinced that the tools available to them, such as pre-analysis plans and data repositories, are useful, rather than a burden. In this video, I discuss what I believe to be the research community’s likely trajectory.
We hope you’ve gained a good understanding of the importance of research transparency, as well as knowledge of some tools you can use to improve your own research and workflow. But our work isn’t done yet. If you’ve enjoyed this course, join the movement for research transparency! At the bottom of this page, you can find a downloadable Research Transparency Action Plan. In it, are actionable steps you can take to make your research more transparent and reproducible right now!
Also, check out the BITSS website. In addition to a Manual of Best Practices, you’ll also find a wealth of other publicly available research transparency resources, information about grant competitions, and research transparency workshops we coordinate at BITSS, as well as our blog, which features posts from leaders in the open science movement. You can also follow us on Twitter @UCBITSS.
You’ll also find links to BITSS-funded meta-science research projects and working papers under the Social Science Meta-Analysis and Research Transparency (SSMART Grants) tab. These projects (i) develop new methods for open science, (ii) produce new meta-analyses, or (iii) examine research culture and the adoption of new methods.
Many SSMART project working papers and reports are currently published on BITSS Preprints, hosted by the Center for Open Science. BITSS Preprints is an interdisciplinary archive of articles focused on improving research transparency and reproducibility. BITSS Preprints is just one of dozens of different open access preprint services. Most focus on specific disciplines like psychology (PsyArxiv or sociology (SocArxiv), but many, like BITSS Preprints, are interdisciplinary. Though the foundational Arxiv – originally for physics and math – is over 20 years old, preprints are revolutionizing the way scientists publish, access, and review scientific literature.
Also, stay tuned for a textbook on research transparency written by Garret, Jeremy Freese, and me, to be published later this year by the University of California Press. It won’t be open access, but we are working to keep prices as low as possible (in the $5-10 range).
Finally, please take a 10-minute post-course survey so that we, and our partners at FutureLearn can continue to improve our course and the platform.
Thank you for participating in this course. We hope this isn’t the last we see of you! Onward and open!
Get extra benefits, upgrade your course
You can now get extra benefits by upgrading this course, including:
Unlimited access to the course: Go at your own pace with unlimited access to the course for as long as it exists on FutureLearn.
A Certificate of Achievement: To help you demonstrate your learning we’ll send you a Certificate of Achievement when you become eligible.
© Center for Effective Global Action