The resources in this section have been suggested to us by readers and people in our networks. They cover broader concepts of open research and publishing, as well as articles and books on methodologies and points of debate. We cannot vouch for their quality but we hope that they offer a relevant mix of insights to support your understanding of the issues surrounding the use of administrative data for research.
Please send us your suggestions for additional resources using the suggestion box at the end of the page.
Introducing open research
Spellman, Gilbert & Corkers (2017). Open Science: What, Why, and How https://psyarxiv.com/ak6jr
Felix Schonbrot. An introduction to Open Science: Doing transparent, credible and efficient research https://osf.io/vza25/
Chiarelli, A., Loffreda, L. & Johnson, R. (2021). The Art of Publishing Reproducible Research Outputs: Supporting emerging practices through cultural and technological innovation. Zenodo. https://doi.org/10.5281/zenodo.5521077
Open research multiverse: https://osf.io/9cv68/
Intro to Open Science (JDI UCL): https://github.com/jdiopen/jdiopen.github.io/blob/master/introduction_slides.pptx
FORRT Framework for Open and Reproducible Research Training: https://forrt.org/
OSF Open Research toolkit https://osf.io/a4ftw/
JDI Open resources: https://jdiopen.github.io/
Open research policy
UKRI: https://www.ukri.org/our-work/supporting-healthy-research-and-innovation-culture/open-research/
Wellcome open research policy: https://wellcome.org/what-we-do/our-work/open-research
European Commission: https://ec.europa.eu/info/research-and-innovation/strategy/strategy-2020-2024/our-digital-future/open-science_en
DORA: https://sfdora.org/
Leiden Manifesto: http://www.leidenmanifesto.org/
IRUS-UK: https://www.jisc.ac.uk/irus
Sorbonne Declaration: https://www.leru.org/files/Sorbonne-declaration.pdf
UCL research transparency policy: https://www.ucl.ac.uk/research/strategy-and-policy/research-transparency
Open research networks
UK Reproducibility Network: https://www.ukrn.org/
repliCATS: https://replicats.research.unimelb.edu.au/
Open research podcasts/audio
Everything Hertz podcast: https://everythinghertz.com/
The Black Goat podcast: https://www.theblackgoatpodcast.com/
Two Psychologists, Four Beers podcast: www.fourbeers.com/
ReproducibiliTea: https://reproducibilitea.org/about/
Open Science Talk podcast: https://septentrio.uit.no/index.php/OSTalk/issue/archive
Paul Meehl philosophy of science talks: https://www.youtube.com/watch?v=AEPbzCTneDs
Pre-registration
What is pre-registration: https://www.cos.io/initiatives/prereg
Open Science Framework: http://osf.io/
AsPredicted pre-registration platform: https://aspredicted.org/
Introduction to Registered Reports: https://www.cos.io/initiatives/registered-reports
Journals offering registered reports: https://www.cos.io/initiatives/registered-reports
Secondary data analysis pre-registration: https://osf.io/x4gzt/
Baldwin, J.R., Pingault, JB., Schoeler, T. et al. Protecting against researcher bias in secondary data analysis: challenges and potential solutions. Eur J Epidemiol (2022). https://doi.org/10.1007/s10654-021-00839-0
Pre-prints
Moshontz H, Binion G, Walton H, Brown BT, Syed M. A Guide to Posting and Managing Preprints. Advances in Methods and Practices in Psychological Science. April 2021. https://journals.sagepub.com/doi/10.1177/25152459211019948
Understanding preprints: https://blogs.ucl.ac.uk/open-access/2020/04/29/preprints/
UKRN primer on pre-prints: https://www.ukrn.org/primers/
A guide to pre-prints and https://asapbio.org/preprint-open-with-purpose
https://elifesciences.org/articles/52646
Wiley pre-print policy: https://authorservices.wiley.com/author-resources/Journal-Authors/open-access/preprints-policy.html
Elsevier pre-print policy: https://www.elsevier.com/about/policies/sharing
Open statistical software
JASP: jasp-stats.org/
JAMOVI: https://www.jamovi.org/
Python: https://www.python.org/
GPower: https://www.psychologie.hhu.de/arbeitsgruppen/allgemeine-psychologie-und-arbeitspsychologie/gpower
Web-based power calculations (runs R through browser): https://rdrr.io/snippets/
Github: https://github.com/
Open data storage
6 repositories to share your research data https://www.teamscopeapp.com/blog/6-repositories-to-share-your-research-data
Open Data Repository: https://www.opendatarepository.org/
Zenodo: https://zenodo.org/
Figshare: https://figshare.com/
GitHub: https://github.com/
Research validity
Chambers, C. (2019). The 7 deadly sins of psychology. Princeton University Press https://press.princeton.edu/books/paperback/9780691192277/the-seven-deadly-sins-of-psychology
Field Sarahanne M., Wagenmakers E.-J., Kiers Henk A. L., Hoekstra Rink, Ernst Anja F. and van Ravenzwaaij Don (2020). The effect of preregistration on trust in empirical research findings: results of a registered report. R. Soc. open sci.7181351181351
http://doi.org/10.1098/rsos.181351
Ioannidis, J.P.A. (2005). Why Most Published Research Findings Are False. PLoS Med 2(8): e124. https://doi.org/10.1371/journal.pmed.0020124
John, L. K., Loewenstein, G., & Prelec, D. (2012). Measuring the Prevalence of Questionable Research Practices With Incentives for Truth Telling. Psychological Science, 23(5), 524–532. https://doi.org/10.1177/0956797611430953
Nosek, B.A. & Bar-Anan, Y. (2012) Scientific Utopia: I. Opening Scientific Communication, Psychological Inquiry, 23:3, 217-243, DOI: 10.1080/1047840X.2012.692215 https://www.tandfonline.com/doi/abs/10.1080/1047840X.2012.692215?journalCode=hpli20
Nosek, B. A., Spies, J. R., & Motyl, M. (2012). Scientific Utopia: II. Restructuring Incentives and Practices to Promote Truth Over Publishability. Perspectives on Psychological Science, 7(6), 615–631. https://doi.org/10.1177/1745691612459058
Ritchie, S. (2020). Science Fictions. Penguin https://www.penguin.co.uk/books/111/1117290/science-fictions/9781529110647.html
Simmons, J. P., Nelson, L. D., & Simonsohn, U. (2011). False-Positive Psychology: Undisclosed Flexibility in Data Collection and Analysis Allows Presenting Anything as Significant. Psychological Science, 22(11), 1359–1366. https://doi.org/10.1177/0956797611417632
Sumner P, Vivian-Griffiths S, Boivin J, Williams A, Venetis C A, Davies A et al. The association between exaggeration in health related science news and academic press releases: retrospective observational study BMJ 2014; 349 :g7015 doi:10.1136/bmj.g7015 https://www.bmj.com/content/349/bmj.g7015
Developing an open science culture
Nosek et al (2015). Promoting an Open Research Culture. Science. 348(6242), 1422–1425. https://www.science.org/doi/abs/10.1126/science.aab2374
Schwab, S., Janiaud, P., Dayan, M., Amrhein, V., Panczak, R., Palagi, P. M., et al. (2021). Ten Simple rules in good research practice for early career researchers. https://doi.org/10.31219/osf.io/am5ck
Parsons, S., Azevedo, F., Elsherif, M.M. et al. A community-sourced glossary of open scholarship terms. Nat Hum Behav (2022). https://doi.org/10.1038/s41562-021-01269-4 https://www.nature.com/articles/s41562-021-01269-4
Popular media and the open research/open science movement
Desperately Seeking (Statistical) Significance. Scholarly Kitchen. https://scholarlykitchen.sspnet.org/2022/06/15/desperately-seeking-statistical-significance/
'Exaggerations' threaten public trust in science, says leading statistician https://www.theguardian.com/science/2017/jun/28/exaggerations-threaten-public-trust-in-science-leading-statistician-david-spiegelhalter
Science has been in a “replication crisis” for a decade. Have we learned anything? https://www.vox.com/future-perfect/21504366/science-replication-crisis-peer-review-statistics
House of Commons Science and Technology Committee Oral evidence: Reproducibility and Research Integrity, HC 606: https://committees.parliament.uk/oralevidence/3142/html/, 1st December 2021.