Logo del repository
  1. Home
 
Opzioni

A Statistical Model to Investigate the Reproducibility Rate Based on Replication Experiments

Pauli, Francesco
2018
  • journal article

Periodico
INTERNATIONAL STATISTICAL REVIEW
Abstract
The reproducibility crisis, that is, the fact that many scientific results are difficult to replicate, pointing to their unreliability or falsehood, is a hot topic in the recent scientific literature, and statistical methodologies, testing procedures and p‐values, in particular, are at the centre of the debate. Assessment of the extent of the problem–the reproducibility rate or the false discovery rate–and the role of contributing factors are still an open problem. Replication experiments, that is, systematic replications of existing results, may offer relevant information on these issues. We propose a statistical model to deal with such information, in particular to estimate the reproducibility rate and the effect of some study characteristics on its reliability. We analyse data from a recent replication experiment in psychology finding a reproducibility rate broadly coherent with other assessments from the same experiment. Our results also confirm the expected role of some contributing factor (unexpectedness of the result and room for bias) while they suggest that the similarity between original study and the replica is not so relevant, thus mitigating some criticism directed to replication experiments.
DOI
10.1111/insr.12273
WOS
WOS:000468039600004
Archivio
http://hdl.handle.net/11368/2928499
info:eu-repo/semantics/altIdentifier/scopus/2-s2.0-85063959155
https://onlinelibrary.wiley.com/doi/full/10.1111/insr.12273
Diritti
open access
license:copyright editore
license:digital rights management non definito
FVG url
https://arts.units.it/request-item?handle=11368/2928499
Soggetti
  • p-value

  • false discovery rate

  • reproducibility crisi...

  • mixture model

Web of Science© citazioni
2
Data di acquisizione
Mar 28, 2024
google-scholar
Get Involved!
  • Source Code
  • Documentation
  • Slack Channel
Make it your own

DSpace-CRIS can be extensively configured to meet your needs. Decide which information need to be collected and available with fine-grained security. Start updating the theme to match your nstitution's web identity.

Need professional help?

The original creators of DSpace-CRIS at 4Science can take your project to the next level, get in touch!

Realizzato con Software DSpace-CRIS - Estensione mantenuta e ottimizzata da 4Science

  • Impostazioni dei cookie
  • Informativa sulla privacy
  • Accordo con l'utente finale
  • Invia il tuo Feedback