Doctor of Philosophy, University of Oxford (2015)
Master of Arts, University Of Essex (2010)
Bachelor of Arts, Sofia University St. Kliment Ohridski (2004)
Calibrating the Scientific Ecosystem Through Meta-Research
Annual Review of Statistics and Its Application
View details for DOI 10.1146/annurev-statistics-031219-041104
Centralized scientific communities are less likely to generate replicable results.
Concerns have been expressed about the robustness of experimental findings in several areas of science, but these matters have not been evaluated at scale. Here we identify a large sample of published drug-gene interaction claims curated in the Comparative Toxicogenomics Database (for example, benzo(a)pyrene decreases expression of SLC22A3) and evaluate these claims by connecting them with high-throughput experiments from the LINCS L1000 program. Our sample included 60,159 supporting findings and 4253 opposing findings about 51,292 drug-gene interaction claims in 3363 scientific articles. We show that claims reported in a single paper replicate 19.0% (95% confidence interval [CI], 16.9-21.2%) more frequently than expected, while claims reported in multiple papers replicate 45.5% (95% CI, 21.8-74.2%) more frequently than expected. We also analyze the subsample of interactions with two or more published findings (2493 claims; 6272 supporting findings; 339 opposing findings; 1282 research articles), and show that centralized scientific communities, which use similar methods and involve shared authors who contribute to many articles, propagate less replicable claims than decentralized communities, which use more diverse methods and contain more independent teams. Our findings suggest how policies that foster decentralized collaboration will increase the robustness of scientific findings in biomedical research.
View details for DOI 10.7554/eLife.43094
View details for PubMedID 31264964
- Neither global nor local: Heterogeneous connectivity in spatial network structures of world migration SOCIAL NETWORKS 2018; 53: 4–19