Teaching open and reproducible scholarship: a critical review of the evidence base for current pedagogical methods and their outcomes.
Royal Society open science
2023; 10 (5): 221255
In recent years, the scientific community has called for improvements in the credibility, robustness and reproducibility of research, characterized by increased interest and promotion of open and transparent research practices. While progress has been positive, there is a lack of consideration about how this approach can be embedded into undergraduate and postgraduate research training. Specifically, a critical overview of the literature which investigates how integrating open and reproducible science may influence student outcomes is needed. In this paper, we provide the first critical review of literature surrounding the integration of open and reproducible scholarship into teaching and learning and its associated outcomes in students. Our review highlighted how embedding open and reproducible scholarship appears to be associated with (i) students' scientific literacies (i.e. students' understanding of open research, consumption of science and the development of transferable skills); (ii) student engagement (i.e. motivation and engagement with learning, collaboration and engagement in open research) and (iii) students' attitudes towards science (i.e. trust in science and confidence in research findings). However, our review also identified a need for more robust and rigorous methods within pedagogical research, including more interventional and experimental evaluations of teaching practice. We discuss implications for teaching and learning scholarship.
View details for DOI 10.1098/rsos.221255
View details for PubMedID 37206965
View details for PubMedCentralID PMC10189598
- A Roadmap to Large-Scale Multi-Country Replications in Psychology COLLABRA-PSYCHOLOGY 2022; 8 (1)
Examining the generalizability of research findings from archival data.
Proceedings of the National Academy of Sciences of the United States of America
2022; 119 (30): e2120377119
This initiative examined systematically the extent to which a large set of archival research findings generalizes across contexts. We repeated the key analyses for 29 original strategic management effects in the same context (direct reproduction) as well as in 52 novel time periods and geographies; 45% of the reproductions returned results matching the original reports together with 55% of tests in different spans of years and 40% of tests in novel geographies. Some original findings were associated with multiple new tests. Reproducibility was the best predictor of generalizability-for the findings that proved directly reproducible, 84% emerged in other available time periods and 57% emerged in other geographies. Overall, only limited empirical evidence emerged for context sensitivity. In a forecasting survey, independent scientists were able to anticipate which effects would find support in tests in new samples.
View details for DOI 10.1073/pnas.2120377119
View details for PubMedID 35858443
View details for PubMedCentralID PMC9335312
- A many-analysts approach to the relation between religiosity and well-being RELIGION BRAIN & BEHAVIOR 2022
Strategic Mindsets and Support for Social Change: Impact Mindset Explains Support for Black Lives Matter Across Racial Groups.
Personality & social psychology bulletin
How does the self-relevance of a social movement shape individuals' engagement with it? We examined the decision-making processes that underlie support for Black Lives Matter (BLM) among Black, Hispanic, Asian, and White Americans. We find significant between-group differences in levels of support for BLM, both in terms of past behavior (Study 1) and in terms of future intentions to support the movement (Study 2). These differences notwithstanding, thinking about how one's decisions impact others - which we label impact mindset - explains support for BLM across racial groups, cross-sectionally as well as longitudinally (over 8 months later). Our findings underscore the equivalence of the impact mindset construct across racial groups and its predictive power in the context of BLM. We conclude that, although the struggle for racial justice has different meanings for different racial groups, the same mindset underlies both in-group advocacy and allyship in the context of BLM.
View details for DOI 10.1177/01461672221099710
View details for PubMedID 35751172
There is no psychology without inferential statistics.
The Behavioral and brain sciences
2022; 45: e2
Quantification has been constitutive of psychology since its inception and is core to its scientific status. The adoption of qualitative methods eschewing inferential statistics is therefore unlikely to obtain. Rather than discarding useful tools because of improper use, we recommend highlighting how inferential statistics can be more thoughtfully applied.
View details for DOI 10.1017/S0140525X2100056X
View details for PubMedID 35139976