Bio

I am a Postdoctoral Scholar at Stanford University, based in the Meta-Research Innovation Center at Stanford. I retain a guest affiliation with the Department of Ethics, Governance, and Society at Vrije Universiteit Amsterdam, where I received my PhD in Economics and Business Administration cum laude. I am also a Fellow of the Institute for Replication.

Stanford Advisors

Additional Info

Links

Current Research and Scholarly Interests

I work on issues in applied econometrics, replication, and metascience, and I am dedicated to improving methods in scientific research. My research can broadly be categorized as follows:

Replication-based methods research

I work to evidence the importance of methodological improvements through re-analyzing the replication data of large numbers of published articles that use similar methods. My job market paper evidences the importance of equivalence testing in 81 articles that advertise null results, my paper on log-like specifications re-analyzes 46 articles that use such specifications, and my paper on manipulation tests in regression discontinuity design re-analyzes 36 published articles using such designs.

Equivalence testing and practical significance testing

My job market paper introduces methods that can provide statistically significant evidence that economic relationships are practically equal to zero. In their absence, error rates in top economics journals are quite high. I’ve also employed these tests in empirical applications, such as my article in Journal of Business Ethics, and in extended methodological applications, such as in my tutorial on three-sided testing.

Robustness tests for causal inference

I work on methods for testing critical assumptions in causal designs, including manipulation tests in regression discontinuity design and hypothetical bias experiments

Replication

I have reproduced over 140 papers throughout my PhD, and I have published replication work in Nature Human Behaviour, Journal of Political Economy: Microeconomics, and two times in the Proceedings of the National Academy of Sciences. I have several comments under invited (re)submission concerning publications in American Economic Journal: Applied Economics and Management Science.

All Publications

  • AI-assisted teams outperform AI-led teams but not human-only teams in assessing research reproducibility in quantitative social science. Proceedings of the National Academy of Sciences of the United States of America Brodeur, A., Valenta, D., Marcoci, A., Aparicio, J. P., Mikola, D., Barbarioli, B., Alexander, R., Deer, L., Stafford, T., Vilhuber, L., Bensch, G., Motoki, F., Abdelhady, M., Abdelmoula, Y., Baki, G. A., Aguirre, T., Aiyer, S., Akhtar, S., Akhtar, F., Albada, M. R., Altman, M., Angenendt, D., Arjmandi Lari, Z., De León Tejada, J. A., Arana, D. R., Asanov, I., Noha, A. M., Ashong, R., Auer, T., Bahamonde-Birke, F. J., Baker, B. J., Bartram, S. M., Bao, D., Batinovic, L., Batistoni, T., Beeder, M., Beland, L. P., Gero Bienz, C., Aryanto, C. B., Bolibaugh, C., Bonander, C., Bravo, R., Bronnikov, E., Bruns, S., Buliskeria, N., Caicedo-Silva, S., Calef, A., Sebastian Cano Arias, J., A Castillo Alvarez, G., Caulker, S., Cepenas, S., Chatton, A., Chen, Z., Chioma Ewurum, N., Ciocîrlan, A. B., Clouth, F. J., Collins, J., Cook, N., Cornejo, C., Craveiro, J., Créchet, J., Cui, J., Chalil Vayalabron, N., Czymara, C., Bermúdez Jaramillo, C. D., Datta, H., Denoo, L., Dhaliwal, A., Dhameja, N., Djemai, E., Dujeancourt, E., Dündar, U., Duprey, T., Eissa, Y., El Fassi, Y., El Fassi, I., Ellis, K., Elminejad, A., Elsherif, M., Emirmahmutoglu, A., Etingin-Frati, G., Eze, E., Dollbaum, J. F., Feld, J., Felipe Rengifo Jaramillo, A., Fenig, G., Fernandes, V., Fiala, L., Fink, L., Firouzjaeiangalougah, M., Fish, S., Fitzgerald, J., Forshaw, R., Fortier-Chouinard, A., Fréget, L., Frese, J., Gabani, J., Gallegos, S., Gamill, M. C., Gáspár, A., Gauriot, R., Gavrilova, E., Geraldes, D., Cantone, G. G., Gibson, G., Goldschmitt, D., Gourdon-Kanhukamwe, A., Gregor de Varda, A., Grigoryeva, I., Gugushvili, A., Fletcher, A. H., Habermann, F., Hablicsek, M., Haddad, J., Hall, J. D., Hammar, O., Hassouneh, M., Hausladen, C. I., Hendrikse, S. C., Hepplewhite, M., Ho, A. T., Hogan-Hennessy, S., Howley, E., Huang, G., Hulstaert, H., Ilchovska, Z. G., Jaimes Santamaria, P., Jakobsson, N., Jansson, J., Jarosz, E., Jebeli, H., Jiang, Y., Junaid, H., Kalluraya, R., Karim, S., Kelly, E., Kimel, E., Kingsuwankul, S., Klotzbücher, V., Krähmer, D., Krūminas, P., Kruus, N., Kujansuu, E., Kurz, C. F., Küster, S., Lee-Whiting, B., Lewandowski, F., Li, T., Li, R., Liu, D., Liu, J., Lo, H., Loter, K., Macedo Dias, F., Madan, C. R., Mäder, N., Mandas, M., Mantilla, C., Marcus, J., Marino Fages, D., Martin, X., McWay, R., Medina-Gaspar, D., Meng, S., Meng, L., Merz, S., Miller, A. P., Mirabel, T., Mishra, D. D., Mishra, S., Moges, B. W., Mohandes Mojarrad, M., Mohnen, M., Morin, L. P., Muehlenbachs, L., Mullin, G., Musulan, A., Muzzì, S., Myers, J. A., Neubauer, F., Nguyen, T., Niazi, A., Nordstrom, A., Nowak, B., O'Habib, D., Ölkers, T., Ong, J., Orozco Castiblanco, V., Özak, Ö., Ozkes, A. I., Paaso, M., Pandey, S., Papazoglou, V., Penheiro, R., Pham, L., Phieler, U., Pütz, P., Qi, Q., Qiu, J., Rein, M. T., Reinstein, D. A., Repo, J., Rudolf, N., Saha, S., Saka, O., Saponaro, C., Sator, G., Schoenmakers, M., Seri, R., Shah, M., Sibille, P., Siemroth, C., Skavysh, V., Slater, B., Song, W., Staubli, S., Steindl, T., Waongo, N. S., Stott, P., Strobel, S., Sudhaharan, R., Sun, P., Swain, S. D., Talavera, O., Tantiangco, H. M., Tarasenko, G., Tarlinton, B., Tarraf, M., Teoh, K., Thériault, R., Thompson, B., Tian, T., Tian, W., Tolani, E., Borgen, N., Topstad Borgen, S., Torralba, J., Velez-Ospina, C., Mak, M. W., Wallrich, L., Wang, Z., Ward, L., Webb, M. D., Webb, D., Weber, B. S., Weber, C., Weng, W. C., Westheide, C., Wilkinson, T., Wong, K. Y., Wroński, M., Wu, Z., Wu, Q., Wu, V. Y., Xiao, B., Xu, F., Xu, C., Yadav, P., Yang Chou, Y., Yap, L., Yazbeck, M., Yao, B., Zagrodzka, Z., Zahra, T., Zaneva, M., Zhang, X., Zhao, Z., Zhong, H., Zirgulis, A., Zou, J., Zoutman, F., Zozoungbo, C. 2026; 123 (22): e2524747123

    Abstract

    Large Language Models (LLMs) such as ChatGPT are transforming how scientists conduct and validate research, offering promise as tools to improve scientific reproducibility. However, computational reproducibility and error detection remain expensive and labor-intensive. We experimentally test how collaboration between researchers and LLM assistants influences the reproduction of quantitative social science findings across different levels of AI autonomy. We randomly assigned 288 researchers to 103 teams working under three conditions: human-only, AI-assisted (using ChatGPT as a collaborative tool), or AI-led (ChatGPT operating with minimal human oversight). Teams reproduced published results from leading social science journals, detected coding errors, and proposed robustness checks. Human-only and AI-assisted teams achieved comparable reproduction rates (94% vs. 91%) and performed similarly on most outcomes, except human-only teams identified significantly more major coding errors. Both substantially outperformed AI-led teams, which achieved only a 37% reproduction rate, detected fewer errors across all categories, proposed weaker robustness checks, and required more time. This autonomous approach, however, likely represents only a lower bound of AI capabilities. Despite rapid model advances, expert human judgment currently remains indispensable for reliable empirical verification. While AI assistance did not degrade most outcomes, it provided no measurable advantages and was associated with reduced detection of major errors. However, the 37% autonomous reproduction rate indicates that AI could provide value in settings where scale or cost constraints preclude human review of papers, even though general-purpose LLMs offer no immediate advantages for human-supervised verification.

    View details for DOI 10.1073/pnas.2524747123

    View details for PubMedID 42207915

  • AI-assisted teams outperform AI-led teams but not human-only teams in assessing research reproducibility in quantitative social science PROCEEDINGS OF THE NATIONAL ACADEMY OF SCIENCES OF THE UNITED STATES OF AMERICA Brodeur, A., Valenta, D., Marcoci, A., Aparicio, J. P., Mikola, D., Barbarioli, B., Alexander, R., Deer, L., Stafford, T., Vilhuber, L., Bensch, G., Motoki, F., Abdelhady, M., Abdelmoula, Y., Baki, G., Aguirre, T., Aiyer, S., Akhtar, S., Akhtar, F., Albada, M. R., Altman, M., Angenendt, D., Lari, Z., Tejada, J., Arana, D., Asanov, I., Noha, A., Ashong, R., Auer, T., Bahamonde-Birke, F. J., Baker, B. J., Bartram, S. M., Bao, D., Batinovic, L., Batistoni, T., Beeder, M., Beland, L., Bienz, C., Aryanto, C., Bolibaugh, C., Bonander, C., Bravo, R., Bronnikov, E., Bruns, S., Buliskeria, N., Caicedo-Silva, S., Calef, A., Arias, J., Alvarez, G., Caulker, S., Cepenas, S., Chatton, A., Chen, Z., Ewurum, N., Ciocirlan, A., Clouth, F. J., Collins, J., Cook, N., Cornejo, C., Craveiro, J., Crechet, J., Cu, J., Vayalabron, N., Czymara, C., Jaramillo, C., Datta, H., Denoo, L., Dhaliwal, A., Dhameja, N., Djemai, E., Dujeancourt, E., Dundar, U., Duprey, T., Eissa, Y., El Fassi, Y., El Fassi, I., Ellis, K., Elminejad, A., Elsherif, M., Emirmahmutoglu, A., Etingin-Frati, G., Eze, E., Dollbaum, J., Feld, J., Jaramillo, A., Fenig, G., Fernandes, V., Fiala, L., Fink, L., Firouzjaeiangalougah, M., Fish, S., Fitzgerald, J., Forshaw, R., Fortier-Chouinard, A., Freget, L., Frese, J., Gabani, J., Gallegos, S., Gamill, M. C., Gaspar, A., Gauriot, R., Gavrilova, E., Geraldes, D., Cantone, G., Gibson, G., Goldschmitt, D., Gourdon-Kanhukamwe, A., de Varda, A., Grigoryeva, I., Gugushvili, A., Fletcher, A. H. A., Habermann, F., Hablicsek, M., Haddad, J., Hall, J. D., Hammar, O., Hassouneh, M., Hausladen, C. I., Hendrikse, S. C. F., Hepplewhite, M., Ho, A. T. Y., Hogan-Hennessy, S., Howley, E., Huang, G., Hulstaert, H., Ilchovska, Z. G., Santamaria, P., Jakobsson, N., Jansson, J., Jarosz, E., Jebeli, H., Jiang, Y., Junaid, H., Kalluraya, R., Karim, S., Kelly, E., Kimel, E., Kingsuwankul, S., Klotzbucher, V., Krahmer, D., Kruminas, P., Kruus, N., Kujansuu, E., Kurz, C. F., Kuster, S., Lee-Whiting, B., Lewandowski, F., Li, T., Li, R., Liu, D., Liu, J., Lo, H., Loter, K., Dias, F., Madan, C. R., Mader, N., Mandas, M., Mantilla, C., Marcus, J., Fages, D., Martin, X., McWay, R., Medina-Gaspar, D., Meng, S., Meng, L., Merz, S., Miller, A. P., Mirabel, T., Mishra, D., Mishra, S., Moges, B. W., Mojarrad, M., Mohnen, M., Morin, L., Muehlenbach, L., Mullin, G., Musulan, A., Muzzi, S., Myers, J. A. C., Neubauer, F., Nguyen, T., Niazi, A., Nordstrom, A., Nowak, B., O'Habib, D., Olkers, T., Ong, J., Castiblanco, V., Ozak, O., Ozkes, A. I., Paaso, M., Pandey, S., Papazoglou, V., Penheiro, R., Pham, L., Phieler, U., Putz, P., Qi, Q., Qiu, J., Rein, M. T., Reinstein, D. A., Repo, J., Rudolf, N., Saha, S., Saka, O., Saponaro, C., Sator, G., Schoenmakers, M., Seri, R., Shah, M., Sibille, P., Siemroth, C., Skavysh, V., Slater, B., Song, W., Staubli, S., Steindl, T., Waongo, N., Stott, P., Strobel, S., Sudhaharan, R., Sun, P., Swain, S. D., Talavera, O., Tantiangco, H. M., Tarasenko, G., Tarlinto, B., Tarraf, M., Teoh, K., Theriault, R., Thompson, B., Tian, T., Tian, W., Tolani, E., Borgen, N., Borgen, S., Torralba, J., Velez-Ospina, C., Mak, M., Wallrich, L., Wang, Z., Ward, L., Webb, M. D., Webb, D., Weber, B. S., Weber, C., Weng, W., Westheide, C., Wilkinson, T., Wong, K., Wronski, M., Wu, Z., Wu, Q., Wu, V. Y., Xiao, B., Xu, F., Xu, C., Yadav, P., Chou, Y., Yap, L., Yazbeck, M., Yao, B., Zagrodzka, Z., Zahra, T., Zaneva, M., Zhang, X., Zhao, Z., Zhong, H., Zirgulis, A., Zou, J., Zoutman, F., Zozoungbo, C. 2026; 123 (22)

    View details for Web of Science ID 001821087300001

  • Three-Sided Testing to Establish Practical Significance: A Tutorial ADVANCES IN METHODS AND PRACTICES IN PSYCHOLOGICAL SCIENCE Isager, P., Fitzgerald, J. 2026; 9 (2)

    View details for DOI 10.1177/25152459251412435

    View details for Web of Science ID 001751066400001

  • Revisiting the cognitive advantages of professional soccer players PROCEEDINGS OF THE NATIONAL ACADEMY OF SCIENCES OF THE UNITED STATES OF AMERICA Fitzgerald, J., Jakobsson, N., Brodeur, A. 2026; 123 (8): e2515523123

    View details for DOI 10.1073/pnas.2515523123

    View details for Web of Science ID 001728252500001

    View details for PubMedID 41706893

    View details for PubMedCentralID PMC12933045

  • Imputations, inverse hyperbolic sines and impossible values NATURE HUMAN BEHAVIOUR Fitzgerald, J. 2026; 10 (2): 239-242

    View details for DOI 10.1038/s41562-025-02347-7

    View details for Web of Science ID 001656594800001

    View details for PubMedID 41507633

  • Identifying the impact of hypothetical stakes on experimental outcomes and treatment effects EXPERIMENTAL ECONOMICS Fitzgerald, J. 2026

    View details for DOI 10.1017/eec.2025.10035

    View details for Web of Science ID 001654662100001

  • US states that mandated COVID-19 vaccination see higher, not lower, take-up of COVID-19 boosters and flu vaccines PROCEEDINGS OF THE NATIONAL ACADEMY OF SCIENCES OF THE UNITED STATES OF AMERICA Fitzgerald, J. 2024; 121 (41): e2403758121

    View details for DOI 10.1073/pnas.2403758121

    View details for Web of Science ID 001408433200004

    View details for PubMedID 39348537

    View details for PubMedCentralID PMC11474055

  • Is There a Foreign Language Effect on Workplace Bribery Susceptibility? Evidence from a Randomized Controlled Vignette Experiment JOURNAL OF BUSINESS ETHICS Fitzgerald, J., Stroet, P., Weissmueller, K. S., van Witteloostuijn, A. 2025; 197 (1): 73-97

    View details for DOI 10.1007/s10551-024-05731-x

    View details for Web of Science ID 001246394400002

https://orcid.org/0000-0002-0322-5104