AI-assisted teams outperform AI-led teams but not human-only teams in assessing research reproducibility in quantitative social science

BibTeX

@article{allodium:10.1073/pnas.2524747123,
  title = {AI-assisted teams outperform AI-led teams but not human-only teams in assessing research reproducibility in quantitative social science},
  author = {Abel Brodeur and David Valenta and Alexandru Marcoci and Juan P. Aparicio and Derek Mikola and Bruno Barbarioli and Rohan Alexander and Lachlan Deer and Tom Stafford and Lars Vilhuber and Gunther Bensch and Fabio Motoki and Mohamed Abdelhady and Yousra Abdelmoula and Ghina Abdul Baki and Tomás Aguirre and Sriraj Aiyer and Shumi Akhtar and Farida Akhtar and Melle R. Albada and Micah Altman and David Angenendt and Zahra Arjmandi Lari and Jorge Armando De León Tejada and David Rodriguez Arana and Igor Asanov and Anastasiya-Mariya Noha and Rebecca Ashong and Tobias Auer and Francisco J. Bahamonde-Birke and Bradley J. Baker and Söhnke M. Bartram and Dongqi Bao and Lucija Batinovic and Tommaso Batistoni and Monica Beeder and Louis-Philippe Beland and Carsten Gero Bienz and Christ Billy Aryanto and Cylcia Bolibaugh and Carl Bonander and Ramiro Bravo and Egor Bronnikov and Stephan Bruns and Nino Buliskeria and Sara Caicedo-Silva and Andrea Calef and Juan Sebastian Cano Arias and Gustavo A. Castillo Alvarez and Solomon Caulker and Simonas Cepenas and Arthur Chatton and Zirou Chen and Ngozi Chioma Ewurum and Anda-Bianca Ciocîrlan and Felix J. Clouth and Jason Collins and Nikolai Cook and Cesar Cornejo and João Craveiro and Jonathan Créchet and Jing Cui and Niveditha Chalil Vayalabron and Christian Czymara and Carlos Daniel Bermúdez Jaramillo and Hannes Datta and Lien Denoo and Arshia Dhaliwal and Nency Dhameja and Elodie Djemai and Erwan Dujeancourt and Uǧurcan Dündar and Thibaut Duprey and Yasmine Eissa and Youssef El Fassi and Ismail El Fassi and Keaton Ellis and Ali Elminejad and Mahmoud Elsherif and Aysil Emirmahmutoglu and Giulian Etingin-Frati and Emeka Eze and Jan Fabian Dollbaum and Jan Feld and Andres Felipe Rengifo Jaramillo and Guidon Fenig and Victoria Fernandes and Lenka Fiala and Lukas Fink and Mojtaba Firouzjaeiangalougah and Sara Fish and Jack Fitzgerald and Rachel Forshaw and Alexandre Fortier-Chouinard and Louis Fréget and Joris Frese and Jacopo Gabani and Sebastian Gallegos and Max C. Gamill and Attila Gáspár and Romain Gauriot and Evelina Gavrilova and Diogo Geraldes and Giulio Giacomo Cantone and Grant Gibson and Dirk Goldschmitt and Amélie Gourdon-Kanhukamwe and Andrea Gregor de Varda and Idaliya Grigoryeva and Alexi Gugushvili and Aaron H. A. Fletcher and Florian Habermann and Márton Hablicsek and Joanne Haddad and Jonathan D. Hall and Olle Hammar and Malek Hassouneh and Carina I. Hausladen and Sophie C. F. Hendrikse and Matthew Hepplewhite and Anson T. Y. Ho and Senan Hogan-Hennessy and Elliot Howley and Gaoyang Huang and Héloïse Hulstaert and Zlatomira G. Ilchovska and Paola Jaimes Santamaria and Niklas Jakobsson and Joakim Jansson and Ewa Jarosz and Hossein Jebeli and Yanchen Jiang and Hiba Junaid and Rohan Kalluraya and Sunny Karim and Edmund Kelly and Eva Kimel and Sorravich Kingsuwankul and Valentin Klotzbücher and Daniel Krähmer and Pijus Krūminas and Nicholas Kruus and Essi Kujansuu and Christoph F. Kurz and Stephan Küster and Blake Lee-Whiting and Felix Lewandowski and Tongzhe Li and Ruoxi Li and Dan Liu and Jiacheng Liu and Helix Lo and Katharina Loter and Felipe Macedo Dias and Christopher R. Madan and Nicolas Mäder and Marco Mandas and Cesar Mantilla and Jan Marcus and Diego Marino Fages and Xavier Martin and Ryan McWay and Daniel Medina-Gaspar and Sisi Meng and Lingyu Meng and Simon Merz and Alex P. Miller and Thibault Mirabel and Dibya Deepta Mishra and Sumit Mishra and Belay W. Moges and Morteza Mohandes Mojarrad and Myra Mohnen and Louis-Philippe Morin and Lucija Muehlenbachs and Gastón Mullin and Andreea Musulan and Sara Muzzì and James A. C. Myers and Florian Neubauer and Tuan Nguyen and Ali Niazi and Ardyn Nordstrom and Bartłomiej Nowak and Daneal O’Habib and Tim Ölkers and Justin Ong and Valeria Orozco Castiblanco and Ömer Özak and Ali I. Ozkes and Mikael Paaso and Shubham Pandey and Varvara Papazoglou and Romeo Penheiro and Linh Pham and Ulrike Phieler and Peter Pütz and Quan Qi and Jingyi Qiu and Manuel T. Rein and David A. Reinstein and Juuso Repo and Nicolas Rudolf and Shree Saha and Orkun Saka and Chiara Saponaro and Georg Sator and Martijn Schoenmakers and Raffaello Seri and Meet Shah and Paul Sibille and Christoph Siemroth and Vladimir Skavysh and Ben Slater and Wenting Song and Stefan Staubli and Tobias Steindl and Nomwendé Steven Waongo and Paul Stott and Stephenson Strobel and Roshini Sudhaharan and Pu Sun and Scott D. Swain and Oleksandr Talavera and Hanz M. Tantiangco and Georgy Tarasenko and Boyd Tarlinton and Mariam Tarraf and Ken Teoh and Rémi Thériault and Bethan Thompson and Tonghui Tian and Wenjie Tian and Emmanuel Tolani and Nicolai Borgen and Solveig Topstad Borgen and Javier Torralba and Carolina Velez-Ospina and Man Wai Mak and Lukas Wallrich and Zeyang Wang and Leah Ward and Matthew D. Webb and Duncan Webb and Bryan S. Weber and Christoph Weber and Wei-Chien Weng and Christian Westheide and Tom Wilkinson and Kwong-Yu Wong and Marcin Wroński and Zhuangchen Wu and Qixia Wu and Victor Y. Wu and Bohan Xiao and Feihong Xu and Cong Xu and Pranav Yadav and Yu Yang Chou and Luther Yap and Myra Yazbeck and Bo Yao and Zuzanna Zagrodzka and Tahreen Zahra and Mirela Zaneva and Xiaomeng Zhang and Ziwei Zhao and Han Zhong and Aras Zirgulis and Jiacheng Zou and Floris Zoutman and Christelle Zozoungbo},
  year = {2026},
  journal = {Proceedings of the National Academy of Sciences},
  doi = {10.1073/pnas.2524747123},
  url = {https://doi.org/10.1073/pnas.2524747123}
}

RIS

TY  - JOUR
TI  - AI-assisted teams outperform AI-led teams but not human-only teams in assessing research reproducibility in quantitative social science
AU  - Abel Brodeur
AU  - David Valenta
AU  - Alexandru Marcoci
AU  - Juan P. Aparicio
AU  - Derek Mikola
AU  - Bruno Barbarioli
AU  - Rohan Alexander
AU  - Lachlan Deer
AU  - Tom Stafford
AU  - Lars Vilhuber
AU  - Gunther Bensch
AU  - Fabio Motoki
AU  - Mohamed Abdelhady
AU  - Yousra Abdelmoula
AU  - Ghina Abdul Baki
AU  - Tomás Aguirre
AU  - Sriraj Aiyer
AU  - Shumi Akhtar
AU  - Farida Akhtar
AU  - Melle R. Albada
AU  - Micah Altman
AU  - David Angenendt
AU  - Zahra Arjmandi Lari
AU  - Jorge Armando De León Tejada
AU  - David Rodriguez Arana
AU  - Igor Asanov
AU  - Anastasiya-Mariya Noha
AU  - Rebecca Ashong
AU  - Tobias Auer
AU  - Francisco J. Bahamonde-Birke
AU  - Bradley J. Baker
AU  - Söhnke M. Bartram
AU  - Dongqi Bao
AU  - Lucija Batinovic
AU  - Tommaso Batistoni
AU  - Monica Beeder
AU  - Louis-Philippe Beland
AU  - Carsten Gero Bienz
AU  - Christ Billy Aryanto
AU  - Cylcia Bolibaugh
AU  - Carl Bonander
AU  - Ramiro Bravo
AU  - Egor Bronnikov
AU  - Stephan Bruns
AU  - Nino Buliskeria
AU  - Sara Caicedo-Silva
AU  - Andrea Calef
AU  - Juan Sebastian Cano Arias
AU  - Gustavo A. Castillo Alvarez
AU  - Solomon Caulker
AU  - Simonas Cepenas
AU  - Arthur Chatton
AU  - Zirou Chen
AU  - Ngozi Chioma Ewurum
AU  - Anda-Bianca Ciocîrlan
AU  - Felix J. Clouth
AU  - Jason Collins
AU  - Nikolai Cook
AU  - Cesar Cornejo
AU  - João Craveiro
AU  - Jonathan Créchet
AU  - Jing Cui
AU  - Niveditha Chalil Vayalabron
AU  - Christian Czymara
AU  - Carlos Daniel Bermúdez Jaramillo
AU  - Hannes Datta
AU  - Lien Denoo
AU  - Arshia Dhaliwal
AU  - Nency Dhameja
AU  - Elodie Djemai
AU  - Erwan Dujeancourt
AU  - Uǧurcan Dündar
AU  - Thibaut Duprey
AU  - Yasmine Eissa
AU  - Youssef El Fassi
AU  - Ismail El Fassi
AU  - Keaton Ellis
AU  - Ali Elminejad
AU  - Mahmoud Elsherif
AU  - Aysil Emirmahmutoglu
AU  - Giulian Etingin-Frati
AU  - Emeka Eze
AU  - Jan Fabian Dollbaum
AU  - Jan Feld
AU  - Andres Felipe Rengifo Jaramillo
AU  - Guidon Fenig
AU  - Victoria Fernandes
AU  - Lenka Fiala
AU  - Lukas Fink
AU  - Mojtaba Firouzjaeiangalougah
AU  - Sara Fish
AU  - Jack Fitzgerald
AU  - Rachel Forshaw
AU  - Alexandre Fortier-Chouinard
AU  - Louis Fréget
AU  - Joris Frese
AU  - Jacopo Gabani
AU  - Sebastian Gallegos
AU  - Max C. Gamill
AU  - Attila Gáspár
AU  - Romain Gauriot
AU  - Evelina Gavrilova
AU  - Diogo Geraldes
AU  - Giulio Giacomo Cantone
AU  - Grant Gibson
AU  - Dirk Goldschmitt
AU  - Amélie Gourdon-Kanhukamwe
AU  - Andrea Gregor de Varda
AU  - Idaliya Grigoryeva
AU  - Alexi Gugushvili
AU  - Aaron H. A. Fletcher
AU  - Florian Habermann
AU  - Márton Hablicsek
AU  - Joanne Haddad
AU  - Jonathan D. Hall
AU  - Olle Hammar
AU  - Malek Hassouneh
AU  - Carina I. Hausladen
AU  - Sophie C. F. Hendrikse
AU  - Matthew Hepplewhite
AU  - Anson T. Y. Ho
AU  - Senan Hogan-Hennessy
AU  - Elliot Howley
AU  - Gaoyang Huang
AU  - Héloïse Hulstaert
AU  - Zlatomira G. Ilchovska
AU  - Paola Jaimes Santamaria
AU  - Niklas Jakobsson
AU  - Joakim Jansson
AU  - Ewa Jarosz
AU  - Hossein Jebeli
AU  - Yanchen Jiang
AU  - Hiba Junaid
AU  - Rohan Kalluraya
AU  - Sunny Karim
AU  - Edmund Kelly
AU  - Eva Kimel
AU  - Sorravich Kingsuwankul
AU  - Valentin Klotzbücher
AU  - Daniel Krähmer
AU  - Pijus Krūminas
AU  - Nicholas Kruus
AU  - Essi Kujansuu
AU  - Christoph F. Kurz
AU  - Stephan Küster
AU  - Blake Lee-Whiting
AU  - Felix Lewandowski
AU  - Tongzhe Li
AU  - Ruoxi Li
AU  - Dan Liu
AU  - Jiacheng Liu
AU  - Helix Lo
AU  - Katharina Loter
AU  - Felipe Macedo Dias
AU  - Christopher R. Madan
AU  - Nicolas Mäder
AU  - Marco Mandas
AU  - Cesar Mantilla
AU  - Jan Marcus
AU  - Diego Marino Fages
AU  - Xavier Martin
AU  - Ryan McWay
AU  - Daniel Medina-Gaspar
AU  - Sisi Meng
AU  - Lingyu Meng
AU  - Simon Merz
AU  - Alex P. Miller
AU  - Thibault Mirabel
AU  - Dibya Deepta Mishra
AU  - Sumit Mishra
AU  - Belay W. Moges
AU  - Morteza Mohandes Mojarrad
AU  - Myra Mohnen
AU  - Louis-Philippe Morin
AU  - Lucija Muehlenbachs
AU  - Gastón Mullin
AU  - Andreea Musulan
AU  - Sara Muzzì
AU  - James A. C. Myers
AU  - Florian Neubauer
AU  - Tuan Nguyen
AU  - Ali Niazi
AU  - Ardyn Nordstrom
AU  - Bartłomiej Nowak
AU  - Daneal O’Habib
AU  - Tim Ölkers
AU  - Justin Ong
AU  - Valeria Orozco Castiblanco
AU  - Ömer Özak
AU  - Ali I. Ozkes
AU  - Mikael Paaso
AU  - Shubham Pandey
AU  - Varvara Papazoglou
AU  - Romeo Penheiro
AU  - Linh Pham
AU  - Ulrike Phieler
AU  - Peter Pütz
AU  - Quan Qi
AU  - Jingyi Qiu
AU  - Manuel T. Rein
AU  - David A. Reinstein
AU  - Juuso Repo
AU  - Nicolas Rudolf
AU  - Shree Saha
AU  - Orkun Saka
AU  - Chiara Saponaro
AU  - Georg Sator
AU  - Martijn Schoenmakers
AU  - Raffaello Seri
AU  - Meet Shah
AU  - Paul Sibille
AU  - Christoph Siemroth
AU  - Vladimir Skavysh
AU  - Ben Slater
AU  - Wenting Song
AU  - Stefan Staubli
AU  - Tobias Steindl
AU  - Nomwendé Steven Waongo
AU  - Paul Stott
AU  - Stephenson Strobel
AU  - Roshini Sudhaharan
AU  - Pu Sun
AU  - Scott D. Swain
AU  - Oleksandr Talavera
AU  - Hanz M. Tantiangco
AU  - Georgy Tarasenko
AU  - Boyd Tarlinton
AU  - Mariam Tarraf
AU  - Ken Teoh
AU  - Rémi Thériault
AU  - Bethan Thompson
AU  - Tonghui Tian
AU  - Wenjie Tian
AU  - Emmanuel Tolani
AU  - Nicolai Borgen
AU  - Solveig Topstad Borgen
AU  - Javier Torralba
AU  - Carolina Velez-Ospina
AU  - Man Wai Mak
AU  - Lukas Wallrich
AU  - Zeyang Wang
AU  - Leah Ward
AU  - Matthew D. Webb
AU  - Duncan Webb
AU  - Bryan S. Weber
AU  - Christoph Weber
AU  - Wei-Chien Weng
AU  - Christian Westheide
AU  - Tom Wilkinson
AU  - Kwong-Yu Wong
AU  - Marcin Wroński
AU  - Zhuangchen Wu
AU  - Qixia Wu
AU  - Victor Y. Wu
AU  - Bohan Xiao
AU  - Feihong Xu
AU  - Cong Xu
AU  - Pranav Yadav
AU  - Yu Yang Chou
AU  - Luther Yap
AU  - Myra Yazbeck
AU  - Bo Yao
AU  - Zuzanna Zagrodzka
AU  - Tahreen Zahra
AU  - Mirela Zaneva
AU  - Xiaomeng Zhang
AU  - Ziwei Zhao
AU  - Han Zhong
AU  - Aras Zirgulis
AU  - Jiacheng Zou
AU  - Floris Zoutman
AU  - Christelle Zozoungbo
PY  - 2026
JO  - Proceedings of the National Academy of Sciences
DO  - 10.1073/pnas.2524747123
UR  - https://doi.org/10.1073/pnas.2524747123
ER  - 

APA

Brodeur, A., Valenta, D., Marcoci, A., Aparicio, J. P., Mikola, D., Barbarioli, B., Alexander, R., Deer, L., Stafford, T., Vilhuber, L., Bensch, G., Motoki, F., Abdelhady, M., Abdelmoula, Y., Baki, G. A., Aguirre, T., Aiyer, S., Akhtar, S., Akhtar, F., Albada, M. R., Altman, M., Angenendt, D., Lari, Z. A., Tejada, J. A. D. L., Arana, D. R., Asanov, I., Noha, A., Ashong, R., Auer, T., Bahamonde-Birke, F. J., Baker, B. J., Bartram, S. M., Bao, D., Batinovic, L., Batistoni, T., Beeder, M., Beland, L., Bienz, C. G., Aryanto, C. B., Bolibaugh, C., Bonander, C., Bravo, R., Bronnikov, E., Bruns, S., Buliskeria, N., Caicedo-Silva, S., Calef, A., Arias, J. S. C., Alvarez, G. A. C., Caulker, S., Cepenas, S., Chatton, A., Chen, Z., Ewurum, N. C., Ciocîrlan, A., Clouth, F. J., Collins, J., Cook, N., Cornejo, C., Craveiro, J., Créchet, J., Cui, J., Vayalabron, N. C., Czymara, C., Jaramillo, C. D. B., Datta, H., Denoo, L., Dhaliwal, A., Dhameja, N., Djemai, E., Dujeancourt, E., Dündar, U., Duprey, T., Eissa, Y., Fassi, Y. E., Fassi, I. E., Ellis, K., Elminejad, A., Elsherif, M., Emirmahmutoglu, A., Etingin-Frati, G., Eze, E., Dollbaum, J. F., Feld, J., Jaramillo, A. F. R., Fenig, G., Fernandes, V., Fiala, L., Fink, L., Firouzjaeiangalougah, M., Fish, S., Fitzgerald, J., Forshaw, R., Fortier-Chouinard, A., Fréget, L., Frese, J., Gabani, J., Gallegos, S., Gamill, M. C., Gáspár, A., Gauriot, R., Gavrilova, E., Geraldes, D., Cantone, G. G., Gibson, G., Goldschmitt, D., Gourdon-Kanhukamwe, A., Varda, A. G. D., Grigoryeva, I., Gugushvili, A., Fletcher, A. H. A., Habermann, F., Hablicsek, M., Haddad, J., Hall, J. D., Hammar, O., Hassouneh, M., Hausladen, C. I., Hendrikse, S. C. F., Hepplewhite, M., Ho, A. T. Y., Hogan-Hennessy, S., Howley, E., Huang, G., Hulstaert, H., Ilchovska, Z. G., Santamaria, P. J., Jakobsson, N., Jansson, J., Jarosz, E., Jebeli, H., Jiang, Y., Junaid, H., Kalluraya, R., Karim, S., Kelly, E., Kimel, E., Kingsuwankul, S., Klotzbücher, V., Krähmer, D., Krūminas, P., Kruus, N., Kujansuu, E., Kurz, C. F., Küster, S., Lee-Whiting, B., Lewandowski, F., Li, T., Li, R., Liu, D., Liu, J., Lo, H., Loter, K., Dias, F. M., Madan, C. R., Mäder, N., Mandas, M., Mantilla, C., Marcus, J., Fages, D. M., Martin, X., McWay, R., Medina-Gaspar, D., Meng, S., Meng, L., Merz, S., Miller, A. P., Mirabel, T., Mishra, D. D., Mishra, S., Moges, B. W., Mojarrad, M. M., Mohnen, M., Morin, L., Muehlenbachs, L., Mullin, G., Musulan, A., Muzzì, S., Myers, J. A. C., Neubauer, F., Nguyen, T., Niazi, A., Nordstrom, A., Nowak, B., O’Habib, D., Ölkers, T., Ong, J., Castiblanco, V. O., Özak, Ö., Ozkes, A. I., Paaso, M., Pandey, S., Papazoglou, V., Penheiro, R., Pham, L., Phieler, U., Pütz, P., Qi, Q., Qiu, J., Rein, M. T., Reinstein, D. A., Repo, J., Rudolf, N., Saha, S., Saka, O., Saponaro, C., Sator, G., Schoenmakers, M., Seri, R., Shah, M., Sibille, P., Siemroth, C., Skavysh, V., Slater, B., Song, W., Staubli, S., Steindl, T., Waongo, N. S., Stott, P., Strobel, S., Sudhaharan, R., Sun, P., Swain, S. D., Talavera, O., Tantiangco, H. M., Tarasenko, G., Tarlinton, B., Tarraf, M., Teoh, K., Thériault, R., Thompson, B., Tian, T., Tian, W., Tolani, E., Borgen, N., Borgen, S. T., Torralba, J., Velez-Ospina, C., Mak, M. W., Wallrich, L., Wang, Z., Ward, L., Webb, M. D., Webb, D., Weber, B. S., Weber, C., Weng, W., Westheide, C., Wilkinson, T., Wong, K., Wroński, M., Wu, Z., Wu, Q., Wu, V. Y., Xiao, B., Xu, F., Xu, C., Yadav, P., Chou, Y. Y., Yap, L., Yazbeck, M., Yao, B., Zagrodzka, Z., Zahra, T., Zaneva, M., Zhang, X., Zhao, Z., Zhong, H., Zirgulis, A., Zou, J., Zoutman, F., & Zozoungbo, C. (2026). AI-assisted teams outperform AI-led teams but not human-only teams in assessing research reproducibility in quantitative social science. Proceedings of the National Academy of Sciences. https://doi.org/10.1073/pnas.2524747123