Estimating the reproducibility of psychological science
No Thumbnail
Authors
Aarts, Alexander A.Anderson, Joanna E.
Anderson, Christopher J.
Attridge, Peter R.
Attwood, Angela

Axt, Jordan
Babel, Molly
Bahnik, Stepan

Baranski, Erica
Barnett-Cowan, Michael
Bartmess, Elizabeth
Beer, Jennifer
Bell, Raoul
Bentley, Heather
Beyan, Leah
Binion, Grace
Borsboom, Denny
Bosch, Annick
Bosco, Frank A.
Bowman, Sara D.

Brandt, Mark J.

Braswell, Erin
Brohmer, Hilmar

Brown, Benjamin T.
Brown, Kristina
Bruening, Jovita
Calhoun-Sauls, Ann
Callahan, Shannon P.
Chagnon, Elizabeth
Chandler, Jesse
Chartier, Christopher R.
Cheung, Felix

Christopherson, Cody D.

Cillessen, Linda

Clay, Russ
Cleary, Hayley

Cloud, Mark D.
Cohn, Michael
Cohoon, Johanna

Columbus, Simon

Cordes, Andreas

Costantini, Giulio

Alvarez, Leslie D. Cramblet
Cremata, Ed
Crusius, Jan

DeCoster, Jamie

DeGaetano, Michelle A.
Della Penna, Nicolas
den Bezemer, Bobby
Deserno, Marie K.
Devitt, Olivia
Dewitte, Laura

Dobolyi, David G.
Dodson, Geneva T.
Donnellan, M. Brent
Donohue, Ryan
Dore, Rebecca A.
Dorrough, Angela

Dreber, Anna
Dugas, Michelle
Dunn, Elizabeth W.
Easey, Kayleigh
Eboigbe, Sylvia
Eggleston, Casey
Embley, Jo
Epskamp, Sacha
Errington, Timothy M.
Estel, Vivien
Farach, Frank J.
Feather, Jenelle
Fedor, Anna

Fernandez-Castilla, Belen
Fiedler, Susann
Field, James G.

Fitneva, Stanka A.
Flagan, Taru
Forest, Amanda L.

Forsell, Eskil
Foster, Joshua D.
Frank, Michael C.

Frazier, Rebecca S.
Fuchs, Heather
Gable, Philip
Galak, Jeff
Galliani, Elisa Maria

Gampa, Anup
Garcia, Sara
Gazarian, Douglas
Gilbert, Elizabeth
Giner-Sorolla, Roger
Gloeckner, Andreas
Goellner, Lars
Goh, Jin X.
Goldberg, Rebecca
Goodbourn, Patrick T.

Gordon-McKeon, Shauna
Gorges, Bryan
Gorges, Jessie
Goss, Justin
Graham, Jesse

Grange, James A.
Gray, Jeremy
Hartgerink, Chris
Hartshorne, Joshua

Hasselman, Fred
Hayes, Timothy
Heikensten, Emma
Henninger, Felix

Hodsoll, John
Holubar, Taylor
Hoogendoorn, Gea
Humphries, Denise J.
Hung, Cathy O. -Y.
Immelman, Nathali
Irsik, Vanessa C.
Jahn, Georg

Jaekel, Frank
Jekel, Marc

Johannesson, Magnus

Johnson, Larissa G.
Johnson, David J.
Johnson, Kate M.
Johnston, William J.
Jonas, Kai

Joy-Gaba, Jennifer
Kappes, Heather Barry
Kelso, Kim
Kidwell, Mallory C.

Kim, Seung Kyung
Kirkhart, Matthew
Kleinberg, Bennett

Knežević, Goran

Kolorz, Franziska Maria
Kossakowski, Jolanda J.

Krause, Robert Wilhelm
Krijnen, Job
Kuhlmann, Tim
Kunkels, Yoram K.
Kyc, Megan M.
Lai, Calvin K.
Laique, Aamir
Lakens, Daniel
Lane, Kristin A.

Lassetter, Bethany
Lazarević, Ljiljana

LeBel, Etienne P.

Lee, Key Jung
Lee, Minha
Lemm, Kristi
Levitan, Carmel A.
Lewis, Melissa
Lin, Lin
Lin, Stephanie
Lippold, Matthias
Loureiro, Darren
Luteijn, Ilse
Mackinnon, Sean
Mainard, Heather N.
Marigold, Denise C.
Martin, Daniel P.
Martinez, Tylar
Masicampo, E. J.
Matacotta, Josh

Mathur, Maya
May, Michael
Mechin, Nicole
Mehta, Pranjal

Meixner, Johannes
Melinger, Alissa

Miller, Jeremy K.
Miller, Mallorie
Moore, Katherine

Moeschl, Marcus
Motyl, Matt

Mueller, Stephanie M.
Munafo, Marcus

Neijenhuijs, Koen I.

Nervi, Taylor
Gandalf, Nicolas
Nilsonne, Gustav
Nosek, Brian A.
Nuijten, Michele B.

Olsson, Catherine
Osborne, Colleen
Ostkamp, Lutz
Pavel, Misha
Penton-Voak, Ian S.

Perna, Olivia
Pernet, Cyril

Perugini, Marco

Pipitone, R. Nathan
Pitts, Michael
Plessow, Franziska
Prenoveau, Jason M.
Rahal, Rima-Maria

Ratliff, Kate A.
Reinhard, David
Renkewitz, Frank
Ricker, Ashley A.

Rigney, Anastasia
Rivers, Andrew M.
Roebke, Mark
Rutchick, Abraham M.
Ryan, Robert S.
Sahin, Onur

Saide, Anondah
Sandstrom, Gillian M.

Santos, David
Saxe, Rebecca
Schlegelmilch, Rene
Schmidt, Kathleen
Scholz, Sabine
Seibel, Larissa
Selterman, Dylan Faulkner
Shaki, Samuel

Simpson, William B.
Sinclair, H. Colleen
Skorinko, Jeanine L. M.
Slowik, Agnieszka
Snyder, Joel S.

Soderberg, Courtney

Sonnleitner, Carina
Spencer, Nick
Spies, Jeffrey R.
Steegen, Sara
Stieger, Stefan

Strohminger, Nina
Sullivan, Gavin B.

Talhelm, Thomas
Tapia, Megan
te Dorsthorst, Anniek
Thomae, Manuela

Thomas, Sarah L.
Tio, Pia

Traets, Frits
Tsang, Steve
Tuerlinckx, Francis

Turchan, Paul
Valasek, Milan
van 't Veer, Anna E.
Van Aert, Robbie
van Assen, Marcel
van Bork, Riet
van de Ven, Mathijs
van den Bergh, Don
van der Hulst, Marije
van Dooren, Roel
van Doorn, Johnny
van Renswoude, Daan R.
van Rijn, Hedderik

Vanpaemel, Wolf
Echeverria, Alejandro Vasquez
Vazquez, Melissa
Velez, Natalia
Vermue, Marieke
Verschoor, Mark
Vianello, Michelangelo

Voracek, Martin

Vuu, Gina
Wagenmakers, Eric-Jan

Weerdmeester, Joanneke

Welsh, Ashlee
Westgate, Erin C.

Wissink, Joeri
Wood, Michael
Woods, Andy
Wright, Emily
Wu, Sining
Zeelenberg, Marcel
Zuni, Kellylynn
Article (Published version)

Metadata
Show full item recordAbstract
Reproducibility is a defining feature of science, but the extent to which it characterizes current research is unknown. We conducted replications of 100 experimental and correlational studies published in three psychology journals using high-powered designs and original materials when available. Replication effects were half the magnitude of original effects, representing a substantial decline. Ninety-seven percent of original studies had statistically significant results. Thirty-six percent of replications had statistically significant results; 47% of original effect sizes were in the 95% confidence interval of the replication effect size; 39% of effects were subjectively rated to have replicated the original result; and if no bias in original results is assumed, combining original and replication results left 68% with statistically significant effects. Correlational tests suggest that replication success was better predicted by the strength of original evidence than by characteristic...s of the original and replication teams.
Source:
Science, 2015, 349, 6251Publisher:
- Amer Assoc Advancement Science, Washington
Funding / projects:
- Center for Open Science
- Laura and John Arnold Foundation
- Medical Research Council and UK Research & Innovation [MC_UU_12013/6] Funding
DOI: 10.1126/science.aac4716
ISSN: 0036-8075
PubMed: 26315443
WoS: 000360646800042
Scopus: 2-s2.0-84940513037
Collections
Institution/Community
Psihologija / PsychologyTY - JOUR AU - Aarts, Alexander A. AU - Anderson, Joanna E. AU - Anderson, Christopher J. AU - Attridge, Peter R. AU - Attwood, Angela AU - Axt, Jordan AU - Babel, Molly AU - Bahnik, Stepan AU - Baranski, Erica AU - Barnett-Cowan, Michael AU - Bartmess, Elizabeth AU - Beer, Jennifer AU - Bell, Raoul AU - Bentley, Heather AU - Beyan, Leah AU - Binion, Grace AU - Borsboom, Denny AU - Bosch, Annick AU - Bosco, Frank A. AU - Bowman, Sara D. AU - Brandt, Mark J. AU - Braswell, Erin AU - Brohmer, Hilmar AU - Brown, Benjamin T. AU - Brown, Kristina AU - Bruening, Jovita AU - Calhoun-Sauls, Ann AU - Callahan, Shannon P. AU - Chagnon, Elizabeth AU - Chandler, Jesse AU - Chartier, Christopher R. AU - Cheung, Felix AU - Christopherson, Cody D. AU - Cillessen, Linda AU - Clay, Russ AU - Cleary, Hayley AU - Cloud, Mark D. AU - Cohn, Michael AU - Cohoon, Johanna AU - Columbus, Simon AU - Cordes, Andreas AU - Costantini, Giulio AU - Alvarez, Leslie D. Cramblet AU - Cremata, Ed AU - Crusius, Jan AU - DeCoster, Jamie AU - DeGaetano, Michelle A. AU - Della Penna, Nicolas AU - den Bezemer, Bobby AU - Deserno, Marie K. AU - Devitt, Olivia AU - Dewitte, Laura AU - Dobolyi, David G. AU - Dodson, Geneva T. AU - Donnellan, M. Brent AU - Donohue, Ryan AU - Dore, Rebecca A. AU - Dorrough, Angela AU - Dreber, Anna AU - Dugas, Michelle AU - Dunn, Elizabeth W. AU - Easey, Kayleigh AU - Eboigbe, Sylvia AU - Eggleston, Casey AU - Embley, Jo AU - Epskamp, Sacha AU - Errington, Timothy M. AU - Estel, Vivien AU - Farach, Frank J. AU - Feather, Jenelle AU - Fedor, Anna AU - Fernandez-Castilla, Belen AU - Fiedler, Susann AU - Field, James G. AU - Fitneva, Stanka A. AU - Flagan, Taru AU - Forest, Amanda L. AU - Forsell, Eskil AU - Foster, Joshua D. AU - Frank, Michael C. AU - Frazier, Rebecca S. AU - Fuchs, Heather AU - Gable, Philip AU - Galak, Jeff AU - Galliani, Elisa Maria AU - Gampa, Anup AU - Garcia, Sara AU - Gazarian, Douglas AU - Gilbert, Elizabeth AU - Giner-Sorolla, Roger AU - Gloeckner, Andreas AU - Goellner, Lars AU - Goh, Jin X. AU - Goldberg, Rebecca AU - Goodbourn, Patrick T. AU - Gordon-McKeon, Shauna AU - Gorges, Bryan AU - Gorges, Jessie AU - Goss, Justin AU - Graham, Jesse AU - Grange, James A. AU - Gray, Jeremy AU - Hartgerink, Chris AU - Hartshorne, Joshua AU - Hasselman, Fred AU - Hayes, Timothy AU - Heikensten, Emma AU - Henninger, Felix AU - Hodsoll, John AU - Holubar, Taylor AU - Hoogendoorn, Gea AU - Humphries, Denise J. AU - Hung, Cathy O. -Y. AU - Immelman, Nathali AU - Irsik, Vanessa C. AU - Jahn, Georg AU - Jaekel, Frank AU - Jekel, Marc AU - Johannesson, Magnus AU - Johnson, Larissa G. AU - Johnson, David J. AU - Johnson, Kate M. AU - Johnston, William J. AU - Jonas, Kai AU - Joy-Gaba, Jennifer AU - Kappes, Heather Barry AU - Kelso, Kim AU - Kidwell, Mallory C. AU - Kim, Seung Kyung AU - Kirkhart, Matthew AU - Kleinberg, Bennett AU - Knežević, Goran AU - Kolorz, Franziska Maria AU - Kossakowski, Jolanda J. AU - Krause, Robert Wilhelm AU - Krijnen, Job AU - Kuhlmann, Tim AU - Kunkels, Yoram K. AU - Kyc, Megan M. AU - Lai, Calvin K. AU - Laique, Aamir AU - Lakens, Daniel AU - Lane, Kristin A. AU - Lassetter, Bethany AU - Lazarević, Ljiljana AU - LeBel, Etienne P. AU - Lee, Key Jung AU - Lee, Minha AU - Lemm, Kristi AU - Levitan, Carmel A. AU - Lewis, Melissa AU - Lin, Lin AU - Lin, Stephanie AU - Lippold, Matthias AU - Loureiro, Darren AU - Luteijn, Ilse AU - Mackinnon, Sean AU - Mainard, Heather N. AU - Marigold, Denise C. AU - Martin, Daniel P. AU - Martinez, Tylar AU - Masicampo, E. J. AU - Matacotta, Josh AU - Mathur, Maya AU - May, Michael AU - Mechin, Nicole AU - Mehta, Pranjal AU - Meixner, Johannes AU - Melinger, Alissa AU - Miller, Jeremy K. AU - Miller, Mallorie AU - Moore, Katherine AU - Moeschl, Marcus AU - Motyl, Matt AU - Mueller, Stephanie M. AU - Munafo, Marcus AU - Neijenhuijs, Koen I. AU - Nervi, Taylor AU - Gandalf, Nicolas AU - Nilsonne, Gustav AU - Nosek, Brian A. AU - Nuijten, Michele B. AU - Olsson, Catherine AU - Osborne, Colleen AU - Ostkamp, Lutz AU - Pavel, Misha AU - Penton-Voak, Ian S. AU - Perna, Olivia AU - Pernet, Cyril AU - Perugini, Marco AU - Pipitone, R. Nathan AU - Pitts, Michael AU - Plessow, Franziska AU - Prenoveau, Jason M. AU - Rahal, Rima-Maria AU - Ratliff, Kate A. AU - Reinhard, David AU - Renkewitz, Frank AU - Ricker, Ashley A. AU - Rigney, Anastasia AU - Rivers, Andrew M. AU - Roebke, Mark AU - Rutchick, Abraham M. AU - Ryan, Robert S. AU - Sahin, Onur AU - Saide, Anondah AU - Sandstrom, Gillian M. AU - Santos, David AU - Saxe, Rebecca AU - Schlegelmilch, Rene AU - Schmidt, Kathleen AU - Scholz, Sabine AU - Seibel, Larissa AU - Selterman, Dylan Faulkner AU - Shaki, Samuel AU - Simpson, William B. AU - Sinclair, H. Colleen AU - Skorinko, Jeanine L. M. AU - Slowik, Agnieszka AU - Snyder, Joel S. AU - Soderberg, Courtney AU - Sonnleitner, Carina AU - Spencer, Nick AU - Spies, Jeffrey R. AU - Steegen, Sara AU - Stieger, Stefan AU - Strohminger, Nina AU - Sullivan, Gavin B. AU - Talhelm, Thomas AU - Tapia, Megan AU - te Dorsthorst, Anniek AU - Thomae, Manuela AU - Thomas, Sarah L. AU - Tio, Pia AU - Traets, Frits AU - Tsang, Steve AU - Tuerlinckx, Francis AU - Turchan, Paul AU - Valasek, Milan AU - van 't Veer, Anna E. AU - Van Aert, Robbie AU - van Assen, Marcel AU - van Bork, Riet AU - van de Ven, Mathijs AU - van den Bergh, Don AU - van der Hulst, Marije AU - van Dooren, Roel AU - van Doorn, Johnny AU - van Renswoude, Daan R. AU - van Rijn, Hedderik AU - Vanpaemel, Wolf AU - Echeverria, Alejandro Vasquez AU - Vazquez, Melissa AU - Velez, Natalia AU - Vermue, Marieke AU - Verschoor, Mark AU - Vianello, Michelangelo AU - Voracek, Martin AU - Vuu, Gina AU - Wagenmakers, Eric-Jan AU - Weerdmeester, Joanneke AU - Welsh, Ashlee AU - Westgate, Erin C. AU - Wissink, Joeri AU - Wood, Michael AU - Woods, Andy AU - Wright, Emily AU - Wu, Sining AU - Zeelenberg, Marcel AU - Zuni, Kellylynn PY - 2015 UR - http://reff.f.bg.ac.rs/handle/123456789/1992 AB - Reproducibility is a defining feature of science, but the extent to which it characterizes current research is unknown. We conducted replications of 100 experimental and correlational studies published in three psychology journals using high-powered designs and original materials when available. Replication effects were half the magnitude of original effects, representing a substantial decline. Ninety-seven percent of original studies had statistically significant results. Thirty-six percent of replications had statistically significant results; 47% of original effect sizes were in the 95% confidence interval of the replication effect size; 39% of effects were subjectively rated to have replicated the original result; and if no bias in original results is assumed, combining original and replication results left 68% with statistically significant effects. Correlational tests suggest that replication success was better predicted by the strength of original evidence than by characteristics of the original and replication teams. PB - Amer Assoc Advancement Science, Washington T2 - Science T1 - Estimating the reproducibility of psychological science IS - 6251 VL - 349 DO - 10.1126/science.aac4716 ER -
@article{ author = "Aarts, Alexander A. and Anderson, Joanna E. and Anderson, Christopher J. and Attridge, Peter R. and Attwood, Angela and Axt, Jordan and Babel, Molly and Bahnik, Stepan and Baranski, Erica and Barnett-Cowan, Michael and Bartmess, Elizabeth and Beer, Jennifer and Bell, Raoul and Bentley, Heather and Beyan, Leah and Binion, Grace and Borsboom, Denny and Bosch, Annick and Bosco, Frank A. and Bowman, Sara D. and Brandt, Mark J. and Braswell, Erin and Brohmer, Hilmar and Brown, Benjamin T. and Brown, Kristina and Bruening, Jovita and Calhoun-Sauls, Ann and Callahan, Shannon P. and Chagnon, Elizabeth and Chandler, Jesse and Chartier, Christopher R. and Cheung, Felix and Christopherson, Cody D. and Cillessen, Linda and Clay, Russ and Cleary, Hayley and Cloud, Mark D. and Cohn, Michael and Cohoon, Johanna and Columbus, Simon and Cordes, Andreas and Costantini, Giulio and Alvarez, Leslie D. Cramblet and Cremata, Ed and Crusius, Jan and DeCoster, Jamie and DeGaetano, Michelle A. and Della Penna, Nicolas and den Bezemer, Bobby and Deserno, Marie K. and Devitt, Olivia and Dewitte, Laura and Dobolyi, David G. and Dodson, Geneva T. and Donnellan, M. Brent and Donohue, Ryan and Dore, Rebecca A. and Dorrough, Angela and Dreber, Anna and Dugas, Michelle and Dunn, Elizabeth W. and Easey, Kayleigh and Eboigbe, Sylvia and Eggleston, Casey and Embley, Jo and Epskamp, Sacha and Errington, Timothy M. and Estel, Vivien and Farach, Frank J. and Feather, Jenelle and Fedor, Anna and Fernandez-Castilla, Belen and Fiedler, Susann and Field, James G. and Fitneva, Stanka A. and Flagan, Taru and Forest, Amanda L. and Forsell, Eskil and Foster, Joshua D. and Frank, Michael C. and Frazier, Rebecca S. and Fuchs, Heather and Gable, Philip and Galak, Jeff and Galliani, Elisa Maria and Gampa, Anup and Garcia, Sara and Gazarian, Douglas and Gilbert, Elizabeth and Giner-Sorolla, Roger and Gloeckner, Andreas and Goellner, Lars and Goh, Jin X. and Goldberg, Rebecca and Goodbourn, Patrick T. and Gordon-McKeon, Shauna and Gorges, Bryan and Gorges, Jessie and Goss, Justin and Graham, Jesse and Grange, James A. and Gray, Jeremy and Hartgerink, Chris and Hartshorne, Joshua and Hasselman, Fred and Hayes, Timothy and Heikensten, Emma and Henninger, Felix and Hodsoll, John and Holubar, Taylor and Hoogendoorn, Gea and Humphries, Denise J. and Hung, Cathy O. -Y. and Immelman, Nathali and Irsik, Vanessa C. and Jahn, Georg and Jaekel, Frank and Jekel, Marc and Johannesson, Magnus and Johnson, Larissa G. and Johnson, David J. and Johnson, Kate M. and Johnston, William J. and Jonas, Kai and Joy-Gaba, Jennifer and Kappes, Heather Barry and Kelso, Kim and Kidwell, Mallory C. and Kim, Seung Kyung and Kirkhart, Matthew and Kleinberg, Bennett and Knežević, Goran and Kolorz, Franziska Maria and Kossakowski, Jolanda J. and Krause, Robert Wilhelm and Krijnen, Job and Kuhlmann, Tim and Kunkels, Yoram K. and Kyc, Megan M. and Lai, Calvin K. and Laique, Aamir and Lakens, Daniel and Lane, Kristin A. and Lassetter, Bethany and Lazarević, Ljiljana and LeBel, Etienne P. and Lee, Key Jung and Lee, Minha and Lemm, Kristi and Levitan, Carmel A. and Lewis, Melissa and Lin, Lin and Lin, Stephanie and Lippold, Matthias and Loureiro, Darren and Luteijn, Ilse and Mackinnon, Sean and Mainard, Heather N. and Marigold, Denise C. and Martin, Daniel P. and Martinez, Tylar and Masicampo, E. J. and Matacotta, Josh and Mathur, Maya and May, Michael and Mechin, Nicole and Mehta, Pranjal and Meixner, Johannes and Melinger, Alissa and Miller, Jeremy K. and Miller, Mallorie and Moore, Katherine and Moeschl, Marcus and Motyl, Matt and Mueller, Stephanie M. and Munafo, Marcus and Neijenhuijs, Koen I. and Nervi, Taylor and Gandalf, Nicolas and Nilsonne, Gustav and Nosek, Brian A. and Nuijten, Michele B. and Olsson, Catherine and Osborne, Colleen and Ostkamp, Lutz and Pavel, Misha and Penton-Voak, Ian S. and Perna, Olivia and Pernet, Cyril and Perugini, Marco and Pipitone, R. Nathan and Pitts, Michael and Plessow, Franziska and Prenoveau, Jason M. and Rahal, Rima-Maria and Ratliff, Kate A. and Reinhard, David and Renkewitz, Frank and Ricker, Ashley A. and Rigney, Anastasia and Rivers, Andrew M. and Roebke, Mark and Rutchick, Abraham M. and Ryan, Robert S. and Sahin, Onur and Saide, Anondah and Sandstrom, Gillian M. and Santos, David and Saxe, Rebecca and Schlegelmilch, Rene and Schmidt, Kathleen and Scholz, Sabine and Seibel, Larissa and Selterman, Dylan Faulkner and Shaki, Samuel and Simpson, William B. and Sinclair, H. Colleen and Skorinko, Jeanine L. M. and Slowik, Agnieszka and Snyder, Joel S. and Soderberg, Courtney and Sonnleitner, Carina and Spencer, Nick and Spies, Jeffrey R. and Steegen, Sara and Stieger, Stefan and Strohminger, Nina and Sullivan, Gavin B. and Talhelm, Thomas and Tapia, Megan and te Dorsthorst, Anniek and Thomae, Manuela and Thomas, Sarah L. and Tio, Pia and Traets, Frits and Tsang, Steve and Tuerlinckx, Francis and Turchan, Paul and Valasek, Milan and van 't Veer, Anna E. and Van Aert, Robbie and van Assen, Marcel and van Bork, Riet and van de Ven, Mathijs and van den Bergh, Don and van der Hulst, Marije and van Dooren, Roel and van Doorn, Johnny and van Renswoude, Daan R. and van Rijn, Hedderik and Vanpaemel, Wolf and Echeverria, Alejandro Vasquez and Vazquez, Melissa and Velez, Natalia and Vermue, Marieke and Verschoor, Mark and Vianello, Michelangelo and Voracek, Martin and Vuu, Gina and Wagenmakers, Eric-Jan and Weerdmeester, Joanneke and Welsh, Ashlee and Westgate, Erin C. and Wissink, Joeri and Wood, Michael and Woods, Andy and Wright, Emily and Wu, Sining and Zeelenberg, Marcel and Zuni, Kellylynn", year = "2015", abstract = "Reproducibility is a defining feature of science, but the extent to which it characterizes current research is unknown. We conducted replications of 100 experimental and correlational studies published in three psychology journals using high-powered designs and original materials when available. Replication effects were half the magnitude of original effects, representing a substantial decline. Ninety-seven percent of original studies had statistically significant results. Thirty-six percent of replications had statistically significant results; 47% of original effect sizes were in the 95% confidence interval of the replication effect size; 39% of effects were subjectively rated to have replicated the original result; and if no bias in original results is assumed, combining original and replication results left 68% with statistically significant effects. Correlational tests suggest that replication success was better predicted by the strength of original evidence than by characteristics of the original and replication teams.", publisher = "Amer Assoc Advancement Science, Washington", journal = "Science", title = "Estimating the reproducibility of psychological science", number = "6251", volume = "349", doi = "10.1126/science.aac4716" }
Aarts, A. A., Anderson, J. E., Anderson, C. J., Attridge, P. R., Attwood, A., Axt, J., Babel, M., Bahnik, S., Baranski, E., Barnett-Cowan, M., Bartmess, E., Beer, J., Bell, R., Bentley, H., Beyan, L., Binion, G., Borsboom, D., Bosch, A., Bosco, F. A., Bowman, S. D., Brandt, M. J., Braswell, E., Brohmer, H., Brown, B. T., Brown, K., Bruening, J., Calhoun-Sauls, A., Callahan, S. P., Chagnon, E., Chandler, J., Chartier, C. R., Cheung, F., Christopherson, C. D., Cillessen, L., Clay, R., Cleary, H., Cloud, M. D., Cohn, M., Cohoon, J., Columbus, S., Cordes, A., Costantini, G., Alvarez, L. D. C., Cremata, E., Crusius, J., DeCoster, J., DeGaetano, M. A., Della Penna, N., den Bezemer, B., Deserno, M. K., Devitt, O., Dewitte, L., Dobolyi, D. G., Dodson, G. T., Donnellan, M. B., Donohue, R., Dore, R. A., Dorrough, A., Dreber, A., Dugas, M., Dunn, E. W., Easey, K., Eboigbe, S., Eggleston, C., Embley, J., Epskamp, S., Errington, T. M., Estel, V., Farach, F. J., Feather, J., Fedor, A., Fernandez-Castilla, B., Fiedler, S., Field, J. G., Fitneva, S. A., Flagan, T., Forest, A. L., Forsell, E., Foster, J. D., Frank, M. C., Frazier, R. S., Fuchs, H., Gable, P., Galak, J., Galliani, E. M., Gampa, A., Garcia, S., Gazarian, D., Gilbert, E., Giner-Sorolla, R., Gloeckner, A., Goellner, L., Goh, J. X., Goldberg, R., Goodbourn, P. T., Gordon-McKeon, S., Gorges, B., Gorges, J., Goss, J., Graham, J., Grange, J. A., Gray, J., Hartgerink, C., Hartshorne, J., Hasselman, F., Hayes, T., Heikensten, E., Henninger, F., Hodsoll, J., Holubar, T., Hoogendoorn, G., Humphries, D. J., Hung, C. O. -Y., Immelman, N., Irsik, V. C., Jahn, G., Jaekel, F., Jekel, M., Johannesson, M., Johnson, L. G., Johnson, D. J., Johnson, K. M., Johnston, W. J., Jonas, K., Joy-Gaba, J., Kappes, H. B., Kelso, K., Kidwell, M. C., Kim, S. K., Kirkhart, M., Kleinberg, B., Knežević, G., Kolorz, F. M., Kossakowski, J. J., Krause, R. W., Krijnen, J., Kuhlmann, T., Kunkels, Y. K., Kyc, M. M., Lai, C. K., Laique, A., Lakens, D., Lane, K. A., Lassetter, B., Lazarević, L., LeBel, E. P., Lee, K. J., Lee, M., Lemm, K., Levitan, C. A., Lewis, M., Lin, L., Lin, S., Lippold, M., Loureiro, D., Luteijn, I., Mackinnon, S., Mainard, H. N., Marigold, D. C., Martin, D. P., Martinez, T., Masicampo, E. J., Matacotta, J., Mathur, M., May, M., Mechin, N., Mehta, P., Meixner, J., Melinger, A., Miller, J. K., Miller, M., Moore, K., Moeschl, M., Motyl, M., Mueller, S. M., Munafo, M., Neijenhuijs, K. I., Nervi, T., Gandalf, N., Nilsonne, G., Nosek, B. A., Nuijten, M. B., Olsson, C., Osborne, C., Ostkamp, L., Pavel, M., Penton-Voak, I. S., Perna, O., Pernet, C., Perugini, M., Pipitone, R. N., Pitts, M., Plessow, F., Prenoveau, J. M., Rahal, R., Ratliff, K. A., Reinhard, D., Renkewitz, F., Ricker, A. A., Rigney, A., Rivers, A. M., Roebke, M., Rutchick, A. M., Ryan, R. S., Sahin, O., Saide, A., Sandstrom, G. M., Santos, D., Saxe, R., Schlegelmilch, R., Schmidt, K., Scholz, S., Seibel, L., Selterman, D. F., Shaki, S., Simpson, W. B., Sinclair, H. C., Skorinko, J. L. M., Slowik, A., Snyder, J. S., Soderberg, C., Sonnleitner, C., Spencer, N., Spies, J. R., Steegen, S., Stieger, S., Strohminger, N., Sullivan, G. B., Talhelm, T., Tapia, M., te Dorsthorst, A., Thomae, M., Thomas, S. L., Tio, P., Traets, F., Tsang, S., Tuerlinckx, F., Turchan, P., Valasek, M., van 't Veer, A. E., Van Aert, R., van Assen, M., van Bork, R., van de Ven, M., van den Bergh, D., van der Hulst, M., van Dooren, R., van Doorn, J., van Renswoude, D. R., van Rijn, H., Vanpaemel, W., Echeverria, A. V., Vazquez, M., Velez, N., Vermue, M., Verschoor, M., Vianello, M., Voracek, M., Vuu, G., Wagenmakers, E., Weerdmeester, J., Welsh, A., Westgate, E. C., Wissink, J., Wood, M., Woods, A., Wright, E., Wu, S., Zeelenberg, M.,& Zuni, K.. (2015). Estimating the reproducibility of psychological science. in Science Amer Assoc Advancement Science, Washington., 349(6251). https://doi.org/10.1126/science.aac4716
Aarts AA, Anderson JE, Anderson CJ, Attridge PR, Attwood A, Axt J, Babel M, Bahnik S, Baranski E, Barnett-Cowan M, Bartmess E, Beer J, Bell R, Bentley H, Beyan L, Binion G, Borsboom D, Bosch A, Bosco FA, Bowman SD, Brandt MJ, Braswell E, Brohmer H, Brown BT, Brown K, Bruening J, Calhoun-Sauls A, Callahan SP, Chagnon E, Chandler J, Chartier CR, Cheung F, Christopherson CD, Cillessen L, Clay R, Cleary H, Cloud MD, Cohn M, Cohoon J, Columbus S, Cordes A, Costantini G, Alvarez LDC, Cremata E, Crusius J, DeCoster J, DeGaetano MA, Della Penna N, den Bezemer B, Deserno MK, Devitt O, Dewitte L, Dobolyi DG, Dodson GT, Donnellan MB, Donohue R, Dore RA, Dorrough A, Dreber A, Dugas M, Dunn EW, Easey K, Eboigbe S, Eggleston C, Embley J, Epskamp S, Errington TM, Estel V, Farach FJ, Feather J, Fedor A, Fernandez-Castilla B, Fiedler S, Field JG, Fitneva SA, Flagan T, Forest AL, Forsell E, Foster JD, Frank MC, Frazier RS, Fuchs H, Gable P, Galak J, Galliani EM, Gampa A, Garcia S, Gazarian D, Gilbert E, Giner-Sorolla R, Gloeckner A, Goellner L, Goh JX, Goldberg R, Goodbourn PT, Gordon-McKeon S, Gorges B, Gorges J, Goss J, Graham J, Grange JA, Gray J, Hartgerink C, Hartshorne J, Hasselman F, Hayes T, Heikensten E, Henninger F, Hodsoll J, Holubar T, Hoogendoorn G, Humphries DJ, Hung CO-, Immelman N, Irsik VC, Jahn G, Jaekel F, Jekel M, Johannesson M, Johnson LG, Johnson DJ, Johnson KM, Johnston WJ, Jonas K, Joy-Gaba J, Kappes HB, Kelso K, Kidwell MC, Kim SK, Kirkhart M, Kleinberg B, Knežević G, Kolorz FM, Kossakowski JJ, Krause RW, Krijnen J, Kuhlmann T, Kunkels YK, Kyc MM, Lai CK, Laique A, Lakens D, Lane KA, Lassetter B, Lazarević L, LeBel EP, Lee KJ, Lee M, Lemm K, Levitan CA, Lewis M, Lin L, Lin S, Lippold M, Loureiro D, Luteijn I, Mackinnon S, Mainard HN, Marigold DC, Martin DP, Martinez T, Masicampo EJ, Matacotta J, Mathur M, May M, Mechin N, Mehta P, Meixner J, Melinger A, Miller JK, Miller M, Moore K, Moeschl M, Motyl M, Mueller SM, Munafo M, Neijenhuijs KI, Nervi T, Gandalf N, Nilsonne G, Nosek BA, Nuijten MB, Olsson C, Osborne C, Ostkamp L, Pavel M, Penton-Voak IS, Perna O, Pernet C, Perugini M, Pipitone RN, Pitts M, Plessow F, Prenoveau JM, Rahal R, Ratliff KA, Reinhard D, Renkewitz F, Ricker AA, Rigney A, Rivers AM, Roebke M, Rutchick AM, Ryan RS, Sahin O, Saide A, Sandstrom GM, Santos D, Saxe R, Schlegelmilch R, Schmidt K, Scholz S, Seibel L, Selterman DF, Shaki S, Simpson WB, Sinclair HC, Skorinko JLM, Slowik A, Snyder JS, Soderberg C, Sonnleitner C, Spencer N, Spies JR, Steegen S, Stieger S, Strohminger N, Sullivan GB, Talhelm T, Tapia M, te Dorsthorst A, Thomae M, Thomas SL, Tio P, Traets F, Tsang S, Tuerlinckx F, Turchan P, Valasek M, van 't Veer AE, Van Aert R, van Assen M, van Bork R, van de Ven M, van den Bergh D, van der Hulst M, van Dooren R, van Doorn J, van Renswoude DR, van Rijn H, Vanpaemel W, Echeverria AV, Vazquez M, Velez N, Vermue M, Verschoor M, Vianello M, Voracek M, Vuu G, Wagenmakers E, Weerdmeester J, Welsh A, Westgate EC, Wissink J, Wood M, Woods A, Wright E, Wu S, Zeelenberg M, Zuni K. Estimating the reproducibility of psychological science. in Science. 2015;349(6251). doi:10.1126/science.aac4716 .
Aarts, Alexander A., Anderson, Joanna E., Anderson, Christopher J., Attridge, Peter R., Attwood, Angela, Axt, Jordan, Babel, Molly, Bahnik, Stepan, Baranski, Erica, Barnett-Cowan, Michael, Bartmess, Elizabeth, Beer, Jennifer, Bell, Raoul, Bentley, Heather, Beyan, Leah, Binion, Grace, Borsboom, Denny, Bosch, Annick, Bosco, Frank A., Bowman, Sara D., Brandt, Mark J., Braswell, Erin, Brohmer, Hilmar, Brown, Benjamin T., Brown, Kristina, Bruening, Jovita, Calhoun-Sauls, Ann, Callahan, Shannon P., Chagnon, Elizabeth, Chandler, Jesse, Chartier, Christopher R., Cheung, Felix, Christopherson, Cody D., Cillessen, Linda, Clay, Russ, Cleary, Hayley, Cloud, Mark D., Cohn, Michael, Cohoon, Johanna, Columbus, Simon, Cordes, Andreas, Costantini, Giulio, Alvarez, Leslie D. Cramblet, Cremata, Ed, Crusius, Jan, DeCoster, Jamie, DeGaetano, Michelle A., Della Penna, Nicolas, den Bezemer, Bobby, Deserno, Marie K., Devitt, Olivia, Dewitte, Laura, Dobolyi, David G., Dodson, Geneva T., Donnellan, M. Brent, Donohue, Ryan, Dore, Rebecca A., Dorrough, Angela, Dreber, Anna, Dugas, Michelle, Dunn, Elizabeth W., Easey, Kayleigh, Eboigbe, Sylvia, Eggleston, Casey, Embley, Jo, Epskamp, Sacha, Errington, Timothy M., Estel, Vivien, Farach, Frank J., Feather, Jenelle, Fedor, Anna, Fernandez-Castilla, Belen, Fiedler, Susann, Field, James G., Fitneva, Stanka A., Flagan, Taru, Forest, Amanda L., Forsell, Eskil, Foster, Joshua D., Frank, Michael C., Frazier, Rebecca S., Fuchs, Heather, Gable, Philip, Galak, Jeff, Galliani, Elisa Maria, Gampa, Anup, Garcia, Sara, Gazarian, Douglas, Gilbert, Elizabeth, Giner-Sorolla, Roger, Gloeckner, Andreas, Goellner, Lars, Goh, Jin X., Goldberg, Rebecca, Goodbourn, Patrick T., Gordon-McKeon, Shauna, Gorges, Bryan, Gorges, Jessie, Goss, Justin, Graham, Jesse, Grange, James A., Gray, Jeremy, Hartgerink, Chris, Hartshorne, Joshua, Hasselman, Fred, Hayes, Timothy, Heikensten, Emma, Henninger, Felix, Hodsoll, John, Holubar, Taylor, Hoogendoorn, Gea, Humphries, Denise J., Hung, Cathy O. -Y., Immelman, Nathali, Irsik, Vanessa C., Jahn, Georg, Jaekel, Frank, Jekel, Marc, Johannesson, Magnus, Johnson, Larissa G., Johnson, David J., Johnson, Kate M., Johnston, William J., Jonas, Kai, Joy-Gaba, Jennifer, Kappes, Heather Barry, Kelso, Kim, Kidwell, Mallory C., Kim, Seung Kyung, Kirkhart, Matthew, Kleinberg, Bennett, Knežević, Goran, Kolorz, Franziska Maria, Kossakowski, Jolanda J., Krause, Robert Wilhelm, Krijnen, Job, Kuhlmann, Tim, Kunkels, Yoram K., Kyc, Megan M., Lai, Calvin K., Laique, Aamir, Lakens, Daniel, Lane, Kristin A., Lassetter, Bethany, Lazarević, Ljiljana, LeBel, Etienne P., Lee, Key Jung, Lee, Minha, Lemm, Kristi, Levitan, Carmel A., Lewis, Melissa, Lin, Lin, Lin, Stephanie, Lippold, Matthias, Loureiro, Darren, Luteijn, Ilse, Mackinnon, Sean, Mainard, Heather N., Marigold, Denise C., Martin, Daniel P., Martinez, Tylar, Masicampo, E. J., Matacotta, Josh, Mathur, Maya, May, Michael, Mechin, Nicole, Mehta, Pranjal, Meixner, Johannes, Melinger, Alissa, Miller, Jeremy K., Miller, Mallorie, Moore, Katherine, Moeschl, Marcus, Motyl, Matt, Mueller, Stephanie M., Munafo, Marcus, Neijenhuijs, Koen I., Nervi, Taylor, Gandalf, Nicolas, Nilsonne, Gustav, Nosek, Brian A., Nuijten, Michele B., Olsson, Catherine, Osborne, Colleen, Ostkamp, Lutz, Pavel, Misha, Penton-Voak, Ian S., Perna, Olivia, Pernet, Cyril, Perugini, Marco, Pipitone, R. Nathan, Pitts, Michael, Plessow, Franziska, Prenoveau, Jason M., Rahal, Rima-Maria, Ratliff, Kate A., Reinhard, David, Renkewitz, Frank, Ricker, Ashley A., Rigney, Anastasia, Rivers, Andrew M., Roebke, Mark, Rutchick, Abraham M., Ryan, Robert S., Sahin, Onur, Saide, Anondah, Sandstrom, Gillian M., Santos, David, Saxe, Rebecca, Schlegelmilch, Rene, Schmidt, Kathleen, Scholz, Sabine, Seibel, Larissa, Selterman, Dylan Faulkner, Shaki, Samuel, Simpson, William B., Sinclair, H. Colleen, Skorinko, Jeanine L. M., Slowik, Agnieszka, Snyder, Joel S., Soderberg, Courtney, Sonnleitner, Carina, Spencer, Nick, Spies, Jeffrey R., Steegen, Sara, Stieger, Stefan, Strohminger, Nina, Sullivan, Gavin B., Talhelm, Thomas, Tapia, Megan, te Dorsthorst, Anniek, Thomae, Manuela, Thomas, Sarah L., Tio, Pia, Traets, Frits, Tsang, Steve, Tuerlinckx, Francis, Turchan, Paul, Valasek, Milan, van 't Veer, Anna E., Van Aert, Robbie, van Assen, Marcel, van Bork, Riet, van de Ven, Mathijs, van den Bergh, Don, van der Hulst, Marije, van Dooren, Roel, van Doorn, Johnny, van Renswoude, Daan R., van Rijn, Hedderik, Vanpaemel, Wolf, Echeverria, Alejandro Vasquez, Vazquez, Melissa, Velez, Natalia, Vermue, Marieke, Verschoor, Mark, Vianello, Michelangelo, Voracek, Martin, Vuu, Gina, Wagenmakers, Eric-Jan, Weerdmeester, Joanneke, Welsh, Ashlee, Westgate, Erin C., Wissink, Joeri, Wood, Michael, Woods, Andy, Wright, Emily, Wu, Sining, Zeelenberg, Marcel, Zuni, Kellylynn, "Estimating the reproducibility of psychological science" in Science, 349, no. 6251 (2015), https://doi.org/10.1126/science.aac4716 . .
Related items
Showing items related by title, author, creator and subject.
-
Social and moral psychology of COVID-19 across 69 countries
Azevedo, Flavio; Pavlović, Tomislav; Rêgo, Gabriel G.; Ay, F. Ceren; Gjoneska, Biljana; Etienne, Tom W.; Ross, Robert M.; Schönegger, Philipp; Riaño-Moreno, Julián C.; Cichocka, Aleksandra; Capraro, Valerio; Cian, Luca; Longoni, Chiara; Chan, Ho Fai; Van Bavel, Jay J.; Sjåstad, Hallgeir; Nezlek, John B.; Alfano, Mark; Gelfand, Michele J.; Birtel, Michèle D.; Cislak, Aleksandra; Lockwood, Patricia L.; Abts, Koen; Agadullina, Elena; Aruta, John Jamir Benzon; Besharati, Sahba Nomvula; Bor, Alexander; Choma, Becky L.; Crabtree, Charles David; Cunningham, William A.; De, Koustav; Ejaz, Waqas; Elbaek, Christian T.; Findor, Andrej; Flichtentrei, Daniel; Franc, Renata; Gruber, June; Gualda, Estrella; Horiuchi, Yusaku; Huynh, Toan Luu Duc; Ibanez, Agustin; Imran, Mostak Ahamed; Israelashvili, Jacob; Jasko, Katarzyna; Kantorowicz, Jaroslaw; Kantorowicz-Reznichenko, Elena; Krouwel, André; Laakasuo, Michael; Lamm, Claus; Leygue, Caroline; Lin, Ming-Jen; Mansoor, Mohammad Sabbir; Marie, Antoine; Mayiwar, Lewend; Mazepus, Honorata; McHugh, Cillian; Minda, John Paul; Mitkidis, Panagiotis; Olsson, Andreas; Otterbring, Tobias; Packer, Dominic J.; Perry, Anat; Petersen, Michael Bang; Puthillam, Arathy; Rothmund, Tobias; Santamaría-García, Hernando; Schmid, Petra C.; Stoyanov, Drozdstoy; Tewari, Shruti; Todosijević, Bojan; Tsakiris, Manos; Tung, Hans H.; Umbres, Radu G.; Vanags, Edmunds; Vlasceanu, Madalina; Vonasch, Andrew; Yucel, Meltem; Zhang, Yucheng; Abad, Mohcine; Adler, Eli; Akrawi, Narin; Mdarhri, Hamza Alaoui; Amara, Hanane; Amodio, David M.; Antazo, Benedict G.; Apps, Matthew; Ba, Mouhamadou Hady; Barbosa, Sergio; Bastian, Brock; Berg, Anton; Bernal-Zárate, Maria P.; Bernstein, Michael; Białek, Michał; Bilancini, Ennio; Bogatyreva, Natalia; Boncinelli, Leonardo; Booth, Jonathan E.; Borau, Sylvie; Buchel, Ondrej; Cameron, C. Daryl; Carvalho, Chrissie F.; Celadin, Tatiana; Cerami, Chiara; Chalise, Hom Nath; Cheng, Xiaojun; Cockcroft, Kate; Conway, Jane; Córdoba-Delgado, Mateo Andres; Crespi, Chiara; Crouzevialle, Marie; Cutler, Jo; Cypryańska, Marzena; Dabrowska, Justyna; Daniels, Michael A.; Davis, Victoria H.; Dayley, Pamala N.; Delouvée, S.; Denkovski, Ognjan; Dezecache, Guillaume; Dhaliwal, Nathan A.; Diato, Alelie B.; Di Paolo, Roberto; Drosinou, Marianna; Dulleck, Uwe; Ekmanis, Jānis; Ertan, Arhan S.; Farhana, Hapsa Hossain; Farkhari, Fahima; Farmer, Harry; Fenwick, Ali; Fidanovski, Kristijan; Flew, Terry; Fraser, Shona; Frempong, Raymond Boadi; Fugelsang, Jonathan A.; Gale, Jessica; Garcia-Navarro, E. Begoña; Garladinne, Prasad; Ghajjou, Oussama; Gkinopoulos, Theofilos; Gray, Kurt; Griffin, Siobhán M.; Gronfeldt, Bjarki; Gümren, Mert; Gurung, Ranju Lama; Halperin, Eran; Harris, Elizabeth; Herzon, Volo; Hruška, Matej; Huang, Guanxiong; Hudecek, Matthias F. C.; Isler, Ozan; Jangard, Simon; Jorgensen, Frederik J.; Kachanoff, Frank; Kahn, John; Dangol, Apsara Katuwal; Keudel, Oleksandra; Koppel, Lina; Koverola, Mika; Kubin, Emily; Kunnari, Anton; Kutiyski, Yordan; Laguna, Oscar; Leota, Josh; Lermer, Eva; Levy, Jonathan; Levy, Neil; Li, Chunyun; Long, Elizabeth U.; Maglić, Marina; McCashin, Darragh; Metcalf, Alexander L.; Mikloušić, Igor; El Mimouni, Soulaimane; Miura, Asako; Molina-Paredes, Juliana; Monroy-Fonseca, César; Morales-Marente, Elena; Moreau, David; Muda, Rafał; Myer, Annalisa; Nash, Kyle; Nesh-Nash, Tarik; Nitschke, Jonas P.; Nurse, Matthew S.; Ohtsubo, Yohsuke; Oldemburgo de Mello, Victoria; O’Madagain, Cathal; Onderco, Michal; Palacios-Galvez, M. Soledad; Palomöki, Jussi; Pan, Yafeng; Papp, Zsófia; Pärnamets, Philip; Paruzel-Czachura, Mariola; Pavlović, Zoran; Payán-Gómez, César; Perander, Silva; Pitman, Michael Mark; Prasad, Rajib; Pyrkosz-Pacyna, Joanna; Rathje, Steve; Raza, Ali; Rhee, Kasey; Robertson, Claire E.; Rodríguez-Pascual, Iván; Saikkonen, Teemu; Salvador-Ginez, Octavio; Santi, Gaia C.; Santiago-Tovar, Natalia; Savage, David; Scheffer, Julian A.; Schultner, David T.; Schutte, Enid M.; Scott, Andy; Sharma, Madhavi; Sharma, Pujan; Skali, Ahmed; Stadelmann, David; Stafford, Clara Alexandra; Stanojević, Dragan; Stefaniak, Anna; Sternisko, Anni; Stoica, Augustin; Stoyanova, Kristina K.; Strickland, Brent; Sundvall, Jukka; Thomas, Jeffrey P.; Tinghög, Gustav; Torgler, Benno; Traast, Iris J.; Tucciarelli, Raffaele; Tyrala, Michael; Ungson, Nick D.; Uysal, Mete S.; Van Lange, Paul A. M.; van Prooijen, Jan-Willem; van Rooy, Dirk; Västfjäll, Daniel; Verkoeijen, Peter; Vieira, Joana B.; von Sikorski, Christian; Walker, Alexander Cameron; Watermeyer, Jennifer; Wetter, Erik; Whillans, Ashley; White, Katherine; Habib, Rishad; Willardt, Robin; Wohl, Michael J. A.; Wójcik, Adrian Dominik; Wu, Kaidi; Yamada, Yuki; Yilmaz, Onurcan; Yogeeswaran, Kumar; Ziemer, Carolin-Theresa; Zwaan, Rolf A.; Boggio, Paulo S.; Sampaio, Waldir M. (Scientific Data, 2023) -
National identity predicts public health support during a global pandemic
Van Bavel, Jay J.; Cichocka, Aleksandra; Capraro, Valerio; Sjåstad, Hallgeir; Nezlek, John B.; Pavlović, Tomislav; Alfano, Mark; Gelfand, Michele J.; Azevedo, Flavio; Birtel, Michèle D.; Cislak, Aleksandra; Lockwood, Patricia L.; Ross, Robert Malcolm; Abts, Koen; Agadullina, Elena; Aruta, John Jamir Benzon; Besharati, Sahba Nomvula; Bor, Alexander; Choma, Becky L.; Crabtree, Charles David; Cunningham, William A.; De, Koustav; Ejaz, Waqas; Elbaek, Christian T.; Findor, Andrej; Flichtentrei, Daniel; Franc, Renata; Gjoneska, Biljana; Gruber, June; Gualda, Estrella; Horiuchi, Yusaku; Huynh, Toan Luu Duc; Ibanez, Augustin; Imran, Mostak Ahamed; Israelashvili, Jacob; Jasko, Katarzyna; Kantorowicz, Jaroslaw; Kantorowicz-Reznichenko, Elena; Krouwel, André; Laakasuo, Michael; Lamm, Claus; Leygue, Caroline; Lin, Ming-Jen; Mansoor, Mohammad Sabbir; Marie, Antoine; Mayiwar, Lewend; Mazepus, Honorata; McHugh, Cillian; Minda, John Paul; Mitkidis, Panagiotis; Olsson, Andreas; Otterbring, Tobias; Packer, Dominic J.; Perry, Anat; Petersen, Michael Bang; Puthillam, Arathy; Riaño-Moreno, Julián C.; Rothmund, Tobias; Santamaría-García, Hernando; Schmid, Petra C.; Stoyanov, Drozdstoy; Tewari, Shruti; Todosijević, Bojan; Tsakiris, Manos; Tung, Hans H.; Umbreș, Radu G.; Vanags, Edmunds; Vlasceanu, Madalina; Vonasch, Andrew; Yucel, Meltem; Zhang, Yucheng; Abad, Mohcine; Adler, Eli; Akrawi, Narin; Mdarhri, Hamza Alaoui; Amara, Hanane; Amodio, David M.; Antazo, Benedict G.; Apps, Matthew; Ay, F. Ceren; Ba, Mouhamadou Hady; Barbosa, Sergio; Bastian, Brock; Berg, Anton; Bernal-Zárate, Maria P.; Bernstein, Michael; Białek, Michał; Bilancini, Ennio; Bogatyreva, Natalia; Boncinelli, Leonardo; Booth, Jonathan E.; Borau, Sylvie; Buchel, Ondrej; Cameron, C. Daryl; Carvalho, Chrissie F.; Celadin, Tatiana; Cerami, Chiara; Chalise, Hom Nath; Cheng, Xiaojun; Cian, Luca; Cockcroft, Kate; Conway, Jane; Córdoba-Delgado, Mateo Andres; Crespi, Chiara; Crouzevialle, Marie; Cutler, Jo; Cypryańska, Marzena; Dabrowska, Justyna; Daniels, Michael A.; Davis, Victoria H.; Dayley, Pamala N.; Delouvee, Sylvain; Denkovski, Ognjan; Dezecache, Guillaume; Dhaliwal, Nathan A.; Diato, Alelie B.; Di Paolo, Roberto; Drosinou, Marianna; Dulleck, Uwe; Ekmanis, Jānis; Ertan, Arhan S.; Etienne, Tom W.; Farhana, Hapsa Hossain; Farkhari, Fahima; Farmer, Harry; Fenwick, Ali; Fidanovski, Kristijan; Flew, Terry; Fraser, Shona; Frempong, Raymond Boadi; Fugelsang, Jonathan A.; Gale, Jessica; Garcia-Navarro, E. Begoña; Garladinne, Prasad; Ghajjou, Oussama; Gkinopoulos, Theofilos; Gray, Kurt; Griffin, Siobhán M.; Gronfeldt, Bjarki; Gümren, Mert; Gurung, Ranju Lama; Halperin, Eran; Harris, Elizabeth; Herzon, Volo; Hruška, Matej; Huang, Guanxiong; Hudecek, Matthias F. C.; Isler, Ozan; Jangard, Simon; Jørgensen, Frederik J.; Kachanoff, Frank; Kahn, John; Dangol, Apsara Katuwal; Keudel, Oleksandra; Koppel, Lina; Koverola, Mika; Kubin, Emily; Kunnari, Anton; Kutiyski, Yordan; Laguna, Oscar; Leota, Josh; Lermer, Eva; Levy, Jonathan; Levy, Neil; Li, Chunyun; Long, Elizabeth U.; Longoni, Chiara; Maglić, Marina; McCashin, Darragh; Metcalf, Alexander L.; Mikloušić, Igor; El Mimouni, Soulaimane; Miura, Asako; Molina-Paredes, Juliana; Monroy-Fonseca, César; Morales-Marente, Elena; Moreau, David; Muda, Rafał; Myer, Annalisa; Nash, Kyle; Nesh-Nash, Tarik; Nitschke, Jonas P.; Nurse, Matthew S.; Ohtsubo, Yohsuke; Oldemburgo de Mello, Victoria; O’Madagain, Cathal; Onderco, Michal; Palacios-Galvez, M. Soledad; Palomäki, Jussi; Pan, Yafeng; Papp, Zsófia; Pärnamets, Philip; Paruzel-Czachura, Mariola; Pavlović, Zoran; Payán-Gómez, César; Perander, Silva; Pitman, Michael Mark; Prasad, Rajib; Pyrkosz-Pacyna, Joanna; Rathje, Steve; Raza, Ali; Rêgo, Gabriel G.; Rhee, Kasey; Robertson, Claire E.; Rodríguez-Pascual, Iván; Saikkonen, Teemu; Salvador-Ginez, Octavio; Sampaio, Waldir M.; Santi, Gaia C.; Santiago-Tovar, Natalia; Savage, David; Scheffer, Julian A.; Schönegger, Philipp; Schultner, David T.; Schutte, Enid M.; Scott, Andy; Sharma, Madhavi; Sharma, Pujan; Skali, Ahmed; Stadelmann, David; Stafford, Clara Alexandra; Stanojević, Dragan; Stefaniak, Anna; Sternisko, Anni; Stoica, Augustin; Stoyanova, Kristina K.; Strickland, Brent; Sundvall, Jukka; Thomas, Jeffrey P.; Tinghög, Gustav; Torgler, Benno; Traast, Iris J.; Tucciarelli, Raffaele; Tyrala, Michael; Ungson, Nick D.; Uysal, Mete S.; Van Lange, Paul A. M.; van Prooijen, Jan-Willem; van Rooy, Dirk; Västfjäll, Daniel; Verkoeijen, Peter; Vieira, Joana B.; von Sikorski, Christian; Walker, Alexander Cameron; Watermeyer, Jennifer; Wetter, Erik; Whillans, Ashley; Willardt, Robin; Wohl, Michael J. A.; Wójcik, Adrian Dominik; Wu, Kaidi; Yamada, Yuki; Yilmaz, Onurcan; Yogeeswaran, Kumar; Ziemer, Carolin-Theresa; Zwaan, Rolf A.; Boggio, Paulo S. (Nature Communications, 2022) -
Many Labs 5: Testing Pre-Data-Collection Peer Review as an Intervention to Increase Replicability
Ebersole, C.R.; Mathur, M.B.; Baranski, Erica; Bart-Plange, D.-J.; Buttrick, N.R.; Chartier, Christopher R.; Corker, K.S.; Corley, M.; Hartshorne, J.K.; IJzerman, Hans; Lazarević, Ljiljana; Rabagliati, H.; Ropovik, I.; Aczel, Balazs; Aeschbach, L.F.; Andrighetto, L.; Arnal, Jack D.; Arrow, H.; Babincak, Peter; Bakos, B.E.; Banik, Gabriel; Baskin, Ernest; Belopavlović, R.; Bernstein, M.H.; Białek, M.; Bloxsom, Nicholas G.; Bodroža, Bojana; Bonfiglio, D.B.V.; Boucher, L.; Brühlmann, F.; Brumbaugh, C.C.; Casini, E.; Chen, Y.; Chiorri, C.; Chopik, William J.; Christ, O.; Ciunci, A.M.; Claypool, H.M.; Coary, S.; Čolić, M.V.; Collins, W.M.; Curran, P.G.; Day, C.R.; Dering, B.; Dreber, Anna; Edlund, J.E.; Falcão, F.; Fedor, A.; Feinberg, L.; Ferguson, I.R.; Ford, M.; Frank, Michael C.; Fryberger, E.; Garinther, A.; Gawryluk, K.; Ashbaugh, K.; Giacomantonio, M.; Giessner, S.R.; Grahe, Jon E.; Guadagno, R.E.; Hałasa, E.; Hancock, P.J.B.; Hilliard, R.A.; Hüffmeier, J.; Hughes, S.; Idzikowska, K.; Inzlicht, Michael; Jern, A.; Jiménez-Leal, W.; Johannesson, Magnus; Joy-Gaba, Jennifer; Kauff, M.; Kellier, D.J.; Kessinger, G.; Kidwell, Mallory C.; Kimbrough, A.M.; King, J.P.J.; Kolb, V.S.; Kołodziej, S.; Kovacs, M.; Krasuska, K.; Kraus, S.; Krueger, L.E.; Kuchno, K.; Lage, C.A.; Langford, E.V.; Levitan, C.A.; de Lima, T.J.S.; Lin, H.; Lins, Samuel; Loy, J.E.; Manfredi, D.; Markiewicz, Ł.; Menon, M.; Mercier, B.; Metzger, M.; Meyet, V.; Millen, A.E.; Miller, Jeremy K.; Montealegre, A.; Moore, D.A.; Muda, R.; Nave, G.; Nichols, A.L.; Novak, S.A.; Nunnally, C.; Orlić, Ana; Palinkas, A.; Panno, A.; Parks, K.P.; Pedović, I.; Pękala, E.; Penner, M.R.; Pessers, S.; Petrović, B.; Pfeiffer, T.; Pieńkosz, D.; Preti, E.; Purić, Danka; Ramos, T.; Ravid, J.; Razza, T.S.; Rentzsch, K.; Richetin, J.; Rife, S.C.; Rosa, A.D.; Rudy, K.H.; Salamon, J.; Saunders, B.; Sawicki, P.; Schmidt, Kathleen; Schuepfer, K.; Schultze, T.; Schulz-Hardt, S.; Schütz, A.; Shabazian, A.N.; Shubella, R.L.; Siegel, A.; Silva, R.; Sioma, B.; Skorb, L.; de Souza, L.E.C.; Steegen, Sara; Stein, L.A.R.; Sternglanz, R.W.; Stojilović, D.; Storage, Daniel; Sullivan, G.B.; Szaszi, B.; Szecsi, Peter; Szöke, O.; Szuts, A.; Thomae, M.; Tidwell, N.D.; Tocco, C.; Torka, A.-K.; Tuerlinckx, Francis; Vanpaemel, Wolf; Vaughn, Leigh Ann; Vianello, Michelangelo; Viganola, D.; Vlachou, M.; Walker, R.J.; Weissgerber, Sophia C.; Wichman, A.L.; Wiggins, B.J.; Wolf, D.; Wood, M.J.; Zealley, D.; Žeželj, Iris; Zrubka, M.; Nosek, Brian A. (SAGE Publications Inc., 2020)