Reproducibility is a defining feature of science, but the extent to which it characterizes current research is unknown. We conducted replications of 100 experimental and correlational studies published in three psychology journals using high-powered designs and original materials when available. Replication effects were half the magnitude of original effects, representing a substantial decline. Ninety-seven percent of original studies had statistically significant results. Thirty-six percent of replications had statistically significant results; 47% of original effect sizes were in the 95% confidence interval of the replication effect size; 39% of effects were subjectively rated to have replicated the original result; and if no bias in original results is assumed, combining original and replication results left 68% with statistically significant effects. Correlational tests suggest that replication success was better predicted by the strength of original evidence than by characteristic...s of the original and replication teams.
Source:
Science, 2015, 349, 6251
Publisher:
Amer Assoc Advancement Science, Washington
Funding / projects:
Center for Open Science
Laura and John Arnold Foundation
Medical Research Council and UK Research & Innovation [MC_UU_12013/6] Funding
TY - JOUR
AU - Aarts, Alexander A.
AU - Anderson, Joanna E.
AU - Anderson, Christopher J.
AU - Attridge, Peter R.
AU - Attwood, Angela
AU - Axt, Jordan
AU - Babel, Molly
AU - Bahnik, Stepan
AU - Baranski, Erica
AU - Barnett-Cowan, Michael
AU - Bartmess, Elizabeth
AU - Beer, Jennifer
AU - Bell, Raoul
AU - Bentley, Heather
AU - Beyan, Leah
AU - Binion, Grace
AU - Borsboom, Denny
AU - Bosch, Annick
AU - Bosco, Frank A.
AU - Bowman, Sara D.
AU - Brandt, Mark J.
AU - Braswell, Erin
AU - Brohmer, Hilmar
AU - Brown, Benjamin T.
AU - Brown, Kristina
AU - Bruening, Jovita
AU - Calhoun-Sauls, Ann
AU - Callahan, Shannon P.
AU - Chagnon, Elizabeth
AU - Chandler, Jesse
AU - Chartier, Christopher R.
AU - Cheung, Felix
AU - Christopherson, Cody D.
AU - Cillessen, Linda
AU - Clay, Russ
AU - Cleary, Hayley
AU - Cloud, Mark D.
AU - Cohn, Michael
AU - Cohoon, Johanna
AU - Columbus, Simon
AU - Cordes, Andreas
AU - Costantini, Giulio
AU - Alvarez, Leslie D. Cramblet
AU - Cremata, Ed
AU - Crusius, Jan
AU - DeCoster, Jamie
AU - DeGaetano, Michelle A.
AU - Della Penna, Nicolas
AU - den Bezemer, Bobby
AU - Deserno, Marie K.
AU - Devitt, Olivia
AU - Dewitte, Laura
AU - Dobolyi, David G.
AU - Dodson, Geneva T.
AU - Donnellan, M. Brent
AU - Donohue, Ryan
AU - Dore, Rebecca A.
AU - Dorrough, Angela
AU - Dreber, Anna
AU - Dugas, Michelle
AU - Dunn, Elizabeth W.
AU - Easey, Kayleigh
AU - Eboigbe, Sylvia
AU - Eggleston, Casey
AU - Embley, Jo
AU - Epskamp, Sacha
AU - Errington, Timothy M.
AU - Estel, Vivien
AU - Farach, Frank J.
AU - Feather, Jenelle
AU - Fedor, Anna
AU - Fernandez-Castilla, Belen
AU - Fiedler, Susann
AU - Field, James G.
AU - Fitneva, Stanka A.
AU - Flagan, Taru
AU - Forest, Amanda L.
AU - Forsell, Eskil
AU - Foster, Joshua D.
AU - Frank, Michael C.
AU - Frazier, Rebecca S.
AU - Fuchs, Heather
AU - Gable, Philip
AU - Galak, Jeff
AU - Galliani, Elisa Maria
AU - Gampa, Anup
AU - Garcia, Sara
AU - Gazarian, Douglas
AU - Gilbert, Elizabeth
AU - Giner-Sorolla, Roger
AU - Gloeckner, Andreas
AU - Goellner, Lars
AU - Goh, Jin X.
AU - Goldberg, Rebecca
AU - Goodbourn, Patrick T.
AU - Gordon-McKeon, Shauna
AU - Gorges, Bryan
AU - Gorges, Jessie
AU - Goss, Justin
AU - Graham, Jesse
AU - Grange, James A.
AU - Gray, Jeremy
AU - Hartgerink, Chris
AU - Hartshorne, Joshua
AU - Hasselman, Fred
AU - Hayes, Timothy
AU - Heikensten, Emma
AU - Henninger, Felix
AU - Hodsoll, John
AU - Holubar, Taylor
AU - Hoogendoorn, Gea
AU - Humphries, Denise J.
AU - Hung, Cathy O. -Y.
AU - Immelman, Nathali
AU - Irsik, Vanessa C.
AU - Jahn, Georg
AU - Jaekel, Frank
AU - Jekel, Marc
AU - Johannesson, Magnus
AU - Johnson, Larissa G.
AU - Johnson, David J.
AU - Johnson, Kate M.
AU - Johnston, William J.
AU - Jonas, Kai
AU - Joy-Gaba, Jennifer
AU - Kappes, Heather Barry
AU - Kelso, Kim
AU - Kidwell, Mallory C.
AU - Kim, Seung Kyung
AU - Kirkhart, Matthew
AU - Kleinberg, Bennett
AU - Knežević, Goran
AU - Kolorz, Franziska Maria
AU - Kossakowski, Jolanda J.
AU - Krause, Robert Wilhelm
AU - Krijnen, Job
AU - Kuhlmann, Tim
AU - Kunkels, Yoram K.
AU - Kyc, Megan M.
AU - Lai, Calvin K.
AU - Laique, Aamir
AU - Lakens, Daniel
AU - Lane, Kristin A.
AU - Lassetter, Bethany
AU - Lazarević, Ljiljana
AU - LeBel, Etienne P.
AU - Lee, Key Jung
AU - Lee, Minha
AU - Lemm, Kristi
AU - Levitan, Carmel A.
AU - Lewis, Melissa
AU - Lin, Lin
AU - Lin, Stephanie
AU - Lippold, Matthias
AU - Loureiro, Darren
AU - Luteijn, Ilse
AU - Mackinnon, Sean
AU - Mainard, Heather N.
AU - Marigold, Denise C.
AU - Martin, Daniel P.
AU - Martinez, Tylar
AU - Masicampo, E. J.
AU - Matacotta, Josh
AU - Mathur, Maya
AU - May, Michael
AU - Mechin, Nicole
AU - Mehta, Pranjal
AU - Meixner, Johannes
AU - Melinger, Alissa
AU - Miller, Jeremy K.
AU - Miller, Mallorie
AU - Moore, Katherine
AU - Moeschl, Marcus
AU - Motyl, Matt
AU - Mueller, Stephanie M.
AU - Munafo, Marcus
AU - Neijenhuijs, Koen I.
AU - Nervi, Taylor
AU - Gandalf, Nicolas
AU - Nilsonne, Gustav
AU - Nosek, Brian A.
AU - Nuijten, Michele B.
AU - Olsson, Catherine
AU - Osborne, Colleen
AU - Ostkamp, Lutz
AU - Pavel, Misha
AU - Penton-Voak, Ian S.
AU - Perna, Olivia
AU - Pernet, Cyril
AU - Perugini, Marco
AU - Pipitone, R. Nathan
AU - Pitts, Michael
AU - Plessow, Franziska
AU - Prenoveau, Jason M.
AU - Rahal, Rima-Maria
AU - Ratliff, Kate A.
AU - Reinhard, David
AU - Renkewitz, Frank
AU - Ricker, Ashley A.
AU - Rigney, Anastasia
AU - Rivers, Andrew M.
AU - Roebke, Mark
AU - Rutchick, Abraham M.
AU - Ryan, Robert S.
AU - Sahin, Onur
AU - Saide, Anondah
AU - Sandstrom, Gillian M.
AU - Santos, David
AU - Saxe, Rebecca
AU - Schlegelmilch, Rene
AU - Schmidt, Kathleen
AU - Scholz, Sabine
AU - Seibel, Larissa
AU - Selterman, Dylan Faulkner
AU - Shaki, Samuel
AU - Simpson, William B.
AU - Sinclair, H. Colleen
AU - Skorinko, Jeanine L. M.
AU - Slowik, Agnieszka
AU - Snyder, Joel S.
AU - Soderberg, Courtney
AU - Sonnleitner, Carina
AU - Spencer, Nick
AU - Spies, Jeffrey R.
AU - Steegen, Sara
AU - Stieger, Stefan
AU - Strohminger, Nina
AU - Sullivan, Gavin B.
AU - Talhelm, Thomas
AU - Tapia, Megan
AU - te Dorsthorst, Anniek
AU - Thomae, Manuela
AU - Thomas, Sarah L.
AU - Tio, Pia
AU - Traets, Frits
AU - Tsang, Steve
AU - Tuerlinckx, Francis
AU - Turchan, Paul
AU - Valasek, Milan
AU - van 't Veer, Anna E.
AU - Van Aert, Robbie
AU - van Assen, Marcel
AU - van Bork, Riet
AU - van de Ven, Mathijs
AU - van den Bergh, Don
AU - van der Hulst, Marije
AU - van Dooren, Roel
AU - van Doorn, Johnny
AU - van Renswoude, Daan R.
AU - van Rijn, Hedderik
AU - Vanpaemel, Wolf
AU - Echeverria, Alejandro Vasquez
AU - Vazquez, Melissa
AU - Velez, Natalia
AU - Vermue, Marieke
AU - Verschoor, Mark
AU - Vianello, Michelangelo
AU - Voracek, Martin
AU - Vuu, Gina
AU - Wagenmakers, Eric-Jan
AU - Weerdmeester, Joanneke
AU - Welsh, Ashlee
AU - Westgate, Erin C.
AU - Wissink, Joeri
AU - Wood, Michael
AU - Woods, Andy
AU - Wright, Emily
AU - Wu, Sining
AU - Zeelenberg, Marcel
AU - Zuni, Kellylynn
PY - 2015
UR - http://reff.f.bg.ac.rs/handle/123456789/1992
AB - Reproducibility is a defining feature of science, but the extent to which it characterizes current research is unknown. We conducted replications of 100 experimental and correlational studies published in three psychology journals using high-powered designs and original materials when available. Replication effects were half the magnitude of original effects, representing a substantial decline. Ninety-seven percent of original studies had statistically significant results. Thirty-six percent of replications had statistically significant results; 47% of original effect sizes were in the 95% confidence interval of the replication effect size; 39% of effects were subjectively rated to have replicated the original result; and if no bias in original results is assumed, combining original and replication results left 68% with statistically significant effects. Correlational tests suggest that replication success was better predicted by the strength of original evidence than by characteristics of the original and replication teams.
PB - Amer Assoc Advancement Science, Washington
T2 - Science
T1 - Estimating the reproducibility of psychological science
IS - 6251
VL - 349
DO - 10.1126/science.aac4716
ER -
@article{
author = "Aarts, Alexander A. and Anderson, Joanna E. and Anderson, Christopher J. and Attridge, Peter R. and Attwood, Angela and Axt, Jordan and Babel, Molly and Bahnik, Stepan and Baranski, Erica and Barnett-Cowan, Michael and Bartmess, Elizabeth and Beer, Jennifer and Bell, Raoul and Bentley, Heather and Beyan, Leah and Binion, Grace and Borsboom, Denny and Bosch, Annick and Bosco, Frank A. and Bowman, Sara D. and Brandt, Mark J. and Braswell, Erin and Brohmer, Hilmar and Brown, Benjamin T. and Brown, Kristina and Bruening, Jovita and Calhoun-Sauls, Ann and Callahan, Shannon P. and Chagnon, Elizabeth and Chandler, Jesse and Chartier, Christopher R. and Cheung, Felix and Christopherson, Cody D. and Cillessen, Linda and Clay, Russ and Cleary, Hayley and Cloud, Mark D. and Cohn, Michael and Cohoon, Johanna and Columbus, Simon and Cordes, Andreas and Costantini, Giulio and Alvarez, Leslie D. Cramblet and Cremata, Ed and Crusius, Jan and DeCoster, Jamie and DeGaetano, Michelle A. and Della Penna, Nicolas and den Bezemer, Bobby and Deserno, Marie K. and Devitt, Olivia and Dewitte, Laura and Dobolyi, David G. and Dodson, Geneva T. and Donnellan, M. Brent and Donohue, Ryan and Dore, Rebecca A. and Dorrough, Angela and Dreber, Anna and Dugas, Michelle and Dunn, Elizabeth W. and Easey, Kayleigh and Eboigbe, Sylvia and Eggleston, Casey and Embley, Jo and Epskamp, Sacha and Errington, Timothy M. and Estel, Vivien and Farach, Frank J. and Feather, Jenelle and Fedor, Anna and Fernandez-Castilla, Belen and Fiedler, Susann and Field, James G. and Fitneva, Stanka A. and Flagan, Taru and Forest, Amanda L. and Forsell, Eskil and Foster, Joshua D. and Frank, Michael C. and Frazier, Rebecca S. and Fuchs, Heather and Gable, Philip and Galak, Jeff and Galliani, Elisa Maria and Gampa, Anup and Garcia, Sara and Gazarian, Douglas and Gilbert, Elizabeth and Giner-Sorolla, Roger and Gloeckner, Andreas and Goellner, Lars and Goh, Jin X. and Goldberg, Rebecca and Goodbourn, Patrick T. and Gordon-McKeon, Shauna and Gorges, Bryan and Gorges, Jessie and Goss, Justin and Graham, Jesse and Grange, James A. and Gray, Jeremy and Hartgerink, Chris and Hartshorne, Joshua and Hasselman, Fred and Hayes, Timothy and Heikensten, Emma and Henninger, Felix and Hodsoll, John and Holubar, Taylor and Hoogendoorn, Gea and Humphries, Denise J. and Hung, Cathy O. -Y. and Immelman, Nathali and Irsik, Vanessa C. and Jahn, Georg and Jaekel, Frank and Jekel, Marc and Johannesson, Magnus and Johnson, Larissa G. and Johnson, David J. and Johnson, Kate M. and Johnston, William J. and Jonas, Kai and Joy-Gaba, Jennifer and Kappes, Heather Barry and Kelso, Kim and Kidwell, Mallory C. and Kim, Seung Kyung and Kirkhart, Matthew and Kleinberg, Bennett and Knežević, Goran and Kolorz, Franziska Maria and Kossakowski, Jolanda J. and Krause, Robert Wilhelm and Krijnen, Job and Kuhlmann, Tim and Kunkels, Yoram K. and Kyc, Megan M. and Lai, Calvin K. and Laique, Aamir and Lakens, Daniel and Lane, Kristin A. and Lassetter, Bethany and Lazarević, Ljiljana and LeBel, Etienne P. and Lee, Key Jung and Lee, Minha and Lemm, Kristi and Levitan, Carmel A. and Lewis, Melissa and Lin, Lin and Lin, Stephanie and Lippold, Matthias and Loureiro, Darren and Luteijn, Ilse and Mackinnon, Sean and Mainard, Heather N. and Marigold, Denise C. and Martin, Daniel P. and Martinez, Tylar and Masicampo, E. J. and Matacotta, Josh and Mathur, Maya and May, Michael and Mechin, Nicole and Mehta, Pranjal and Meixner, Johannes and Melinger, Alissa and Miller, Jeremy K. and Miller, Mallorie and Moore, Katherine and Moeschl, Marcus and Motyl, Matt and Mueller, Stephanie M. and Munafo, Marcus and Neijenhuijs, Koen I. and Nervi, Taylor and Gandalf, Nicolas and Nilsonne, Gustav and Nosek, Brian A. and Nuijten, Michele B. and Olsson, Catherine and Osborne, Colleen and Ostkamp, Lutz and Pavel, Misha and Penton-Voak, Ian S. and Perna, Olivia and Pernet, Cyril and Perugini, Marco and Pipitone, R. Nathan and Pitts, Michael and Plessow, Franziska and Prenoveau, Jason M. and Rahal, Rima-Maria and Ratliff, Kate A. and Reinhard, David and Renkewitz, Frank and Ricker, Ashley A. and Rigney, Anastasia and Rivers, Andrew M. and Roebke, Mark and Rutchick, Abraham M. and Ryan, Robert S. and Sahin, Onur and Saide, Anondah and Sandstrom, Gillian M. and Santos, David and Saxe, Rebecca and Schlegelmilch, Rene and Schmidt, Kathleen and Scholz, Sabine and Seibel, Larissa and Selterman, Dylan Faulkner and Shaki, Samuel and Simpson, William B. and Sinclair, H. Colleen and Skorinko, Jeanine L. M. and Slowik, Agnieszka and Snyder, Joel S. and Soderberg, Courtney and Sonnleitner, Carina and Spencer, Nick and Spies, Jeffrey R. and Steegen, Sara and Stieger, Stefan and Strohminger, Nina and Sullivan, Gavin B. and Talhelm, Thomas and Tapia, Megan and te Dorsthorst, Anniek and Thomae, Manuela and Thomas, Sarah L. and Tio, Pia and Traets, Frits and Tsang, Steve and Tuerlinckx, Francis and Turchan, Paul and Valasek, Milan and van 't Veer, Anna E. and Van Aert, Robbie and van Assen, Marcel and van Bork, Riet and van de Ven, Mathijs and van den Bergh, Don and van der Hulst, Marije and van Dooren, Roel and van Doorn, Johnny and van Renswoude, Daan R. and van Rijn, Hedderik and Vanpaemel, Wolf and Echeverria, Alejandro Vasquez and Vazquez, Melissa and Velez, Natalia and Vermue, Marieke and Verschoor, Mark and Vianello, Michelangelo and Voracek, Martin and Vuu, Gina and Wagenmakers, Eric-Jan and Weerdmeester, Joanneke and Welsh, Ashlee and Westgate, Erin C. and Wissink, Joeri and Wood, Michael and Woods, Andy and Wright, Emily and Wu, Sining and Zeelenberg, Marcel and Zuni, Kellylynn",
year = "2015",
abstract = "Reproducibility is a defining feature of science, but the extent to which it characterizes current research is unknown. We conducted replications of 100 experimental and correlational studies published in three psychology journals using high-powered designs and original materials when available. Replication effects were half the magnitude of original effects, representing a substantial decline. Ninety-seven percent of original studies had statistically significant results. Thirty-six percent of replications had statistically significant results; 47% of original effect sizes were in the 95% confidence interval of the replication effect size; 39% of effects were subjectively rated to have replicated the original result; and if no bias in original results is assumed, combining original and replication results left 68% with statistically significant effects. Correlational tests suggest that replication success was better predicted by the strength of original evidence than by characteristics of the original and replication teams.",
publisher = "Amer Assoc Advancement Science, Washington",
journal = "Science",
title = "Estimating the reproducibility of psychological science",
number = "6251",
volume = "349",
doi = "10.1126/science.aac4716"
}
Aarts, A. A., Anderson, J. E., Anderson, C. J., Attridge, P. R., Attwood, A., Axt, J., Babel, M., Bahnik, S., Baranski, E., Barnett-Cowan, M., Bartmess, E., Beer, J., Bell, R., Bentley, H., Beyan, L., Binion, G., Borsboom, D., Bosch, A., Bosco, F. A., Bowman, S. D., Brandt, M. J., Braswell, E., Brohmer, H., Brown, B. T., Brown, K., Bruening, J., Calhoun-Sauls, A., Callahan, S. P., Chagnon, E., Chandler, J., Chartier, C. R., Cheung, F., Christopherson, C. D., Cillessen, L., Clay, R., Cleary, H., Cloud, M. D., Cohn, M., Cohoon, J., Columbus, S., Cordes, A., Costantini, G., Alvarez, L. D. C., Cremata, E., Crusius, J., DeCoster, J., DeGaetano, M. A., Della Penna, N., den Bezemer, B., Deserno, M. K., Devitt, O., Dewitte, L., Dobolyi, D. G., Dodson, G. T., Donnellan, M. B., Donohue, R., Dore, R. A., Dorrough, A., Dreber, A., Dugas, M., Dunn, E. W., Easey, K., Eboigbe, S., Eggleston, C., Embley, J., Epskamp, S., Errington, T. M., Estel, V., Farach, F. J., Feather, J., Fedor, A., Fernandez-Castilla, B., Fiedler, S., Field, J. G., Fitneva, S. A., Flagan, T., Forest, A. L., Forsell, E., Foster, J. D., Frank, M. C., Frazier, R. S., Fuchs, H., Gable, P., Galak, J., Galliani, E. M., Gampa, A., Garcia, S., Gazarian, D., Gilbert, E., Giner-Sorolla, R., Gloeckner, A., Goellner, L., Goh, J. X., Goldberg, R., Goodbourn, P. T., Gordon-McKeon, S., Gorges, B., Gorges, J., Goss, J., Graham, J., Grange, J. A., Gray, J., Hartgerink, C., Hartshorne, J., Hasselman, F., Hayes, T., Heikensten, E., Henninger, F., Hodsoll, J., Holubar, T., Hoogendoorn, G., Humphries, D. J., Hung, C. O. -Y., Immelman, N., Irsik, V. C., Jahn, G., Jaekel, F., Jekel, M., Johannesson, M., Johnson, L. G., Johnson, D. J., Johnson, K. M., Johnston, W. J., Jonas, K., Joy-Gaba, J., Kappes, H. B., Kelso, K., Kidwell, M. C., Kim, S. K., Kirkhart, M., Kleinberg, B., Knežević, G., Kolorz, F. M., Kossakowski, J. J., Krause, R. W., Krijnen, J., Kuhlmann, T., Kunkels, Y. K., Kyc, M. M., Lai, C. K., Laique, A., Lakens, D., Lane, K. A., Lassetter, B., Lazarević, L., LeBel, E. P., Lee, K. J., Lee, M., Lemm, K., Levitan, C. A., Lewis, M., Lin, L., Lin, S., Lippold, M., Loureiro, D., Luteijn, I., Mackinnon, S., Mainard, H. N., Marigold, D. C., Martin, D. P., Martinez, T., Masicampo, E. J., Matacotta, J., Mathur, M., May, M., Mechin, N., Mehta, P., Meixner, J., Melinger, A., Miller, J. K., Miller, M., Moore, K., Moeschl, M., Motyl, M., Mueller, S. M., Munafo, M., Neijenhuijs, K. I., Nervi, T., Gandalf, N., Nilsonne, G., Nosek, B. A., Nuijten, M. B., Olsson, C., Osborne, C., Ostkamp, L., Pavel, M., Penton-Voak, I. S., Perna, O., Pernet, C., Perugini, M., Pipitone, R. N., Pitts, M., Plessow, F., Prenoveau, J. M., Rahal, R., Ratliff, K. A., Reinhard, D., Renkewitz, F., Ricker, A. A., Rigney, A., Rivers, A. M., Roebke, M., Rutchick, A. M., Ryan, R. S., Sahin, O., Saide, A., Sandstrom, G. M., Santos, D., Saxe, R., Schlegelmilch, R., Schmidt, K., Scholz, S., Seibel, L., Selterman, D. F., Shaki, S., Simpson, W. B., Sinclair, H. C., Skorinko, J. L. M., Slowik, A., Snyder, J. S., Soderberg, C., Sonnleitner, C., Spencer, N., Spies, J. R., Steegen, S., Stieger, S., Strohminger, N., Sullivan, G. B., Talhelm, T., Tapia, M., te Dorsthorst, A., Thomae, M., Thomas, S. L., Tio, P., Traets, F., Tsang, S., Tuerlinckx, F., Turchan, P., Valasek, M., van 't Veer, A. E., Van Aert, R., van Assen, M., van Bork, R., van de Ven, M., van den Bergh, D., van der Hulst, M., van Dooren, R., van Doorn, J., van Renswoude, D. R., van Rijn, H., Vanpaemel, W., Echeverria, A. V., Vazquez, M., Velez, N., Vermue, M., Verschoor, M., Vianello, M., Voracek, M., Vuu, G., Wagenmakers, E., Weerdmeester, J., Welsh, A., Westgate, E. C., Wissink, J., Wood, M., Woods, A., Wright, E., Wu, S., Zeelenberg, M.,& Zuni, K.. (2015). Estimating the reproducibility of psychological science. in Science
Amer Assoc Advancement Science, Washington., 349(6251).
https://doi.org/10.1126/science.aac4716
Aarts AA, Anderson JE, Anderson CJ, Attridge PR, Attwood A, Axt J, Babel M, Bahnik S, Baranski E, Barnett-Cowan M, Bartmess E, Beer J, Bell R, Bentley H, Beyan L, Binion G, Borsboom D, Bosch A, Bosco FA, Bowman SD, Brandt MJ, Braswell E, Brohmer H, Brown BT, Brown K, Bruening J, Calhoun-Sauls A, Callahan SP, Chagnon E, Chandler J, Chartier CR, Cheung F, Christopherson CD, Cillessen L, Clay R, Cleary H, Cloud MD, Cohn M, Cohoon J, Columbus S, Cordes A, Costantini G, Alvarez LDC, Cremata E, Crusius J, DeCoster J, DeGaetano MA, Della Penna N, den Bezemer B, Deserno MK, Devitt O, Dewitte L, Dobolyi DG, Dodson GT, Donnellan MB, Donohue R, Dore RA, Dorrough A, Dreber A, Dugas M, Dunn EW, Easey K, Eboigbe S, Eggleston C, Embley J, Epskamp S, Errington TM, Estel V, Farach FJ, Feather J, Fedor A, Fernandez-Castilla B, Fiedler S, Field JG, Fitneva SA, Flagan T, Forest AL, Forsell E, Foster JD, Frank MC, Frazier RS, Fuchs H, Gable P, Galak J, Galliani EM, Gampa A, Garcia S, Gazarian D, Gilbert E, Giner-Sorolla R, Gloeckner A, Goellner L, Goh JX, Goldberg R, Goodbourn PT, Gordon-McKeon S, Gorges B, Gorges J, Goss J, Graham J, Grange JA, Gray J, Hartgerink C, Hartshorne J, Hasselman F, Hayes T, Heikensten E, Henninger F, Hodsoll J, Holubar T, Hoogendoorn G, Humphries DJ, Hung CO-, Immelman N, Irsik VC, Jahn G, Jaekel F, Jekel M, Johannesson M, Johnson LG, Johnson DJ, Johnson KM, Johnston WJ, Jonas K, Joy-Gaba J, Kappes HB, Kelso K, Kidwell MC, Kim SK, Kirkhart M, Kleinberg B, Knežević G, Kolorz FM, Kossakowski JJ, Krause RW, Krijnen J, Kuhlmann T, Kunkels YK, Kyc MM, Lai CK, Laique A, Lakens D, Lane KA, Lassetter B, Lazarević L, LeBel EP, Lee KJ, Lee M, Lemm K, Levitan CA, Lewis M, Lin L, Lin S, Lippold M, Loureiro D, Luteijn I, Mackinnon S, Mainard HN, Marigold DC, Martin DP, Martinez T, Masicampo EJ, Matacotta J, Mathur M, May M, Mechin N, Mehta P, Meixner J, Melinger A, Miller JK, Miller M, Moore K, Moeschl M, Motyl M, Mueller SM, Munafo M, Neijenhuijs KI, Nervi T, Gandalf N, Nilsonne G, Nosek BA, Nuijten MB, Olsson C, Osborne C, Ostkamp L, Pavel M, Penton-Voak IS, Perna O, Pernet C, Perugini M, Pipitone RN, Pitts M, Plessow F, Prenoveau JM, Rahal R, Ratliff KA, Reinhard D, Renkewitz F, Ricker AA, Rigney A, Rivers AM, Roebke M, Rutchick AM, Ryan RS, Sahin O, Saide A, Sandstrom GM, Santos D, Saxe R, Schlegelmilch R, Schmidt K, Scholz S, Seibel L, Selterman DF, Shaki S, Simpson WB, Sinclair HC, Skorinko JLM, Slowik A, Snyder JS, Soderberg C, Sonnleitner C, Spencer N, Spies JR, Steegen S, Stieger S, Strohminger N, Sullivan GB, Talhelm T, Tapia M, te Dorsthorst A, Thomae M, Thomas SL, Tio P, Traets F, Tsang S, Tuerlinckx F, Turchan P, Valasek M, van 't Veer AE, Van Aert R, van Assen M, van Bork R, van de Ven M, van den Bergh D, van der Hulst M, van Dooren R, van Doorn J, van Renswoude DR, van Rijn H, Vanpaemel W, Echeverria AV, Vazquez M, Velez N, Vermue M, Verschoor M, Vianello M, Voracek M, Vuu G, Wagenmakers E, Weerdmeester J, Welsh A, Westgate EC, Wissink J, Wood M, Woods A, Wright E, Wu S, Zeelenberg M, Zuni K. Estimating the reproducibility of psychological science. in Science. 2015;349(6251).
doi:10.1126/science.aac4716 .
Aarts, Alexander A., Anderson, Joanna E., Anderson, Christopher J., Attridge, Peter R., Attwood, Angela, Axt, Jordan, Babel, Molly, Bahnik, Stepan, Baranski, Erica, Barnett-Cowan, Michael, Bartmess, Elizabeth, Beer, Jennifer, Bell, Raoul, Bentley, Heather, Beyan, Leah, Binion, Grace, Borsboom, Denny, Bosch, Annick, Bosco, Frank A., Bowman, Sara D., Brandt, Mark J., Braswell, Erin, Brohmer, Hilmar, Brown, Benjamin T., Brown, Kristina, Bruening, Jovita, Calhoun-Sauls, Ann, Callahan, Shannon P., Chagnon, Elizabeth, Chandler, Jesse, Chartier, Christopher R., Cheung, Felix, Christopherson, Cody D., Cillessen, Linda, Clay, Russ, Cleary, Hayley, Cloud, Mark D., Cohn, Michael, Cohoon, Johanna, Columbus, Simon, Cordes, Andreas, Costantini, Giulio, Alvarez, Leslie D. Cramblet, Cremata, Ed, Crusius, Jan, DeCoster, Jamie, DeGaetano, Michelle A., Della Penna, Nicolas, den Bezemer, Bobby, Deserno, Marie K., Devitt, Olivia, Dewitte, Laura, Dobolyi, David G., Dodson, Geneva T., Donnellan, M. Brent, Donohue, Ryan, Dore, Rebecca A., Dorrough, Angela, Dreber, Anna, Dugas, Michelle, Dunn, Elizabeth W., Easey, Kayleigh, Eboigbe, Sylvia, Eggleston, Casey, Embley, Jo, Epskamp, Sacha, Errington, Timothy M., Estel, Vivien, Farach, Frank J., Feather, Jenelle, Fedor, Anna, Fernandez-Castilla, Belen, Fiedler, Susann, Field, James G., Fitneva, Stanka A., Flagan, Taru, Forest, Amanda L., Forsell, Eskil, Foster, Joshua D., Frank, Michael C., Frazier, Rebecca S., Fuchs, Heather, Gable, Philip, Galak, Jeff, Galliani, Elisa Maria, Gampa, Anup, Garcia, Sara, Gazarian, Douglas, Gilbert, Elizabeth, Giner-Sorolla, Roger, Gloeckner, Andreas, Goellner, Lars, Goh, Jin X., Goldberg, Rebecca, Goodbourn, Patrick T., Gordon-McKeon, Shauna, Gorges, Bryan, Gorges, Jessie, Goss, Justin, Graham, Jesse, Grange, James A., Gray, Jeremy, Hartgerink, Chris, Hartshorne, Joshua, Hasselman, Fred, Hayes, Timothy, Heikensten, Emma, Henninger, Felix, Hodsoll, John, Holubar, Taylor, Hoogendoorn, Gea, Humphries, Denise J., Hung, Cathy O. -Y., Immelman, Nathali, Irsik, Vanessa C., Jahn, Georg, Jaekel, Frank, Jekel, Marc, Johannesson, Magnus, Johnson, Larissa G., Johnson, David J., Johnson, Kate M., Johnston, William J., Jonas, Kai, Joy-Gaba, Jennifer, Kappes, Heather Barry, Kelso, Kim, Kidwell, Mallory C., Kim, Seung Kyung, Kirkhart, Matthew, Kleinberg, Bennett, Knežević, Goran, Kolorz, Franziska Maria, Kossakowski, Jolanda J., Krause, Robert Wilhelm, Krijnen, Job, Kuhlmann, Tim, Kunkels, Yoram K., Kyc, Megan M., Lai, Calvin K., Laique, Aamir, Lakens, Daniel, Lane, Kristin A., Lassetter, Bethany, Lazarević, Ljiljana, LeBel, Etienne P., Lee, Key Jung, Lee, Minha, Lemm, Kristi, Levitan, Carmel A., Lewis, Melissa, Lin, Lin, Lin, Stephanie, Lippold, Matthias, Loureiro, Darren, Luteijn, Ilse, Mackinnon, Sean, Mainard, Heather N., Marigold, Denise C., Martin, Daniel P., Martinez, Tylar, Masicampo, E. J., Matacotta, Josh, Mathur, Maya, May, Michael, Mechin, Nicole, Mehta, Pranjal, Meixner, Johannes, Melinger, Alissa, Miller, Jeremy K., Miller, Mallorie, Moore, Katherine, Moeschl, Marcus, Motyl, Matt, Mueller, Stephanie M., Munafo, Marcus, Neijenhuijs, Koen I., Nervi, Taylor, Gandalf, Nicolas, Nilsonne, Gustav, Nosek, Brian A., Nuijten, Michele B., Olsson, Catherine, Osborne, Colleen, Ostkamp, Lutz, Pavel, Misha, Penton-Voak, Ian S., Perna, Olivia, Pernet, Cyril, Perugini, Marco, Pipitone, R. Nathan, Pitts, Michael, Plessow, Franziska, Prenoveau, Jason M., Rahal, Rima-Maria, Ratliff, Kate A., Reinhard, David, Renkewitz, Frank, Ricker, Ashley A., Rigney, Anastasia, Rivers, Andrew M., Roebke, Mark, Rutchick, Abraham M., Ryan, Robert S., Sahin, Onur, Saide, Anondah, Sandstrom, Gillian M., Santos, David, Saxe, Rebecca, Schlegelmilch, Rene, Schmidt, Kathleen, Scholz, Sabine, Seibel, Larissa, Selterman, Dylan Faulkner, Shaki, Samuel, Simpson, William B., Sinclair, H. Colleen, Skorinko, Jeanine L. M., Slowik, Agnieszka, Snyder, Joel S., Soderberg, Courtney, Sonnleitner, Carina, Spencer, Nick, Spies, Jeffrey R., Steegen, Sara, Stieger, Stefan, Strohminger, Nina, Sullivan, Gavin B., Talhelm, Thomas, Tapia, Megan, te Dorsthorst, Anniek, Thomae, Manuela, Thomas, Sarah L., Tio, Pia, Traets, Frits, Tsang, Steve, Tuerlinckx, Francis, Turchan, Paul, Valasek, Milan, van 't Veer, Anna E., Van Aert, Robbie, van Assen, Marcel, van Bork, Riet, van de Ven, Mathijs, van den Bergh, Don, van der Hulst, Marije, van Dooren, Roel, van Doorn, Johnny, van Renswoude, Daan R., van Rijn, Hedderik, Vanpaemel, Wolf, Echeverria, Alejandro Vasquez, Vazquez, Melissa, Velez, Natalia, Vermue, Marieke, Verschoor, Mark, Vianello, Michelangelo, Voracek, Martin, Vuu, Gina, Wagenmakers, Eric-Jan, Weerdmeester, Joanneke, Welsh, Ashlee, Westgate, Erin C., Wissink, Joeri, Wood, Michael, Woods, Andy, Wright, Emily, Wu, Sining, Zeelenberg, Marcel, Zuni, Kellylynn, "Estimating the reproducibility of psychological science" in Science, 349, no. 6251 (2015),
https://doi.org/10.1126/science.aac4716 . .
Related items
Showing items related by title, author, creator and subject.
