Many Analysts, One Data Set: Making Transparent How Variations in Analytic Choices Affect Results

R. Silberzahn, E. L. Uhlmann, D. P. Martin et al., 2018. Advances in Methods and Practices in Psychological Science.

Twenty-nine teams analysed the same data set to answer the same question about soccer referees and skin tone, and reached a wide range of estimates.

Voynich ManuscriptArticledoi: 10.1177/2515245917747646Checked against the original0

What it's used for here

The inquiry-framework survey cites it to show how much processing choices can change a result.

Cited by on this site 1 record

1 methods surveys

Frameworks of inquiry

SRC

Cite it

Silberzahn, R., Uhlmann, E. L., Martin, D. P., Anselmi, P., Aust, F., Awtrey, E., Bahník, Š., Bai, F., Bannard, C., Bonnier, E., Carlsson, R., Cheung, F., Christensen, G., Clay, R., Craig, M. A., Dalla Rosa, A., Dam, L., Evans, M. H., Flores Cervantes, I., Fong, N., Gamez-Djokic, M., Glenz, A., Gordon-McKeon, S., Heaton, T. J., Hederos, K., Heene, M., Hofelich Mohr, A. J., Högden, F., Hui, K., Johannesson, M., Kalodimos, J., Kaszubowski, E., Kennedy, D. M., Lei, R., Lindsay, T. A., Liverani, S., Madan, C. R., Molden, D., Molleman, E., Morey, R. D., Mulder, L. B., Nijstad, B. R., Pope, N. G., Pope, B., Prenoveau, J. M., Rink, F., Robusto, E., Roderique, H., Sandberg, A., Schlüter, E., Schönbrodt, F. D., Sherman, M. F., Sommer, S. A., Sotak, K., Spain, S., Spörlein, C., Stafford, T., Stefanutti, L., Tauber, S., Ullrich, J., Vianello, M., Wagenmakers, E. J., Witkowiak, M., Yoon, S., & Nosek, B. A. (2018). Many Analysts, One Data Set: Making Transparent How Variations in Analytic Choices Affect Results. Advances in Methods and Practices in Psychological Science. https://doi.org/10.1177/2515245917747646

@article{silberzahn2018many,
  author = {Silberzahn, R. and Uhlmann, E. L. and Martin, D. P. and Anselmi, P. and Aust, F. and Awtrey, E. and Bahník, Š. and Bai, F. and Bannard, C. and Bonnier, E. and Carlsson, R. and Cheung, F. and Christensen, G. and Clay, R. and Craig, M. A. and Dalla Rosa, A. and Dam, L. and Evans, M. H. and Flores Cervantes, I. and Fong, N. and Gamez-Djokic, M. and Glenz, A. and Gordon-McKeon, S. and Heaton, T. J. and Hederos, K. and Heene, M. and Hofelich Mohr, A. J. and Högden, F. and Hui, K. and Johannesson, M. and Kalodimos, J. and Kaszubowski, E. and Kennedy, D. M. and Lei, R. and Lindsay, T. A. and Liverani, S. and Madan, C. R. and Molden, D. and Molleman, E. and Morey, R. D. and Mulder, L. B. and Nijstad, B. R. and Pope, N. G. and Pope, B. and Prenoveau, J. M. and Rink, F. and Robusto, E. and Roderique, H. and Sandberg, A. and Schlüter, E. and Schönbrodt, F. D. and Sherman, M. F. and Sommer, S. A. and Sotak, K. and Spain, S. and Spörlein, C. and Stafford, T. and Stefanutti, L. and Tauber, S. and Ullrich, J. and Vianello, M. and Wagenmakers, E.-J. and Witkowiak, M. and Yoon, S. and Nosek, B. A.},
  title = {Many Analysts, One Data Set: Making Transparent How Variations in Analytic Choices Affect Results},
  journal = {Advances in Methods and Practices in Psychological Science},
  year = {2018},
  doi = {10.1177/2515245917747646},
  url = {https://doi.org/10.1177/2515245917747646}
}

TY  - JOUR
TI  - Many Analysts, One Data Set: Making Transparent How Variations in Analytic Choices Affect Results
AU  - Silberzahn, R.
AU  - Uhlmann, E. L.
AU  - Martin, D. P.
AU  - Anselmi, P.
AU  - Aust, F.
AU  - Awtrey, E.
AU  - Bahník, Š.
AU  - Bai, F.
AU  - Bannard, C.
AU  - Bonnier, E.
AU  - Carlsson, R.
AU  - Cheung, F.
AU  - Christensen, G.
AU  - Clay, R.
AU  - Craig, M. A.
AU  - Dalla Rosa, A.
AU  - Dam, L.
AU  - Evans, M. H.
AU  - Flores Cervantes, I.
AU  - Fong, N.
AU  - Gamez-Djokic, M.
AU  - Glenz, A.
AU  - Gordon-McKeon, S.
AU  - Heaton, T. J.
AU  - Hederos, K.
AU  - Heene, M.
AU  - Hofelich Mohr, A. J.
AU  - Högden, F.
AU  - Hui, K.
AU  - Johannesson, M.
AU  - Kalodimos, J.
AU  - Kaszubowski, E.
AU  - Kennedy, D. M.
AU  - Lei, R.
AU  - Lindsay, T. A.
AU  - Liverani, S.
AU  - Madan, C. R.
AU  - Molden, D.
AU  - Molleman, E.
AU  - Morey, R. D.
AU  - Mulder, L. B.
AU  - Nijstad, B. R.
AU  - Pope, N. G.
AU  - Pope, B.
AU  - Prenoveau, J. M.
AU  - Rink, F.
AU  - Robusto, E.
AU  - Roderique, H.
AU  - Sandberg, A.
AU  - Schlüter, E.
AU  - Schönbrodt, F. D.
AU  - Sherman, M. F.
AU  - Sommer, S. A.
AU  - Sotak, K.
AU  - Spain, S.
AU  - Spörlein, C.
AU  - Stafford, T.
AU  - Stefanutti, L.
AU  - Tauber, S.
AU  - Ullrich, J.
AU  - Vianello, M.
AU  - Wagenmakers, E.-J.
AU  - Witkowiak, M.
AU  - Yoon, S.
AU  - Nosek, B. A.
PY  - 2018
JO  - Advances in Methods and Practices in Psychological Science
DO  - 10.1177/2515245917747646
UR  - https://doi.org/10.1177/2515245917747646
ER  -

Silberzahn, R. et al.. “Many Analysts, One Data Set: Making Transparent How Variations in Analytic Choices Affect Results.” Advances in Methods and Practices in Psychological Science (2018). https://doi.org/10.1177/2515245917747646.