We don’t know what you did last summer. On the importance of transparent reporting of reaction time data pre-processing
Аутори
Loenneker, Hannah DorotheaBuchanan, Erin M.
Martinovici, Ana
Primbs, Maximilian A.
Elsherif, Mahmoud Medhat
Baker, Bradley J.
Dudda, Leonie A.
Filipović Đurđević, Dušica
Mišić, Ksenija
Peetz, Hannah K.
Röer, Jan Philipp
Schulze, Lars
Wagner, Lisa
Wolska, Julia Katharina
Kührt, Korinna
Pronizius, Ekaterina
Препринт (Радна верзија)
Метаподаци
Приказ свих података о документуАпстракт
In behavioral, cognitive, and social sciences, reaction time measures are an important source of information. However, analyses on reaction time data are affected by researchers’ analytical choices and the order in which these choices are applied. The results of a systematic literature review, presented in this paper, revealed that the justification for and order in which analytical choices are conducted are rarely reported, leading to difficulty in reproducing results and interpreting mixed findings. To address this methodological shortcoming, we created a checklist on reporting reaction time pre-processing to make these decisions more explicit, improve transparency, and thus, promote best practices within the field. The importance of the pre-processing checklist was additionally supported by an expert consensus survey and a multiverse analysis. Consequently, we appeal for maximal transparency on all methods applied and offer a checklist to improve replicability and reproducibility of... studies that use reaction time measures.
Кључне речи:
checklist / open scholarship / pre-processing / reaction time / transparencyИзвор:
PsychArxiv Preprints, 2022Институција/група
Psihologija / PsychologyTY - GEN AU - Loenneker, Hannah Dorothea AU - Buchanan, Erin M. AU - Martinovici, Ana AU - Primbs, Maximilian A. AU - Elsherif, Mahmoud Medhat AU - Baker, Bradley J. AU - Dudda, Leonie A. AU - Filipović Đurđević, Dušica AU - Mišić, Ksenija AU - Peetz, Hannah K. AU - Röer, Jan Philipp AU - Schulze, Lars AU - Wagner, Lisa AU - Wolska, Julia Katharina AU - Kührt, Korinna AU - Pronizius, Ekaterina PY - 2022 UR - http://reff.f.bg.ac.rs/handle/123456789/5488 AB - In behavioral, cognitive, and social sciences, reaction time measures are an important source of information. However, analyses on reaction time data are affected by researchers’ analytical choices and the order in which these choices are applied. The results of a systematic literature review, presented in this paper, revealed that the justification for and order in which analytical choices are conducted are rarely reported, leading to difficulty in reproducing results and interpreting mixed findings. To address this methodological shortcoming, we created a checklist on reporting reaction time pre-processing to make these decisions more explicit, improve transparency, and thus, promote best practices within the field. The importance of the pre-processing checklist was additionally supported by an expert consensus survey and a multiverse analysis. Consequently, we appeal for maximal transparency on all methods applied and offer a checklist to improve replicability and reproducibility of studies that use reaction time measures. T2 - PsychArxiv Preprints T1 - We don’t know what you did last summer. On the importance of transparent reporting of reaction time data pre-processing DO - 10.31234/osf.io/tgzdk ER -
@misc{ author = "Loenneker, Hannah Dorothea and Buchanan, Erin M. and Martinovici, Ana and Primbs, Maximilian A. and Elsherif, Mahmoud Medhat and Baker, Bradley J. and Dudda, Leonie A. and Filipović Đurđević, Dušica and Mišić, Ksenija and Peetz, Hannah K. and Röer, Jan Philipp and Schulze, Lars and Wagner, Lisa and Wolska, Julia Katharina and Kührt, Korinna and Pronizius, Ekaterina", year = "2022", abstract = "In behavioral, cognitive, and social sciences, reaction time measures are an important source of information. However, analyses on reaction time data are affected by researchers’ analytical choices and the order in which these choices are applied. The results of a systematic literature review, presented in this paper, revealed that the justification for and order in which analytical choices are conducted are rarely reported, leading to difficulty in reproducing results and interpreting mixed findings. To address this methodological shortcoming, we created a checklist on reporting reaction time pre-processing to make these decisions more explicit, improve transparency, and thus, promote best practices within the field. The importance of the pre-processing checklist was additionally supported by an expert consensus survey and a multiverse analysis. Consequently, we appeal for maximal transparency on all methods applied and offer a checklist to improve replicability and reproducibility of studies that use reaction time measures.", journal = "PsychArxiv Preprints", title = "We don’t know what you did last summer. On the importance of transparent reporting of reaction time data pre-processing", doi = "10.31234/osf.io/tgzdk" }
Loenneker, H. D., Buchanan, E. M., Martinovici, A., Primbs, M. A., Elsherif, M. M., Baker, B. J., Dudda, L. A., Filipović Đurđević, D., Mišić, K., Peetz, H. K., Röer, J. P., Schulze, L., Wagner, L., Wolska, Julia Katharina, Kührt, K.,& Pronizius, E.. (2022). We don’t know what you did last summer. On the importance of transparent reporting of reaction time data pre-processing. in PsychArxiv Preprints. https://doi.org/10.31234/osf.io/tgzdk
Loenneker HD, Buchanan EM, Martinovici A, Primbs MA, Elsherif MM, Baker BJ, Dudda LA, Filipović Đurđević D, Mišić K, Peetz HK, Röer JP, Schulze L, Wagner L, Wolska, Julia Katharina, Kührt K, Pronizius E. We don’t know what you did last summer. On the importance of transparent reporting of reaction time data pre-processing. in PsychArxiv Preprints. 2022;. doi:10.31234/osf.io/tgzdk .
Loenneker, Hannah Dorothea, Buchanan, Erin M., Martinovici, Ana, Primbs, Maximilian A., Elsherif, Mahmoud Medhat, Baker, Bradley J., Dudda, Leonie A., Filipović Đurđević, Dušica, Mišić, Ksenija, Peetz, Hannah K., Röer, Jan Philipp, Schulze, Lars, Wagner, Lisa, Wolska, Julia Katharina, Kührt, Korinna, Pronizius, Ekaterina, "We don’t know what you did last summer. On the importance of transparent reporting of reaction time data pre-processing" in PsychArxiv Preprints (2022), https://doi.org/10.31234/osf.io/tgzdk . .