Reproducibility in Management Science
The result's identifiers
Result code in IS VaVaI
<a href="https://www.isvavai.cz/riv?ss=detail&h=RIV%2F00216224%3A14560%2F24%3A00135279" target="_blank" >RIV/00216224:14560/24:00135279 - isvavai.cz</a>
Alternative codes found
RIV/61384399:31130/24:00060119
Result on the web
<a href="https://pubsonline.informs.org/doi/full/10.1287/mnsc.2023.03556" target="_blank" >https://pubsonline.informs.org/doi/full/10.1287/mnsc.2023.03556</a>
DOI - Digital Object Identifier
<a href="http://dx.doi.org/10.1287/mnsc.2023.03556" target="_blank" >10.1287/mnsc.2023.03556</a>
Alternative languages
Result language
angličtina
Original language name
Reproducibility in Management Science
Original language description
With the help of more than 700 reviewers we assess the reproducibility of nearly 500 articles published in the journal Management Science before and after the introduction of a new Data and Code Disclosure policy in 2019. When considering only articles for which data accessibility and hard- and software requirements were not an obstacle for reviewers, the results of more than 95 % of articles under the new disclosure policy could be fully or largely computationally reproduced. However, for 29 % of articles at least part of the dataset was not accessible to the reviewer. Considering all articles in our sample reduces the share of reproduced articles to 68 %. These figures represent a significant increase compared to the period before the introduction of the disclosure policy, where only 12% of articles voluntarily provided replication materials, out of which 55 % could be (largely) reproduced. Substantial heterogeneity in reproducibility rates across different fields is mainly driven by differences in dataset accessibility. Other reasons for unsuccessful reproduction attempts include missing code, unresolvable code errors, weak or missing documentation, but also soft- and hardware requirements and code complexity. Our findings highlight the importance of journal code and data disclosure policies, and suggest potential avenues for enhancing their effectiveness.
Czech name
—
Czech description
—
Classification
Type
J<sub>imp</sub> - Article in a specialist periodical, which is included in the Web of Science database
CEP classification
—
OECD FORD branch
50200 - Economics and Business
Result continuities
Project
—
Continuities
I - Institucionalni podpora na dlouhodoby koncepcni rozvoj vyzkumne organizace
Others
Publication year
2024
Confidentiality
S - Úplné a pravdivé údaje o projektu nepodléhají ochraně podle zvláštních právních předpisů
Data specific for result type
Name of the periodical
MANAGEMENT SCIENCE
ISSN
0025-1909
e-ISSN
1526-5501
Volume of the periodical
70
Issue of the periodical within the volume
3
Country of publishing house
US - UNITED STATES
Number of pages
14
Pages from-to
1343-1356
UT code for WoS article
001132639700001
EID of the result in the Scopus database
2-s2.0-85187694519