“reproducibility refers to the ability of a researcher to duplicate the results of a prior study using the same materials as were used by the original investigator. That is, a second researcher might use the same raw data to build the same analysis files and implement the same statistical analysis in an attempt to yield the same results. Reproducibility is a minimum necessary condition for a finding to be believable and informative.”
– U.S. National Science Foundation (NSF) subcommittee on replicability in science
Computer programs are expected to produce the same output for the same inputs. Is that true for research software?
Can you give some examples? What can we do about it?
Not all images can be trusted! There have been examples of contaminated images so investigate before using images blindly. Apply same caution as installing software packages from untrusted package repositories.
Arguments in favor (from Wikipedia):
Arguments against (from Wikipedia):
Even though this is usually referred to as “open data”, it means considering and making good decisions, even if non-open.
Note that FAIR principles do not require data/software to be open.
FAIR principles are usually discussed in the context of data, but they apply also for research software.