Transparency is critical to the integrity of the scientific process. When a researcher explains what he or she intends to study, makes the elements of the experiment easily accessible, and publishes the findings regardless of whether they confirm the hypothesis, we can have greater confidence in the results. However, a great deal of research fails to meet this standard. Reporting requirements within the scientific community are often weak and lack enforceability. Furthermore, scientific journals frequently show a strong bias for provocative findings and statistically significant results. This perpetuates the “publish or perish” culture. Researchers, who have a better chance of securing future funding when their previous studies have been featured in prominent journals, are incentivized to alter their research and manipulate results, which compromises the pursuit of scientific truth. By partnering with scholars, evaluators, and scientific journals to make the process more transparent, LJAF is working to address this issue and ensure the reliability and validity of scientific research.
We are the lead funder of the Center for Open Science, an organization that is building free, open-source research tools, promoting the adoption of high-quality methods, and conducting metascience research to better understand the gaps between scientific values and existing practices. The Center’s signature project, the Open Science Framework (OSF), allows scientists to preregister their studies by submitting a description of the project before the analyses are performed. This is an important step, as preregistration makes it possible for others to assess whether a study’s findings truly confirm the stated hypothesis. In addition to preregistering studies, researchers use the OSF to make their datasets, computer code, and results publicly available. Sharing this information, even in instances where findings are not published in a peer-reviewed journal, expands the body of scientific literature and helps to accelerate scientific discovery.
COS Co-Founder Brian Nosek describes how the organization is working to improve the way science is conducted and communicated.