Reproducibility is a fundamental principle of research, and crucial in scientific disciplines such as climate research which impact decision and policy making and, eventually, our daily lives. This does not only apply to experimental and empirical research, but also to research relying on software and simulations. In the past decade or so, the so-called replication crisis has led to a number of initiatives and networks which address issues with computational reproducibility. One such initiative is the ReproHack community and hub.
The Institute of Computing for Climate Science (ICCS) Research Software Engineers (RSE) team is organising a ReproHack for the climate research community. A ReproHack is an event where the participants come together to reproduce computational key results of research papers which have been submitted for this purpose before the event. This provides a number of benefits for both the participants and the authors of the papers:
-
The participants learn hands-on about research reproducibility and software best practices. Going back to their own codes and research after the event they will be aware how they can improve their practices.
-
The participants will also have the experience of working in a team with an unfamiliar code. Less experienced programmers can see how experienced coders approach the task, and gain confidence talking about their thought processes and problems.
-
The paper authors receive feedback on the reproducibility of their papers as well as the code, which helps them improve. This is particularly useful if they submit papers which have not yet been published, as they can incorporate the feedback.
By joining our event, you agree to abide by our Code of Conduct
Two ways to get involved:
Nominate a paper
We invite nominations for papers that have both associated code and data publicly available. We also encourage analyses based on open source tools as we cannot guarantee participants will have access to specialised licenced software.
See list below for paper associated with this event or browse the full list of submitted papers. You can also consult our author guidelines for more information.
Review and reproduce a paper
Join us at the hack to dig into exciting science, learn more about reproducibility, working with other people’s code and data and more!
Agenda
| Time (UTC) | Event |
|---|---|
| 13:00 | Welcome and Orientation |
| 13:10 | Ice breaker session |
| 13:40 | Talk with Alejandro Coca-Castro on "The Turing Way" |
| 14:00 | Tips and Tricks for Reproducing and Reviewing. |
| 14:10 | Select papers, chat and coffee |
| 14:30 | Round I of ReproHacking (break-out rooms) |
| 15:30 | Re-group and sharing of experiences |
| 15:50 | Coffee break |
| 16:15 | Round II of ReproHacking (break-out rooms) - Complete Feedback Form |
| 17:15 | Re-group and sharing of experiences |
| 17:45 | Feedback and Closing |
| 18:00 | End |
On the day
We’ll track of discussions and collaborative notes on the event hackpad
As all ReproHack events, we strive to make this event open and inclusive to all. As such the event is governed by the ReproHack Code of Conduct. Please read it before participating. By participating, you are expected to uphold this code.
Authors
We encourage authors that are keen and submitting to a specific event, to engage with the event, even just to say hello! You can do so on twitter (check for event specific hashtags or use @ReproHack) or by joining the review-chat channel in our slack group. We’ve also set up an authors channel in our slack group as a place where you can reach the organisers prior to the hack.
Participants
Further participant information can be found in the event hackpad.
Registration
Please register yourself here and find more information on the event website. Closing date for sign-up is February 29th by the end of the day.