SC21 will be organizing an artifact evaluation process. More details can be found in the call for artifacts (https://sc21.supercomputing.org/submit/reproducibility-initiative/). We are seeking senior graduate students, postdocs, and early-career researchers to join the Artifact Evaluation Committee (AEC). As a committee member, you will judge artifact descriptions during the paper submission and evaluate artifacts of accepted papers. You will evaluate how well each artifact supports its paper and give feedback to its authors. Finally, you will help to decide which papers will receive badges.

In a first step, the AEC will review the artifact description of each paper submission in May and communicate the accuracy of the description to the program committee. In a second step, we expect each AEC member will evaluate 2–4 artifacts of accepted papers and that each evaluation will take about 10–20 hours. AEC members “bid” on artifacts starting at the beginning of July. The main evaluation period runs from July to end of August. Nominees should make sure that they have enough time and availability for the AEC during all of these timeframes.

If you are interested in becoming a part of the Artifact Evaluation Committee, please fill out the following form. For any questions or concerns, feel free to reach out to the organizing chairs at https://sc21.supercomputing.org/contact-us/?topic=AD/AE%20Appendices.