17/08/2020

Code replicability in computer graphics

Nicolas Bonneel, David Coeurjolly, Julie Digne, Nicolas Mellado

Keywords: replicability, open source, siggraph, code review, reproducibility

Abstract Paper Similar Papers

Abstract: Being able to duplicate published research results is an important process of conducting research whether to build upon these findings or to compare with them. This process is called "replicability" when using the original authors’ artifacts (e.g., code), or "reproducibility" otherwise (e.g., re-implementing algorithms). Reproducibility and replicability of research results have gained a lot of interest recently with assessment studies being led in various fields, and they are often seen as a trigger for better result diffusion and transparency. In this work, we assess replicability in Computer Graphics, by evaluating whether the code is available and whether it works properly. As a proxy for this field we compiled, ran and analyzed 151 codes out of 374 papers from 2014, 2016 and 2018 SIGGRAPH conferences. This analysis shows a clear increase in the number of papers with available and operational research codes with a dependency on the subfields, and indicates a correlation between code replicability and citation count. We further provide an interactive tool to explore our results and evaluation data.

The video of this talk cannot be embedded. You can watch it here:
https://dl.acm.org/doi/10.1145/3386569.3392413#sec-supp
(Link will open in new window)
 0
 0
 0
 0
  Share    
This is an embedded video. Talk and the respective paper are published at SIGGRAPH 2020 virtual conference. If you are one of the authors of the paper and want to manage your upload, see the question "My papertalk has been externally embedded..." in the FAQ section.

Comments

Post Comment
no comments yet
code of conduct: tbd Characters remaining: 140

Similar Papers

 0
 0
 0
 0
 11:52 
 0
 0
 0
 0
 14:51 
 0
 0
 0
 0
 5:59 
 0
 0
 0
 0
 14:56 
 0
 0
 0
 0
 8:44 
 0
 0
 0
 0
 12:17 
 0
 0
 0
 0
 10:07 
 0
 0
 0
 0
 16:01 
 0
 0
 0
 0
 12:15 
 0
 0
 0
 0
 15:50 
 0
 0
 0
 0
 10:29 
 0
 0
 0
 0
 14:49 
 0
 0
 0
 0
 16:16 
 0
 0
 0
 0
 19:25 
 0
 0
 0
 0
 24:57 
 0
 0
 0
 0
 22:04 
 0
 0
 0
 0
 15:21 
 0
 0
 0
 0
 15:42 
 0
 0
 0
 0
 21:09 
 0
 0
 0
 0
 16:16 
 0
 0
 0
 0
 6:36 
 0
 0
 0
 1
 14:39 
 0
 0
 0
 0
 20:47 
 0
 0
 0
 0
 20:15 
 0
 0
 0
 0
 5:10 
 0
 0
 0
 0
 15:16 
 0
 0
 0
 0
 12:40 
 0
 0
 0
 0
 10:26 
 0
 0
 0
 0
 11:14 
 0
 0
 0
 0
 3:12 
 0
 0
 0
 0
 11:40 
 0
 0
 0
 0
 13:48 
 0
 0
 0
 0
 17:08 
 0
 0
 0
 0
 16:10 
 0
 0
 0
 0
 9:31 
 0
 0
 0
 0
 10:05 
 0
 0
 0
 0
 15:58 
 0
 0
 0
 0
 6:14 
 0
 0
 0
 0
 13:22 
 0
 0
 0
 0
 5:39