23/06/2021

Test-Case Reduction and Deduplication Almost for Free with Transformation-Based Compiler Testing

Alastair F. Donaldson, Paul Thomson, Vasyl Teliman, Stefano Milizia, André Perez Maselco, Antoni Karpiński

Keywords: Compilers, metamorphic testing, SPIR-V

Abstract Paper Code Similar Papers

Abstract: Recent transformation-based approaches to compiler testing look for mismatches between the results of pairs of equivalent programs, where one program is derived from the other by randomly applying semantics-preserving transformations. We present a formulation of transformation-based compiler testing that provides effective test-case reduction almost for free: if transformations are designed to be as small and independent as possible, standard delta debugging can be used to shrink a bug-inducing transformation sequence to a smaller subsequence that still triggers the bug. The bug can then be reported as a delta between an original and minimally-transformed program. Minimized transformation sequences can also be used to heuristically deduplicate a set of bug-inducing tests, recommending manual investigation of those that involve disparate types of transformations and thus may have different root causes. We demonstrate the effectiveness of our approach via a new tool, spirv-fuzz, the first compiler-testing tool for the SPIR-V intermediate representation that underpins the Vulkan GPU programming model.

The video of this talk cannot be embedded. You can watch it here:
https://slideslive.com/38956317
(Link will open in new window)
 0
 0
 0
 0
  Share    
This is an embedded video. Talk and the respective paper are published at PLDI 2021 virtual conference. If you are one of the authors of the paper and want to manage your upload, see the question "My papertalk has been externally embedded..." in the FAQ section.

Comments

Post Comment
no comments yet
code of conduct: tbd Characters remaining: 140

Similar Papers

 0
 0
 0
 0
 6:27 
 0
 0
 0
 0
 13:48 
 0
 0
 0
 0
 15:43 
 0
 0
 0
 0
 15:52 
 0
 0
 0
 0
 14:33 
 0
 0
 0
 0
 14:59 
 0
 0
 0
 0
 15:21 
 0
 0
 0
 0
 16:14 
 0
 0
 0
 0
 12:18 
 0
 0
 0
 0
 15:11 
 0
 0
 0
 0
 16:16 
 0
 0
 0
 1
 14:39 
 0
 0
 0
 0
 7:18 
 0
 0
 0
 0
 18:05 
 0
 0
 0
 0
 3:30 
 0
 0
 0
 0
 16:29 
 0
 0
 0
 0
 16:00 
 0
 0
 0
 0
 3:23 
 0
 0
 0
 0
 5:02 
 0
 0
 0
 0
 8:44 
 0
 0
 0
 0
 12:00 
 0
 0
 0
 0
 4:15 
 0
 0
 0
 0
 5:00 
 0
 0
 0
 0
 12:40 
 0
 0
 0
 1
 5:06 
 0
 0
 0
 0
 22:15 
 0
 0
 0
 0
 14:33 
 0
 0
 0
 1
 14:57 
 0
 0
 0
 0
 6:43 
 0
 0
 0
 0
 11:27 
 0
 0
 0
 0
 22:48 
 0
 0
 0
 0
 5:17 
 0
 0
 0
 0
 21:04 
 0
 0
 0
 0
 15:08 
 0
 0
 0
 0
 15:08 
 0
 0
 0
 0
 20:26 
 0
 0
 0
 0
 5:06 
 0
 0
 0
 0
 17:28 
 0
 0
 0
 0
 15:28 
 0
 0
 0
 0
 14:57