02/02/2021

TripleTree: A Versatile Interpretable Representation of Black Box Agents and their Environments

Tom Bewley, Jonathan Lawry

Keywords:

Abstract Paper Similar Papers

Abstract: In explainable artificial intelligence, there is increasing interest in understanding the behaviour of autonomous agents to build trust and validate performance. Modern agent architectures, such as those trained by deep reinforcement learning, are currently so lacking in interpretable structure as to effectively be black boxes, but insights may still be gained from an external, behaviourist perspective. Inspired by conceptual spaces theory, we suggest that a versatile first step towards general understanding is to discretise the state space into convex regions, jointly capturing similarities over the agent's action, value function and temporal dynamics within a dataset of observations. We create such a representation using a novel variant of the CART decision tree algorithm, and demonstrate how it facilitates practical understanding of black box agents through prediction, visualisation and rule-based explanation.

The video of this talk cannot be embedded. You can watch it here:
https://slideslive.com/38948123
(Link will open in new window)
 0
 0
 0
 0
  Share    
This is an embedded video. Talk and the respective paper are published at AAAI 2021 virtual conference. If you are one of the authors of the paper and want to manage your upload, see the question "My papertalk has been externally embedded..." in the FAQ section.

Comments

Post Comment
no comments yet
code of conduct: tbd Characters remaining: 140

Similar Papers

 0
 0
 0
 0
 2:28 
 0
 0
 0
 0
 5:05 
 0
 0
 0
 0
 16:43 
 0
 0
 0
 0
 12:31 
 0
 0
 0
 0
 18:50 
 0
 0
 0
 0
 14:43 
 0
 0
 0
 0
 4:51 
 0
 0
 0
 0
 5:14 
 0
 0
 0
 0
 11:47 
 0
 0
 0
 0
 15:15 
 0
 0
 0
 0
 17:44 
 0
 0
 0
 0
 11:24 
 0
 0
 0
 0
 16:11 
 0
 0
 0
 0
 18:48 
 0
 0
 0
 0
 3:08 
 0
 0
 0
 0
 5:10 
 0
 0
 0
 0
 14:02 
 0
 0
 0
 0
 14:48 
 0
 0
 0
 0
 13:54 
 0
 0
 0
 0
 4:39 
 0
 0
 0
 0
 9:42 
 0
 0
 0
 0
 18:27 
 0
 0
 0
 0
 11:26 
 0
 0
 0
 0
 5:14 
 0
 0
 0
 0
 15:02 
 0
 0
 0
 0
 8:43 
 0
 0
 0
 0
 3:19 
 0
 0
 0
 0
 3:15 
 0
 0
 0
 0
 13:41 
 0
 0
 0
 0
 4:59 
 0
 0
 0
 0
 12:13 
 0
 0
 0
 0
 15:25 
 0
 0
 0
 0
 3:28 
 0
 0
 0
 0
 5:34 
 0
 0
 0
 0
 14:44 
 0
 0
 0
 0
 16:18 
 0
 0
 0
 1
 9:09 
 0
 0
 0
 0
 12:05 
 0
 0
 0
 0
 3:27 
 0
 0
 0
 0
 16:26