02/02/2021

A Scalable Reasoning and Learning Approach for Neural-Symbolic Stream Fusion

Danh Le-Phuoc, Thomas Eiter, Anh Le-Tuan

Keywords:

Abstract Paper Similar Papers

Abstract: Driven by deep neural networks (DNN), the recent development of computer vision makes vision sensors such as stereo cameras and Lidars ubiquitous in autonomous cars, robotics and traffic monitoring. However, a traditional DNN-based data fusion pipeline like object tracking has to hard-wire an engineered set of DNN models to a fixed processing logic, which makes it difficult to infuse new models to that pipeline. To overcome this, we propose a novel neural-symbolic stream reasoning approach realised by semantic stream reasoning programs which specify DNN-based data fusion pipelines via logic rules with learnable probabilistic degrees as weights. The reasoning task over this program is governed by a novel incremental reasoning algorithm, which lends itself also as a core building block for a scalable and parallel algorithm to learn the weights for such program. Extensive experiments with our first prototype on multi-object tracking benchmarks for autonomous driving and traffic monitoring show that our flexible approach can considerably improve both accuracy and processing throughput compared to the DNN-based counterparts.

The video of this talk cannot be embedded. You can watch it here:
https://slideslive.com/38948487
(Link will open in new window)
 0
 0
 0
 0
  Share    
This is an embedded video. Talk and the respective paper are published at AAAI 2021 virtual conference. If you are one of the authors of the paper and want to manage your upload, see the question "My papertalk has been externally embedded..." in the FAQ section.

Comments

Post Comment
no comments yet
code of conduct: tbd Characters remaining: 140

Similar Papers

 0
 0
 0
 0
 1:01 
 0
 0
 0
 0
 5:00 
 0
 0
 0
 0
 5:06 
 0
 0
 0
 0
 4:03 
 0
 0
 0
 0
 10:05 
 0
 0
 0
 0
 5:05 
 0
 0
 0
 0
 20:29 
 0
 0
 0
 0
 5:31 
 0
 0
 0
 0
 12:25 
 0
 0
 0
 0
 3:28 
 0
 0
 0
 0
 3:04 
 0
 0
 1
 0
 3:20 
 0
 0
 0
 0
 1:01 
 1
 0
 0
 0
 4:39 
 0
 0
 0
 0
 4:59 
 0
 0
 0
 0
 1:01 
 0
 0
 0
 0
 13:40 
 0
 0
 0
 0
 4:50 
 0
 0
 0
 0
 11:21 
 0
 0
 0
 0
 3:09 
 0
 0
 0
 0
 13:45 
 0
 0
 0
 0
 5:05 
 0
 0
 0
 0
 12:35 
 0
 0
 0
 0
 20:54 
 0
 0
 0
 0
 1:02 
 0
 0
 0
 0
 3:02 
 0
 0
 0
 0
 3:20 
 0
 0
 0
 0
 3:18 
 0
 0
 0
 0
 2:49 
 0
 0
 0
 0
 21:49 
 0
 0
 0
 0
 15:15 
 0
 0
 0
 0
 14:57 
 0
 0
 0
 0
 5:50 
 0
 0
 0
 0
 3:10 
 0
 0
 0
 0
 15:01 
 0
 0
 0
 0
 14:04 
 0
 0
 0
 0
 13:58 
 0
 0
 0
 0
 8:43 
 0
 0
 0
 0
 13:31 
 0
 0
 0
 0
 18:00