19/10/2020

WebLens: Towards interactive large-scale structured data profiling

Rituparna Khan, Michael Gubanov

Keywords: relational model, large-scale structured data, metadata profiling

Abstract Paper Similar Papers

Abstract: Data profiling is a "set of statistical data analysis activities and processes to determine properties of a given dataset". Historically,most of the data profiling tasks were aimed at data. At scale, when a dataset has millions of tables, their meta-data (i.e. titles, attribute names and types) becomes abundant similar to data instances, and its profiling starts playing a vital role.Here we demonstrate our work on WebLens- an interactive, scalable metadata profiler for large-scale structured data. At its core is a new data structure - Metadata-profile, coupled with Machine/Deep-Learning models trained to construct it. It represents a meta-data summary of a specific real world object collected over millions of data sources. Such profiles significantly simplify access to large-scale structured datasets for both data scientists and end users.Finally, we performed a user study with 20 students and found WebLens trained models significantly outperform 20 people on the task of construction of metadata-profiles for 10 objects from different domains. For demonstration and evaluation we used a large-scale dataset of ’15 Million relational English tables from the Web.

The video of this talk cannot be embedded. You can watch it here:
https://dl.acm.org/doi/10.1145/3340531.3417443#sec-supp
(Link will open in new window)
 0
 0
 0
 0
  Share    
This is an embedded video. Talk and the respective paper are published at CIKM 2020 virtual conference. If you are one of the authors of the paper and want to manage your upload, see the question "My papertalk has been externally embedded..." in the FAQ section.

Comments

Post Comment
no comments yet
code of conduct: tbd Characters remaining: 140

Similar Papers

 0
 0
 0
 0
 11:14 
 0
 0
 0
 0
 5:59 
 0
 0
 0
 0
 11:29 
 0
 0
 0
 0
 8:44 
 0
 0
 0
 0
 1:00 
 0
 0
 0
 0
 31:24 
 0
 0
 0
 0
 12:54 
 0
 0
 0
 0
 8:30 
 0
 0
 0
 0
 14:08 
 0
 0
 0
 0
 14:10 
 0
 1
 1
 1
 3:24 
 0
 0
 0
 0
 6:29 
 0
 0
 0
 0
 12:19 
 0
 0
 0
 0
 11:44 
 0
 0
 0
 0
 1:03 
 0
 0
 0
 0
 29:33 
 0
 0
 0
 0
 5:09 
 0
 0
 0
 0
 5:13 
 0
 0
 0
 0
 4:56 
 0
 0
 0
 0
 14:43 
 0
 0
 0
 0
 10:14 
 0
 0
 0
 0
 7:16 
 0
 0
 0
 0
 2:42 
 0
 0
 0
 0
 12:21 
 0
 0
 0
 0
 6:36 
 0
 0
 0
 0
 7:14 
 0
 0
 0
 0
 4:50 
 0
 0
 0
 0
 5:14 
 0
 0
 0
 0
 3:29 
 0
 0
 0
 0
 11:16 
 0
 0
 0
 0
 11:52 
 0
 0
 0
 0
 15:07 
 0
 0
 0
 0
 16:27 
 0
 0
 0
 0
 2:25 
 0
 0
 0
 0
 3:06 
 0
 0
 0
 0
 5:15 
 0
 0
 0
 0
 15:43 
 0
 0
 0
 0
 16:04 
 0
 0
 0
 0
 11:33 
 0
 0
 0
 0
 3:25