Interactively-Propagative Attention Learning for Implicit Discourse Relation Recognition

08/12/2020

Interactively-Propagative Attention Learning for Implicit Discourse Relation Recognition

Huibin Ruan, Yu Hong, Yang Xu, Zhen Huang, Guodong Zhou, Min Zhang

Keywords:

Abstract Paper Similar Papers

Abstract: We tackle implicit discourse relation recognition. Both self-attention and interactive-attention mechanisms have been applied for attention-aware representation learning, which improves the current discourse analysis models. To take advantages of the two attention mechanisms simultaneously, we develop a propagative attention learning model using a cross-coupled two-channel network. We experiment on Penn Discourse Treebank. The test results demonstrate that our model yields substantial improvements over the baselines (BiLSTM and BERT).

The video of this talk cannot be embedded. You can watch it here:

https://underline.io/lecture/6132-interactively-propagative-attention-learning-for-implicit-discourse-relation-recognition

(Link will open in new window)

0

0

0

0

Share

This is an embedded video. Talk and the respective paper are published at COLING 2020 virtual conference. If you are one of the authors of the paper and want to manage your upload, see the question "My papertalk has been externally embedded..." in the FAQ section.

Comments

Post Comment

no comments yet

Similar Papers

01/07/2020

Multi-Task Supervised Pretraining for Neural Domain Adaptation

Sara Meftah, Nasredine Semmar, Mohamed-Ayoub Tahiri and
Youssef Tamaazousti, Hassane Essafi, Fatiha Sadat

Keywords Paper

0

0

0

0

15:47

04/07/2020

Active Learning for Coreference Resolution using Discrete Annotation

Belinda Z. Li, Gabriel Stanovsky, Luke Zettlemoyer

Keywords Paper

Coreference Resolution, active resolution, Active Learning, Discrete Annotation

0

0

0

0

6:36

26/04/2020

Sharing Knowledge in Multi-Task Deep Reinforcement Learning

Carlo D'Eramo, Davide Tateo, Andrea Bonarini and
Marcello Restelli, Jan Peters

Keywords Paper

Deep Reinforcement Learning, Multi-Task

0

0

0

0

4:27

22/11/2021

Cross-Modal Generative Augmentation for Visual Question Answering

Zixu Wang, Yishu Miao, Lucia Specia

Keywords Paper

visual question answering, data augmentation, generative model, multimodal machine learning

0

0

0

0

2:49

04/07/2020

Semi-Supervised Semantic Dependency Parsing Using CRF Autoencoders

Zixia Jia, Youmi Ma, Jiong Cai, Kewei Tu

Keywords Paper

Semantic parsing, semi-supervised parsers, parsing, learning

0

0

0

0

10:49

16/11/2020

PatchBERT: Just-in-Time, Out-of-Vocabulary Patching

Sangwhan Moon, Naoaki Okazaki

Keywords Paper

natural processing, downstream tasks, mitigation, large models

0

0

0

0

7:02

03/05/2021

Improving Transformation Invariance in Contrastive Representation Learning

Adam Foster, Rattana Pukdee, Tom Rainforth

Keywords Paper

transformation invariance, contrastive learning, representation learning

0

0

0

0

5:23

02/02/2021

Bridging Towers of Multi-task Learning with a Gating Mechanism for Aspect-based Sentiment Analysis and Sequential Metaphor Identification

Rui Mao, Xiao Li

Keywords Paper

0

0

0

0

19:27

22/11/2021

Leveraging Class Hierarchies with Metric-Guided Prototype Learning

Vivien Sainte Fare Garnot, Loic Landrieu

Keywords Paper

hierarchical classification, class hierarchy, prototype learning, prototypical networks, metric-guiding

0

0

0

0

3:01

07/06/2020

MimicProp: Learning to Incorporate Lexicon Knowledge into Distributed Word Representation for Social Media Analysis

Muheng Yan, Yu-Ru Lin, Rebecca Hwa and
Ali Mert Ertugrul, Meiqi Guo, Wen-Ting Chung

Keywords Paper

classification, embeddings, impact, learning, performance, representations, terms, texts, word embeddings, words

0

0

0

0

10:25

04/07/2020

Cross-modal Coherence Modeling for Caption Generation

Malihe Alikhani, Piyush Sharma, Shengjie Li and
Radu Soricut, Matthew Stone

Keywords Paper

Caption Generation, image captioning, coherence prediction, Cross-modal Modeling

0

0

0

0

13:14

03/05/2021

Learning Task Decomposition with Ordered Memory Policy Network

Yuchen Lu, Yikang Shen, Siyuan Zhou and
Aaron Courville, Joshua B Tenenbaum, Chuang Gan

Keywords Paper

Task Segmentation, Network Inductive Bias, Hierarchical Imitation Learning

0

0

0

0

4:57

26/04/2020

Progressive learning and disentanglement of hierarchical representations

Zhiyuan Li, Jaideep Vitthal Murkute, Prashnna Kumar Gyawali, Linwei Wang

Keywords Paper

generative model, disentanglement, progressive learning, VAE

0

0

0

0

5:06

13/04/2021

Counterfactual representation learning with balancing weights

Serge Assaad, Shuxi Zeng, Chenyang Tao and
Shounak Datta, Nikhil Mehta, Ricardo Henao, Fan Li, Lawrence Carin Duke

Keywords Paper

0

0

0

0

3:05

02/02/2021

A Simple and Effective Self-Supervised Contrastive Learning Framework for Aspect Detection

Tian Shi, Liuqing Li, Ping Wang, Chandan K. Reddy

Keywords Paper

0

0

0

0

19:21

26/04/2020

Meta-Q-Learning

Rasool Fakoor, Pratik Chaudhari, Stefano Soatto, Alexander J. Smola

Keywords Paper

meta reinforcement learning, propensity estimation, off-policy

0

0

0

0

15:50

19/04/2021

Enhancing sequence-to-sequence neural lemmatization with external resources

Kirill Milintsevich, Kairit Sirts

Keywords Paper

0

0

0

0

12:00

06/12/2021

Flexible Option Learning

Martin Klissarov, Doina Precup

Keywords Paper

reinforcement learning and planning

1

0

0

0

15:47

16/11/2020

BERT-enhanced Relational Sentence Ordering Network

Baiyun Cui, Yingming Li, Zhongfei Zhang

Keywords Paper

bert-enhanced network, brson, bert, coherence modeling

0

0

0

0

11:33

04/07/2020

Multidirectional Associative Optimization of Function-Specific Word Representations

Daniela Gerz, Ivan Vulić, Marek Rei and
Roi Reichart, Anna Korhonen

Keywords Paper

estimating preference, Multidirectional Representations, neural framework, task-independent model

0

0

0

0

12:35

02/02/2021

A General Class of Transfer Learning Regression without Implementation Cost

Shunya Minami, Song Liu, Stephen Wu and
Kenji Fukumizu, Ryo Yoshida

Keywords Paper

0

0

0

0

14:13

04/07/2020

Multi-Granularity Interaction Network for Extractive and Abstractive Multi-Document Summarization

Hanqi Jin, Tianming Wang, Xiaojun Wan

Keywords Paper

Extractive Summarization, Extractive , abstractive summarization, Multi-Granularity Network

0

0

0

0

10:38

03/05/2021

Learning Robust State Abstractions for Hidden-Parameter Block MDPs

Amy Zhang, Shagun Sodhani, Khimya Khetarpal, Joelle Pineau

Keywords Paper

bisimulation, block mdp, hidden-parameter mdp, multi-task reinforcement learning

0

0

0

0

4:17

18/07/2021

Phasic Policy Gradient

Karl Cobbe, Jacob Hilton, Oleg Klimov, John Schulman

Keywords Paper

Reinforcement Learning and Planning, Deep RL

0

0

0

0

20:40

03/05/2021

$i$-Mix: A Domain-Agnostic Strategy for Contrastive Representation Learning

Kibok Lee, Yian Zhu, Kihyuk Sohn and
Chun-Liang Li, Jinwoo Shin, Honglak Lee

Keywords Paper

self-supervised learning, unsupervised representation learning, data augmentation, MixUp, contrastive representation learning

0

0

0

0

5:04

02/02/2021

Augmented Partial Mutual Learning with Frame Masking for Video Captioning

Ke Lin, Zhuoxin Gan, Liwei Wang

Keywords Paper

0

0

0

0

16:57

26/10/2020

Integrating Acting, Planning, and Learning in Hierarchical Operational Models

Sunandita Patra, James Mason, Amit Kumar and
Malik Ghallab, Paolo Traverso, Dana Nau

Keywords Paper

integrated planning and acting, integrated planning and learning, hierarchical operational models, online planning, dynamic environments

0

0

0

0

11:35

02/02/2021

Dynamic Automaton-Guided Reward Shaping for Monte Carlo Tree Search

Alvaro Velasquez, Brett Bissey, Lior Barak and
Andre Beckus, Ismail Alkhouri, Daniel Melcer, George Atia

Keywords Paper

0

0

0

0

18:52

16/11/2020

Learning to Represent Image and Text with Denotation Graph

Bowen Zhang, Hexiang Hu, Vihan Jain and
Eugene Ie, Fei Sha

Keywords Paper

cross-modal retrieval, referring expression, compositional recognition, pre-training

0

0

0

0

10:59

02/02/2021

Self-Supervised Hypergraph Convolutional Networks for Session-based Recommendation

Xin Xia, Hongzhi Yin, Junliang Yu and
Qinyong Wang, Lizhen Cui, Xiangliang Zhang

Keywords Paper

0

0

0

0

21:04

03/05/2021

Learning and Evaluating Representations for Deep One-Class Classification

Kihyuk Sohn, Chun-Liang Li, Jinsung Yoon and
Minho Jin, Tomas Pfister

Keywords Paper

self-supervised learning, deep one-class classification

0

0

0

1

5:13

04/07/2020

Highway Transformer: Self-Gating Enhanced Self-Attentive Networks

Yekun Chai, Shuo Jin, Xinwen Hou

Keywords Paper

sequence tasks, optimization process, Highway Transformer, Self-Gating Networks

0

0

0

0

12:14

03/05/2021

Evaluating the Disentanglement of Deep Generative Models through Manifold Topology

Sharon Zhou, Eric Zelikman, Fred Lu and
Andrew Ng, Gunnar E Carlsson, Stefano Ermon

Keywords Paper

generative models, disentanglement, evaluation

0

0

0

0

5:06

16/11/2020

Textual Data Augmentation for Efficient Active Learning on Tiny Datasets

Husam Quteineh, Spyridon Samothrakis, Richard Sutcliffe

Keywords Paper

data task, optimization problem, non-guided process, trec-

0

0

0

0

11:20

02/02/2021

Exploring Auxiliary Reasoning Tasks for Task-oriented Dialog Systems with Meta Cooperative Learning

Bowen Qin, Min Yang, Lidong Bing and
Qingshan Jiang, Chengming Li, Ruifeng Xu

Keywords Paper

0

0

0

0

15:41

14/06/2020

Exploring Self-Attention for Image Recognition

Hengshuang Zhao, Jiaya Jia, Vladlen Koltun

Keywords Paper

self-attention, pairwise, patchwise, vector attention, image recognition

0

0

0

0

1:02

03/05/2021

CPR: Classifier-Projection Regularization for Continual Learning

Sungmin Cha, Hsiang Hsu, Taebaek Hwang and
Flavio Calmon, Taesup Moon

Keywords Paper

regularization, wide local minima, continual learning

0

0

0

1

5:21

19/10/2020

OFFER: A motif dimensional framework for network representation learning

Shuo Yu, Feng Xia, Jin Xu and
Zhikui Chen, Ivan Lee

Keywords Paper

network motif, multivariate relationship, link prediction, network representation learning

0

0

0

0

5:01

18/11/2020

Dual learning: Theoretical study and an algorithmic extension

Zhibing Zhao, Yingce Xia, Tao Qin and
Lirong Xia, Tie-Yan Liu

Keywords Paper

0

0

0

0

10:01

26/04/2020

Unsupervised Model Selection for Variational Disentangled Representation Learning

Sunny Duan, Loic Matthey, Andre Saraiva and
Nick Watters, Chris Burgess, Alexander Lerchner, Irina Higgins

Keywords Paper

unsupervised disentanglement metric, disentangling, representation learning

0

0

0

0

5:02