02/02/2021

Generate Your Counterfactuals: Towards Controlled Counterfactual Generation for Text

Nishtha Madaan, Inkit Padhi, Naveen Panwar, Diptikalyan Saha

Keywords:

Abstract Paper Similar Papers

Abstract: Machine Learning has seen tremendous growth recently, which has led to a larger adaptation of ML systems for educational assessments, credit risk, healthcare, employment, criminal justice, to name a few. The trustworthiness of ML and NLP systems is a crucial aspect and requires a guarantee that the decisions they make are fair and robust. Aligned with this, we propose a novel framework GYC, to generate a set of exhaustive counterfactual text, which are crucial for testing these ML systems. Our main contributions include a) We introduce GYC, a framework to generate counterfactual samples such that the generation is plausible, diverse, goal-oriented, and effective, b) We generate counterfactual samples, that can direct the generation towards a corresponding \texttt{condition} such as named-entity tag, semantic role label, or sentiment. Our experimental results on various domains show that GYC generates counterfactual text samples exhibiting the above four properties. GYC generates counterfactuals that can act as test cases to evaluate a model and any text debiasing algorithm.

The video of this talk cannot be embedded. You can watch it here:
https://slideslive.com/38948383
(Link will open in new window)
 0
 0
 0
 0
  Share    
This is an embedded video. Talk and the respective paper are published at AAAI 2021 virtual conference. If you are one of the authors of the paper and want to manage your upload, see the question "My papertalk has been externally embedded..." in the FAQ section.

Comments

Post Comment
no comments yet
code of conduct: tbd Characters remaining: 140

Similar Papers

 0
 0
 0
 0
 11:24 
 0
 0
 0
 0
 5:11 
 0
 0
 0
 0
 5:18 
 0
 0
 0
 0
 14:30 
 0
 0
 0
 0
 5:05 
 0
 0
 0
 0
 3:17 
 0
 0
 0
 0
 5:01 
 0
 0
 0
 0
 6:18 
 0
 0
 0
 0
 13:56 
 0
 0
 0
 0
 13:53 
 0
 0
 0
 0
 11:29 
 0
 0
 0
 0
 14:47 
 0
 0
 0
 0
 15:05 
 0
 0
 0
 0
 15:00 
 0
 0
 0
 0
 13:05 
 0
 0
 0
 0
 8:33 
 0
 0
 0
 0
 10:32 
 0
 0
 0
 0
 10:28 
 0
 0
 0
 0
 3:06 
 0
 0
 0
 0
 5:01 
 0
 0
 0
 0
 10:29 
 0
 0
 0
 0
 8:27 
 0
 0
 0
 0
 8:39 
 0
 0
 0
 0
 8:26 
 0
 0
 0
 0
 13:26 
 0
 0
 0
 0
 6:27 
 0
 0
 0
 0
 2:49 
 0
 0
 0
 0
 11:33 
 0
 0
 0
 0
 12:57 
 0
 0
 0
 0
 14:56 
 0
 0
 0
 0
 15:30 
 0
 0
 0
 0
 4:11 
 0
 0
 0
 0
 14:58 
 0
 0
 0
 0
 3:23 
 0
 0
 0
 0
 4:57 
 0
 0
 0
 0
 2:42 
 0
 0
 0
 0
 8:30 
 0
 0
 0
 0
 10:05 
 0
 0
 0
 0
 14:56 
 0
 0
 0
 0
 11:52