08/12/2020

Ensemble BERT for Classifying Medication-mentioning Tweets

Huong Dang, Kahyun Lee, Sam Henry, Özlem Uzuner

Keywords:

Abstract Paper Similar Papers

Abstract: Twitter is a valuable source of patient-generated data that has been used in various population health studies. The first step in many of these studies is to identify and capture Twitter messages (tweets) containing medication mentions. In this article, we describe our submission to Task 1 of the Social Media Mining for Health Applications (SMM4H) Shared Task 2020. This task challenged participants to detect tweets that mention medications or dietary supplements in a natural, highly imbalance dataset. Our system combined a handcrafted preprocessing step with an ensemble of 20 BERT-based classifiers generated by dividing the training dataset into subsets using 10-fold cross validation and exploiting two BERT embedding models. Our system ranked first in this task, and improved the average F1 score across all participating teams by 19.07% with a precision, recall, and F1 on the test set of 83.75%, 87.01%, and 85.35% respectively.

The video of this talk cannot be embedded. You can watch it here:
https://underline.io/lecture/6453-ensemble-bert-for-classifying-medication-mentioning-tweets
(Link will open in new window)
 0
 0
 0
 0
  Share    
This is an embedded video. Talk and the respective paper are published at COLING Workshops 2020 virtual conference. If you are one of the authors of the paper and want to manage your upload, see the question "My papertalk has been externally embedded..." in the FAQ section.

Comments

Post Comment
no comments yet
code of conduct: tbd Characters remaining: 140

Similar Papers

 0
 0
 0
 0
 11:56 
 0
 0
 0
 0
 8:00 
 0
 0
 0
 0
 6:12 
 0
 0
 0
 0
 3:07 
 0
 0
 0
 0
 9:50 
 0
 0
 0
 0
 9:59 
 0
 0
 0
 0
 7:40 
 0
 0
 0
 0
 9:34 
 0
 0
 0
 0
 11:47 
 0
 0
 0
 0
 12:58 
 0
 0
 0
 0
 12:38 
 0
 0
 0
 0
 12:27 
 0
 0
 0
 0
 5:17 
 0
 0
 0
 0
 3:05 
 0
 0
 0
 0
 18:02 
 0
 0
 0
 0
 12:49 
 0
 0
 0
 0
 11:28 
 0
 0
 0
 0
 8:20 
 0
 0
 0
 0
 11:07 
 0
 0
 0
 1
 7:54 
 0
 0
 0
 0
 6:56 
 0
 0
 0
 0
 12:21 
 0
 0
 0
 0
 7:57 
 0
 0
 0
 0
 12:12 
 0
 0
 0
 0
 8:14 
 0
 0
 0
 0
 17:37 
 0
 0
 0
 0
 11:24 
 0
 0
 0
 0
 5:00 
 0
 0
 0
 0
 7:16 
 0
 0
 0
 0
 10:52 
 0
 0
 0
 0
 8:07 
 0
 0
 0
 0
 2:57 
 0
 0
 0
 0
 5:11 
 0
 0
 0
 0
 7:55 
 0
 0
 0
 0
 9:43 
 0
 0
 0
 0
 11:16 
 0
 0
 0
 0
 4:55 
 0
 0
 0
 0
 7:57 
 0
 0
 0
 0
 8:23 
 0
 0
 0
 0
 3:27