02/02/2021

Deep Contextual Clinical Prediction with Reverse Distillation

Rohan Kodialam, Rebecca Boiarsky, Justin Lim, Aditya Sai, Neil Dixit, David Sontag

Keywords:

Abstract Paper Similar Papers

Abstract: Healthcare providers are increasingly using machine learning to predict patient outcomes to make meaningful interventions. However, despite innovations in this area, deep learning models often struggle to match performance of shallow linear models in predicting these outcomes, making it difficult to leverage such techniques in practice. In this work, motivated by the task of clinical prediction from insurance claims, we present a new technique called reverse distillation which pretrains deep models by using high-performing linear models for initialization. We make use of the longitudinal structure of insurance claims datasets to develop Self Attention with Reverse Distillation, or SARD, an architecture that utilizes a combination of contextual embedding, temporal embedding and self-attention mechanisms and most critically is trained via reverse distillation. SARD outperforms state-of-the-art methods on multiple clinical prediction outcomes, with ablation studies revealing that reverse distillation is a primary driver of these improvements. Code is available at https://github.com/clinicalml/omop-learn.

The video of this talk cannot be embedded. You can watch it here:
https://slideslive.com/38949355
(Link will open in new window)
 0
 0
 0
 0
  Share    
This is an embedded video. Talk and the respective paper are published at AAAI 2021 virtual conference. If you are one of the authors of the paper and want to manage your upload, see the question "My papertalk has been externally embedded..." in the FAQ section.

Comments

Post Comment
no comments yet
code of conduct: tbd Characters remaining: 140

Similar Papers

 0
 0
 0
 0
 7:58 
 0
 0
 0
 0
 5:17 
 0
 0
 0
 0
 5:21 
 0
 0
 0
 0
 14:36 
 0
 0
 0
 0
 9:14 
 0
 0
 0
 0
 15:53 
 0
 0
 0
 0
 14:26 
 0
 0
 0
 0
 17:07 
 0
 0
 0
 0
 2:40 
 0
 0
 0
 0
 10:32 
 0
 0
 0
 0
 8:07 
 0
 0
 0
 0
 17:52 
 0
 0
 0
 0
 10:35 
 0
 0
 0
 0
 2:59 
 0
 0
 0
 0
 2:57 
 0
 0
 0
 0
 5:17 
 0
 0
 0
 0
 5:15 
 0
 0
 0
 0
 11:51 
 0
 0
 0
 0
 14:40 
 0
 0
 0
 0
 11:13 
 0
 0
 0
 0
 15:37 
 0
 0
 0
 0
 9:51 
 0
 0
 0
 0
 16:56 
 0
 0
 0
 0
 2:56 
 0
 0
 0
 0
 15:20 
 0
 0
 0
 0
 3:04 
 0
 0
 0
 0
 4:56 
 0
 0
 0
 0
 6:35 
 0
 0
 0
 0
 14:56 
 0
 0
 0
 0
 14:35 
 0
 0
 0
 0
 3:50 
 0
 0
 0
 0
 6:47 
 0
 0
 0
 0
 3:29 
 0
 0
 0
 0
 9:53 
 0
 0
 0
 0
 2:57 
 0
 0
 0
 0
 3:13 
 0
 0
 0
 0
 7:54 
 0
 0
 0
 0
 7:44 
 0
 0
 0
 0
 6:04 
 0
 0
 0
 0
 14:58