02/02/2021

Constrained Risk-Averse Markov Decision Processes

Mohamadreza Ahmadi, Ugo Rosolia, Michel D. Ingham, Richard M. Murray, Aaron D. Ames

Keywords:

Abstract Paper Similar Papers

Abstract: We consider the problem of designing policies for Markov decision processes (MDPs) with dynamic coherent risk objectives and constraints. We begin by formulating the problem in a Lagrangian framework. Under the assumption that the risk objectives and constraints can be represented by a Markov risk transition mapping, we propose an optimization-based method to synthesize Markovian policies that lower-bound the constrained risk-averse problem. We demonstrate that the formulated optimization problems are in the form of difference convex programs (DCPs) and can be solved by the disciplined convex-concave programming (DCCP) framework. We show that these results generalize linear programs for constrained MDPs with total discounted expected costs and constraints. Finally, we illustrate the effectiveness of the proposed method with numerical experiments on a rover navigation problem involving conditional-value-at-risk (CVaR) and entropic-value-at-risk (EVaR) coherent risk measures.

The video of this talk cannot be embedded. You can watch it here:
https://slideslive.com/38948733
(Link will open in new window)
 0
 0
 0
 0
  Share    
This is an embedded video. Talk and the respective paper are published at AAAI 2021 virtual conference. If you are one of the authors of the paper and want to manage your upload, see the question "My papertalk has been externally embedded..." in the FAQ section.

Comments

Post Comment
no comments yet
code of conduct: tbd Characters remaining: 140

Similar Papers

 0
 0
 0
 0
 14:56 
 0
 0
 0
 0
 3:13 
 0
 0
 0
 0
 13:38 
 0
 0
 0
 0
 14:45 
 0
 0
 0
 0
 4:42 
 0
 0
 0
 0
 3:29 
 0
 0
 0
 0
 2:02 
 0
 0
 0
 0
 3:26 
 0
 0
 0
 0
 5:03 
 0
 0
 0
 0
 3:21 
 0
 0
 0
 0
 3:11 
 0
 0
 0
 0
 5:09 
 0
 0
 0
 0
 3:24 
 0
 0
 0
 0
 3:20 
 0
 0
 0
 0
 11:49 
 0
 0
 0
 0
 3:17 
 0
 0
 0
 0
 16:09 
 0
 0
 0
 0
 14:13 
 0
 0
 0
 0
 3:14 
 0
 0
 0
 0
 2:44 
 0
 0
 0
 0
 3:24 
 0
 0
 0
 0
 15:31 
 0
 0
 0
 0
 9:29 
 0
 0
 0
 0
 2:28 
 0
 0
 0
 0
 3:16 
 0
 0
 0
 0
 9:06 
 0
 0
 0
 0
 5:13 
 0
 0
 0
 0
 15:13 
 0
 0
 0
 0
 14:10 
 0
 0
 0
 0
 10:02 
 0
 0
 0
 0
 12:17 
 0
 0
 0
 0
 8:17 
 0
 0
 0
 0
 3:11 
 0
 0
 0
 0
 16:23 
 0
 0
 0
 0
 18:01 
 0
 0
 0
 0
 14:46 
 0
 0
 0
 0
 5:11 
 0
 0
 0
 0
 4:55 
 0
 0
 0
 0
 5:44 
 0
 0
 0
 0
 5:05