Please use this identifier to cite or link to this item:
Title: Epopt: Learning robust neural network policies using model ensembles
Authors: Rajeswaran, A.
Ghotra, S.
Ravindran, B.
Levine, S.
Issue Date: 2019
Citation: 5th International Conference on Learning Representations, ICLR 2017 - Conference Track Proceedings, 2019, Vol., , pp.-
Abstract: Sample complexity and safety are major challenges when learning policies with reinforcement learning for real-world tasks, especially when the policies are represented using rich function approximators like deep neural networks. Model-based methods where the real-world target domain is approximated using a simulated source domain provide an avenue to tackle the above challenges by augmenting real data with simulated data. However, discrepancies between the simulated source domain and the target domain pose a challenge for simulated training. We introduce the EPOpt algorithm, which uses an ensemble of simulated source domains and a form of adversarial training to learn policies that are robust and generalize to a broad range of possible target domains, including unmodeled effects. Further, the probability distribution over source domains in the ensemble can be adapted using data from target domain and approximate Bayesian methods, to progressively make it a better approximation. Thus, learning on a model ensemble, along with source domain adaptation, provides the benefit of both robustness and learning/adaptation. � ICLR 2019 - Conference Track Proceedings. All rights reserved.
Appears in Collections:2. Conference Papers

Files in This Item:
There are no files associated with this item.

Items in DSpace are protected by copyright, with all rights reserved, unless otherwise indicated.