On the Verification of Deep Reinforcement Learning Solution for Intelligent Operation of Distribution Grids

Date
2022-01-04
Authors
Hosseini, Mohammad Mehdi
Parvania, Masood
Journal Title
Journal ISSN
Volume Title
Publisher
Abstract
Capabilities of deep reinforcement learning (DRL) in obtaining fast decision policies in high dimensional and stochastic environments have led to its extensive use in operational research, including the operation of distribution grids with high penetration of distributed energy resources (DER). However, the feasibility and robustness of DRL solutions are not guaranteed for the system operator, and hence, those solutions may be of limited practical value. This paper proposes an analytical method to find feasibility ellipsoids that represent the range of multi-dimensional system states in which the DRL solution is guaranteed to be feasible. Empirical studies and stochastic sampling determine the ratio of the discovered to the actual feasible space as a function of the sample size. In addition, the performance of logarithmic, linear, and exponential penalization of infeasibility during the DRL training are studied and compared in order to reduce the number of infeasible solutions.
Description
Keywords
Monitoring, Control, and Protection, deep reinforcement learning, distributed energy resources, power distribution system, solution verification
Citation
Rights
Access Rights
Email libraryada-l@lists.hawaii.edu if you need this content in ADA-compliant format.