Efficient Representation for Electric Vehicle Charging Station Operations using Reinforcement Learning

Simple item page
dc.contributor.authorKwon, Kyung-Bin
dc.contributor.authorZhu, Hao
dc.date.accessioned2021-12-24T17:50:49Z
dc.date.available2021-12-24T17:50:49Z
dc.date.issued2022-01-04
dc.description.abstractEffectively operating an electric vehicle charging station (EVCS) is crucial for enabling the rapid transition of electrified transportation. By utilizing the flexibility of EV charging needs, the EVCS can reduce the total electricity cost for meeting the EV demand. To solve this problem using reinforcement learning (RL), the dimension of state/action spaces unfortunately grows with the number of EVs, which becomes very large and time-varying. This dimensionality issue affects the efficiency and convergence performance of generic RL algorithms. To this end, we advocate to develop aggregation schemes for state/action according to the emergency of EV charging, or its laxity. A least-laxity first (LLF) rule is used to consider only the total charging power of the EVCS, while ensuring the feasibility of individual EV schedules. In addition, we propose an equivalent state aggregation that can guarantee to attain the same optimal policy. Using the proposed aggregation scheme, the policy gradient method is applied to find the best parameters of a linear Gaussian policy. Numerical tests have demonstrated the performance improvement of the proposed representation approaches in increasing the total reward and policy efficiency over existing approximation-based method.
dc.format.extent9 pages
dc.identifier.doi10.24251/HICSS.2022.437
dc.identifier.isbn978-0-9981331-5-7
dc.identifier.urihttp://hdl.handle.net/10125/79772
dc.language.isoeng
dc.relation.ispartofProceedings of the 55th Hawaii International Conference on System Sciences
dc.rightsAttribution-NonCommercial-NoDerivatives 4.0 International
dc.rights.urihttps://creativecommons.org/licenses/by-nc-nd/4.0/
dc.subjectResilient Networks
dc.subjectdemand response
dc.subjectelectrical vehicle charging
dc.subjectequivalent state aggregation
dc.subjectload aggregation
dc.subjectreinforcement learning
dc.titleEfficient Representation for Electric Vehicle Charging Station Operations using Reinforcement Learning
dc.type.dcmitext

Files

Original bundle
Now showing 1 - 1 of 1
Thumbnail Image
Name:
0352.pdf
Size:
546.08 KB
Format:
Adobe Portable Document Format
Download

Collections

Resilient Networks