Reinforcement Learning for Adversarial Environments

Date

2025-01-07

Contributor

Advisor

Department

Instructor

Depositor

Speaker

Researcher

Consultant

Interviewer

Narrator

Transcriber

Annotator

Journal Title

Journal ISSN

Volume Title

Publisher

Volume

Number/Issue

Starting Page

821

Ending Page

Alternative Title

Abstract

This paper explores the development of more intelligent and competitive AI agents for adversarial environments. A hide and seek simulation environment with three sensor models is developed, including a lidar, a far filed sensor, and a near-filed sensor. Four AI vs AI adversarial scenarios are investigated using the Proximal Policy Optimization (PPO) and Soft Actor Critic (SAC) reinforcement learning (RL) algorithms. Various experimental results across RL algorithms and sensor models have shown the seeker and hider have the most competitive advantage in the scenario of a SAC seeker versus a PPO hider and a PPO seeker versus a SAC hider, respectively. Additionally, the impact of sensing modalities on agent learning performance is investigated. Comparative studies reveal that extra sensing modalities improve agent performance, and the far-field sensor outperforms the near-field sensor. The results also suggest that an agent with a competitive advantage of AI algorithm is more resilient to variations in sensing modalities.

Description

Keywords

AI Model Evaluation, adversarial ai, artificial intelligence, reinforcement learning, sensing platforms, sensors

Citation

Extent

10

Format

Geographic Location

Time Period

Related To

Proceedings of the 58th Hawaii International Conference on System Sciences

Related To (URI)

Table of Contents

Rights

Attribution-NonCommercial-NoDerivatives 4.0 International

Rights Holder

Local Contexts

Email libraryada-l@lists.hawaii.edu if you need this content in ADA-compliant format.