PulseAugur
EN
LIVE 22:22:15

User questions adversarial RL paper findings based on new experiments

A Reddit user is questioning findings from a 2020 paper by Zhang et al. regarding adversarial reinforcement learning. The paper proposed that attacks targeting the critic network (V(s)) would be weaker than those targeting the actor network (pi(s)). However, the user's own experiments with multi-agent PPO policies in the VMAS library consistently show the opposite, with critic-based attacks proving more effective. The user is seeking clarification on whether their methodology is flawed or if their results are consistent with the paper's findings given the different experimental contexts. AI

IMPACT This discussion highlights potential discrepancies in adversarial reinforcement learning research, prompting further investigation into attack methodologies.

RANK_REASON User-generated discussion and questioning of a prior research paper.

Read on r/MachineLearning →

AI-generated summary · Google Gemini · from 1 sources. How we write summaries →

User questions adversarial RL paper findings based on new experiments

COVERAGE [1]

  1. r/MachineLearning TIER_1 (CA) · /u/ham_bam0 ·

    On Adversarial RL [R]

    <!-- SC_OFF --><div class="md"><p>Zhang et al. paper's introducing the SA-MDP framework (2020) (state adversarial MDP) argues that an attack using the critic network (V(s)) is expected and supposed to produce a weaker attack than an attack using the actor network (pi(s)) itself t…