AI 지식창고 AI 지식창고

InstructGPT

• Advantage Function in RL

  CS & ML Basic 2023. 2. 14. 16:02

  The advantage function in reinforcement learning is a measure of how much better an action is compared to other actions in a given state. It is a critical component in many reinforcement learning algorithms, including PPO. Mathematically, the advantage function is defined as the difference between the expected reward of taking a specific action in a given state and the expected reward of followi..

  Read More
• Proximal Policy Optimization (PPO) Algorithm

  CS & ML Basic 2023. 2. 14. 16:02

  The objective of the Proximal Policy Optimization (PPO) algorithm is to train a policy function that can control an agent's behavior in a given environment, such that it maximizes the expected cumulative reward over time. More formally, we can define the objective of PPO as follows: $$J(\theta )=\mathbb{E}\pi \theta \left[\sum _{t=0}^{\mathrm{\infty }}{\gamma }^t{r}_t\right]$$ where $J(\theta )$ is the ..

  Read More